CN108287895B

CN108287895B - Dominant frame adjustment-based question searching method and system and handheld photographing device

Info

Publication number: CN108287895B
Application number: CN201810055260.7A
Authority: CN
Inventors: 徐杨
Original assignee: Guangdong Genius Technology Co Ltd
Current assignee: Guangdong Genius Technology Co Ltd
Priority date: 2018-01-19
Filing date: 2018-01-19
Publication date: 2020-11-06
Anticipated expiration: 2038-01-19
Also published as: CN108287895A

Abstract

A title searching method and system based on explicit frame adjustment and a handheld photographing device comprise: when an opening instruction triggered by a user is detected, the handheld photographing device projects the dominant frame according to the opening instruction, if the user triggers a frame selection adjusting instruction, the size of the dominant frame is adjusted according to an adjusting mode corresponding to the frame selection adjusting instruction triggered by the user to obtain the adjusted dominant frame, information selected by the adjusted dominant frame is determined as information to be searched, and an information photo to be searched and obtained through photographing is sent to the electronic device which is connected with the handheld photographing device in advance to display a searching result obtained by a background server aiming at the information to be searched on a display screen of the electronic device. By implementing the embodiment of the invention, the information to be searched can be accurately determined by adjusting the size of the dominant frame, so that the information to be searched can be shot in a targeted manner, and the accuracy of the search result (such as answer to test questions) for the information to be searched (such as test questions) is improved.

Description

Dominant frame adjustment-based question searching method and system and handheld photographing device

Technical Field

The invention relates to the technical field of electronic equipment, in particular to a question searching method and system based on dominant frame adjustment and handheld photographing equipment.

Background

At present, in order to meet the learning requirement, a large amount of question searching software is available on the market, and the question searching software is used for searching answers of test questions corresponding to the shot test questions by calling a camera of a mobile phone to shoot the test questions. In practical applications, this method of searching for test questions requires the user to accurately photograph one test question, but if there are a plurality of test questions photographed by the user, the answer to the finally searched test question may not match the test question that the user wants to search for. It can be seen that the problem of low accuracy of the answer to the searched test questions exists in the current question searching mode.

Disclosure of Invention

The embodiment of the invention discloses a method and a system for searching questions based on explicit frame adjustment and a handheld photographing device, which can improve the accuracy of searched answer to test questions.

The first aspect of the embodiment of the invention discloses a topic searching method based on explicit frame adjustment, which comprises the following steps:

when a starting instruction triggered by a user is detected, the handheld photographing equipment projects an explicit frame according to the starting instruction;

the handheld photographing equipment detects whether a frame selection adjusting instruction triggered by a user is received; the frame selection adjusting instruction is used for adjusting the size of the dominant frame, if so, the size of the dominant frame is adjusted according to an adjusting mode corresponding to the frame selection adjusting instruction to obtain the adjusted dominant frame;

the handheld photographing equipment determines the information selected by the adjusted dominant frame as the information to be searched;

when the handheld photographing device detects that a photographing instruction triggered by a user is received, the handheld photographing device photographs the information to be searched to obtain a photo of the information to be searched;

and the handheld photographing device sends the information photo to be searched to the electronic device which is connected with the handheld photographing device in advance, so that the electronic device displays a search result of the background server for the information to be searched on a display screen of the electronic device according to the information photo to be searched.

As an optional implementation manner, in a first aspect of the embodiment of the present invention, the taking a picture of the information to be searched by the handheld shooting device to obtain a photo of the information to be searched includes:

the handheld photographing equipment carries out fixed-focus photographing on the information to be searched according to a preset focus distance to obtain a picture of the information to be searched;

the handheld photographing device sends the information photo to be searched to the electronic device which is connected with the handheld photographing device in advance, so that the electronic device displays a search result of a background server aiming at the information to be searched on a display screen of the electronic device according to the information photo to be searched, and the method comprises the following steps:

the handheld photographing device sends the information photo to be searched to the electronic device which is connected with the handheld photographing device in advance and used for activating the electronic device in a black screen state, and the activated electronic device displays a search result of the background server for the information to be searched on a display screen of the awakened electronic device according to the information photo to be searched.

As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:

when the handheld photographing device detects that the photographing instruction triggered by the user is not received, the handheld photographing device detects whether a projection instruction triggered by the user is received or not, wherein the projection instruction is used for indicating projection of the information to be searched;

if so, the handheld photographing equipment sends a prompt message, and the prompt message is used for prompting a user to enable a projection device of the handheld photographing equipment to face a projection area;

and the handheld photographing equipment projects the information to be searched.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the information to be searched at least includes an english word, and after the handheld photographing device projects the information to be searched, the method further includes:

the handheld photographing equipment detects whether the user presses a certain English word in the information to be searched obtained by projection for a long time;

if yes, the handheld photographing equipment projects and outputs a paraphrase interface aiming at the English word, and detects whether a user clicks a virtual pronunciation key of the English word on the paraphrase interface or not, wherein the virtual pronunciation key is used for indicating and outputting the pronunciation of the English word;

when the fact that the user clicks the virtual pronunciation key of the English word is detected, the handheld photographing device outputs the pronunciation of the English word according to the pronunciation mode selected by the user, and the pronunciation mode comprises English pronunciation or American pronunciation.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the projecting, by the handheld image capturing device according to the opening instruction, an explicit frame includes:

the handheld photographing equipment judges whether text information exists at the position facing the projection device of the handheld photographing equipment;

and if so, the handheld photographing equipment projects an explicit frame according to the opening instruction.

The second aspect of the embodiments of the present invention discloses a handheld photographing apparatus, including:

the starting unit is used for projecting an explicit frame according to a starting instruction when the starting instruction triggered by a user is detected;

the first detection unit is used for detecting whether a frame selection adjusting instruction triggered by a user is received; the frame selection adjusting instruction is used for adjusting the size of the dominant frame projected by the opening unit;

the adjusting unit is used for adjusting the size of the dominant frame according to an adjusting mode corresponding to the framing adjusting instruction when the first detecting unit detects that the framing adjusting instruction triggered by a user is received, so that the adjusted dominant frame is obtained;

the determining unit is used for determining the information selected by the frame of the dominant frame adjusted by the adjusting unit as the information to be searched;

the photographing unit is used for photographing the information to be searched determined by the determining unit when a photographing instruction triggered by a user is detected to be received, so as to obtain a photo of the information to be searched;

and the sending unit is used for sending the information photo to be searched, which is obtained by shooting by the shooting unit, to the electronic equipment which is connected with the handheld shooting equipment in advance, so that the electronic equipment displays a search result of the background server aiming at the information to be searched on a display screen of the electronic equipment according to the information photo to be searched.

As an alternative implementation, in the second aspect of the embodiment of the present invention,

the photographing unit is specifically used for performing fixed-focus photographing on the information to be searched according to a preset focus distance to obtain a picture of the information to be searched;

the sending unit is specifically configured to send the information photo to be searched to the electronic device which is connected with the handheld photographing device in advance, so as to activate the electronic device in a black screen state, and enable the activated electronic device to display a search result of the background server for the information to be searched on a display screen of the awakened electronic device according to the information photo to be searched.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the method further includes:

the second detection unit is used for detecting whether a projection instruction triggered by a user is received or not when the photographing instruction triggered by the user is detected not to be received, and the projection instruction is used for indicating projection of the information to be searched;

the prompting unit is used for sending a prompting message when the second detection unit detects that the projection instruction triggered by the user is received, wherein the prompting message is used for prompting the user to enable the projection device of the handheld photographing equipment to face a projection area;

and the projection unit is used for projecting the information to be searched.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the information to be searched at least includes an english word,

the second detection unit is further configured to detect whether the user presses an english word in the information to be searched obtained by projection for a long time after the projection unit projects the information to be searched;

the handheld photographing apparatus further comprises:

the output unit is used for projecting and outputting a paraphrase interface aiming at the English word when the second detection unit detects that the user presses the English word in the information to be searched obtained by projection;

the second detection unit is further configured to detect whether a user clicks a virtual pronunciation key of the certain english word on the paraphrase interface output by the output unit, where the virtual pronunciation key is used to instruct to output a pronunciation of the certain english word;

the output unit is further configured to output the pronunciation of the certain english word according to a pronunciation mode selected by the user when the second detection unit detects that the user clicks the virtual pronunciation key of the certain english word, where the pronunciation mode includes english pronunciation or american pronunciation.

As an optional implementation manner, in a second aspect of the embodiment of the present invention, the opening unit includes:

the judging subunit is used for judging whether text information exists at the position facing the projection device of the handheld photographing equipment;

and the projection subunit is used for projecting an explicit frame according to the opening instruction when the judgment subunit judges that the position facing the projection device of the handheld photographing equipment has the text information.

The third aspect of the invention discloses a topic searching system based on explicit frame adjustment, which comprises handheld shooting equipment, electronic equipment and a background server, wherein the handheld shooting equipment, the electronic equipment and the background server are disclosed by the second aspect of the invention;

wherein the electronic device comprises:

the first receiving unit is used for receiving the information photo to be searched sent by the handheld photographing equipment;

the first interaction unit is used for sending the information photo to be searched received by the first receiving unit to the background server;

wherein, the background server comprises:

the second receiving unit is used for receiving the information photo to be searched sent by the first interaction unit;

the analysis unit is used for analyzing the information photo to be searched received by the second receiving unit to obtain the information to be searched;

the searching unit is used for inquiring a searching result corresponding to the information to be searched analyzed by the analyzing unit in a database;

the second interaction unit is used for sending the search result searched by the search unit to the electronic equipment;

wherein, in the electronic device,

the first receiving unit is further configured to receive the search result sent by the second interacting unit;

the electronic device further includes:

and the display unit is used for displaying the search result of the background server aiming at the information to be searched on a display screen of the electronic equipment.

A fourth aspect of the present invention discloses a handheld photographing apparatus, including:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute a topic searching method based on explicit frame adjustment disclosed in the first aspect of the embodiment of the present invention.

A fifth aspect of embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.

A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product is configured to, when running on a computer, cause the computer to perform part or all of the steps of any one of the methods in the first aspect.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, when a starting instruction triggered by a user is detected, the handheld photographing device projects the dominant frame according to the starting instruction, if the user triggers a frame selection adjusting instruction, the size of the dominant frame is adjusted according to an adjusting mode corresponding to the frame selection adjusting instruction triggered by the user to obtain the adjusted dominant frame, information selected by the adjusted dominant frame is determined as information to be searched, and an information photo to be searched obtained by photographing is sent to the electronic device which is connected with the handheld photographing device in advance to display a searching result obtained by a background server aiming at the information to be searched on a display screen of the electronic device. The process can accurately determine the information to be searched by adjusting the size of the dominant frame so as to realize the targeted shooting of the information to be searched, thereby improving the accuracy of the search result (such as answer to test questions) aiming at the information to be searched (such as test questions).

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic flowchart of a title searching method based on explicit frame adjustment according to an embodiment of the present invention;

FIG. 2 is a schematic flowchart of another topic searching method based on explicit frame adjustment according to an embodiment of the present invention;

FIG. 3 is a schematic flowchart of another topic searching method based on explicit frame adjustment according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a handheld photographing device disclosed in the embodiment of the present invention;

fig. 5 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention;

fig. 6 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a topic searching system based on explicit frame adjustment according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of another topic searching system based on explicit frame adjustment according to an embodiment of the present invention;

FIG. 9 is a diagram illustrating a search result presentation of an electronic device according to an embodiment of the disclosure;

fig. 10 is a schematic structural diagram of an entity apparatus of a handheld photographing device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.

The embodiment of the invention discloses a method and a system for searching questions based on explicit frame adjustment and a handheld photographing device, which can improve the accuracy of searched answer to test questions. The following are detailed below.

Example one

Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a title searching method based on explicit frame adjustment according to an embodiment of the present invention. As shown in FIG. 1, the title searching method based on dominant frame adjustment may include the following steps:

101. when a starting instruction triggered by a user is detected, the handheld photographing device projects an explicit frame according to the starting instruction.

In the embodiment of the present invention, a photographing key may be disposed on the handheld photographing device, wherein the manner in which the user triggers the start instruction may be to lightly press the photographing key, or to touch the photographing key, and the like. When a starting instruction triggered by a user is detected, the handheld photographing device can start a projection module of the handheld photographing device, and the dominant frame is projected to a position where the projection module faces. The shape of the explicit frame may be a rectangular frame or a circular frame, which is not limited in the embodiments of the present invention.

102. And the handheld photographing device detects whether a frame selection adjusting instruction triggered by a user is received, if so, the step 103 to the step 106 are executed, and if not, the process is ended.

In an embodiment of the invention, the framing adjustment instruction is used to adjust the size of the dominant frame. Can be provided with the direction button on the handheld equipment of shooing, wherein, the direction button can be including four direction keys about from top to bottom, when the user presses the direction key to last, the last frame of dominant frame can the rebound preset distance, when the user presses the direction key to the bottom, the lower frame of dominant frame can the rebound preset distance, when the user presses the direction key left, the left frame of dominant frame can the rebound preset distance, when the user presses the direction key to the right, the right frame of dominant frame can the right displacement preset distance. Or, the up-down direction key may be used to adjust the size of the long side of the dominant frame, and when the up direction key is pressed, the distance between the two long sides of the dominant frame becomes wider, and when the down direction key is pressed, the distance between the two long sides of the dominant frame becomes narrower; the left and right direction keys may be used to adjust the size of the wide side of the overt frame, and when the left direction key is pressed, the distance between the two narrow sides of the overt frame becomes narrow, and when the right direction key is pressed, the distance between the two narrow sides of the overt frame becomes wide.

In the embodiment of the present invention, optionally, when the direction key is arranged on the handheld photographing device, the manner of detecting whether the handheld photographing device receives the frame selection adjustment instruction triggered by the user may be to detect whether the direction key is pressed; if the direction is the direction corresponding to the region subjected to the pressing operation in the direction key, the handheld photographing device acquires the direction corresponding to the region subjected to the pressing operation in the direction key, and generates a frame selection adjusting instruction containing the direction, wherein the direction comprises any one of an upper direction, a lower direction, a left direction and a right direction. The process can generate a framing adjustment instruction containing a certain direction by detecting the pressing condition of the direction key, so that the handheld photographing device can adjust the frame of the corresponding direction of the dominant frame according to the direction included by the framing adjustment instruction.

103. And the handheld photographing equipment adjusts the size of the dominant frame according to the adjusting mode corresponding to the frame selection adjusting instruction to obtain the adjusted dominant frame.

As an optional implementation manner, the handheld photographing device adjusts the size of the dominant frame according to the adjustment manner corresponding to the frame selection adjustment instruction, and obtaining the adjusted dominant frame may include:

the handheld photographing equipment analyzes an explicit frame needing to be adjusted corresponding to the framing adjustment instruction, wherein the explicit frame comprises an upper frame, a lower frame, a left frame or a right frame;

the handheld photographing equipment controls the dominant frame to be adjusted to move a preset distance towards the moving direction contained in the frame selection adjusting instruction;

the handheld photographing equipment judges whether the moved dominant frame has a frame covering character information;

if so, the handheld photographing equipment captures first information to be searched which is selected by the dominant frame and contains the character information covered by the frame and second information to be searched which is selected by the dominant frame and does not contain the character information covered by the frame;

the handheld photographing equipment sends the first information to be searched and the second information to be searched to the electronic equipment, so that the electronic equipment judges target search information which a user more likely wants to search from the first information and the second information, and returns the target search information to the handheld photographing equipment;

the handheld photographing equipment analyzes whether the target search information contains character information covered by a frame or not, and if so, automatically adjusts the dominant frame to the character information just covered by the frame to obtain the adjusted dominant frame; if not, automatically adjusting the dominant frame to just remove the text information covered by the frame to obtain the adjusted dominant frame.

For example, when the target search information that the user wants to search is the text information included in the fifth line to the seventh line of a certain page of text and the upper frame of the adjusted dominant frame covers part of the text information in the fourth line of the page of text, the first information to be searched includes part of the text information in the fourth line and the text information in the fifth line to the seventh line, the second information to be searched includes the text information in the fifth line to the seventh line, the handheld photographing device sends the first information to be searched and the second information to be searched to the electronic device, the electronic device can select the target search information (second information to be searched) including more search records from the first information to be searched and the second information to be searched, and a search result searched by the background server for the target search information (second information to be searched) is displayed on the display screen of the electronic device; meanwhile, the electronic equipment returns the target search information (second information to be searched) to the handheld photographing equipment, so that the handheld photographing equipment automatically adjusts the position of the upper frame of the dominant frame to a position between the fourth line and the fifth line.

By implementing the optional implementation mode, the handheld photographing device can analyze the frame of the dominant frame which needs to be adjusted and the corresponding moving direction contained in the frame selection adjusting instruction to move the dominant frame, if any frame of the moved dominant frame is covered with the text information, the first information to be searched and the second information to be searched which do not contain the text information are obtained, and the first information to be searched and the second information to be searched are sent to the electronic device, so that the electronic device can select the target search information which is more likely to be searched by a user, wherein the electronic device can select the target search information containing more search records by respectively searching the first information to be searched and the second information to be searched in the preset database. And the handheld photographing equipment adjusts the dominant frame according to the target search information returned by the electronic equipment to obtain the adjusted dominant frame. The process can intelligently judge whether the information which the user wants to select includes the character information when the frame of the dominant frame covers the character information, and intelligently adjust the selection range of the dominant frame according to the character information, so that the intelligence and the accuracy rate of determining the information to be searched are increased.

104. And the handheld photographing equipment determines the information selected by the adjusted dominant frame as the information to be searched.

In the embodiment of the present invention, the information to be searched may include words or test questions, and the like, which is not limited in the embodiment of the present invention.

105. When the handheld photographing device detects that a photographing instruction triggered by a user is received, the handheld photographing device photographs information to be searched to obtain information photos to be searched.

In the embodiment of the present invention, the manner in which the user triggers the photographing instruction may be to deeply press a photographing key on the handheld photographing device, or to input "photograph" for voice, and the like. When a user uses the handheld photographing device to photograph test questions or words for searching, the distance between the handheld photographing device and the test questions or the words is always in a certain range, therefore, the handheld photographing device can photograph the information to be searched in a fixed-focus photographing mode, the time required by zooming of a lens can be saved, faster photographing is achieved, and the efficiency of searching the questions is improved.

106. The handheld photographing device sends the information photo to be searched to the electronic device which is connected with the handheld photographing device in advance, so that the electronic device displays a search result of the background server aiming at the information to be searched on a display screen of the electronic device according to the information photo to be searched.

In the embodiment of the present invention, the electronic device may be a tablet, a learning machine, a mobile phone, and the like, which is not limited in the embodiment of the present invention. After receiving the information photo to be searched sent by the handheld photographing device, the electronic device can analyze the information photo to be searched and obtain information to be searched, the information to be searched is sent to the background server, the background server inquires a search result aiming at the information to be searched in a preset database and returns the search result to the electronic device, and therefore the electronic device can display the search result on a display screen of the electronic device. Or, the electronic device may also directly send the information photo to be searched to the background server, so that the background server analyzes the information photo to be searched to obtain the information to be searched, and queries the search result for the information to be searched in a preset database of the background server. Or when the electronic equipment receives the information photo to be searched, the information photo to be searched can be displayed on a display screen of the electronic equipment, whether the user clicks a certain position of the information photo to be searched is detected, if yes, the test question corresponding to the certain position is intercepted, the test question is sent to the background server, so that the background server returns the answer of the searched test question to the electronic equipment for display, the interaction between the electronic equipment and the background server can be triggered when the user clicks a certain area in the information photo to be searched, and the test question for carrying out the interaction of the search question is only a certain test question clicked by the user, so that the workload of searching the question is reduced, the efficiency of searching the question is improved, and the power consumption is saved to a certain extent. As shown in fig. 9, if the information photo to be searched includes a plurality of test questions, all the test questions can be displayed on the display screen of the electronic device, and when a user clicks a certain test question, a test question analysis for the certain test question pops up.

It can be seen that, with the adoption of the method for searching for the subject based on the adjustment of the dominant frame described in fig. 1, when a start instruction triggered by a user is detected, the handheld photographing device projects the dominant frame according to the start instruction, if the user triggers the frame selection adjustment instruction, the size of the dominant frame is adjusted according to an adjustment mode corresponding to the frame selection adjustment instruction triggered by the user to obtain the adjusted dominant frame, information selected by the adjusted dominant frame is determined as information to be searched, and a picture of the information to be searched obtained by photographing is sent to the electronic device which is connected with the handheld photographing device in advance to display a search result obtained by a background server for the information to be searched on a display screen of the electronic device. The process can accurately determine the information to be searched by adjusting the size of the dominant frame so as to realize the targeted shooting of the information to be searched, thereby improving the accuracy of the search result (such as answer to test questions) aiming at the information to be searched (such as test questions).

Example two

Referring to fig. 2, fig. 2 is a schematic flowchart illustrating another title searching method based on explicit frame adjustment according to an embodiment of the present invention. As shown in FIG. 2, the title searching method based on dominant frame adjustment may include the following steps:

201. when a starting instruction triggered by a user is detected, the handheld photographing device projects an explicit frame according to the starting instruction.

202. And the handheld photographing device detects whether a frame selection adjusting instruction triggered by a user is received, if so, the step 203 to the step 204 are executed, and if not, the process is ended.

In an embodiment of the invention, the framing adjustment instruction is used to adjust the size of the dominant frame.

203. And the handheld photographing equipment adjusts the size of the dominant frame according to the adjusting mode corresponding to the frame selection adjusting instruction to obtain the adjusted dominant frame.

204. And the handheld photographing device determines the information selected by the adjusted dominant frame as the information to be searched, detects whether a photographing instruction triggered by a user is received, if so, executes the step 205 to the step 206, and if not, executes the step 207.

205. And the handheld photographing equipment performs fixed-focus photographing on the information to be searched according to a preset focus distance to obtain a picture of the information to be searched.

206. The handheld photographing device sends the information photo to be searched to the electronic device which is connected with the handheld photographing device in advance and used for activating the electronic device in a black screen state, and the activated electronic device displays a search result of the background server aiming at the information to be searched on a display screen of the awakened electronic device according to the information photo to be searched.

207. And the handheld photographing device detects whether a projection instruction triggered by a user is received, if so, the step 208 to the step 209 are executed, and if not, the process is ended.

In the embodiment of the invention, the projection instruction is used for indicating projection of the information to be searched. The mode of the user triggering the projection instruction may be pressing a projection key on the body of the handheld photographing device, and the like, which is not limited in the embodiment of the present invention.

208. And the handheld photographing equipment sends out a prompt message.

In the embodiment of the invention, the prompt message is used for prompting the user to enable the projection device of the handheld photographing equipment to face the projection area.

209. And the handheld photographing equipment projects the information to be searched.

For example, when a student is reading and understanding training, when reading and understanding test questions are located on two pages, the student often needs to continuously look over the test questions, which brings inconvenience to the student and also affects learning efficiency. At the moment, the students can select the content frame of a certain page of test question as information to be searched by using the handheld photographing equipment, send projection instructions, project the information to be searched to a plane which is convenient for the students to watch, and facilitate the students to read and understand the content on two pages simultaneously, so that the learning efficiency is improved.

It can be seen that, by implementing the method for searching for questions based on adjustment of the dominant frame described in fig. 2, the information to be searched can be accurately determined by adjusting the size of the dominant frame, so that the targeted shooting of the information to be searched can be realized, and the accuracy of the search result (e.g., answer to test questions) for the information to be searched (e.g., test questions) can be improved.

In addition, when the problem searching method based on dominant frame adjustment described in fig. 2 is implemented, it is also considered that when a user uses the handheld photographing device to photograph a test problem, the distance between the test problem and the handheld photographing device is within a certain distance range, the handheld photographing device can photograph the information to be searched in a fixed-focus photographing manner, and compared with a zoom photographing manner, the process can acquire the information photo to be searched more quickly, so that the problem searching efficiency is improved. And when the electronic equipment connected with the handheld photographing equipment is in a black screen state, the handheld photographing equipment can automatically activate the electronic equipment so as to display a search result aiming at the information to be searched on a display screen of the electronic equipment. The process avoids the complex problem searching mode of starting, screen sliding unlocking, selecting the to-be-searched problem app, starting the application, starting the camera, focusing and photographing, intercepting, confirming, uploading, identifying, matching and feeding back, simplifies the problem searching steps and obviously improves the problem searching efficiency. Moreover, due to the fact that students love playing nature, when the homework problem is solved by the problem searching app, the students always get interference of the entertainment app, the students do problems and see the interference and the interference is attracted, so that the problems that parents worry and feel headache due to low homework efficiency and the like are caused.

In addition, when the handheld photographing device detects that a photographing instruction triggered by a user is not received, whether the user sends a projection instruction can also be detected by implementing the topic searching method based on explicit frame adjustment described in fig. 2. When detecting that the user sends a projection instruction, the information to be searched can be projected. The process can determine the test questions on a certain page as the information to be searched and project the information when the students encounter the problem that the problem is hard to do because one test question is distributed on two pages, so that the students can read the test questions, the problem doing efficiency is improved, and the learning score is improved to a certain extent.

EXAMPLE III

Referring to fig. 3, fig. 3 is a flowchart illustrating another title searching method based on explicit frame adjustment according to an embodiment of the present invention. As shown in FIG. 3, the title searching method based on dominant frame adjustment may include the following steps:

301. when a starting instruction triggered by a user is detected, the handheld photographing device judges whether text information exists at the position where the projection device of the handheld photographing device faces, if so, the steps 302 to 303 are executed, and if not, the process is ended.

As an optional implementation manner, the determining, by the handheld photographing apparatus, whether text information exists at a position to which a projection device of the handheld photographing apparatus faces may include:

the handheld photographing equipment starts a camera of the handheld photographing equipment;

the handheld photographing equipment captures photo information of a position where the projection device faces by using the camera and sends the photo information to the electronic equipment so that the electronic equipment can judge whether the photo information comprises character information or not;

and the handheld photographing equipment receives a judgment result returned by the electronic equipment and judges whether the judgment result indicates that the photo information comprises character information.

By implementing the optional implementation mode, the dominant frame can be projected when the photo information comprises the text information, so that the power consumption of the handheld photographing device can be saved to a certain extent.

302. And the handheld photographing equipment projects the dominant frame according to the opening instruction.

It should be noted that, for detailed descriptions of step 303 to step 307 in the embodiment of the present invention, refer to the detailed descriptions of step 202 to step 206 in the second embodiment, which are not described in detail in the embodiment of the present invention.

308. And the handheld photographing device detects whether a projection instruction triggered by a user is received, if so, the step 309-step 311 are executed, and if not, the process is ended.

In the embodiment of the invention, the projection instruction is used for indicating projection of information to be searched; the projected information to be searched at least comprises English words.

309. And the handheld photographing equipment sends out a prompt message.

310. And the handheld photographing equipment projects the information to be searched.

311. The handheld photographing device detects whether the user presses a certain English word in the information to be searched obtained by projection for a long time, if so, step 312 is executed, and if not, the process is ended.

As an optional implementation manner, the detecting, by the handheld photographing device, whether the user presses a certain english word in the projected information to be searched for may include:

the handheld photographing device detects whether a projection area where a preset object is long and the information to be searched is located exists or not by using a camera of the handheld photographing device; the preset object can be a finger or a touch pen;

if yes, the handheld shooting device judges whether an English word corresponding to the projection area pressed by the preset object in length exists or not;

when it is determined that there is an english word corresponding to the projection area where the preset object is pressed, go to step 312; and when judging that a certain English word corresponding to the projection area pressed by the preset object length does not exist, ending the process.

Through implementing the optional implementation mode, the handheld photographing equipment can detect whether the user presses a certain English word in the information to be searched obtained by projection for a long time through the camera on the handheld photographing equipment, the hardware cost required by the detection mode is low, the detection effect is accurate, the interest of inquiring the English word is increased, and the user experience is improved.

312. And projecting and outputting a paraphrase interface aiming at an English word by the handheld photographing equipment, detecting whether a user clicks a virtual pronunciation key of the English word on the paraphrase interface, if so, executing the step 313, and if not, ending the process.

In the embodiment of the invention, the virtual pronunciation key is used for indicating and outputting the pronunciation of a certain English word.

313. The handheld photographing device outputs the pronunciation of a certain English word according to the pronunciation mode selected by the user, wherein the pronunciation mode comprises English pronunciation or American pronunciation.

It can be seen that, by implementing the method for searching for questions based on adjustment of the dominant frame described in fig. 3, the information to be searched can be accurately determined by adjusting the size of the dominant frame, so that the targeted shooting of the information to be searched can be realized, and the accuracy of the search result (e.g., answer to test questions) for the information to be searched (e.g., test questions) can be improved.

In addition, by implementing the method for searching for the questions based on the dominant frame adjustment described in fig. 3, the information photos to be searched can be acquired more quickly, and the steps of searching for the questions can be simplified, so that the efficiency of searching for the questions can be improved remarkably, and the learning efficiency can be improved.

In addition, when the student meets that one test question is distributed on two pages to cause low question-making efficiency, the method for searching the questions based on dominant frame adjustment described in the figure 3 can be implemented, the test question on a certain page is determined as the information to be searched and projected, so that the student can read the test question, the question-making efficiency is improved, and the learning score is improved to a certain extent.

In addition, implementing a search question method based on explicit frame adjustment described in fig. 3, students can obtain a projected paraphrase interface by long-pressing a projected english word, and can obtain the pronunciation of the english word by clicking a virtual pronunciation key on the paraphrase interface. The novel and convenient word searching mode can increase the learning interest of students and improve the user experience.

In addition, by implementing the problem searching method based on dominant frame adjustment described in fig. 3, when there is no text information in the position to which the projection device of the handheld photographing apparatus faces, the dominant frame does not need to be projected, and the dominant frame is projected when there is text information, which can save the power consumption of the handheld photographing apparatus to a certain extent.

Example four

Referring to fig. 4, fig. 4 is a schematic structural diagram of a handheld photographing device according to an embodiment of the present invention. As shown in fig. 4, the handheld photographing device 400 may include an opening unit 401, a first detecting unit 402, an adjusting unit 403, a determining unit 404, a photographing unit 405, and a sending unit 406, where in the electronic device 400:

the opening unit 401 is configured to project an explicit frame according to an opening instruction when the opening instruction triggered by the user is detected.

A first detecting unit 402, configured to detect whether a frame selection adjustment instruction triggered by a user is received; the framing adjustment instruction is used to adjust the size of the dominant frame projected by the opening unit 401.

Specifically, after the enabling unit 401 projects the dominant frame according to the enabling instruction, the enabling unit 401 sends a starting instruction to the first detecting unit 402 to start the first detecting unit 402.

An adjusting unit 403, configured to, when the first detecting unit 402 detects that a framing adjustment instruction triggered by a user is received, adjust the size of the dominant frame according to an adjustment manner corresponding to the framing adjustment instruction, to obtain an adjusted dominant frame.

As an alternative implementation, the adjusting unit 403 adjusts the size of the explicit frame according to the adjustment manner corresponding to the frame selection adjustment instruction, and obtaining the adjusted explicit frame may include:

the adjusting unit 403 analyzes an explicit frame to be adjusted corresponding to the framing adjustment instruction, where the explicit frame includes an upper frame, a lower frame, a left frame, or a right frame;

the adjusting unit 403 controls the dominant frame to be adjusted to move a preset distance in the moving direction included in the frame selection adjusting instruction;

the adjusting unit 403 determines whether all the frames of the moved dominant frame cover the text information;

if yes, the adjusting unit 403 automatically captures first information to be searched that contains the text information covered by the border and second information to be searched that does not contain the text information covered by the border;

the adjusting unit 403 sends the first information to be searched and the second information to be searched to the electronic device, so that the electronic device determines target search information from which the user is more likely to want to search, and returns the target search information to the handheld photographing device;

the adjusting unit 403 analyzes whether the target search information includes the text information covered by the frame, and if so, automatically adjusts the explicit frame to the text information just covered by the frame, so as to obtain the adjusted explicit frame; if not, automatically adjusting the dominant frame to just remove the text information covered by the frame to obtain the adjusted dominant frame.

By implementing the optional implementation mode, the handheld photographing device can analyze the frame of the dominant frame needing to be adjusted contained in the frame selection adjusting instruction and the corresponding moving direction to move the dominant frame, if any frame of the moved dominant frame is covered with the text information, the first information to be searched containing the text information and the second information to be searched not containing the text information are obtained, and the first information to be searched and the second information to be searched are sent to the electronic device, so that the electronic device can select the target search information which is more likely to be searched by a user from the target search information, wherein the electronic device can select the target search information containing more search results by respectively searching the first information to be searched and the second information to be searched in the preset database. And the handheld photographing equipment adjusts the dominant frame according to the target search information returned by the electronic equipment to obtain the adjusted dominant frame. The process can intelligently judge whether the information which the user wants to select includes the character information when the frame of the dominant frame covers the character information, and intelligently adjust the selection range of the dominant frame according to the character information, so that the intelligence and the accuracy rate of determining the information to be searched are increased.

A determining unit 404, configured to determine information selected by the frame of the explicit frame adjusted by the adjusting unit 403 as information to be searched.

Specifically, after the adjusting unit 403 adjusts the size of the dominant frame according to the adjusting manner corresponding to the frame selection adjusting instruction to obtain the adjusted dominant frame, the adjusting unit 403 sends a trigger instruction to the determining unit 404 to trigger the determining unit 404 to determine the information selected by the frame of the adjusted dominant frame as the information to be searched.

And the photographing unit 405 is configured to photograph the information to be searched determined by the determining unit 404 when it is detected that a photographing instruction triggered by a user is received, so as to obtain a photo of the information to be searched.

The sending unit 406 is configured to send the information photo to be searched, which is obtained by shooting by the shooting unit 405, to the electronic device that is connected with the handheld shooting device in advance, so that the electronic device displays a search result of the background server for the information to be searched on a display screen of the electronic device according to the information photo to be searched.

In the embodiment of the present invention, as shown in fig. 9, if the information photo to be searched includes a plurality of test questions, all the test questions can be displayed on the display screen of the electronic device, and when a user clicks a certain test question, a test question analysis for the certain test question pops up.

It can be seen that, with the implementation of the handheld photographing device described in fig. 4, the information to be searched can be accurately determined by adjusting the size of the dominant frame, so that the targeted photographing of the information to be searched is realized, and thus the accuracy of the search result (e.g., answer to test question) for the information to be searched (e.g., test question) is improved.

EXAMPLE five

Referring to fig. 5, fig. 5 is a schematic structural diagram of another handheld photographing apparatus according to an embodiment of the disclosure. The handheld photographing device 400 shown in fig. 5 is optimized from the handheld photographing device 400 shown in fig. 4. In the handheld photographing device 400 shown in figure 5,

the photographing unit 405 is specifically configured to perform fixed-focus photographing on the information to be searched according to a preset focus distance, so as to obtain a photo of the information to be searched.

The sending unit 406 is specifically configured to send the information photo to be searched to the electronic device that is connected to the handheld photographing device in advance, so as to activate the electronic device in a black screen state, and enable the activated electronic device to display a search result of the background server for the information to be searched on the display screen of the awakened electronic device according to the information photo to be searched.

Further optionally, the handheld photographing apparatus 400 shown in fig. 5 may further include:

the second detecting unit 407 is configured to detect whether a projection instruction triggered by a user is received when it is detected that a photographing instruction triggered by the user is not received, where the projection instruction is used to instruct projection of information to be searched.

Specifically, after the first detecting unit 402 detects that the frame selection adjustment instruction triggered by the user is not received, a trigger instruction is sent to the second detecting unit 407 to trigger the second detecting unit 407 to detect whether the projection instruction triggered by the user is received.

The prompting unit 408 is configured to issue a prompting message when the second detecting unit 407 detects that a projection instruction triggered by the user is received, where the prompting message is used to prompt the user to direct the projection apparatus of the handheld photographing device to the projection area.

And a projection unit 409 for projecting the information to be searched.

Specifically, after the prompt unit 408 sends the prompt message, the prompt unit 408 sends a trigger instruction to the projection unit 409 to trigger the projection unit 409 to project the information to be searched.

It can be seen that, with the implementation of the handheld photographing device described in fig. 5, the information to be searched can be accurately determined by adjusting the size of the dominant frame, so that the targeted photographing of the information to be searched is realized, and thus the accuracy of the search result (e.g., answer to test question) for the information to be searched (e.g., test question) is improved.

In addition, by implementing the handheld photographing device described in fig. 5, the information photo to be searched can be acquired more quickly, so that the efficiency of searching the question is improved. In addition, the step of searching the questions is simplified, and the efficiency of searching the questions is obviously improved. And, the learning efficiency is improved.

In addition, the implementation of the handheld photographing device described in fig. 5 can determine the test questions on a certain page as the information to be searched and project the information when the student encounters a test question distributed on two pages, so that the student can read the test questions, the question making efficiency is improved, and the learning score is improved to a certain extent.

EXAMPLE six

Referring to fig. 6, fig. 6 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention. The handheld photographing device 400 shown in fig. 6 is optimized from the handheld photographing device 400 shown in fig. 5. In the handheld photographing device 400 shown in fig. 6, the information to be searched at least includes english words, where:

the second detecting unit 407 is further configured to detect whether the user presses an english word in the information to be searched obtained by projection for a long time after the projection unit 409 projects the information to be searched.

Specifically, after the projection unit 409 projects the information to be searched, the projection unit 409 sends a trigger instruction to the second detection unit 407 to trigger the second detection unit 407 to detect whether the user presses an english word in the projected information to be searched for a long time.

The handheld photographing apparatus 400 shown in fig. 6 may further include:

the output unit 410 is configured to project and output a paraphrase interface for a certain english word when the second detection unit 407 detects that the user presses the certain english word in the projected information to be searched.

The second detecting unit 407 is further configured to detect whether the user clicks a virtual pronunciation key of an english word on the paraphrase interface output by the output unit 410, where the virtual pronunciation key is used to instruct to output a pronunciation of the english word.

The output unit 410 is further configured to output the pronunciation of a certain english word according to the pronunciation mode selected by the user when the second detecting unit 407 detects that the user clicks the virtual pronunciation key of the certain english word, where the pronunciation mode includes english pronunciation or american pronunciation.

Further optionally, in the handheld photographing device 400 shown in fig. 6, the opening unit 401 may include:

the determining sub-unit 4011 is configured to determine whether text information exists in a position facing a projection apparatus of the handheld photographing device.

And the projection sub-unit 4012 is configured to project the explicit frame according to the opening instruction when the judgment sub-unit 4011 judges that the position, to which the projection apparatus of the handheld photographing device faces, has the text information.

As an optional implementation manner, the determining sub-unit 4011 determines whether text information exists in a position facing a projection apparatus of the handheld photographing device, where the position facing the projection apparatus may include:

the judgment sub-unit 4011 starts a camera of the handheld photographing equipment;

the judgment sub-unit 4011 captures photo information of a position to which the projection apparatus faces by using the camera, and sends the photo information to the electronic equipment, so that the electronic equipment analyzes whether the photo information includes text information;

the judgment sub-unit 4011 receives the judgment result information returned by the electronic equipment, and judges whether the judgment result information is text information.

By implementing the optional implementation mode, the dominant frame can be projected when the text information exists, and the power consumption of the handheld photographing device can be saved to a certain extent.

It can be seen that, with the implementation of the handheld photographing device described in fig. 6, the information to be searched can be accurately determined by adjusting the size of the dominant frame, so that the targeted photographing of the information to be searched is realized, and thus the accuracy of the search result (e.g., answer to test question) for the information to be searched (e.g., test question) is improved.

In addition, by implementing the handheld photographing device described in fig. 6, the information photo to be searched can be acquired more quickly, so that the efficiency of searching the question is improved. In addition, the step of searching the questions is simplified, and the efficiency of searching the questions is obviously improved. And, the learning efficiency is improved.

In addition, the implementation of the handheld photographing device described in fig. 6 can determine the test questions on a certain page as the information to be searched and project the information when the student encounters a test question distributed on two pages, so that the student can read the test questions, the question making efficiency is improved, and the learning score is improved to a certain extent.

In addition, by implementing the handheld photographing device described in fig. 6, the novel and convenient way of searching for words can increase the learning interest of students and improve the user experience.

In addition, the implementation of the handheld photographing device described in fig. 6 can project the dominant frame only when text information exists, so that the power consumption of the handheld photographing device can be saved to a certain extent.

EXAMPLE seven

Referring to fig. 7, fig. 7 is a schematic structural diagram of a topic searching system based on explicit frame adjustment according to an embodiment of the present invention. As shown in fig. 7, the system may include the handheld photographing device 400, the electronic device 200, and the backend server 300 according to the fourth embodiment to the sixth embodiment:

wherein, the electronic device 200 includes:

the first receiving unit 2001 is configured to receive the information photo to be searched sent by the handheld photographing device 400.

The first interacting unit 2002 is configured to send the information photo to be searched, which is received by the first receiving unit 2001, to the backend server 300.

Among them, the background server 300 includes:

the second receiving unit 3001 is configured to receive the information photo to be searched sent by the first interacting unit 2002.

And an analyzing unit 3002, configured to analyze the photo of the information to be searched received by the second receiving unit 3001, so as to obtain the information to be searched.

A searching unit 3003, configured to query the database for a search result corresponding to the information to be searched analyzed by the analyzing unit 3002.

And a second interaction unit 3004 for transmitting the search result searched by the search unit 3003 to the electronic device 200.

Wherein, in the electronic device 200,

the first receiving unit 2001 is further configured to receive the search result sent by the second interacting unit 3004.

The electronic device 200 further includes:

a display unit 2003 for displaying the search result of the background server 300 for the information to be searched on the display screen of the electronic device 200.

Further optionally, in the system shown in fig. 7, the electronic device 200 may further include:

the activating unit 2004 is configured to activate the electronic device 200 in the black screen state after receiving the information photo to be searched sent by the handheld photographing device 400, and trigger the first receiving unit 2001 to receive the information photo to be searched sent by the handheld photographing device 400.

Referring to fig. 8, when the electronic device 200 is a tablet and the handheld photographing device 400 is a cylindrical body, the handheld photographing device 400 may turn on a built-in projection apparatus to project an explicit frame on the test question a, and the user may adjust the explicit frame to select information to be searched, where the information to be searched selected by the user frame in fig. 8 is a whole-page test question, and the handheld photographing device 400 may send the whole-page test question to the electronic device 200 to display the whole-page test question on a display screen of the electronic device 200. And, the electronic device 200 may send the whole page of test questions to the backend server 300, so that the backend server 300 queries the answer to the test questions corresponding to each test question included in the whole page of test questions in a preset database and returns the answer to the electronic device, and when the user clicks the test question a displayed on the electronic device 200, the electronic device 200 displays the answer corresponding to the test question clicked by the user. The process can accurately determine the information to be searched by adjusting the size of the dominant frame so as to realize the targeted shooting of the information to be searched, thereby improving the accuracy of the search result (such as answer to test questions) aiming at the information to be searched (such as test questions).

Example eight

The handheld photographing device provided by the embodiment of the invention can comprise any one of a search pen, a scanning pen, a photographing pen and the like. Taking a search pen as an example, fig. 10 is a block diagram illustrating a partial structure of the search pen of the handheld photographing apparatus according to the embodiment of the present invention. Referring to fig. 10, the search pen may include: an input unit 1010, a memory 1020, a photographing unit 1030, a processor 1040, a wireless communication module 1050, and a power supply 1060. Those skilled in the art will appreciate that the search pen configuration shown in FIG. 10 does not constitute a limitation of a search pen, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes the components of the search pen in detail with reference to fig. 10:

the input unit 1010 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the search pen. Specifically, the input unit 1010 may include, but is not limited to, a physical key 1011 (e.g., a photographing key, a switch key) disposed on the search pen, and the like, and may be configured to detect a pressing operation of the user thereon (e.g., an operation of the user on the physical key 1011 using a finger, a handheld touch and press device, or any other suitable object or accessory), and drive a corresponding connection device according to a preset program. The input unit 1010 may further include a pressure sensor 1012 that may detect a pressure value applied to the physical key 1011 and transmit the detected pressure value to the processor 1040.

The memory 1020 can be used for storing executable program codes, and the processor 1040 can execute various functional applications and data processing of the handheld photographing device by running the executable program codes stored in the memory 1020, and is particularly used for executing any one of the first to third embodiments of the title searching method based on dominant frame adjustment. The memory 1020 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a photographing function, a focus positioning function, etc.), and the like; the storage data area may store data (such as a test question image, voice data, etc.) created according to the use of the search pen, etc. Further, the memory 1020 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The search pen may further include a projection module 1093, the projection module 1093 may utilize the internal light source to emit a virtual image (e.g., an explicit frame and information to be projected), and may adjust projection parameters of the internal light source according to an adjustment instruction made by a user for the explicit frame to adjust a size, an orientation, and the like of the projected virtual image, and the projection module 1093 may further capture specified contents (e.g., all text information included in the explicit frame) in the projection area and feed back the captured contents to the photographing unit 1030 included in the search pen, so that the photographing unit 1030 photographs the pictures including the specified contents in the projection area.

The photographing unit 1030 may include, but is not limited to, an external camera 1031, a focus positioning module 1032, and an angle correction module 1033. Specifically, the external camera 1031 can rotate 180 degrees, and performs a preview of photographing through the dominant frame, obtains a test question image by photographing under the drive of a corresponding program, or outputs the test question image to the memory 1020. The focusing module 1032 may include a laser focusing module, an ultraviolet focusing module, etc., and the focusing module 1032 may automatically focus, position, or perform information projection, or may adjust focusing and positioning of the external camera 1031 according to a moving track of the search pen. The angle correction module 1033 may adjust the photographing angle of the external camera 1031 according to the parameters or the user operation.

The search pen may further include a gyroscope 1034 or a gravity sensor 1035, the focus positioning module 1032 may adjust the focus and the position according to the rotational angular velocity detected by the gyroscope 1034 or the gravitational acceleration detected by the gravity sensor 1035, and the angle correction module 1033 may adjust the photographing angle according to the rotational angular velocity detected by the gyroscope 1034 or the gravitational acceleration detected by the gravity sensor 1035.

Processor 1040 is the control center of the search pen, connects various portions of the entire search pen using various interfaces and lines, and performs various functions of the search pen and processes data by running or executing software programs and/or modules stored in memory 1020 and calling up data stored in memory 1020, thereby monitoring the search pen as a whole. Alternatively, processor 1040 may include one or more processing units; preferably, processor 1040 may integrate an application processor, which handles primarily operating systems, applications, etc., and a modem processor, which handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1040.

The wireless communication module 1050 may be used to transmit the test question image, receive a control instruction of the external device, and the like when the photographing function is performed, and particularly, may be transmitted to the processor 1040 after receiving the control instruction of the external device, and may be processed by the processor 1040. The wireless communication module 1050 may include, for example, a wireless fidelity (WiFi) module. WiFi belongs to a short-distance wireless transmission technology, the search pen can be used for sending test question images and receiving control instructions of external equipment and the like through a WiFi module, and wireless broadband internet access is provided for users.

The search pen may also include a power source 1060 (e.g., a battery) to power the various components, which may preferably be logically connected to the processor 1040 through a power management system to manage charging, discharging, and power consumption management functions through the power management system.

The search pen may further include a stylus head 1070, and the stylus head 1070 may include, but is not limited to, any one of a rubber soft pen head, a carbon fiber hard pen head, a pressure-retractable metal pen head, and the like, which may be used on a touch screen. The stylus head 1070 may act on the touchscreen/touch screen of the external device to input signals to the external device.

The search pen can also include at least one sensor 1080, such as an image sensor, a light sensor, a motion sensor, a biosensor, and others. In particular, the image sensor may convert an optical image into an electronic signal. The light sensor can adjust the brightness of the dominant frame in the photographing unit 1030 according to the brightness of the ambient light. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture (such as vertical placement, horizontal placement) of the search pen, and related functions (such as tapping) of vibration identification; the search pen may be further configured with other sensors such as a gyroscope, an infrared sensor, etc., which are not described herein.

The search pen may also include audio circuitry 1090, a speaker 1091, and a microphone 1092 may provide an audio interface between the user and the search pen. The audio circuit 1090 can transmit the electrical signal converted from the received audio data to the loudspeaker 1091, and the electrical signal is converted into a sound signal by the loudspeaker 1091 and output; on the other hand, the microphone 1092 converts the collected sound signals into electrical signals, which are received by the audio circuit 1090 and converted into audio data, which are processed by the audio data output processor 1040 and transmitted to, for example, an electronic device via the wireless communication module 1050, or output to the memory 1020 for further processing.

Although not shown, the search pen may further include a charging interface through which the power supply 1060 of the search pen may be charged. The interface that charges can include Micro USB interface, USB Type C interface etc.. The search pen may further include a switch indicator, a charge indicator, etc., which will not be described herein.

The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one of the problem searching methods based on explicit frame adjustment in figures 1-3.

Embodiments of the present invention also disclose a computer program product, wherein, when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method as in the above method embodiments.

The embodiment of the present invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.

In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

In the embodiments provided herein, it should be understood that "B corresponding to A" means that B is associated with A from which B can be determined. It should also be understood, however, that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.

The method and the system for searching for the subject based on the dominant frame adjustment and the handheld photographing device disclosed by the embodiment of the invention are described in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A title searching method based on explicit frame adjustment is characterized by comprising the following steps:

the handheld photographing equipment detects whether a frame selection adjusting instruction triggered by a user is received; the frame selection adjusting instruction is used for adjusting the size of the dominant frame, and if the frame selection adjusting instruction is used for adjusting the size of the dominant frame, the handheld photographing equipment analyzes a frame of the dominant frame to be adjusted, which corresponds to the frame selection adjusting instruction; the handheld photographing equipment controls the dominant frame to be adjusted to move a preset distance towards the moving direction contained in the frame selection adjusting instruction;

the handheld photographing equipment judges whether the moved dominant frame has a frame covering character information or not;

if so, the handheld photographing equipment captures first information to be searched which is selected by the moved dominant frame and contains the character information covered by the frame, and second information to be searched which is selected by the moved dominant frame and does not contain the character information covered by the frame;

the handheld photographing device sends the first information to be searched and the second information to be searched to the electronic device, so that the electronic device selects target search information containing more search records from the first information to be searched and the second information to be searched, and returns the target search information to the handheld photographing device;

the handheld photographing equipment analyzes whether the target search information contains character information covered by a frame or not, and if so, automatically adjusts the dominant frame to the character information just covered by the frame to obtain the adjusted dominant frame; if not, automatically adjusting the dominant frame to just remove the text information covered by the frame to obtain the adjusted dominant frame;

2. The method of claim 1, wherein the step of photographing the information to be searched by the handheld photographing device to obtain a photo of the information to be searched comprises:

3. The method of claim 2, further comprising:

4. The method of claim 3, wherein the information to be searched at least comprises English words, and after the handheld photographing device projects the information to be searched, the method further comprises:

5. The method according to any one of claims 1 to 4, wherein the handheld photographing device projects an explicit frame according to the turn-on instruction, and comprises:

6. A handheld photographing apparatus, comprising:

the adjusting unit is used for analyzing an explicit frame which is required to be adjusted and corresponds to the framing adjusting instruction when the first detecting unit detects that the framing adjusting instruction triggered by a user is received; controlling the dominant frame to be adjusted to move a preset distance towards the moving direction contained in the frame selection adjusting instruction;

judging whether the moved dominant frame has a frame covering the character information;

if so, capturing first information to be searched which is selected by the moved dominant frame and contains the character information covered by the frame, and second information to be searched which is selected by the moved dominant frame and does not contain the character information covered by the frame by using a camera of the handheld photographing equipment;

sending the first information to be searched and the second information to be searched to electronic equipment so that the electronic equipment selects target search information containing more search records from the first information to be searched and the second information to be searched, and returning the target search information to the handheld photographing equipment;

analyzing whether the target search information contains character information covered by a frame or not, if so, automatically adjusting the dominant frame to the character information just covered by the frame to obtain the adjusted dominant frame; if not, automatically adjusting the dominant frame to just remove the text information covered by the frame to obtain the adjusted dominant frame;

7. The handheld photographing apparatus of claim 6,

8. The handheld photographing apparatus according to claim 7, further comprising:

and the projection unit is used for projecting the information to be searched.

9. The handheld photographing apparatus according to claim 8, wherein the information to be searched includes at least an English word,

the handheld photographing apparatus further comprises:

10. The handheld photographing apparatus according to any one of claims 6 to 9, wherein the opening unit includes:

11. A topic searching system based on dominant frame adjustment, which is characterized by comprising the handheld photographing device, the electronic device and the background server as claimed in any one of claims 6 to 10;

wherein the electronic device comprises:

wherein, the background server comprises:

wherein, in the electronic device,

the electronic device further includes: