CN108282614B - Photographing and question searching method and system based on multiple light sources and handheld photographing equipment - Google Patents

Photographing and question searching method and system based on multiple light sources and handheld photographing equipment Download PDF

Info

Publication number
CN108282614B
CN108282614B CN201810055249.0A CN201810055249A CN108282614B CN 108282614 B CN108282614 B CN 108282614B CN 201810055249 A CN201810055249 A CN 201810055249A CN 108282614 B CN108282614 B CN 108282614B
Authority
CN
China
Prior art keywords
handheld
test question
photographing
handheld photographing
searched
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810055249.0A
Other languages
Chinese (zh)
Other versions
CN108282614A (en
Inventor
徐杨
李先兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Genius Technology Co Ltd
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201810055249.0A priority Critical patent/CN108282614B/en
Publication of CN108282614A publication Critical patent/CN108282614A/en
Application granted granted Critical
Publication of CN108282614B publication Critical patent/CN108282614B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means

Abstract

The invention relates to the technical field of electronic equipment, in particular to a method and a system for searching questions by photographing based on multiple light sources and a handheld photographing device, wherein the method comprises the following steps: the method comprises the steps that a handheld photographing device detects the photographing distance between the handheld photographing device and a test question to be photographed, a plurality of target light sources needing to be started in a plurality of light sources preset on the handheld photographing device are determined according to the photographing distance, each target light source is started, an explicit frame matched with the plurality of target light sources is projected on the test question to be photographed, photographing operation is carried out on a region framed and selected by the explicit frame, an image of the test question to be searched is obtained, the image of the test question to be searched is sent to electronic equipment in wireless connection with the handheld photographing device, the electronic equipment is triggered to output the image of the test question to be searched, and an analysis result of the test question to be searched contained in the image of the test question to be searched is obtained from a server and output. Therefore, the embodiment of the invention can simplify the operation process of photographing and searching the questions and improve the efficiency of photographing and searching the questions.

Description

Photographing and question searching method and system based on multiple light sources and handheld photographing equipment
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a photographing and question searching method and system based on multiple light sources and handheld photographing equipment.
Background
At present, many electronic devices on the market have a photographing and question searching function, a student user can start the electronic device and select the photographing and question searching function when needing to search answers to test questions, then focus and photograph the questions to be searched by controlling a camera of the electronic device, intercept the photographed photos through a selection frame on a display interface of the electronic device after focusing and photographing are completed, and upload the intercepted photos to a server to obtain answers to the test questions. However, in actual operation, it is found that a student user needs to adjust the size of the selection frame and continuously move the position of the selection frame to be able to make the selection frame completely select the test questions to be searched, and the whole photographing and question searching process is complex in operation and low in efficiency.
Disclosure of Invention
The embodiment of the invention discloses a photographing and question searching method and system based on multiple light sources and a handheld photographing device, which can simplify the operation process of photographing and question searching and improve the efficiency of photographing and question searching.
The first aspect of the embodiment of the invention discloses a photographing question searching method based on multiple light sources, which comprises the following steps:
the method comprises the steps that a handheld photographing device detects the photographing distance between the handheld photographing device and a test question to be photographed;
the handheld photographing device determines a plurality of target light sources needing to be started in a plurality of preset light sources on the handheld photographing device according to the photographing distance, and starts each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed;
the handheld photographing device controls a camera on the handheld photographing device to perform photographing operation on the area framed and selected by the dominant frame to obtain an image of the test question to be searched, and sends the image of the test question to be searched to the electronic device wirelessly connected with the handheld photographing device so as to trigger the electronic device to output the image of the test question to be searched and obtain and output a test question analysis result of the test question to be searched contained in the image of the test question to be searched from a server.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the handheld photographing apparatus turns on each of the target light sources to project an explicit frame matching with the plurality of target light sources on the test question to be photographed, the method further includes:
the handheld photographing device controls a camera on the handheld photographing device to execute laser focusing operation and detects whether a photographing instruction triggered by a user is received;
if so, the handheld photographing equipment executes the shooting operation of controlling the camera on the handheld photographing equipment to the area framed and selected by the dominant frame, and a test question image to be searched is obtained.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the controlling, by the handheld image capturing device, a camera on the handheld image capturing device to execute a laser focusing operation includes:
the handheld photographing equipment controls a laser emitting device on the handheld photographing equipment to emit first laser to the area framed by the dominant frame, and records a first moment of emitting the first laser;
the handheld photographing equipment controls a laser receiving device on the handheld photographing equipment to receive second laser reflected by the first laser in the area framed by the dominant frame, and records a second moment when the second laser is received;
the handheld photographing device calculates the time difference between the first time and the second time;
the handheld photographing equipment calculates the actual distance between the handheld photographing equipment and the area framed by the dominant frame according to the time difference;
and the handheld photographing equipment adjusts the camera on the handheld photographing equipment according to the actual distance so as to finish laser focusing of the camera on the handheld photographing equipment.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after detecting that the shooting instruction triggered by the user is received, and before the handheld photographing apparatus controls the camera on the handheld photographing apparatus to perform a shooting operation on the region framed by the dominant frame, so as to obtain a to-be-searched test question image, the method further includes:
the handheld photographing device controls a built-in sensor of the handheld photographing device to record shake information of the handheld photographing device, wherein the shake information at least comprises an angular velocity variation of the handheld photographing device and an acceleration variation of the handheld photographing device;
the handheld photographing device judges whether the jitter information is larger than a preset jitter threshold value;
if so, the handheld photographing equipment calculates the displacement to be compensated of the handheld photographing equipment according to the jitter information;
and the handheld photographing equipment performs displacement compensation on photographing parameters of a camera on the handheld photographing equipment according to the displacement to be compensated, and triggers and executes the control of the camera on the handheld photographing equipment to execute photographing operation on the area framed by the dominant frame, so as to obtain a to-be-searched test question image.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the handheld photographing apparatus sends the to-be-searched test question image to an electronic apparatus wirelessly connected to the handheld photographing apparatus to trigger the electronic apparatus to output the to-be-searched test question image, and obtain, from a server, a test question analysis result of a to-be-searched test question included in the to-be-searched test question image, and output the test question analysis result, the method further includes:
the handheld photographing device acquires a pressure value of the handheld photographing device at the current moment;
the handheld photographing equipment judges whether the pressure value is larger than a preset pressure value or not;
if yes, the handheld photographing device controls the plurality of preset light sources on the handheld photographing device to emit flashing signals within a preset time length so as to prompt whether to continue to execute photographing operation or not, and detects whether a detection instruction triggered by a user is received or not, wherein the detection instruction is used for indicating detection of a photographing distance between the handheld photographing device and the test question to be photographed;
and if the handheld photographing device does not receive the detection instruction triggered by the user, the handheld photographing device switches the current mode of the handheld photographing device into the sleep mode.
A second aspect of the embodiments of the present invention discloses a handheld photographing apparatus, which is characterized by comprising:
the detection unit is used for detecting the photographing distance between the handheld photographing equipment and the test question to be photographed;
the starting unit is used for determining a plurality of target light sources needing to be started in a plurality of preset light sources on the handheld photographing equipment according to the photographing distance, and starting each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed;
the shooting unit is used for controlling a camera on the handheld shooting equipment to execute shooting operation on the area framed and selected by the dominant frame to obtain a test question image to be searched;
and the sending unit is used for sending the to-be-searched test question image to the electronic equipment wirelessly connected with the handheld photographing equipment so as to trigger the electronic equipment to output the to-be-searched test question image, and acquiring and outputting a test question analysis result of the to-be-searched test question contained in the to-be-searched test question image from a server.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the handheld photographing apparatus further includes:
the focusing unit is used for controlling a camera on the handheld photographing equipment to execute laser focusing operation after the starting unit starts each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed;
and the detection unit is used for detecting whether a shooting instruction triggered by a user is received or not, and when the shooting instruction is detected to be received, triggering the shooting unit to execute the shooting operation of controlling a camera on the handheld shooting equipment to execute the shooting operation on the area framed and selected by the dominant frame to obtain the test question image to be searched.
As an alternative implementation, in a second aspect of the embodiments of the present invention, the focusing unit includes:
the control subunit is configured to control a laser emitting device on the handheld photographing apparatus to emit first laser to an area framed by the dominant frame after the starting unit starts each of the target light sources to project the dominant frame matched with the plurality of target light sources on the test question to be photographed, and record a first time at which the first laser is emitted;
the control subunit is further configured to control a laser receiving device on the handheld photographing apparatus to receive second laser reflected by the first laser in the area framed by the dominant frame, and record a second time when the second laser is received;
the calculating subunit is configured to calculate a time difference between the first time and the second time, and calculate an actual distance between the handheld photographing device and the region framed by the dominant frame according to the time difference;
and the adjusting subunit is used for adjusting the camera on the handheld photographing equipment according to the actual distance so as to complete laser focusing of the camera on the handheld photographing equipment.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the handheld photographing apparatus further includes:
the first control unit is used for controlling a built-in sensor of the handheld photographing equipment to record shake information of the handheld photographing equipment after the detection unit detects that the handheld photographing equipment receives a photographing instruction triggered by a user and before the photographing unit controls a camera on the handheld photographing equipment to perform photographing operation on an area framed by the dominant frame to obtain a to-be-searched test question image, wherein the shake information at least comprises an angular velocity variation of the handheld photographing equipment and an acceleration variation of the handheld photographing equipment;
the first judging unit is used for judging whether the jitter information is larger than a preset jitter threshold value or not;
the calculation unit is used for calculating the displacement to be compensated of the handheld photographing device according to the jitter information when the first judgment unit judges that the jitter information is larger than a preset jitter threshold;
the compensation unit is used for carrying out displacement compensation on the photographing parameters of the camera on the handheld photographing equipment according to the displacement to be compensated;
the shooting unit is specifically configured to, when the detection unit detects that the shooting instruction is received, and after the compensation unit performs displacement compensation on the shooting parameters of the camera on the handheld shooting device according to the displacement to be compensated, control the camera on the handheld shooting device to perform shooting operation on the region framed by the dominant frame, so as to obtain a to-be-searched test question image.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the handheld photographing apparatus further includes:
the acquisition unit is used for acquiring the current pressure value of the handheld photographing equipment after the sending unit sends the test question image to be searched to the electronic equipment wirelessly connected with the handheld photographing equipment;
the second judgment unit is used for judging whether the pressure value is larger than a preset pressure value or not;
the second control unit is used for controlling the plurality of preset light sources on the handheld photographing equipment to send out flashing signals within a preset time length to prompt whether to continue to execute the photographing operation or not when the second judgment unit judges that the pressure value is larger than the preset pressure value;
the second detection unit is used for detecting whether a detection instruction triggered by a user is received or not, wherein the detection instruction is used for indicating and detecting a photographing distance between the handheld photographing device and the test question to be photographed;
and the switching unit is used for switching the current mode to the sleep mode when the second detection unit detects that the handheld photographing device does not receive the detection instruction triggered by the user.
The third aspect of the embodiment of the invention discloses a photographing and question searching system based on multiple light sources, which comprises electronic equipment, a server and handheld photographing equipment;
the handheld photographing device is the handheld photographing device according to the second aspect of the embodiment of the invention;
the electronic equipment comprises a receiving unit, a display unit and a first communication unit;
the server comprises a content acquisition unit, a storage unit, a data matching unit and a second communication unit;
the receiving unit is used for receiving the test question image to be searched, which is sent by the handheld photographing equipment;
the display unit is used for outputting the test question image to be searched to a display interface of the electronic equipment;
the first communication unit is used for uploading the to-be-searched test question image to the server and acquiring a test question analysis result of the to-be-searched test question contained in the to-be-searched test question image from the server;
the display unit is further configured to output a test question analysis result matched with the viewing instruction according to the viewing instruction after the viewing instruction triggered by the user is detected, where the viewing instruction includes a test question identifier of one of the test questions to be searched, and the test question analysis result matched with the viewing instruction is a test question analysis result of the one of the test questions to be searched;
the second communication unit is used for receiving the test question image to be searched sent by the first communication unit;
the content acquisition unit is used for identifying the test questions to be searched contained in the test question image to be searched from the test question image to be searched received by the second communication unit;
the data matching unit is used for matching the test question database stored in the storage unit to obtain a test question analysis result of the test question to be searched contained in the test question image to be searched;
the second communication unit is further configured to send the test question analysis result of the test question to be searched, which is contained in the test question image to be searched and obtained by the data matching unit through matching, to the electronic device.
The fourth aspect of the embodiments of the present invention discloses a handheld photographing apparatus, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the photographing question searching method disclosed by the first aspect of the embodiment of the invention.
A fifth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute the method for searching for questions by taking a picture based on multiple light sources disclosed in the first aspect of the embodiments of the present invention.
A sixth aspect of the present invention discloses a computer program product, which when running on a computer, causes the computer to execute the method for searching for problems by taking pictures based on multiple light sources disclosed in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the handheld photographing device detects the photographing distance between the handheld photographing device and the test questions to be photographed, a plurality of target light sources needing to be started in a plurality of light sources preset on the handheld photographing device are determined according to the photographing distance, each target light source is started to project an explicit frame matched with the plurality of target light sources on the test questions to be photographed, then, the photographing operation is carried out on the area framed and selected by the explicit frame to obtain the test question images to be searched, the test question images to be searched are sent to the electronic device wirelessly connected with the handheld photographing device, and the electronic device is triggered to output the test question images to be searched and obtain the test question analysis results of the test questions to be searched contained in the test question images to be searched from a server and output the test question analysis results. Therefore, by implementing the embodiment of the invention, the target light source to be started on the handheld photographing device can be quickly determined according to the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected on the test question to be photographed by the target light source, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic flow chart of a method for searching for questions by photographing based on multiple light sources according to an embodiment of the present invention;
FIG. 2 is an exemplary diagram of interaction between a handheld photographing device and an electronic device according to an embodiment of the present disclosure;
FIG. 3 is a schematic flowchart of another method for searching for questions by taking a picture based on multiple light sources according to an embodiment of the present invention;
FIG. 4 is a schematic flowchart of another method for searching questions by taking a picture based on multiple light sources according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a handheld photographing device disclosed in the embodiment of the present invention;
fig. 6 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention;
fig. 7 is a schematic structural diagram of another handheld photographing device disclosed in the embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a system for searching for questions by taking a picture according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of a user interface of an electronic device for outputting an image of a test question to be searched and a result of analyzing the test question according to an embodiment of the present invention;
fig. 10 is a block diagram of a partial structure of a search pen according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a photographing and question searching method and system based on multiple light sources and a handheld photographing device, which can simplify the operation process of photographing and question searching and improve the efficiency of photographing and question searching. The following are detailed below.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a method for searching for questions by taking pictures based on multiple light sources according to an embodiment of the present invention. As shown in fig. 1, the method for searching questions by taking a picture based on multiple light sources may include the following operations:
101. the handheld photographing device detects the photographing distance between the handheld photographing device and the test question to be photographed.
In the embodiment of the present invention, the handheld photographing device may detect the photographing distance between the handheld photographing device and the test question to be photographed through a built-in distance sensor, where the distance sensor may be an optical distance sensor, an infrared distance sensor, or an ultrasonic distance sensor, and the present invention is not limited thereto. It should be noted that the photographing distance is a vertical distance between the handheld photographing device and the test question to be photographed.
As an optional implementation manner, before detecting the photographing distance between the handheld photographing device and the test question to be photographed, the handheld photographing device may detect whether a detection instruction triggered by a user is received, where the detection instruction is used to indicate that the photographing distance between the handheld photographing device and the test question to be photographed is detected. Optionally, the handheld photographing device may be preset with an input interface for the detection instruction, so that the user may input the detection instruction through the input interface. Specifically, the input interface may be represented as a physical key of an entity, for example, the physical key of the entity may be a "photographing key" located on the handheld photographing device, and the user may trigger the detection instruction by lightly pressing the "photographing key"; or, the input interface may be a built-in pressure sensor of the handheld photographing device, for example, the user may grip the handheld photographing device tightly, and when the built-in pressure sensor of the handheld photographing device detects that a pressure value of the surface of the handheld photographing device is greater than a preset pressure threshold, the handheld photographing device determines that the user has triggered the detection instruction; or, the input interface may be a microphone or a sound pickup device on the handheld photographing device, such as a microphone, for example, the user may send a voice instruction to the handheld photographing device, and if the microphone or the sound pickup device on the handheld photographing device detects that the voice instruction includes one or more keywords such as "photograph", "test question", and "distance measurement", the handheld photographing device determines that the user has triggered the detection instruction; or, the input interface may be represented as a start interface of an application program of the electronic device wirelessly connected to the handheld photographing device, for example, when a user starts a learning APP on the electronic device, the detection instruction may be triggered. Therefore, the embodiment of the invention can provide diversified selections for the user through the preset multiple input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved.
102. The handheld photographing device determines a plurality of target light sources needing to be started in a plurality of preset light sources on the handheld photographing device according to the photographing distance, and starts each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed.
Optionally, a plurality of distance gears may be preset in the handheld photographing device, each distance gear corresponds to a preset distance range and a group of light sources in a plurality of light sources preset on the handheld photographing device, and in addition, each distance gear may trigger to start a corresponding number of target light sources to be started in a corresponding position. After the photographing distance between the handheld photographing device and the test questions to be photographed is detected in the step 101, the handheld photographing device may match the photographing distance with a plurality of preset distance gears one by one, and if the photographing distance is successfully matched with the target distance gears, the target light sources to be started in corresponding numbers and positions may be triggered. For example, three distance gears and three circles of light sources can be preset on the handheld photographing device, and one circle of light source forms a group of light sources, and specifically includes a first distance gear and an inner circle light source matched with the first distance gear, a second distance gear and a middle circle light source matched with the second distance gear and a third distance gear and an outer circle light source matched with the third distance gear, wherein the distance range corresponding to the first distance gear is 8 centimeters or less and does not include 8 centimeters, the distance range corresponding to the second distance gear is 8 centimeters to 16 centimeters and does not include 16 centimeters, and the distance gear corresponding to the third distance gear is 16 centimeters or more. Then, when the handheld photographing device detects that the photographing distance between the handheld photographing device and the test question to be photographed is 16 centimeters, the handheld photographing device matches the 16 centimeters with the three preset distance gears one by one, and it is easy to know that the matching between the 16 centimeters and the third distance gear is successful, and then, the starting corresponding to the third distance gear and the outer ring light source can be triggered.
It should be noted that, the positions of the preset light sources on the handheld photographing device are not limited, and based on the characteristics of light projection, the shapes of the dominant frames projected on the test questions to be photographed by the preset light sources are also not limited. For example, based on the work condition of the student (the size of the work paper commonly used by the student is a4 paper size), the handheld photographing device can be preset with a light source placement position with the same proportion as the size of the a4 paper for placing the light source.
103. And the handheld photographing equipment controls a camera on the handheld photographing equipment to perform photographing operation on the area framed and selected by the dominant frame to obtain a to-be-searched test question image.
As an optional implementation manner, the handheld photographing apparatus controls the camera on the handheld photographing apparatus to perform a photographing operation on the area framed by the dominant frame, before obtaining the test question image to be searched, and starts each target light source, so that after the dominant frame matched with the plurality of target light sources is projected on the test question to be photographed, the angle correction can be performed on the camera on the handheld photographing apparatus. Particularly, the handheld photographing device can trigger a gravity sensor and a gyroscope which are arranged in the handheld photographing device to detect the inclination angle of the handheld photographing device in the vertical direction, judge whether the inclination angle is larger than a preset angle threshold value or not, and adjust the photographing angle of a camera on the handheld photographing device according to the inclination angle if the inclination angle is larger than the preset angle threshold value, so that the camera on the handheld photographing device is perpendicular to a plane where test questions are photographed. Therefore, the embodiment of the invention can reduce the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment by automatically detecting and correcting the shooting angle of the camera on the handheld shooting equipment, and does not need the user to manually adjust the holding mode of the handheld shooting equipment, so that the operation is more convenient and faster, and the use experience of the user is further improved.
104. The handheld photographing device sends the to-be-searched test question image to the electronic device in wireless connection with the handheld photographing device so as to trigger the electronic device to output the to-be-searched test question image, and obtain and output a test question analysis result of the to-be-searched test question contained in the to-be-searched test question image from the server.
In the embodiment of the present invention, optionally, the handheld photographing device may trigger a speaker built in the handheld photographing device to emit a prompt sound while or after sending the to-be-searched test question image to the electronic device wirelessly connected to the handheld photographing device, so as to inform the user that the to-be-searched test question image is uploaded to the electronic device, and the user can conveniently check the to-be-searched test question image through the electronic device in time.
Therefore, by the method described in fig. 1, the target light source to be turned on the handheld photographing device can be quickly determined according to the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected by the target light source on the test question to be photographed, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved; in addition, various selections can be provided for the user through various preset input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved; in addition, the shooting angle of the camera on the handheld shooting equipment can be automatically detected and corrected, the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment is reduced, the holding mode of the handheld shooting equipment does not need to be manually adjusted by a user, the operation is more convenient, and the use experience of the user is further improved.
Referring to fig. 2, fig. 2 is an exemplary diagram of interaction between a handheld photographing device and an electronic device according to an embodiment of the present invention. As shown in fig. 2, for example, the handheld photographing apparatus may be a search pen having a photographing function, and the electronic apparatus may be a learning tablet, then the search pen may project a dominant frame matching with a plurality of target light sources on a test question to be photographed, and control a camera on the search pen to perform a photographing operation on an area framed by the dominant frame, so as to obtain an image of the test question to be searched, and send the image of the test question to be searched to the learning tablet wirelessly connected to the search pen, so as to trigger the learning tablet to output the image of the test question to be searched to a display interface of the learning tablet for a user to view, where the image of the test question to be searched may include one or more test questions to be searched. Therefore, the method shown in fig. 2 can enable the user to check the image of the test question to be searched on the learning tablet in time through the interaction between the search pen and the learning tablet, so that the user can acquire information more conveniently and quickly, and the efficiency of photographing and searching the question is improved; in addition, the shooting of the test questions to be searched can be completed through the search pen when the learning tablet is in the black screen standby state, so that the interference of other applications on the learning tablet on the shooting and question searching process is avoided, and the shooting and question searching efficiency is further improved.
Example two
Referring to fig. 3, fig. 3 is a flowchart of another photographing question searching method based on multiple light sources according to an embodiment of the present invention. As shown in fig. 3, the method for searching questions by taking a picture based on multiple light sources may include the following steps:
in the embodiment of the present invention, the method for searching questions by taking a picture based on multiple light sources further includes steps 201 to 202, and for the description of steps 201 to 202, please refer to the detailed description of steps 101 to 102 in the first embodiment, which is not repeated herein.
203. The handheld photographing device controls a camera on the handheld photographing device to execute laser focusing operation.
As an optional implementation, the controlling, by the handheld photographing apparatus, the camera on the handheld photographing apparatus to perform the laser focusing operation may include:
the handheld photographing equipment controls a laser emitting device on the handheld photographing equipment to emit first laser to the area framed and selected by the dominant frame, and records a first moment of emitting the first laser;
the handheld photographing equipment controls a laser receiving device on the handheld photographing equipment to receive second laser reflected by the first laser in the area framed and selected by the dominant frame, and records a second moment when the second laser is received;
the handheld photographing equipment calculates the time difference between the first time and the second time;
the handheld photographing equipment calculates the actual distance between the handheld photographing equipment and the area framed and selected by the dominant frame according to the time difference;
and the handheld photographing equipment adjusts the camera on the handheld photographing equipment according to the actual distance so as to finish laser focusing on the camera on the handheld photographing equipment.
In the embodiment of the present invention, the laser receiving device on the handheld photographing apparatus may be in a vicinity of the camera, which is not limited in the embodiment of the present invention.
Therefore, in the embodiment of the invention, the focusing object (the area framed by the dominant frame) can be quickly locked by using the laser, so that the lens of the camera on the handheld photographing equipment can be moved to the designated position in one step to complete the whole laser focusing process, and the handheld photographing equipment can control the camera to complete focusing operation in a dark environment due to less influence of the laser on a weak light or pure color environment, so that the focusing speed of the handheld photographing equipment is improved, and the handheld photographing equipment has strong adaptability.
As an optional implementation manner, after the handheld photographing device controls the camera on the handheld photographing device to perform the laser focusing operation, the handheld photographing device may trigger a plurality of light sources preset on the handheld photographing device to change a light emitting color, or may trigger a sound generating device on the handheld photographing device to generate a prompt sound to prompt the user that the focusing is successful. Therefore, the embodiment of the invention can prompt the user to successfully focus through the change of the light emitting color of the light source or prompt sound, so that the user can timely and intuitively know the focusing condition of the handheld photographing equipment; in addition, when the electronic equipment wirelessly connected with the handheld photographing equipment is in a black screen standby state, the user can know the focusing condition of the handheld photographing equipment without the electronic equipment, and the experience of the user is further improved.
204. The handheld photographing device detects whether a photographing instruction triggered by a user is received, if so, step 205 is executed, otherwise, the process is ended.
205. The handheld photographing device controls a built-in sensor of the handheld photographing device to record shake information of the handheld photographing device, and the shake information at least comprises angular speed variation of the handheld photographing device and acceleration variation of the handheld photographing device.
In the embodiment of the present invention, the handheld photographing device may record shake information of the handheld photographing device through a built-in sensor (e.g., a gyroscope and an acceleration sensor), where the shake information may include an angular velocity variation of the handheld photographing device and an acceleration variation of the handheld photographing device; furthermore, the shake information in all directions of the handheld photographing equipment can be recorded through the built-in sensor, so that the shake information can reflect the shake condition of the handheld photographing equipment more comprehensively, the accuracy of correcting the photographing parameters of the camera on the handheld photographing equipment according to the shake information is improved, and the image shooting definition of the handheld photographing equipment is also improved.
206. The handheld photographing device judges whether the jitter information is larger than a preset jitter threshold value, if so, step 207 is executed, otherwise, the process is ended.
207. And the handheld photographing equipment calculates the displacement to be compensated of the handheld photographing equipment according to the shake information.
In the embodiment of the invention, after judging that the jitter information is greater than the preset jitter threshold value, the handheld photographing device triggers the built-in sensor to send the signal of the jitter information to the microprocessor of the handheld photographing device, and the microprocessor calculates the displacement to be compensated (the displacement to be compensated of the handheld photographing device). Specifically, the shake information includes an acceleration variation of the handheld photographing device and an angular velocity variation of the handheld photographing device, the acceleration variation of the handheld photographing device is subjected to integral operation to obtain a displacement variation and the angular velocity variation of the handheld photographing device is subjected to integral operation to obtain an angular displacement variation, and then the displacement to be compensated of the handheld photographing device is obtained according to the displacement variation and the angular displacement variation.
208. And the handheld photographing equipment performs displacement compensation on the photographing parameters of the camera on the handheld photographing equipment according to the displacement to be compensated.
In the embodiment of the present invention, the handheld photographing device sends the displacement to be compensated of the handheld photographing device calculated by the microprocessor in step 208 to the micro driving motor on the handheld photographing device, and the micro driving motor adjusts the position of the lens in the camera, so as to complete the displacement compensation of the photographing parameters of the camera on the handheld photographing device.
209. And the handheld photographing equipment controls a camera on the handheld photographing equipment to perform photographing operation on the area framed and selected by the dominant frame to obtain the test question image to be searched.
210. The handheld photographing device sends the to-be-searched test question image to the electronic device in wireless connection with the handheld photographing device so as to trigger the electronic device to output the to-be-searched test question image, and obtain and output a test question analysis result of the to-be-searched test question contained in the to-be-searched test question image from the server.
Therefore, by the method described in fig. 3, the target light source to be turned on the handheld photographing device can be quickly determined according to the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected by the target light source on the test question to be photographed, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved; in addition, various selections can be provided for the user through various preset input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved; in addition, the shooting angle of the camera on the handheld shooting equipment can be automatically detected and corrected, the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment is reduced, the holding mode of the handheld shooting equipment does not need to be manually adjusted by a user, the operation is more convenient, and the use experience of the user is further improved.
In addition, by the method described in fig. 3, the user can check the image of the test question to be searched on the learning tablet in time through the interaction between the search pen and the learning tablet, so that the user can acquire information more conveniently, and the efficiency of photographing and searching the question is improved; in addition, the shooting of the test questions to be searched can be completed through the search pen when the learning tablet is in the black screen standby state, so that the interference of other applications on the learning tablet on the shooting and question searching process is avoided, and the shooting and question searching efficiency is further improved.
In addition, by the method described in fig. 3, the focusing object (the area framed by the dominant frame) can be quickly locked by using laser, so that the lens of the camera on the handheld photographing device can be moved to a designated position in one step to complete the whole laser focusing process, and the handheld photographing device can control the camera to complete focusing operation in a dark environment due to the fact that the laser is slightly influenced in a weak light or pure color environment, so that the focusing speed of the handheld photographing device is improved, and the handheld photographing device has strong adaptability; the user can be prompted to be successfully focused through the change of the light emitting color of the light source or the prompt sound, so that the user can timely and intuitively know the focusing condition of the handheld photographing equipment; in addition, when the electronic equipment wirelessly connected with the handheld photographing equipment is in a black screen standby state, a user can know the focusing condition of the handheld photographing equipment without the electronic equipment, so that the experience of the user is further improved; and the shake information in all directions of the handheld photographing equipment can be recorded through the built-in sensor, so that the shake information can reflect the shake condition of the handheld photographing equipment more comprehensively, the accuracy of correcting the photographing parameters of the camera on the handheld photographing equipment according to the shake information is improved, and the definition of images photographed by the handheld photographing equipment is also improved.
EXAMPLE III
Referring to fig. 4, fig. 4 is a flowchart of another photographing question searching method based on multiple light sources according to an embodiment of the present invention. As shown in fig. 4, the method for searching questions by taking a picture based on multiple light sources may include the following steps:
in the embodiment of the present invention, the method for searching questions by taking pictures based on multiple light sources further includes steps 301 to 310, and for the description of steps 301 to 310, please refer to the detailed description of steps 201 to 210 in the first embodiment, which is not repeated herein.
311. The handheld photographing device acquires a pressure value of the handheld photographing device at the current moment.
In the embodiment of the invention, the handheld photographing device can acquire the pressure value of the handheld photographing device at the current moment through the built-in pressure sensor, and further, the pressure value can be the pressure value of the surface of the handheld photographing device detected by the pressure sensor.
312. The handheld photographing device judges whether the pressure value is larger than a preset pressure value, if so, step 313 is executed, and if not, step 315 is executed.
313. The handheld photographing device controls a plurality of light sources preset on the handheld photographing device to send out flashing signals within a preset time length so as to prompt whether to continue to execute photographing operation.
314. And the handheld photographing device detects whether a detection instruction triggered by a user is received, if so, the process is ended, otherwise, step 315 is executed, wherein the detection instruction is used for indicating and detecting the photographing distance between the handheld photographing device and the test question to be photographed.
315. The handheld photographing device switches its current mode to the sleep mode.
For steps 311-315, for example, the handheld photographing device may be a search pen with a photographing function. After a user finishes shooting an image of a test question to be searched through a search pen, the user may still hold the search pen by hand but does not use the search pen, then, at this time, the search pen may obtain a pressure value on the surface of the search pen, which is larger than a preset pressure value, through a built-in pressure sensor, and then, the search pen may control a plurality of light sources preset on the search pen to emit flicker signals within a preset time length to prompt the user whether to continue shooting operation, when the search pen does not detect a detection instruction triggered by the user within the preset time length in which the light sources emit the flicker signals, it is stated that the user does not need to continue shooting the test question, and the search pen may switch the current working mode to a sleep mode. Therefore, the embodiment of the invention can avoid switching the current mode of the handheld photographing device into the sleep mode under the condition that a user holds the handheld photographing device by hand but does not use the handheld photographing device to perform photographing and searching questions, and reduces the power consumption of the handheld photographing device to a certain extent.
Therefore, by the method described in fig. 4, the target light source to be turned on the handheld photographing device can be quickly determined according to the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected by the target light source on the test question to be photographed, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved; in addition, various selections can be provided for the user through various preset input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved; in addition, the shooting angle of the camera on the handheld shooting equipment can be automatically detected and corrected, the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment is reduced, the holding mode of the handheld shooting equipment does not need to be manually adjusted by a user, the operation is more convenient, and the use experience of the user is further improved.
In addition, by the method described in fig. 4, the user can check the image of the test question to be searched on the learning tablet in time through the interaction between the search pen and the learning tablet, so that the user can acquire information more conveniently, and the efficiency of photographing and searching the question is improved; in addition, the shooting of the test questions to be searched can be completed through the search pen when the learning tablet is in the black screen standby state, so that the interference of other applications on the learning tablet on the shooting and question searching process is avoided, and the shooting and question searching efficiency is further improved.
In addition, by the method described in fig. 4, a focusing object (an area framed by a dominant frame) can be quickly locked by laser, so that a lens of a camera on the handheld photographing device can be moved to a designated position in one step to complete the whole laser focusing process, and the handheld photographing device can control the camera to complete focusing operation in a dark environment due to small influence of the laser on a weak light or pure color environment, so that the focusing speed of the handheld photographing device is improved, and the handheld photographing device has strong adaptability; the user can be prompted to be successfully focused through the change of the light emitting color of the light source or the prompt sound, so that the user can timely and intuitively know the focusing condition of the handheld photographing equipment; in addition, when the electronic equipment wirelessly connected with the handheld photographing equipment is in a black screen standby state, a user can know the focusing condition of the handheld photographing equipment without the electronic equipment, so that the experience of the user is further improved; and the shake information in all directions of the handheld photographing equipment can be recorded through the built-in sensor, so that the shake information can reflect the shake condition of the handheld photographing equipment more comprehensively, the accuracy of correcting the photographing parameters of the camera on the handheld photographing equipment according to the shake information is improved, and the definition of images photographed by the handheld photographing equipment is also improved.
In addition, by the method described in fig. 4, it is avoided that the current mode of the handheld photographing device is switched to the sleep mode when the user holds the handheld photographing device with a hand but does not use the handheld photographing device to perform photographing and searching questions, and power consumption of the handheld photographing device is reduced to a certain extent.
Example four
Referring to fig. 5, fig. 5 is a schematic structural diagram of a handheld photographing device according to an embodiment of the present invention. As shown in fig. 5, the handheld photographing apparatus may include:
the detection unit 401 is configured to detect a photographing distance between the handheld photographing device and the test question to be photographed.
In this embodiment of the present invention, the detecting unit 401 may detect the photographing distance between the handheld photographing device and the test question to be photographed through a built-in distance sensor, where the distance sensor may be an optical distance sensor, an infrared distance sensor, or an ultrasonic distance sensor, which is not limited in the present invention. It should be noted that the photographing distance is a vertical distance between the handheld photographing device and the test question to be photographed.
As an optional implementation manner, before detecting the photographing distance between the handheld photographing device and the test question to be photographed, the detecting unit 401 may detect whether a detection instruction triggered by a user is received, where the detection instruction is used to instruct to detect the photographing distance between the handheld photographing device and the test question to be photographed. Alternatively, the detection unit 401 may be preset with an input interface for the detection instruction, so that the user may input the detection instruction through the input interface. Specifically, the input interface may be represented as a physical key of an entity, for example, the physical key of the entity may be a "photographing key" located on the handheld photographing device, and the user may trigger the detection instruction by lightly pressing the "photographing key"; or, the input interface may be a built-in pressure sensor of the handheld photographing device, for example, the user may grip the handheld photographing device tightly, and when the built-in pressure sensor of the handheld photographing device detects that a pressure value of the surface of the handheld photographing device is greater than a preset pressure threshold, the handheld photographing device determines that the user has triggered the detection instruction; or, the input interface may be a microphone or a sound pickup device on the handheld photographing device, such as a microphone, for example, the user may send a voice instruction to the handheld photographing device, and if the microphone or the sound pickup device on the handheld photographing device detects that the voice instruction includes one or more keywords such as "photograph", "test question", and "distance measurement", the handheld photographing device determines that the user has triggered the detection instruction; or, the input interface may be represented as a start interface of an application program of the electronic device wirelessly connected to the handheld photographing device, for example, when a user starts a learning APP on the electronic device, the detection instruction may be triggered. Therefore, the embodiment of the invention can provide diversified selections for the user through the preset multiple input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved.
A starting unit 402, configured to determine, according to the photographing distance detected by the detecting unit 401, multiple target light sources that need to be turned on in multiple preset light sources on the handheld photographing apparatus, turn on each target light source, so as to project an explicit frame matched with the multiple target light sources on the test question to be photographed, and trigger the photographing unit 403 to start.
And a shooting unit 403, configured to control a camera on the handheld photographing apparatus to perform a shooting operation on an area framed by the dominant frame formed by the starting unit 402, to obtain a to-be-searched test question image, and provide the to-be-searched test question image to the sending unit 404.
As an optional implementation manner, the shooting unit 403 may perform angle correction on the camera on the handheld shooting device before controlling the camera on the handheld shooting device to perform shooting operation on the area framed by the dominant frame to obtain the test question image to be searched, and turn on each target light source to project the dominant frame matched with the multiple target light sources on the test question to be shot. Specifically, the shooting unit 403 may trigger a gravity sensor and a gyroscope built in the handheld shooting device to detect an inclination angle of the handheld shooting device in the vertical direction, and determine whether the inclination angle is greater than a preset angle threshold, and if the inclination angle is greater than the preset angle threshold, adjust a shooting angle of a camera on the handheld shooting device according to the inclination angle, so that the camera on the handheld shooting device is perpendicular to a plane where the test questions are shot. Therefore, the embodiment of the invention can reduce the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment by automatically detecting and correcting the shooting angle of the camera on the handheld shooting equipment, and does not need the user to manually adjust the holding mode of the handheld shooting equipment, so that the operation is more convenient and faster, and the use experience of the user is further improved.
A sending unit 404, configured to send the image of the test question to be searched obtained by the shooting unit 403 to an electronic device wirelessly connected to the handheld shooting device, so as to trigger the electronic device to output the image of the test question to be searched, and obtain and output a test question analysis result of the test question to be searched included in the image of the test question to be searched from a server.
In this embodiment of the present invention, optionally, the sending unit 404 may trigger a speaker built in the handheld photographing device to send a prompt sound while or after sending the to-be-searched test question image to the electronic device wirelessly connected to the handheld photographing device, so as to inform the user that the to-be-searched test question image is uploaded to the electronic device, and the user can check the to-be-searched test question image through the electronic device in time.
Therefore, through the handheld photographing device described in fig. 5, the target light source to be turned on the handheld photographing device can be quickly determined through the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected by the target light source on the test question to be photographed, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved; in addition, various selections can be provided for the user through various preset input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved; in addition, the shooting angle of the camera on the handheld shooting equipment can be automatically detected and corrected, the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment is reduced, the holding mode of the handheld shooting equipment does not need to be manually adjusted by a user, the operation is more convenient, and the use experience of the user is further improved.
EXAMPLE five
Referring to fig. 6, fig. 6 is a schematic structural diagram of another handheld photographing device according to an embodiment of the present invention, wherein the handheld photographing device shown in fig. 6 is obtained by further optimizing the handheld photographing device shown in fig. 4. In comparison with the handheld photographing apparatus shown in fig. 5, the handheld photographing apparatus shown in fig. 6 further includes:
and the focusing unit 405 is configured to turn on each target light source in the starting unit 402, so as to control a camera on the handheld photographing device to perform a laser focusing operation after an explicit frame matched with the plurality of target light sources is projected on the test question to be photographed, and trigger the detecting unit 406 to start.
Specifically, after each target light source is turned on by the starting unit 402 to project an explicit frame matching with a plurality of target light sources on the test question to be photographed, the focusing unit 405 may be triggered to execute the above-mentioned laser focusing operation for controlling the camera on the handheld photographing device.
As an optional implementation manner, after controlling the camera on the handheld photographing device to perform the laser focusing operation, the focusing unit 405 may trigger a plurality of light sources preset on the handheld photographing device to change a light emitting color, or may trigger a sound generating device on the handheld photographing device to generate a prompt sound to prompt the user that the focusing is successful. Therefore, the embodiment of the invention can prompt the user to successfully focus through the change of the light emitting color of the light source or prompt sound, so that the user can timely and intuitively know the focusing condition of the handheld photographing equipment; in addition, when the electronic equipment wirelessly connected with the handheld photographing equipment is in a black screen standby state, the user can know the focusing condition of the handheld photographing equipment without the electronic equipment, and the experience of the user is further improved.
The detecting unit 406 is configured to detect whether a shooting instruction triggered by a user is received, and when a detection result is yes, trigger the shooting unit 403 to execute the above-mentioned shooting operation performed by the camera on the handheld shooting device on the area framed by the dominant frame, so as to obtain a to-be-searched test question image.
In an alternative embodiment, the first control unit 407 is configured to control a built-in sensor of the handheld photographing apparatus to record shake information of the handheld photographing apparatus when the detection unit 406 detects that a photographing instruction triggered by a user is received, and provide the shake information to the first determination unit 408, where the shake information at least includes an angular velocity variation of the handheld photographing apparatus and an acceleration variation of the handheld photographing apparatus.
In this embodiment of the present invention, the first control unit 407 may record shake information of the handheld photographing apparatus through a built-in sensor (e.g., a gyroscope and an acceleration sensor), where the shake information may include an angular velocity variation of the handheld photographing apparatus and an acceleration variation of the handheld photographing apparatus; furthermore, the shake information in all directions of the handheld photographing equipment can be recorded through the built-in sensor, so that the shake information can reflect the shake condition of the handheld photographing equipment more comprehensively, the accuracy of correcting the photographing parameters of the camera on the handheld photographing equipment according to the shake information is improved, and the image shooting definition of the handheld photographing equipment is also improved.
The first determining unit 408 is configured to determine whether the jitter information is greater than a preset jitter threshold.
A calculating unit 409, configured to calculate a displacement to be compensated of the handheld photographing apparatus according to the shake information when the first determining unit 408 determines that the shake information is greater than a preset shake threshold, and provide the calculated displacement to the compensating unit 410.
In the embodiment of the present invention, after determining that the shake information is greater than the preset shake threshold, the first determining unit 408 triggers the built-in sensor to send a signal of the shake information to the microprocessor controlled by the calculating unit 409, and the microprocessor calculates the displacement to be compensated (the displacement to be compensated of the handheld photographing device). Specifically, the shake information includes an acceleration variation of the handheld photographing device and an angular velocity variation of the handheld photographing device, the acceleration variation of the handheld photographing device is subjected to integral operation to obtain a displacement variation and the angular velocity variation of the handheld photographing device is subjected to integral operation to obtain an angular displacement variation, and then the displacement to be compensated of the handheld photographing device is obtained according to the displacement variation and the angular displacement variation.
The compensation unit 410 is configured to perform displacement compensation on the photographing parameters of the camera on the handheld photographing device according to the displacement to be compensated calculated by the calculation unit 409.
Specifically, after the compensation unit 410 performs the displacement compensation on the photographing parameters of the camera on the handheld photographing device according to the displacement to be compensated, the photographing unit 403 may be triggered to execute the operation of controlling the camera on the handheld photographing device to perform the photographing operation on the region framed by the dominant frame, so as to obtain the test question image to be searched.
The shooting unit 403 is specifically configured to, when the detection unit 406 detects that the handheld shooting device receives a shooting instruction triggered by a user, and after the compensation unit 410 performs displacement compensation on the shooting parameters of the camera on the handheld shooting device according to the displacement to be compensated, control the camera on the handheld shooting device to perform shooting operation on the area framed by the dominant frame, so as to obtain a to-be-searched test question image.
Therefore, through the handheld photographing device described in fig. 6, the target light source to be turned on the handheld photographing device can be quickly determined through the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected by the target light source on the test question to be photographed, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved; in addition, various selections can be provided for the user through various preset input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved; in addition, the shooting angle of the camera on the handheld shooting equipment can be automatically detected and corrected, the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment is reduced, the holding mode of the handheld shooting equipment does not need to be manually adjusted by a user, the operation is more convenient, and the use experience of the user is further improved.
In addition, with the handheld photographing device described in fig. 6, the user can be prompted to successfully focus through the change of the light emitting color of the light source or the prompt sound, so that the user can timely and intuitively know the focusing condition of the handheld photographing device; in addition, when the electronic equipment wirelessly connected with the handheld photographing equipment is in a black screen standby state, a user can know the focusing condition of the handheld photographing equipment without the electronic equipment, so that the experience of the user is further improved; and the shake information in all directions of the handheld photographing equipment can be recorded through the built-in sensor, so that the shake information can reflect the shake condition of the handheld photographing equipment more comprehensively, the accuracy of correcting the photographing parameters of the camera on the handheld photographing equipment according to the shake information is improved, and the definition of images photographed by the handheld photographing equipment is also improved.
EXAMPLE six
Referring to fig. 7, fig. 7 is a schematic structural diagram of another handheld photographing apparatus according to an embodiment of the present invention, wherein the handheld photographing apparatus shown in fig. 7 is obtained by further optimizing the handheld photographing apparatus shown in fig. 5. Compared to the handheld photographing apparatus shown in fig. 6, the handheld photographing apparatus shown in fig. 7 further includes:
the obtaining unit 411 is configured to obtain a pressure value of the handheld photographing device at the current time after the sending unit 404 sends the to-be-searched test question image to the electronic device wirelessly connected to the handheld photographing device, and send the obtained pressure value to the second determining unit 412.
Specifically, after the sending unit 404 sends the to-be-searched test question image to the electronic device wirelessly connected to the handheld photographing device, the obtaining unit 411 may be triggered to execute an operation of obtaining the current pressure value of the handheld photographing device.
The second determining unit 412 is configured to determine whether the pressure value obtained by the obtaining unit 411 is greater than a preset pressure value.
The second control unit 413 is configured to control a plurality of light sources preset on the handheld photographing device to emit a flashing signal within a preset time period when the second determination unit 412 determines that the pressure value is greater than the preset pressure value, so as to prompt whether to continue to perform the photographing operation, and trigger the second detection unit 414 to start.
The second detecting unit 414 is configured to detect whether a detection instruction triggered by the user is received, where the detection instruction is used to instruct to detect a photographing distance between the handheld photographing device and the test question to be photographed.
The switching unit 415 is configured to switch the current mode to the sleep mode when the second detecting unit 414 detects that the handheld photographing apparatus does not receive the detection instruction triggered by the user.
For example, the handheld photographing device may be a search pen with a photographing function. After the user finishes shooting the image of the test question to be searched through the search pen, there may be a situation that the user still holds the search pen but does not use the search pen, then, at this time, the obtaining unit 411 may obtain the pressure value on the surface of the search pen through the built-in pressure sensor and judge that the pressure value is greater than the preset pressure value through the second judging unit 412, then, the second controlling unit 413 may control the multiple light sources preset on the search pen to emit the flashing signals within the preset time length to prompt the user whether the shooting operation needs to be continued, when the second detecting unit 414 does not detect the detection instruction triggered by the user within the preset time length in which the light sources emit the flashing signals, that is, it indicates that the user does not need to continue to shoot the test question, the switching unit 415 may switch the current working mode to the sleep mode. Therefore, the embodiment of the invention can avoid switching the current mode of the handheld photographing device into the sleep mode under the condition that a user holds the handheld photographing device by hand but does not use the handheld photographing device to perform photographing and searching questions, and reduces the power consumption of the handheld photographing device to a certain extent.
As an alternative embodiment, in the handheld photographing apparatus shown in fig. 6, the focusing unit 405 may include:
the control subunit 4051 is configured to start each target light source in the starting unit 402, so as to control the laser emitting device on the handheld photographing apparatus to emit the first laser to the area framed by the dominant frame after the dominant frame matched with the multiple target light sources is projected on the test question to be photographed, and record a first time for emitting the first laser.
The control sub-unit 4051 is further configured to control a laser receiving apparatus on the handheld photographing device to receive second laser reflected by the first laser in an area framed by the dominant frame, record a second time when the second laser is received, and trigger the calculation sub-unit 4052 to start.
The calculating subunit 4052 is configured to calculate a time difference between the first time and the second time recorded by the control subunit 4051, calculate an actual distance between the handheld photographing apparatus and the region framed by the dominant frame according to the time difference, and provide the actual distance to the adjusting subunit 4053.
An adjusting subunit 4053, configured to adjust a camera on the handheld photographing apparatus according to the actual distance calculated by the calculating subunit 4052, so as to complete laser focusing on the camera on the handheld photographing apparatus.
Therefore, in the embodiment of the invention, the focusing object (the area framed by the dominant frame) can be quickly locked by using the laser, so that the lens of the camera on the handheld photographing equipment can be moved to the designated position in one step to complete the whole laser focusing process, and the handheld photographing equipment can control the camera to complete focusing operation in a dark environment due to less influence of the laser on a weak light or pure color environment, so that the focusing speed of the handheld photographing equipment is improved, and the handheld photographing equipment has strong adaptability.
Therefore, through the handheld photographing device described in fig. 7, the target light source to be turned on the handheld photographing device can be quickly determined through the photographing distance between the handheld photographing device and the test question to be photographed, and the photographing operation is performed on the area framed by the dominant frame projected by the target light source on the test question to be photographed, so that the operation that a user needs to manually adjust the size and the position of the selected frame on the electronic device in the process of photographing and searching the test question is avoided, the operation flow of photographing and searching the test question is simplified, and the efficiency of photographing and searching the test question is improved; in addition, various selections can be provided for the user through various preset input interfaces, so that the user can select different input interfaces to trigger the handheld photographing device to detect the photographing distance between the handheld photographing device and the test question to be photographed, and the use experience of the user is improved; in addition, the shooting angle of the camera on the handheld shooting equipment can be automatically detected and corrected, the probability of image deformation of the to-be-searched test question image shot by the handheld shooting equipment is reduced, the holding mode of the handheld shooting equipment does not need to be manually adjusted by a user, the operation is more convenient, and the use experience of the user is further improved.
In addition, through the handheld photographing device described in fig. 7, a focusing object (an area framed by a dominant frame) can be quickly locked by using laser, so that a lens of a camera on the handheld photographing device is moved to a specified position in one step to complete the whole laser focusing process, and the handheld photographing device can control the camera to complete focusing operation in a dark environment due to small influence of the laser on a weak light or pure color environment, so that the focusing speed of the handheld photographing device is improved, and the handheld photographing device has strong adaptability; the user can be prompted to be successfully focused through the change of the light emitting color of the light source or the prompt sound, so that the user can timely and intuitively know the focusing condition of the handheld photographing equipment; in addition, when the electronic equipment wirelessly connected with the handheld photographing equipment is in a black screen standby state, a user can know the focusing condition of the handheld photographing equipment without the electronic equipment, so that the experience of the user is further improved; and the shake information in all directions of the handheld photographing equipment can be recorded through the built-in sensor, so that the shake information can reflect the shake condition of the handheld photographing equipment more comprehensively, the accuracy of correcting the photographing parameters of the camera on the handheld photographing equipment according to the shake information is improved, and the definition of images photographed by the handheld photographing equipment is also improved.
In addition, with the handheld photographing device described in fig. 7, it is possible to avoid switching the current mode of the handheld photographing device to the sleep mode when the user holds the handheld photographing device with his hand but does not use the handheld photographing device to perform the photographing and searching, thereby reducing the power consumption of the handheld photographing device to a certain extent.
EXAMPLE seven
Referring to fig. 8, fig. 8 is a schematic structural diagram of a photographing topic searching system disclosed in the embodiment of the invention in fig. 8. As shown in fig. 8, the photo topic-taking and searching system may include an electronic device 801, a server 802, and a handheld photo device 803 as described in the fourth to sixth embodiments, wherein:
the electronic device 801 includes a receiving unit 8011, a display unit 8012, and a first communication unit 8013;
the server 802 includes a content acquisition unit 8021, a storage unit 8022, a data matching unit 8023, and a second communication unit 8024;
the receiving unit 8011 is configured to receive the test question image to be searched, which is sent by the handheld photographing device 803.
The display unit 8012 is configured to output the to-be-searched test question image received by the receiving unit 8011 to a display interface of the electronic device 801.
The first communication unit 8013 is configured to upload the to-be-searched test question image received by the receiving unit 8011 to the server 802, and obtain a test question analysis result of the to-be-searched test question included in the to-be-searched test question image from the server 802.
The display unit 8012 is further configured to, after a viewing instruction triggered by a user is detected, output a test question analysis result matched with the viewing instruction according to the viewing instruction, where the viewing instruction includes a test question identifier of one of the test questions to be searched, and the test question analysis result matched with the viewing instruction is a test question analysis result of the one of the test questions to be searched.
The second communication unit 8024 is configured to receive the to-be-searched test question image sent by the first communication unit 8013.
The content acquiring unit 8021 is configured to identify the test questions to be searched included in the test question image to be searched from the test question image to be searched received by the second communication unit 8024, and provide the test questions to be searched to the data matching unit 8023.
The data matching unit 8023 is configured to match the test question database stored in the storage unit 8022 to obtain a test question analysis result of the test question to be searched included in the test question image to be searched.
The second communication unit 8024 is further configured to send the analysis result of the test questions to be searched, which is included in the image of the test questions to be searched and obtained by the data matching unit 8023, to the electronic device 801.
It can be seen that, by implementing the system for searching questions by taking pictures based on multiple light sources as described in fig. 8, the efficiency of searching questions by taking pictures can be improved through the interaction among the electronic device 801, the server 802 and the handheld shooting device 803.
Referring to fig. 9, fig. 9 is a schematic view of a user interface of an electronic device for outputting an image of a test question to be searched and a result of analyzing the test question according to an embodiment of the present invention. For example, the electronic device may be a learning tablet, an image of a test question to be searched is displayed on a screen of the learning tablet as shown in fig. 9, and a plurality of test questions to be searched are included in the image of the test question to be searched. As shown in fig. 9, the oval area outlined by the dotted line is a test question "10" to be searched included in the viewing instruction triggered by the user, and the small window on the right side in the drawing is a test question analysis result corresponding to the test question 10 (a test question analysis result matched with the viewing instruction), and optionally, the test question analysis result may include train of thought elicitation, inductive review, answer analysis and related course recommendation for the test question 10.
Example eight
The handheld photographing device provided by the embodiment of the invention can comprise any one of a search pen, a scanning pen, a photographing pen and the like. Taking a search pen as an example, fig. 10 is a block diagram illustrating a part of the structure of the search pen according to the embodiment of the present invention. Referring to fig. 10, the search pen may include: an input unit 1010, a memory 1020, a photographing unit 1030, a processor 1040, a wireless communication module 1050, and a power supply 1060. Those skilled in the art will appreciate that the search pen configuration shown in FIG. 10 does not constitute a limitation of a search pen, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes the components of the search pen in detail with reference to fig. 10:
the input unit 1010 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the search pen. Specifically, the input unit 1010 may include, but is not limited to, a physical key 1011 (e.g., a photographing key, a switch key) disposed on the search pen, and the like, and may be configured to detect a pressing operation of the user thereon (e.g., an operation of the user on the physical key 1011 using a finger, a handheld touch and press device, or any other suitable object or accessory), and drive a corresponding connection device according to a preset program. The input unit 1010 may further include a pressure sensor 1012 that may detect a pressure value applied to the physical key 1011 and transmit the detected pressure value to the processor 1040.
The memory 1020 can be used for storing executable program codes, and the processor 1040 executes various functional applications and data processing of the search pen by running the executable program codes stored in the memory 1020, and is particularly used for executing any one of the first to third embodiments of the method for searching for a subject by photographing based on multiple light sources. The memory 1020 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a photographing function, a focus positioning function, etc.), and the like; the storage data area may store data (such as a test question image, voice data, etc.) created according to the use of the search pen, etc. Further, the memory 1020 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The photographing unit 1030 may include, but is not limited to, an external camera 1031, a focus positioning module 1032, and an angle correction module 1033. Specifically, the external camera 1031 can rotate 180 degrees, and performs a preview of photographing through the dominant frame, obtains a test question image by photographing under the drive of a corresponding program, or outputs the test question image to the memory 1020. The focusing module 1032 may include a laser focusing module, an ultraviolet focusing module, etc., and the focusing module 1032 may automatically focus, position, or perform information projection, or may adjust focusing and positioning of the external camera 1031 according to a moving track of the search pen. The angle correction module 1033 may adjust the photographing angle of the external camera 1031 according to the parameters or the user operation.
The search pen may further include a gyroscope 1034 or a gravity sensor 1035, the focus positioning module 1032 may adjust the focus and the position according to the rotational angular velocity detected by the gyroscope 1034 or the gravitational acceleration detected by the gravity sensor 1035, and the angle correction module 1033 may adjust the photographing angle according to the rotational angular velocity detected by the gyroscope 1034 or the gravitational acceleration detected by the gravity sensor 1035.
Processor 1040 is the control center of the search pen, connects various portions of the entire search pen using various interfaces and lines, and performs various functions of the search pen and processes data by running or executing software programs and/or modules stored in memory 1020 and calling up data stored in memory 1020, thereby monitoring the search pen as a whole. Alternatively, processor 1040 may include one or more processing units; preferably, processor 1040 may integrate an application processor, which handles primarily operating systems, applications, etc., and a modem processor, which handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1040.
The wireless communication module 1050 may be used to transmit the test question image, receive a control instruction of the external device, and the like when the photographing function is performed, and particularly, may be transmitted to the processor 1040 after receiving the control instruction of the external device, and may be processed by the processor 1040. The wireless communication module 1050 may include, for example, a wireless fidelity (WiFi) module. WiFi belongs to a short-distance wireless transmission technology, the search pen can be used for sending test question images and receiving control instructions of external equipment and the like through a WiFi module, and wireless broadband internet access is provided for users.
The search pen may also include a power source 1060 (e.g., a battery) to power the various components, which may preferably be logically connected to the processor 1040 through a power management system to manage charging, discharging, and power consumption management functions through the power management system.
The search pen may further include a stylus head 1070, and the stylus head 1070 may include, but is not limited to, any one of a rubber soft pen head, a carbon fiber hard pen head, a pressure-retractable metal pen head, and the like, which may be used on a touch screen. The stylus head 1070 may act on the touchscreen/touch screen of the external device to input signals to the external device.
The search pen can also include at least one sensor 1080, such as an image sensor, a light sensor, a motion sensor, a biosensor, and others. In particular, the image sensor may convert an optical image into an electronic signal. The light sensor can adjust the brightness of the dominant frame in the photographing unit 1030 according to the brightness of the ambient light. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture (such as vertical placement, horizontal placement) of the search pen, and related functions (such as tapping) of vibration identification; the search pen may be further configured with other sensors such as a gyroscope, an infrared sensor, etc., which are not described herein.
The search pen may also include audio circuitry 1090, a speaker 1091, and a microphone 1092 may provide an audio interface between the user and the search pen. The audio circuit 1090 can transmit the electrical signal converted from the received audio data to the loudspeaker 1091, and the electrical signal is converted into a sound signal by the loudspeaker 1091 and output; on the other hand, the microphone 1092 converts the collected sound signals into electrical signals, which are received by the audio circuit 1090 and converted into audio data, which are processed by the audio data output processor 1040 and transmitted to, for example, an electronic device via the wireless communication module 1050, or output to the memory 1020 for further processing.
Although not shown, the search pen may further include a charging interface through which the power supply 1060 of the search pen may be charged. The interface that charges can include Micro USB interface, USB Type C interface etc.. The search pen may further include a switch indicator, a charge indicator, etc., which will not be described herein.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.
The above embodiments are only used for illustrating the technical solutions of the present application and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art; the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (11)

1. A method for searching questions by taking pictures based on multiple light sources is characterized by comprising the following steps:
the method comprises the steps that a handheld photographing device detects the photographing distance between the handheld photographing device and a test question to be photographed;
the handheld photographing device determines a corresponding distance gear according to the photographing distance, determines a plurality of target light sources which are required to be started and correspond to the distance gear in number and positions from a plurality of light sources preset on the handheld photographing device, and starts each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed;
the handheld photographing device controls a camera on the handheld photographing device to perform photographing operation on the area framed and selected by the dominant frame to obtain an image of the test question to be searched, and sends the image of the test question to be searched to the electronic device wirelessly connected with the handheld photographing device so as to trigger the electronic device to output the image of the test question to be searched and obtain and output a test question analysis result of the test question to be searched contained in the image of the test question to be searched from a server.
2. The method of claim 1, wherein the handheld photographing apparatus turns on each of the target light sources to project an explicit frame matching the plurality of target light sources on the test question to be photographed, and the method further comprises:
the handheld photographing device controls a camera on the handheld photographing device to execute laser focusing operation and detects whether a photographing instruction triggered by a user is received;
if so, the handheld photographing equipment executes the shooting operation of controlling the camera on the handheld photographing equipment to the area framed and selected by the dominant frame, and a test question image to be searched is obtained.
3. The method of claim 2, wherein the controlling the camera on the handheld photographing device to perform the laser focusing operation by the handheld photographing device comprises:
the handheld photographing equipment controls a laser emitting device on the handheld photographing equipment to emit first laser to the area framed by the dominant frame, and records a first moment of emitting the first laser;
the handheld photographing equipment controls a laser receiving device on the handheld photographing equipment to receive second laser reflected by the first laser in the area framed by the dominant frame, and records a second moment when the second laser is received;
the handheld photographing device calculates the time difference between the first time and the second time;
the handheld photographing equipment calculates the actual distance between the handheld photographing equipment and the area framed by the dominant frame according to the time difference;
and the handheld photographing equipment adjusts the camera on the handheld photographing equipment according to the actual distance so as to finish laser focusing of the camera on the handheld photographing equipment.
4. The method according to claim 2 or 3, wherein after detecting that the photographing instruction triggered by the user is received and before the handheld photographing device controls the camera on the handheld photographing device to perform a photographing operation on the region framed by the dominant frame to obtain the test question image to be searched, the method further comprises:
the handheld photographing device controls a built-in sensor of the handheld photographing device to record shake information of the handheld photographing device, wherein the shake information at least comprises an angular velocity variation of the handheld photographing device and an acceleration variation of the handheld photographing device;
the handheld photographing device judges whether the jitter information is larger than a preset jitter threshold value;
if so, the handheld photographing equipment calculates the displacement to be compensated of the handheld photographing equipment according to the jitter information;
and the handheld photographing equipment performs displacement compensation on photographing parameters of a camera on the handheld photographing equipment according to the displacement to be compensated, and triggers and executes the control of the camera on the handheld photographing equipment to execute photographing operation on the area framed by the dominant frame, so as to obtain a to-be-searched test question image.
5. The method according to any one of claims 1 to 3, wherein the handheld photographing device sends the to-be-searched test question image to an electronic device wirelessly connected to the handheld photographing device to trigger the electronic device to output the to-be-searched test question image, and after obtaining and outputting a test question analysis result of the to-be-searched test question included in the to-be-searched test question image from a server, the method further comprises:
the handheld photographing device acquires a pressure value of the handheld photographing device at the current moment;
the handheld photographing equipment judges whether the pressure value is larger than a preset pressure value or not;
if yes, the handheld photographing device controls the plurality of preset light sources on the handheld photographing device to emit flashing signals within a preset time length so as to prompt whether to continue to execute photographing operation or not, and detects whether a detection instruction triggered by a user is received or not, wherein the detection instruction is used for indicating detection of a photographing distance between the handheld photographing device and the test question to be photographed;
and if the handheld photographing device does not receive the detection instruction triggered by the user, the handheld photographing device switches the current mode of the handheld photographing device into the sleep mode.
6. A handheld photographing apparatus, comprising:
the detection unit is used for detecting the photographing distance between the handheld photographing equipment and the test question to be photographed;
the starting unit is used for determining a corresponding distance gear according to the photographing distance, determining a plurality of target light sources which are required to be started and correspond to the distance gear in quantity and position from a plurality of preset light sources on the handheld photographing equipment, and starting each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed;
the shooting unit is used for controlling a camera on the handheld shooting equipment to execute shooting operation on the area framed and selected by the dominant frame to obtain a test question image to be searched;
and the sending unit is used for sending the to-be-searched test question image to the electronic equipment wirelessly connected with the handheld photographing equipment so as to trigger the electronic equipment to output the to-be-searched test question image, and acquiring and outputting a test question analysis result of the to-be-searched test question contained in the to-be-searched test question image from a server.
7. The handheld photographing apparatus according to claim 6, further comprising:
the focusing unit is used for controlling a camera on the handheld photographing equipment to execute laser focusing operation after the starting unit starts each target light source so as to project an explicit frame matched with the plurality of target light sources on the test question to be photographed;
and the detection unit is used for detecting whether a shooting instruction triggered by a user is received or not, and when the shooting instruction is detected to be received, triggering the shooting unit to execute the shooting operation of controlling a camera on the handheld shooting equipment to execute the shooting operation on the area framed and selected by the dominant frame to obtain the test question image to be searched.
8. The handheld photographing apparatus according to claim 7, wherein the focusing unit includes:
the control subunit is configured to control a laser emitting device on the handheld photographing apparatus to emit first laser to an area framed by the dominant frame after the starting unit starts each of the target light sources to project the dominant frame matched with the plurality of target light sources on the test question to be photographed, and record a first time at which the first laser is emitted;
the control subunit is further configured to control a laser receiving device on the handheld photographing apparatus to receive second laser reflected by the first laser in the area framed by the dominant frame, and record a second time when the second laser is received;
the calculating subunit is configured to calculate a time difference between the first time and the second time, and calculate an actual distance between the handheld photographing device and the region framed by the dominant frame according to the time difference;
and the adjusting subunit is used for adjusting the camera on the handheld photographing equipment according to the actual distance so as to complete laser focusing of the camera on the handheld photographing equipment.
9. The handheld photographing apparatus according to claim 7 or 8, wherein the handheld photographing apparatus further comprises:
the first control unit is used for controlling a built-in sensor of the handheld photographing equipment to record shake information of the handheld photographing equipment after the detection unit detects that the handheld photographing equipment receives a photographing instruction triggered by a user and before the photographing unit controls a camera on the handheld photographing equipment to perform photographing operation on an area framed by the dominant frame to obtain a to-be-searched test question image, wherein the shake information at least comprises an angular velocity variation of the handheld photographing equipment and an acceleration variation of the handheld photographing equipment;
the first judging unit is used for judging whether the jitter information is larger than a preset jitter threshold value or not;
the calculation unit is used for calculating the displacement to be compensated of the handheld photographing device according to the jitter information when the first judgment unit judges that the jitter information is larger than a preset jitter threshold;
the compensation unit is used for carrying out displacement compensation on the photographing parameters of the camera on the handheld photographing equipment according to the displacement to be compensated;
the shooting unit is specifically configured to, when the detection unit detects that the shooting instruction is received, and after the compensation unit performs displacement compensation on the shooting parameters of the camera on the handheld shooting device according to the displacement to be compensated, control the camera on the handheld shooting device to perform shooting operation on the region framed by the dominant frame, so as to obtain a to-be-searched test question image.
10. The handheld photographing apparatus according to any one of claims 6 to 8, further comprising:
the acquisition unit is used for acquiring the current pressure value of the handheld photographing equipment after the sending unit sends the test question image to be searched to the electronic equipment wirelessly connected with the handheld photographing equipment;
the second judgment unit is used for judging whether the pressure value is larger than a preset pressure value or not;
the second control unit is used for controlling the plurality of preset light sources on the handheld photographing equipment to send out flashing signals within a preset time length to prompt whether to continue to execute the photographing operation or not when the second judgment unit judges that the pressure value is larger than the preset pressure value;
the second detection unit is used for detecting whether a detection instruction triggered by a user is received or not, wherein the detection instruction is used for indicating and detecting a photographing distance between the handheld photographing device and the test question to be photographed;
and the switching unit is used for switching the current mode to the sleep mode when the second detection unit detects that the handheld photographing device does not receive the detection instruction triggered by the user.
11. A multiple light source-based photographing and question searching system, comprising an electronic device, a server and the handheld photographing device according to any one of claims 6 to 10, wherein the handheld photographing device establishes a wireless connection with the electronic device in advance, wherein:
the electronic equipment comprises a receiving unit, a display unit and a first communication unit;
the server comprises a content acquisition unit, a storage unit, a data matching unit and a second communication unit;
the receiving unit is used for receiving the test question image to be searched, which is sent by the handheld photographing equipment;
the display unit is used for outputting the test question image to be searched to a display interface of the electronic equipment;
the first communication unit is used for uploading the to-be-searched test question image to the server and acquiring a test question analysis result of the to-be-searched test question contained in the to-be-searched test question image from the server;
the display unit is further configured to output a test question analysis result matched with the viewing instruction according to the viewing instruction after the viewing instruction triggered by the user is detected, where the viewing instruction includes a test question identifier of one of the test questions to be searched, and the test question analysis result matched with the viewing instruction is a test question analysis result of the one of the test questions to be searched;
the second communication unit is used for receiving the test question image to be searched sent by the first communication unit;
the content acquisition unit is used for identifying the test questions to be searched contained in the test question image to be searched from the test question image to be searched received by the second communication unit;
the data matching unit is used for matching the test question database stored in the storage unit to obtain a test question analysis result of the test question to be searched contained in the test question image to be searched;
the second communication unit is further configured to send the test question analysis result of the test question to be searched, which is contained in the test question image to be searched and obtained by the data matching unit through matching, to the electronic device.
CN201810055249.0A 2018-01-19 2018-01-19 Photographing and question searching method and system based on multiple light sources and handheld photographing equipment Active CN108282614B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810055249.0A CN108282614B (en) 2018-01-19 2018-01-19 Photographing and question searching method and system based on multiple light sources and handheld photographing equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810055249.0A CN108282614B (en) 2018-01-19 2018-01-19 Photographing and question searching method and system based on multiple light sources and handheld photographing equipment

Publications (2)

Publication Number Publication Date
CN108282614A CN108282614A (en) 2018-07-13
CN108282614B true CN108282614B (en) 2020-11-06

Family

ID=62804217

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810055249.0A Active CN108282614B (en) 2018-01-19 2018-01-19 Photographing and question searching method and system based on multiple light sources and handheld photographing equipment

Country Status (1)

Country Link
CN (1) CN108282614B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111698426B (en) * 2020-06-23 2021-08-03 广东小天才科技有限公司 Test question shooting method and device, electronic equipment and storage medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0815412A (en) * 1994-06-28 1996-01-19 Nikon Corp Light-beam projecting optical system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10169456B2 (en) * 2012-08-14 2019-01-01 International Business Machines Corporation Automatic determination of question in text and determination of candidate responses using data mining
CN103955525A (en) * 2014-05-09 2014-07-30 北京奇虎科技有限公司 Method and client for searching answer to test question
CN105282446A (en) * 2015-10-29 2016-01-27 小米科技有限责任公司 Camera management method and device
CN106202539B (en) * 2016-07-25 2019-07-26 广东小天才科技有限公司 Syndication search method and device
CN106407923B (en) * 2016-09-08 2020-01-03 广东小天才科技有限公司 Information processing method and device applied to electronic terminal
CN106777363A (en) * 2017-01-22 2017-05-31 广东小天才科技有限公司 Take pictures searching method and the device of a kind of mobile terminal
CN106973232A (en) * 2017-04-26 2017-07-21 广东小天才科技有限公司 A kind of terminal camera control method and device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0815412A (en) * 1994-06-28 1996-01-19 Nikon Corp Light-beam projecting optical system

Also Published As

Publication number Publication date
CN108282614A (en) 2018-07-13

Similar Documents

Publication Publication Date Title
CN108848308B (en) Shooting method and mobile terminal
CN108197299B (en) Photographing and question searching method and system based on handheld photographing equipment
CN109361865B (en) Shooting method and terminal
US9282239B2 (en) Apparatus and method for photographing portrait in portable terminal having camera
CN111182205B (en) Photographing method, electronic device, and medium
US8022982B2 (en) Camera system and method for operating a camera system
US20150296120A1 (en) Imaging apparatus and imaging system
CN104580901B (en) Determine the method and terminal of acquisition parameters
TWI656794B (en) Focusing method, device, computer readable storage medium, and terminal
US20180063421A1 (en) Wearable camera, wearable camera system, and recording control method
US20140176777A1 (en) Method for controlling electronic device and electronic device
CN108848313B (en) Multi-person photographing method, terminal and storage medium
KR101322465B1 (en) Method and apparatus for taking a self camera recording
CN108063859B (en) Automatic photographing control method, terminal and computer storage medium
CN108282614B (en) Photographing and question searching method and system based on multiple light sources and handheld photographing equipment
EP3211879A1 (en) Method and device for automatically capturing photograph, electronic device
JP5993164B2 (en) COMMUNICATION DEVICE, COMMUNICATION METHOD, AND PROGRAM
CN108924413B (en) Shooting method and mobile terminal
CN108287895B (en) Dominant frame adjustment-based question searching method and system and handheld photographing device
CN110881105B (en) Shooting method and electronic equipment
CN108197620B (en) Photographing and question searching method and system based on eye positioning and handheld photographing equipment
CN111147744B (en) Shooting method, data processing device, electronic equipment and storage medium
CN108182277B (en) Method and system for searching questions based on dominant points and handheld photographing equipment
TWI485505B (en) Digital camera and image capturing method thereof
CN112188089A (en) Distance acquisition method and device, focal length adjustment method and device, and distance measurement assembly

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant