CN111079726B - Image processing method and electronic equipment - Google Patents
Image processing method and electronic equipment Download PDFInfo
- Publication number
- CN111079726B CN111079726B CN201910494086.0A CN201910494086A CN111079726B CN 111079726 B CN111079726 B CN 111079726B CN 201910494086 A CN201910494086 A CN 201910494086A CN 111079726 B CN111079726 B CN 111079726B
- Authority
- CN
- China
- Prior art keywords
- image
- content
- initial image
- target
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000000034 method Methods 0.000 claims abstract description 60
- 238000004458 analytical method Methods 0.000 claims description 21
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 238000005520 cutting process Methods 0.000 claims description 4
- 238000004590 computer program Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000002349 favourable effect Effects 0.000 description 8
- 230000001737 promoting effect Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/04—Electrically-operated educational appliances with audible presentation of the material to be studied
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The embodiment of the invention discloses an image processing method and electronic equipment, wherein the method comprises the following steps: judging whether non-printing body content exists in the photographed initial image; if the non-printing body content exists, determining the area where the non-printing body content exists as an area to be filled; filling the region to be filled with background pixels of the initial image to cover the non-printing body content, so as to obtain a target image; searching a preset image matched with the target image, and taking the content contained in the preset image as the content of the initial image. By implementing the embodiment of the invention, the identification efficiency of the images with the interference factors can be improved, and the click-reading experience of students can be improved.
Description
Technical Field
The present invention relates to the field of electronic devices, and in particular, to an image processing method and an electronic device.
Background
When a student uses the home education equipment to read the unknown characters, words and sentences on the paper book surface, the home education equipment often needs to collect the click areas of the student on the paper book surface so as to obtain book images, and based on the identification of the book images, the newspaper reading of the unknown characters, words and sentences of the student is realized. In practice, it is found that the home teaching device generally identifies the book image by searching the image in a picture, but if the acquired book image has interference factors such as handwritten notes or graffiti, it is generally difficult for the home teaching device to determine an image matched with the book image from a picture library. Therefore, the existing home teaching equipment has low recognition efficiency on images with interference factors, and affects the click-reading experience of students.
Disclosure of Invention
The embodiment of the invention discloses an image processing method and electronic equipment, which can improve the recognition efficiency of images with interference factors.
An embodiment of the present invention in a first aspect discloses an image processing method, including:
judging whether non-printing body content exists in the photographed initial image;
if the non-printing body content exists, determining the area where the non-printing body content exists as an area to be filled;
filling the region to be filled with background pixels of the initial image to cover the non-printing body content, so as to obtain a target image;
searching a preset image matched with the target image, and taking the content contained in the preset image as the content of the initial image.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, before the determining whether the non-printed body content exists in the captured initial image, the method further includes:
determining working parameters of the shooting module according to the current ambient brightness;
when the indication information for starting the image acquisition process is received, the shooting module is controlled to shoot the current learning page according to the working parameters, and an initial image is obtained.
In an optional implementation manner, in a first aspect of the embodiment of the present invention, when receiving the instruction information for starting the image acquisition process, the controlling the shooting module to shoot the current learning page according to the working parameter to obtain the initial image includes:
when receiving the indication information for starting the image acquisition process, controlling the shooting module to shoot a current learning page according to the working parameters to obtain a shooting image;
determining a click point in the photographed image;
determining a clicking region of the shot image according to the clicking point;
and cutting out the clicking region from the shooting image to serve as an initial image.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the content included in the preset image is used as the content of the initial image, the method further includes:
determining a target newspaper reading tone according to the user information;
synthesizing the target newspaper reading tone and the content of the initial image to obtain target voice;
and executing output operation on the target voice.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the performing an output operation on the target voice, the method further includes:
judging whether the following voice of the user is received or not;
if so, analyzing the follow-up voice according to the target voice to obtain an analysis result;
and outputting the analysis result according to a preset output mode.
A second aspect of an embodiment of the present invention discloses an electronic device, including:
a judging unit for judging whether the non-printing body content exists in the photographed initial image;
a first determining unit configured to determine, when the initial image has the non-print content, an area where the non-print content is located as an area to be filled;
a filling unit, configured to fill the to-be-filled region with background pixels of the initial image to cover the non-print content, so as to obtain a target image;
and the identification unit is used for searching a preset image matched with the target image and taking the content contained in the preset image as the content of the initial image.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the second determining unit is used for determining working parameters of the shooting module according to the current environment brightness before the judging unit judges whether the non-printing body content exists in the shot initial image;
and the shooting unit is used for controlling the shooting module to shoot the current learning page according to the working parameters when receiving the indication information for starting the image acquisition process, so as to obtain an initial image.
In a second aspect of the embodiment of the present invention, when the shooting unit receives the indication information for starting the image acquisition process, the mode for controlling the shooting module to shoot the current learning page according to the working parameter to obtain the initial image specifically includes:
the shooting unit is used for controlling the shooting module to shoot a current learning page according to the working parameters when receiving the indication information for starting the image acquisition process so as to obtain a shooting image; and determining a click point in the captured image; determining a clicking area of the shot image according to the clicking point; and cutting out the click region from the photographed image as an initial image.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the acquisition unit is used for determining a target reading tone according to user information after the identification unit takes the content contained in the preset image as the content of the initial image, and synthesizing the target reading tone and the learning content of the initial image to obtain target voice;
and the output unit is used for executing output operation on the target voice.
In a second aspect of the embodiment of the present invention, the determining unit is further configured to determine whether a read-following voice of the user is received after the output unit performs the output operation on the target voice;
the electronic device further includes:
the analysis unit is used for analyzing the follow-up voice according to the target voice when the judgment unit judges that the follow-up voice is received, so as to obtain an analysis result;
the output unit is further used for outputting the analysis result according to a preset output mode.
A third aspect of an embodiment of the present invention discloses an electronic device, including:
a memory storing executable program code;
a processor coupled to the memory;
the processor invokes the executable program code stored in the memory to perform some or all of the steps of any of the methods of the first aspect of the invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program comprising part or all of the steps for performing any one of the methods of the first aspect of the present invention.
A fifth aspect of embodiments of the invention discloses a computer program product which, when run on a computer, causes the computer to perform part or all of the steps of any of the methods of the first aspect.
A sixth aspect of the embodiments of the present invention discloses an application publishing system for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, whether the non-printing body content exists in the photographed initial image is judged; if the non-printing body content exists, determining the area where the non-printing body content exists as an area to be filled; filling the region to be filled with background pixels of the initial image to cover the non-printing body content, so as to obtain a target image; searching a preset image matched with the target image, and taking the content contained in the preset image as the content of the initial image. By implementing the embodiment of the invention, the pixel filling is carried out on the area where the non-printing body content is located in the image, so that the interference of the non-printing body content on the image processing can be reduced, the identification efficiency of the image with interference factors is improved, and the click-reading experience of students is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without the need of creative efforts for a person of ordinary skill in the art.
FIG. 1 is a flow chart of an image processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another image processing method disclosed in an embodiment of the present invention;
FIG. 3 is a flow chart of yet another image processing method disclosed in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of another electronic device according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of another electronic device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of still another electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "comprising," "having," and any variations thereof in the embodiments of the present invention and the accompanying drawings are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses an image processing method and electronic equipment, which can improve the recognition efficiency of images with interference factors. In the embodiment of the invention, the image processing method can be applied to various electronic devices such as smart phones, smart watches, tablets and the like, and the embodiment of the invention is not limited. The operating systems of various electronic devices may include, but are not limited to, an Android operating system, an IOS operating system, a Symbian operating system, a Black Berry operating system, a Windows Phone8 operating system, and the like, which are not limited to embodiments of the present invention.
Example 1
Referring to fig. 1, fig. 1 is a flowchart of an image processing method according to an embodiment of the invention. The image processing method shown in fig. 1 may specifically include the following steps:
101. judging whether the non-printing body content exists in the photographed initial image, and if so, executing the steps 102-104; if not, the process is ended.
In the embodiment of the invention, the initial image may be obtained by shooting a paper page or by shooting an electronic page, and the embodiment of the invention is not limited. If the initial image is obtained by shooting a paper page, the non-printed content in the initial image can be the note or the graffiti content written on the paper page by the user, and if the initial image is obtained by shooting an electronic page, the non-printed content in the initial image can be the note or the graffiti content written on the electronic page by the user. If the determination result in step 101 is no, the preset image matched with the initial image may be searched.
In an optional implementation manner, in the embodiment of the present invention, if the non-printed content is the note content of the user on the electronic page or the paper page, when the determination result in step 101 is yes, the following operations may be further executed:
detecting whether a note receiving instruction input by a user is received;
when receiving the note recording instruction, identifying the non-printed body content to obtain note information;
setting a note label of the note information; wherein, the note tag can include at least a learning page identifier;
and storing the note information and the note label in a note library in an associated manner.
By implementing the method, the automatic arrangement of the user notes can be realized, and the learning efficiency of the user is improved.
Further optionally, the identifying the non-printed content to obtain note information may include:
acquiring identity information of a user;
searching a target word stock matched with the identity information in a preset word stock of the electronic equipment;
and identifying the non-printing body content according to the target raw word stock to obtain note information.
The identity information of the user may be facial information, fingerprint information, iris information, or the like of the user, which is not limited in the embodiment of the present invention. The preset word stock can be obtained by recording the historical handwriting of the user, and the recognition efficiency of the note content can be improved by implementing the method.
102. The area where the non-print content is located is determined as the area to be filled.
103. And filling the area to be filled with background pixels of the initial image to cover the non-printing body content, thereby obtaining the target image.
In an alternative implementation manner, in the embodiment of the present invention, before executing step 102, it may further be determined whether there is non-print content that is overlaid on the print content in the non-print content, and if there is no non-print content that is overlaid on the print content, then executing step 102 continuously. By implementing the method, the identification efficiency of the image with the interference factors can be further improved.
104. Searching a preset image matched with the target image, and taking the content contained in the preset image as the content of the initial image.
By implementing the method, the recognition efficiency of the images with the interference factors can be improved, the click-to-read experience of students can be improved, the automatic arrangement of the user notes can be realized, the learning efficiency of the user can be improved, and the recognition efficiency of the note content can be improved.
Example two
Referring to fig. 2, fig. 2 is a flowchart illustrating another image processing method according to an embodiment of the invention. The image processing method as shown in fig. 2 may specifically include the steps of:
201. and determining the working parameters of the shooting module according to the current ambient brightness.
202. When receiving the indication information for starting the image acquisition process, controlling the shooting module to shoot the current learning page according to the working parameters to obtain an initial image.
In the embodiment of the invention, the step 201 can be executed when the electronic device is in the click-to-read mode, and the steps 201 to 202 are executed, so that the working parameters of the shooting module can be adjusted according to the current ambient brightness, thereby achieving the purpose of ensuring the image quality.
As an optional implementation manner, in an embodiment of the present invention, when receiving indication information for starting an image acquisition process, controlling a shooting module to shoot a current learning page according to the working parameters, where obtaining an initial image may include:
when receiving the indication information for starting the image acquisition process, controlling the shooting module to shoot the current learning page according to the working parameters to obtain a shooting image;
determining a click point in the photographed image;
determining a clicking region of the shot image according to the clicking point;
the click region is cut out from the photographed image as an initial image.
By implementing the method, the determination efficiency of the initial image can be improved based on the identification of the click point, and further accurate click reading of the electronic equipment is realized.
Further optionally, when receiving the instruction information for starting the image acquisition process, controlling the shooting module to shoot the current learning page according to the working parameter, and obtaining the shot image may include:
when receiving indication information for starting an image acquisition process, starting a projection device to project a shooting indication area on a horizontal plane where an electronic page or a paper page is placed through the projection device;
detecting whether a current learning page is in a shooting indication area or not;
when the current learning page is in the shooting indication area, controlling the projection device to stop the projection process aiming at the shooting indication area, and controlling the shooting module to shoot the current learning page according to the working parameters to obtain a shooting image;
or when the current learning page is not in the shooting indication area, outputting prompt information for indicating the user to adjust the position of the learning page.
By implementing the method, the user can conveniently place the learning page in a standardized manner by shooting the projection of the indication area.
For the description of steps 203 to 206, please refer to the description of steps 101 to 104 in the first embodiment, and the description of the embodiment of the present invention is omitted.
207. And determining the target newspaper reading tone according to the user information.
208. And synthesizing the target newspaper reading tone and the content of the initial image to obtain target voice.
209. And executing output operation on the target voice.
In the embodiment of the invention, the user information mentioned in step 207 at least can include the grade information, sex information, hobby information and the like of the user, and by executing steps 207-209, learning content newspaper reading is realized based on the user information, so that the learning interest of the user can be stimulated, and the click-reading experience of the user can be improved.
As an alternative implementation, in an embodiment of the present invention, after step 206, the following steps may be further performed:
detecting whether the current electric quantity of the electronic equipment is smaller than a preset electric quantity or not;
if the electric quantity is smaller than the preset electric quantity, judging whether the electronic equipment is connected with the audio server or not;
if the electronic equipment is connected, the electronic equipment sends audio request information carrying the electronic equipment identifier to an audio server; the audio request information at least comprises user information and the content of an initial image, so that when the audio server receives the audio request information, a preselected reading tone is determined at the cloud end of the audio server according to the user information, and the preselected reading tone is fed back to the electronic equipment;
the electronic equipment determines a target newspaper reading tone from the preselected newspaper reading tone according to the selection operation of the user;
and the electronic equipment feeds back the feedback information indicating the target newspaper reading tone to the audio server, so that the audio server synthesizes the target newspaper reading tone and the content of the initial image to obtain target voice, and feeds back the target voice to the electronic equipment.
Under the condition of small electric quantity of the electronic equipment, the method is implemented, and the generation work of the target voice is delivered to the audio server to be completed, so that the power consumption of the electronic equipment can be effectively reduced.
By implementing the method, the recognition efficiency of the images with the interference factors can be improved, the click-to-read experience of students can be improved, the automatic arrangement of the user notes can be realized, the learning efficiency of the users can be improved, the recognition efficiency of the note content can be improved, the learning interest of the users can be stimulated, the click-to-read experience of the users can be improved, and the generation work of target voice can be delivered to an audio server to be completed under the condition of small electric quantity of the electronic equipment, so that the power consumption of the electronic equipment is effectively reduced.
Example III
Referring to fig. 3, fig. 3 is a flowchart illustrating another image processing method according to an embodiment of the invention. The image processing method as shown in fig. 3 may specifically include the steps of:
for a detailed description of steps 301 to 309, please refer to the description of steps 201 to 209 in the second embodiment, and the detailed description is omitted.
310. Judging whether the follow-up voice of the user is received or not, and if yes, executing the steps 311-312; if not, the process is ended.
311. And analyzing the follow-up voice according to the target voice to obtain an analysis result.
312. And outputting an analysis result according to a preset output mode.
In the embodiment of the present invention, the preset output mode mentioned in step 312 may be text, audio or video, etc., which is not limited in the embodiment of the present invention. If the content of the initial image is a new word, the analysis result mentioned in step 311 may include a spoken word score, a standard pinyin of the new word, and a read-following pinyin, and by executing steps 310 to 312, automatic analysis of the read-following speech of the user may be achieved, which is helpful for the user to perform spoken word exercises.
By implementing the method, the recognition efficiency of the images with the interference factors can be improved, the click-to-read experience of students can be improved, the automatic arrangement of the user notes can be realized, the learning efficiency of the user can be improved, the recognition efficiency of the note content can be improved, the learning interest of the user can be stimulated, the click-to-read experience of the user can be improved, the generation work of target voice can be delivered to an audio server to be completed under the condition that the electric quantity of the electronic equipment is small, the power consumption of the electronic equipment is effectively reduced, the automatic analysis of the following-to-read voice of the user can be realized, and the spoken language exercise of the user is facilitated.
Example IV
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the invention. As shown in fig. 4, the electronic device may include:
a judging unit 401 is configured to judge whether or not non-print content exists in the captured initial image.
As an optional implementation manner, in the embodiment of the present invention, if the non-printed content is a note content of the user on an electronic page or a paper page, the determining unit 401 may be further configured to detect whether a note receiving instruction input by the user is received when it is determined that the non-printed content exists in the initial image; when receiving the note recording instruction, identifying the non-printed body content to obtain note information; setting a note tag of the note information; wherein, the note tag can include at least a learning page identifier; and storing the note information and the note label in a note library in an associated manner. Through the implementation of the method, the automatic arrangement of the user notes can be realized, and the learning efficiency of the user is improved.
Further optionally, the determining unit 401 is configured to identify the non-print content, so as to obtain the note information, which may specifically be:
a judging unit 401, configured to obtain identity information of a user; searching a target word stock matched with the identity information in a preset word stock of the electronic equipment; and identifying the non-printed content according to the target raw word stock to obtain note information.
The identity information of the user may be facial information, fingerprint information, iris information, or the like of the user, which is not limited in the embodiment of the present invention. The preset word stock can be obtained by recording the historical handwriting of the user, and the recognition efficiency of the note content can be improved by implementing the mode.
The first determining unit 402 is configured to determine, when the non-print content exists in the initial image, an area where the non-print content is located as an area to be filled.
As an optional implementation manner, in an embodiment of the present invention, the determining unit 401 may be further configured to determine, when it is determined that there is non-print content in the initial image, whether there is non-print content that is overlaid on the print content in the non-print content, and if there is no non-print content that is overlaid on the print content, trigger the first determining unit 402 to execute the above operation of determining, as the area to be filled, the area where the non-print content is located. By implementing this embodiment, the recognition efficiency of the image having the interference factor can be further improved.
And a filling unit 403 for filling the region to be filled with background pixels of the initial image to cover the non-print content, resulting in a target image.
And an identifying unit 404, configured to search for a preset image matched with the target image, and take the content contained in the preset image as the content of the initial image.
Through implementing above-mentioned electronic equipment, can improve the recognition efficiency to the image that has the interference factor, be favorable to promoting student's point-to-read experience, can also realize the automatic arrangement of user's notes, be favorable to improving user's learning efficiency, can also improve the recognition efficiency of note content.
Example five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another electronic device according to an embodiment of the invention. The electronic device shown in fig. 5 is optimized by the electronic device shown in fig. 4, and as shown in fig. 5, the electronic device may further include:
the second determining unit 405 is configured to determine an operating parameter of the photographing module according to the current ambient brightness before the determining unit 401 determines whether the non-print content exists in the photographed initial image.
And the shooting unit 406 is used for controlling the shooting module to shoot the current learning page according to the working parameters when receiving the indication information for starting the image acquisition process, so as to obtain an initial image.
Optionally, in the embodiment of the present invention, when receiving the instruction information for starting the image acquisition process, the shooting unit 406 is configured to control the shooting module to shoot the current learning page according to the working parameters, and the manner of obtaining the initial image may specifically be:
the shooting unit 406 is configured to control the shooting module to shoot a current learning page according to the working parameters when receiving the indication information for starting the image acquisition process, so as to obtain a shot image; determining a click point in the photographed image; determining a clicking area of the shot image according to the clicking point; and clipping the click region from the photographed image as an initial image.
In the embodiment of the invention, the shooting unit 406 can improve the determination efficiency of the initial image based on the identification of the click point, thereby realizing the accurate click reading of the electronic device.
Further optionally, when receiving the instruction information for starting the image acquisition process, the shooting unit 406 is configured to control the shooting module to shoot the current learning page according to the working parameters, and the mode of obtaining the shot image may specifically be:
a shooting unit 406, configured to, when receiving indication information for starting an image acquisition process, turn on a projection device to project a shooting indication area on a horizontal plane on which an electronic page or a paper page is placed by the projection device; detecting whether the current learning page is in a shooting indication area; when the current learning page is in the shooting indication area, controlling the projection device to stop the projection process aiming at the shooting indication area, and controlling the shooting module to shoot the current learning page according to the working parameters to obtain a shooting image;
alternatively, the shooting unit 406 may be further configured to output prompt information for instructing the user to adjust the position of the learning page when the current learning page is not in the shooting instruction area. By implementing the mode, the user can conveniently place the learning page in a standardized manner by shooting the projection of the indication area.
Further optionally, the electronic device shown in fig. 5 may further include:
an obtaining unit 407, configured to determine a target speech according to the user information after the identifying unit 404 uses the content included in the preset image as the content of the initial image, and integrate the target speech with the learning content of the initial image to obtain the target speech.
An output unit 408 for performing an output operation on the target voice.
In the embodiment of the invention, the user information at least can comprise the grade information, the sex information, the hobby information and the like of the user, and by implementing the embodiment, the learning content newspaper reading is realized based on the user information, so that the learning interest of the user can be stimulated, and the click-to-read experience of the user is improved.
As an optional implementation manner, in an embodiment of the present invention, the identifying unit 404 may be further configured to detect, after taking the content included in the preset image as the content of the initial image, whether the current electric quantity of the electronic device is less than the preset electric quantity; when the electric quantity is smaller than the preset electric quantity, judging whether the electronic equipment is connected with the audio server or not; when the audio server is connected, sending audio request information carrying the electronic equipment identifier to the audio server; the audio request information at least comprises user information and the content of an initial image, so that when the audio server receives the audio request information, a preselected reading tone is determined at the cloud end of the audio server according to the user information, and the preselected reading tone is fed back to the electronic equipment; determining a target newspaper reading tone from the preselected newspaper reading tone according to the selection operation of the user; and feeding back feedback information indicating the target newspaper reading tone to the audio server, so that the audio server synthesizes the target newspaper reading tone and the content of the initial image to obtain target voice, and feeds back the target voice to the electronic equipment. By implementing the embodiment, under the condition that the electric quantity of the electronic equipment is smaller, the generation work of the target voice is delivered to the audio server to be completed, so that the power consumption of the electronic equipment can be effectively reduced.
Through implementing above-mentioned electronic equipment, can improve the recognition efficiency to the image that has the interference factor, be favorable to promoting student's click-to-read experience, still can realize the automatic arrangement of user's notes, be favorable to improving user's learning efficiency, can also improve the recognition efficiency of note content, can also arouse user's learning interest, be favorable to improving user's click-to-read experience and feel, can also be under the less circumstances of electronic equipment electric quantity, accomplish the generation work delivery of target pronunciation in audio server, effectively reduce electronic equipment's consumption.
Example six
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the present invention. The electronic device shown in fig. 6 is optimized by the electronic device shown in fig. 5, and the determining unit 401 of the electronic device shown in fig. 6 may be further configured to determine whether the read-following voice of the user is received after the output unit 408 performs the output operation on the target voice.
The electronic device shown in fig. 6 may further include:
and an analysis unit 409, configured to, when the judgment unit 401 judges that the read-following voice of the user is received, analyze the read-following voice according to the target voice, and obtain an analysis result.
The output unit 408 is further configured to output the analysis result according to a preset output manner.
In the embodiment of the invention, if the content of the initial image is a new word, the analysis result can include a spoken word score, a standard pinyin of the new word and a read-following pinyin, and the automatic analysis of the read-following voice of the user can be realized by executing the embodiment, so that the user is facilitated to practice the spoken word.
Through implementing above-mentioned electronic equipment, can improve the recognition efficiency to the image that has interference factor, be favorable to promoting student's click-to-read experience, still can realize the automatic arrangement of user's note, be favorable to improving user's learning efficiency, still can improve the recognition efficiency of note content, still can arouse user's learning interest, be favorable to improving user's click-to-read experience and feel, still can be under the less circumstances of electronic equipment electric quantity, the production work delivery of target pronunciation is accomplished in audio server, effectively reduce electronic equipment's consumption, still can realize the automatic analysis of user's follow-up pronunciation, help the user to carry out the spoken language exercise.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the invention. As shown in fig. 7, the electronic device may include:
a memory 701 storing executable program code;
a processor 702 coupled with the memory 701;
the processor 702 calls executable program codes stored in the memory 701 to execute any one of the image processing methods of fig. 1 to 3.
The embodiment of the invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute any one of image processing methods of fig. 1 to 3.
Embodiments of the present invention disclose a computer program product that, when run on a computer, causes the computer to perform any of the image processing methods of fig. 1-3.
The embodiment of the invention discloses an application release system which is used for releasing a computer program product, wherein the computer program product is used for enabling the computer to execute any one of image processing methods shown in fig. 1-3 when running on the computer.
Those of ordinary skill in the art will appreciate that all or part of the steps of the various methods of the above embodiments may be implemented by a program that instructs associated hardware, the program may be stored in a computer readable storage medium including Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM) or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium that can be used for carrying or storing data that is readable by a computer.
The above describes an image processing method and an electronic device disclosed in the embodiments of the present invention in detail, and specific examples are applied to describe the principles and implementations of the present invention, and the magnitude of the step numbers in the specific examples does not mean that the execution sequence is necessarily sequential, and the execution sequence of each process should be determined by its functions and internal logic, but should not constitute any limitation to the implementation process of the embodiments of the present invention. The units described above as separate components may or may not be physically separate, and some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
The character "/" herein generally indicates that the associated object is an "or" relationship. In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B may be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information. In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units. If the integrated unit is implemented in the form of a software functional unit and sold or used as a stand-alone product, it may be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, comprising several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in a computer device) to execute some or all of the steps of the above-mentioned method of the various embodiments of the present invention.
The above description of embodiments is only for aiding in the understanding of the method of the present invention and its core ideas; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (10)
1. An image processing method, comprising:
judging whether non-printing body content exists in the photographed initial image;
if the non-printing body content exists, determining the area where the non-printing body content exists as an area to be filled; filling the region to be filled with background pixels of the initial image to cover the non-printing body content, so as to obtain a target image; searching a preset image matched with the target image, and taking the content contained in the preset image matched with the target image as the content of the initial image;
if the initial image is not found, searching the preset image matched with the initial image, and taking the content contained in the preset image matched with the initial image as the content of the initial image.
2. The method of claim 1, wherein before determining whether non-print content is present in the captured initial image, the method further comprises:
determining working parameters of the shooting module according to the current ambient brightness;
when the indication information for starting the image acquisition process is received, the shooting module is controlled to shoot the current learning page according to the working parameters, and an initial image is obtained.
3. The method according to claim 2, wherein when receiving the indication information for starting the image acquisition process, controlling the shooting module to shoot the current learning page according to the working parameter to obtain the initial image, includes:
when receiving the indication information for starting the image acquisition process, controlling the shooting module to shoot a current learning page according to the working parameters to obtain a shooting image;
determining a click point in the photographed image;
determining a clicking region of the shot image according to the clicking point;
and cutting out the clicking region from the shooting image to serve as an initial image.
4. A method according to any one of claims 1 to 3, wherein after said content included in the preset image to which the target image is matched is taken as the content of the initial image, the method further comprises:
determining a target newspaper reading tone according to the user information;
synthesizing the target newspaper reading tone and the content of the initial image to obtain target voice;
and executing output operation on the target voice.
5. The method of claim 4, wherein after performing the output operation on the target speech, the method further comprises:
judging whether the following voice of the user is received or not;
if so, analyzing the follow-up voice according to the target voice to obtain an analysis result;
and outputting the analysis result according to a preset output mode.
6. An electronic device, comprising:
a judging unit for judging whether the non-printing body content exists in the photographed initial image;
a first determining unit configured to determine, when the initial image has the non-print content, an area where the non-print content is located as an area to be filled;
a filling unit, configured to fill the to-be-filled region with background pixels of the initial image to cover the non-print content, so as to obtain a target image;
the identification unit is used for searching the preset image matched with the target image and taking the content contained in the preset image matched with the target image as the content of the initial image;
and a unit for searching for a preset image matched with the initial image when the non-print content does not exist in the initial image, and taking the content contained in the preset image matched with the initial image as the content of the initial image.
7. The electronic device of claim 6, wherein the electronic device further comprises:
the second determining unit is used for determining working parameters of the shooting module according to the current environment brightness before the judging unit judges whether the non-printing body content exists in the shot initial image;
and the shooting unit is used for controlling the shooting module to shoot the current learning page according to the working parameters when receiving the indication information for starting the image acquisition process, so as to obtain an initial image.
8. The electronic device according to claim 7, wherein the shooting unit is configured to control the shooting module to shoot a current learning page according to the working parameter when receiving the indication information for starting the image acquisition process, so as to obtain the initial image specifically in the following manner:
the shooting unit is used for controlling the shooting module to shoot a current learning page according to the working parameters when receiving the indication information for starting the image acquisition process so as to obtain a shooting image; and determining a click point in the captured image; determining a clicking area of the shot image according to the clicking point; and cutting out the click region from the photographed image as an initial image.
9. The electronic device according to any one of claims 6 to 8, characterized in that the electronic device further comprises:
the acquisition unit is used for determining a target reading tone according to user information after the identification unit takes the content contained in the preset image matched with the target image as the content of the initial image, and synthesizing the target reading tone and the learning content of the initial image to obtain target voice;
and the output unit is used for executing output operation on the target voice.
10. The electronic device according to claim 9, wherein the judging unit is further configured to judge whether or not a read-following voice of the user is received after the output unit performs an output operation on the target voice;
the electronic device further includes:
the analysis unit is used for analyzing the follow-up voice according to the target voice when the judgment unit judges that the follow-up voice is received, so as to obtain an analysis result;
the output unit is further used for outputting the analysis result according to a preset output mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910494086.0A CN111079726B (en) | 2019-06-09 | 2019-06-09 | Image processing method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910494086.0A CN111079726B (en) | 2019-06-09 | 2019-06-09 | Image processing method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111079726A CN111079726A (en) | 2020-04-28 |
| CN111079726B true CN111079726B (en) | 2024-03-22 |
Family
ID=70310044
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910494086.0A Active CN111079726B (en) | 2019-06-09 | 2019-06-09 | Image processing method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111079726B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111461103B (en) * | 2020-05-14 | 2023-05-16 | 广东小天才科技有限公司 | Method and device for eliminating interference of click-to-read scene, electronic equipment and storage medium |
| CN113900602B (en) * | 2021-12-09 | 2022-03-11 | 北京辰光融信技术有限公司 | Intelligent printing method and system for automatically eliminating target object filling information |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101237500A (en) * | 2006-12-14 | 2008-08-06 | 三星电子株式会社 | Image forming apparatus and method of controlling the same |
| CN104157171A (en) * | 2014-08-13 | 2014-11-19 | 三星电子（中国）研发中心 | Point-reading system and method thereof |
| CN108509136A (en) * | 2018-04-12 | 2018-09-07 | 山东音为爱智能科技有限公司 | A kind of children based on artificial intelligence paint this aid reading method |
| CN108805126A (en) * | 2017-04-28 | 2018-11-13 | 上海斯睿德信息技术有限公司 | A kind of long interfering line minimizing technology of text image |
| CN109637286A (en) * | 2019-01-16 | 2019-04-16 | 广东小天才科技有限公司 | A kind of Oral Training method and private tutor's equipment based on image recognition |
-
2019
- 2019-06-09 CN CN201910494086.0A patent/CN111079726B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101237500A (en) * | 2006-12-14 | 2008-08-06 | 三星电子株式会社 | Image forming apparatus and method of controlling the same |
| CN104157171A (en) * | 2014-08-13 | 2014-11-19 | 三星电子（中国）研发中心 | Point-reading system and method thereof |
| CN108805126A (en) * | 2017-04-28 | 2018-11-13 | 上海斯睿德信息技术有限公司 | A kind of long interfering line minimizing technology of text image |
| CN108509136A (en) * | 2018-04-12 | 2018-09-07 | 山东音为爱智能科技有限公司 | A kind of children based on artificial intelligence paint this aid reading method |
| CN109637286A (en) * | 2019-01-16 | 2019-04-16 | 广东小天才科技有限公司 | A kind of Oral Training method and private tutor's equipment based on image recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111079726A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180260479A1 (en) | Method, apparatus, system and electronic device for picture book recognition | |
| CN109597943B (en) | Learning content recommendation method based on scene and learning equipment | |
| CN110232340B (en) | Method and device for establishing video classification model and video classification | |
| CN111626383B (en) | Font identification method and device, electronic equipment and storage medium | |
| CN110544470B (en) | Voice recognition method and device, readable storage medium and electronic equipment | |
| CN111079726B (en) | Image processing method and electronic equipment | |
| CN111026949A (en) | Question searching method and system based on electronic equipment | |
| CN110874554B (en) | Action recognition method, terminal device, server, system and storage medium | |
| CN111639158B (en) | Learning content display method and electronic equipment | |
| CN110992958B (en) | Content recording method, content recording apparatus, electronic device, and storage medium | |
| CN111079503B (en) | Character recognition method and electronic equipment | |
| CN110209280B (en) | Response method, response device and storage medium | |
| CN112542163B (en) | Intelligent voice interaction method, device and storage medium | |
| CN112163513A (en) | Information selection method, system, device, electronic equipment and storage medium | |
| CN110795918A (en) | Method, device and equipment for determining reading position | |
| CN111027353A (en) | Search content extraction method and electronic equipment | |
| CN111582281B (en) | Picture display optimization method and device, electronic equipment and storage medium | |
| CN109447081B (en) | Method and system for acquiring optical character recognition data set | |
| CN111090383B (en) | Instruction identification method and electronic equipment | |
| CN111079727B (en) | Click-to-read control method and electronic equipment | |
| CN111078080B (en) | Point reading control method and electronic equipment | |
| CN111027317A (en) | Control method for dictation and reading progress and electronic equipment | |
| CN111078082A (en) | Point reading method based on image recognition and electronic equipment | |
| CN111753715A (en) | Method and device for shooting test questions in click-to-read scene, electronic equipment and storage medium | |
| CN111028558A (en) | Dictation detection method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |