CN108090126B - Image processing method and device, mobile terminal, image identification method and server - Google Patents
Image processing method and device, mobile terminal, image identification method and server Download PDFInfo
- Publication number
- CN108090126B CN108090126B CN201711125033.9A CN201711125033A CN108090126B CN 108090126 B CN108090126 B CN 108090126B CN 201711125033 A CN201711125033 A CN 201711125033A CN 108090126 B CN108090126 B CN 108090126B
- Authority
- CN
- China
- Prior art keywords
- image
- preview image
- category information
- biological
- biological category
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses an image processing method, an image processing device, a mobile terminal, an image identification method and a server. The image processing method comprises the following steps: receiving a shooting preview instruction, and acquiring an initial preview image; identifying an identification object having a biometric feature in the initial preview image; sending the identification object to a biological category identification server; receiving biological category information fed back by the biological category identification server; and adding the biological category information to the initial preview image to obtain a target preview image. According to the embodiment of the invention, the efficiency of obtaining information by the user is improved.
Description
Technical Field
Embodiments of the present invention relate to the field of communications, and in particular, to an image processing method and an image processing apparatus, an image recognition method and a server, and a mobile terminal.
Background
Currently, more and more users acquire information through a map-identifying website. For example, when a user sees a certain tree and wants to know information such as the name and the description of the tree, the user can first take a picture of the tree with a mobile phone, then log on a certain figure recognition website, upload the picture of the tree to the certain figure recognition website, recognize the picture by the figure recognition website, and return a recognition result to the user.
However, in the process of acquiring information by using the image-identifying website, the user needs to perform a plurality of operations such as taking a picture, logging in the website, uploading a picture, and the like, which consumes the operation and time of the user, and affects the efficiency of acquiring information by the user. Therefore, the conventional image recognizing method has the problem of low information acquisition efficiency.
Disclosure of Invention
The invention provides an image processing method and an image processing device, an image identification method and a server, and a mobile terminal, aiming at solving the problem of low information acquisition efficiency of the existing image identification method.
In order to solve the technical problem, the invention is realized as follows: an image processing method is applied to a mobile terminal, and comprises the following steps:
receiving a shooting preview instruction, and acquiring an initial preview image;
identifying an identification object having a biometric feature in the initial preview image;
sending the identification object to a biological category identification server;
receiving biological category information fed back by the biological category identification server;
and adding the biological category information to the initial preview image to obtain a target preview image.
In a first aspect, an embodiment of the present invention further provides an image identification method, which is applied to a biological category identification server, and the method includes:
receiving an identification object of a mobile terminal;
identifying a target biological category to which the identification object belongs;
extracting target biological category information corresponding to the target biological category;
and sending the target biological category information to the mobile terminal.
In a second aspect, an embodiment of the present invention further provides an image processing apparatus, including:
the initial preview image acquisition module is used for receiving a shooting preview instruction and acquiring an initial preview image;
the identification object identification module is used for identifying an identification object with biological characteristics in the initial preview image;
the identification object sending module is used for sending the identification object to a biological category identification server;
the biological category information receiving module is used for receiving the biological category information fed back by the biological category identification server;
and the biological category information adding module is used for adding the biological category information to the initial preview image to obtain a target preview image.
In a third aspect, an embodiment of the present invention further provides a server, including:
the identification object receiving module is used for receiving an identification object of the mobile terminal;
the biological category identification module is used for identifying a target biological category to which the identification object belongs;
the biological category information extraction module is used for extracting target biological category information corresponding to the target biological category;
and the biological type information sending module is used for sending the target biological type information to the mobile terminal.
In a fourth aspect, an embodiment of the present invention further provides a mobile terminal, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the image processing method.
According to the embodiment of the invention, the initial preview image is collected when the shooting preview instruction is received, the identification object with the biological characteristics in the initial preview image is identified, the identification object is sent to the biological category identification server, the biological category identification server returns biological category information for the identification object, and after the biological category information is received, the biological category information is added to the initial preview image to obtain the target preview image. Therefore, the time for the user to carry out a plurality of operations such as photographing, logging in a picture recognition website, uploading pictures and the like and the operation is saved, and the efficiency of the user for obtaining information is improved.
Drawings
Fig. 1 is a flowchart of an image processing method according to an embodiment of the present invention;
FIG. 2 is a flowchart of an image processing method according to a second embodiment of the present invention;
FIG. 3 is a schematic diagram of adding biological category information according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a search results page according to an embodiment of the present invention;
FIG. 5 is a schematic illustration of a preview image of a target according to an embodiment of the present invention;
fig. 6 is an image recognition method according to a third embodiment of the present invention;
fig. 7 is a block diagram of an image processing apparatus according to a fourth embodiment of the present invention;
fig. 8 is a block diagram of an image processing apparatus according to a fifth embodiment of the present invention;
fig. 9 is a block diagram of a server according to a sixth embodiment of the present invention;
fig. 10 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Example one
Fig. 1 is a flowchart of an image processing method according to an embodiment of the present invention, where the method is applied to a mobile terminal, and the method specifically includes the following steps:
and step 110, receiving a shooting preview instruction, and collecting an initial preview image.
It should be noted that the mobile terminal may include a mobile phone, a tablet computer, and other terminals. The mobile terminal is provided with a camera and can be used for collecting preview images and displaying the preview images on a shooting preview interface for a user to browse.
In a specific implementation, when a user sees a certain flower, a certain tree, a certain animal, in order to obtain information such as the name, category, and characteristic introduction of the flower, the tree, and the insect, the user may submit a shooting preview instruction on the mobile terminal to start a shooting preview interface. When a shooting preview instruction is received, the mobile terminal can call a camera to acquire an image as the initial preview image.
After the initial preview image is acquired, the mobile terminal may identify a biometric object in the initial preview image. The biometric object may be various objects having a biometric feature, such as an animal, a plant, or the like.
The mobile terminal may transmit the biometric object to the biometric class identification server after recognizing the biometric object in the initial preview image. In practical application, a preview sub-image containing a biological feature recognition object can be intercepted from an initial preview image, and the preview sub-image is uploaded to a certain recognition website through a browser in a mobile terminal background.
In practical application, the mobile terminal may be installed with a recognition application, so that after the preview sub-image is obtained, the recognition application can be called in the mobile terminal background, and the preview sub-image is uploaded through the recognition application. Those skilled in the art may send the biometric object to the biometric server in various ways according to actual needs, and the embodiment of the present invention is not limited thereto.
The biometric type identification server comprises a plurality of biometric types and a plurality of biometric type information respectively corresponding to the biometric types, and is used for identifying a target biometric type to which the biometric feature identification object belongs and sending the biometric type information corresponding to the target biometric type to the mobile terminal.
More specifically, the above-described biometrics authentication server may identify, as the above-described target biometrics type, the biometrics type to which the biometrics authentication target belongs, based on the biometrics characteristics of the biometrics authentication target. For example, the web sites such as Baidu recognization pictures, flowers and plants, etc. The biological category identification server may be pre-stored with a plurality of biological categories and with a plurality of biological category information. The plurality of biological categories and the plurality of biological category information have corresponding relations, and the biological category identification server can inquire the biological category information corresponding to the target biological category after identifying the target biological category of the biological feature identification object, and return the inquired biological category information to the mobile terminal.
In a specific implementation, the mobile terminal may receive the biological category information returned by the biological category identification server, so as to add the biological category information to the initial preview image.
The biological category information may be information such as popular names, academic names, categories, varieties, morphological characteristics, generation environments, geographical distributions, associated histories and cultures, biological values, and the like of certain categories of organisms. In practical application, the biological category identification server may return an initial biological category information, the initial biological category information may include a large amount of text and picture information, and the mobile terminal may screen the initial biological category information to obtain key information as the biological category information. The person skilled in the art can set the specific content of the biological category information according to the actual needs, and the embodiment of the present invention is not limited thereto.
And 150, adding the biological category information to the initial preview image to obtain a target preview image.
In a specific implementation, after the biological category information is acquired, the biological category information may be added to the initial preview image to obtain a target preview image. The manner of adding the biometric information may be various, and for example, the biometric information may be added to the periphery of the biometric object or may be overlaid on the biometric object.
After the target preview image is obtained, the target preview image can be displayed on a shooting preview interface of the mobile terminal, and a user can obtain the biological category information of the biological feature recognition object in real time.
In practical application, the user can also shoot a target preview image added with the biological type information to obtain a photo containing the biological feature recognition object and the corresponding biological type information.
According to the embodiment of the invention, the initial preview image is collected when the shooting preview instruction is received, the identification object with the biological characteristics in the initial preview image is identified, the identification object is sent to the biological category identification server, the biological category identification server returns biological category information for the identification object, and after the biological category information is received, the biological category information is added to the initial preview image to obtain the target preview image. Therefore, the time for the user to carry out a plurality of operations such as photographing, logging in a picture recognition website, uploading pictures and the like and the operation is saved, and the efficiency of the user for obtaining information is improved.
Example two
Fig. 2 is a flowchart of an image processing method according to a second embodiment of the present invention, where the method is applied to a mobile terminal, and the method specifically includes the following steps:
and step 210, receiving a shooting preview instruction, and acquiring an initial preview image.
In practical applications, the biometric features in the initial preview image may be recognized, and the recognition object may be determined according to the biometric features. Those skilled in the art may adopt various specific identification methods, and the embodiment of the present invention is not limited thereto.
Optionally, the step 230 includes:
step 231, extracting a preview sub-image from the initial preview image; the preview sub-image contains the recognition object with the biological feature.
In a specific implementation, a region where the recognition object is located in the image may be identified in the initial preview image, and a partial image of the region may be extracted as a preview sub-image, where the preview sub-image includes the recognition object with the biometric feature.
At step 232, an object identification request is generated.
In a specific implementation, the mobile terminal may invoke a browser or a map recognition application in the background, and generate an object recognition request including the preview sub-image through the browser or the map recognition application.
Step 233, sending the object identification request to the biometric identification server.
In a specific implementation, the mobile terminal may send the object identification request to the biological category identification server through a browser or a graph identification application, so that the biological category identification server identifies the identification object in the preview sub-image and feeds back biological category information.
And step 240, receiving the biological category information fed back by the biological category identification server.
And step 250, adding the biological category information to the initial preview image to obtain a target preview image.
For example, a floating text indication box is added to the initial preview image, and the biometrics type information is written in the text indication box.
Optionally, the initial preview image includes a plurality of image positions, and the image positions have an association relationship therebetween, where step 250 may include:
in step 251, a first image position of the identified object with the biological feature in the initial preview image is determined.
In a specific implementation, the initial preview image may include a plurality of image positions, and an association relationship between the image positions may be set. For example, for the image position at the upper left, it may be set that it has an associated relationship with the image position at the upper right. Upon receiving the biological category information, an image position at which the recognition object is currently located in the initial preview image may be identified as the first image position.
Step 252, adding the biological category information to a second image location associated with the first image location.
In a specific implementation, another image location associated with the first image location may be determined as the second image location. Then, the biological category information is added to the second image location.
And step 253, taking the initial preview image added with the biological category information as the target preview image.
In a specific implementation, after adding the biological category information to the second image position of the initial preview image, the initial preview image with the biological category information added thereto may be used as the target preview image described above.
Fig. 3 is a schematic diagram of adding biological category information according to an embodiment of the present invention. As can be seen from the figure, an initial preview image is displayed on the shooting preview interface, the initial preview image includes two pots of plants, the two pots of plants are respectively located on the left and right sides of the image, the image positions of the two pots of plants on the left and right sides in the initial preview image are taken as a first image position a1 and a first image position B1, and corresponding biological category information is respectively added to a second image position a2 associated with the first image position a1 and a second image position B2 associated with the first image position B1, so that a target preview image is obtained.
Optionally, the method may further include:
receiving a position moving operation instruction of a user;
moving the biological category information from the second image position to a third image position in the initial preview image.
In practical applications, after the biological category information is added to the second image position, the biological category information may block other objects in the preview image, the user may need to adjust the position of the biological category information in the image, and the user may submit a position moving operation instruction. The position moving operation instruction may be a click operation of the user on a certain position on the shooting preview interface, or a click operation of dragging the biological category information to a certain position on the shooting preview interface. The position of the target clicked or dragged by the user may be used as the third image position, and the biological category information may be moved from the current second image position to the third image position.
Optionally, after the step of adding the biological category information to a second image location associated with the first image location, the method may further comprise:
receiving an information editing request for the biological category information; the information editing request comprises user-defined biological category information;
and replacing the biological category information with the custom biological category information at a second image position of the initial preview image.
In a specific implementation, the user can edit the biological category information. The user may submit a message editing request on the mobile terminal. For example, the biological category information of the initial preview image is pressed for a long time to trigger the submission of the information editing request, or an information editing entry preset on the shooting preview interface is clicked. The user can input the self-defined biological category information, and the self-defined biological category information replaces part or all of the original biological category information. Thereby obtaining a preview image containing custom biological category information.
In practical application, a user can input user-defined biological category information in a voice mode, and convenience of inputting information by the user is improved.
Optionally, after the step 250, the method further comprises:
and when the mobile terminal is detected to shake, acquiring an initial preview image of the next frame, and adding the biological category information to the initial preview image of the next frame to obtain a target preview image of the next frame.
In practical applications, when the initial preview image is captured, the mobile terminal may shake, which may cause the position of the biometric object in the initial preview image to change, so that the shake state of the mobile terminal may be detected, and when the shake of the mobile terminal is detected, a next frame of the initial preview image is captured, the first image position of the biometric object in the next frame of the initial preview image is re-determined, the second image position associated with the new first image position is updated, and the biometric type information is added to the updated second image position. Therefore, even if the position of the biological feature recognition object in the initial preview image changes due to shaking of the mobile terminal, the position of the biological category information in the preview image can be updated accordingly, and the position of the biological category information is prevented from deviating from the position of the biological feature recognition object.
And step 260, adding a page search entry on the target preview image.
In a specific implementation, a page search entry may be added to the target preview image, and the entry may be used to invoke a browser and initiate a page search request. The page search entry may be set on the biometric type information or on the biometric identification object, and the specific position of the page search entry is not limited in the embodiment of the present invention.
In a specific implementation, a user may perform a page search operation of clicking, double-clicking biological category information or a biological feature identification object, and after detecting the page search operation, the mobile terminal may invoke a browser to send a page search request to a page search server, where the page search request may include biological category information, for example, using a plant name as a keyword for page search.
In specific implementation, after receiving the page search request, the page search server can perform page search according to the biological category information to obtain a plurality of pages containing the biological category information as search result pages, and returns the search result pages to the mobile terminal.
In specific implementation, after receiving the search result page, the mobile terminal may call a browser to load the search result page, and switch to the foreground to display the search result page to the user. The search result page may contain detailed information about the biometric object, so that the user can obtain more information according to his needs.
FIG. 4 is a schematic diagram of a search results page display according to an embodiment of the present invention. As can be seen from the figure, when a user requests a search page, the browser may be switched to a shooting preview interface, and a search result page is loaded in the browser, where the search result page contains more detailed information about the biometric object.
In practical applications, the target preview image may be stored. More specifically, the user may submit a shooting instruction for the target preview image, and the mobile terminal may store the target preview image as a shot photograph when receiving the shooting instruction.
FIG. 5 is a diagram of a target preview image according to an embodiment of the present invention. As can be seen from the figure, the target preview image contains the plant and the category information of the plant.
According to the embodiment of the invention, the biological category information is added to the initial preview image to obtain the target preview image, and the target preview image is stored. Moreover, the user can directly share the target preview image with other users, so that the user can conveniently share the biological category information without sending the image and then sending the biological category information, and the information interaction efficiency among the users is improved.
EXAMPLE III
Fig. 6 is an image recognition method provided in a third embodiment of the present invention, and the method is applied to a biological category recognition server, where the biological category recognition server includes a plurality of biological categories and biological category information respectively corresponding to the biological categories, and the method may specifically include the following steps:
In a specific implementation, the biological category identification server may receive an object identification request submitted by the mobile terminal, where the object identification request includes a preview sub-image, and the preview sub-image may include an identification object with biological characteristics. The biometric class recognition server may extract the preview sub-image, and recognize a recognition object having a biometric characteristic with respect to the preview sub-image.
The biometric type recognition server may recognize the biometric type of the recognition object as the target biometric type according to the biometric feature in the preview sub-image.
The biometrics authentication server may extract biometrics type information corresponding to the target biometrics type as the target biometrics type information.
The biological category identification server can return the extracted target biological category information to the mobile terminal, so that the mobile terminal can add the target biological category information to the initial preview image to obtain the target preview image.
Example four
Fig. 7 is a block diagram of an image processing apparatus according to a fourth embodiment of the present invention, where the image processing apparatus 400 may specifically include the following modules:
an initial preview image acquisition module 410, configured to receive a shooting preview instruction and acquire an initial preview image;
an identifying object identifying module 420 for identifying an identifying object having a biometric characteristic in the initial preview image;
an identification object sending module 430, configured to send the identification object to a biological category identification server;
a biological category information receiving module 440, configured to receive biological category information fed back by the biological category identification server;
a biological category information adding module 450, configured to add the biological category information to the initial preview image to obtain a target preview image.
EXAMPLE five
Fig. 8 is a block diagram of an image processing apparatus according to a fifth embodiment of the present invention, where the image processing apparatus 500 may specifically include the following modules:
an initial preview image collecting module 510, configured to receive a shooting preview instruction and collect an initial preview image;
an identifying object identifying module 520 for identifying an identifying object having a biometric characteristic in the initial preview image;
an identification object sending module 530, configured to send the biometric identification object to a biometric class identification server;
a biological category information receiving module 540, configured to receive biological category information fed back by the biological category identification server;
and a biological category information adding module 550, configured to add the biological category information to the initial preview image to obtain a target preview image.
A page search entry adding module 560, configured to add a page search entry on the target preview image;
a search request sending module 570, configured to send a page search request to a page search server when receiving a page search operation for the page search entry; the page search request includes the biological category information;
a search result page receiving module 580, configured to receive a search result page fed back by the page search server for the biological category information;
and a search result page loading module 590, configured to invoke a browser of the mobile terminal and load the search result page.
Optionally, the identification object sending module 530 may include:
the preview subimage extracting submodule is used for extracting a preview subimage from the initial preview image; the preview sub-image contains the recognition object with the biological characteristics;
the request generation submodule is used for generating an object identification request;
and the request sending submodule is used for sending the object identification request to the biological category identification server.
Optionally, the initial preview image includes a plurality of image positions, each of the image positions has an association relationship therebetween, and the biological category information adding module 550 may include:
a first image position determination sub-module for determining a first image position of the biometric object in the initial preview image;
an information adding sub-module for adding the biological category information to a second image position associated with the first image position;
and the target preview image generation sub-module is used for taking the initial preview image added with the biological category information as the target preview image.
Optionally, the biological category information adding module 550 may further include:
the operation receiving submodule is used for receiving a position moving operation instruction of a user;
and the information moving submodule is used for moving the biological category information from the second image position to a third image position in the initial preview image.
Optionally, the image processing apparatus 500 may further include:
and the next frame image acquisition module is used for acquiring an initial preview image of the next frame when the mobile terminal is detected to shake, and adding the biological category information to the initial preview image of the next frame to obtain a target preview image of the next frame.
Optionally, the biological category information adding module 550 may further include:
an information editing request receiving sub-module for receiving an information editing request for the biological category information; the information editing request comprises user-defined biological category information;
and the information replacement submodule is used for replacing the biological category information with the self-defined biological category information at a second image position of the initial preview image.
EXAMPLE six
Fig. 9 is a block diagram of a server according to a sixth embodiment of the present invention, where the server 600 includes a plurality of biological categories and biological category information respectively corresponding to the biological categories, and the server 600 may specifically include the following modules:
an identification object receiving module 610 for receiving an identification object of the mobile terminal;
a biological category identifying module 620, configured to identify a target biological category to which the identification object belongs;
a biological category information extraction module 630, configured to extract target biological category information corresponding to the target biological category;
a biological category information sending module 640, configured to send the target biological category information to the mobile terminal.
The image processing apparatus and the server provided in the fourth embodiment of the present invention, the fifth embodiment of the present invention, and the sixth embodiment of the present invention can implement each process implemented by the image processing apparatus and the server in the method embodiments of fig. 1 to fig. 2 and fig. 6, and are not described herein again to avoid repetition.
Fig. 10 is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, where the mobile terminal 700 includes but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, a power supply 711, and the like. Those skilled in the art will appreciate that the mobile terminal architecture illustrated in fig. 10 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 710 is configured to receive a shooting preview instruction, and acquire an initial preview image; identifying an identification object having a biometric feature in the initial preview image; sending the identification object to a biological category identification server; receiving biological category information fed back by the biological category identification server; and adding the biological category information to the initial preview image to obtain a target preview image.
In the embodiment of the invention, the initial preview image is collected when the shooting preview instruction is received, the identification object with the biological characteristics in the initial preview image is identified, the identification object is sent to the biological category identification server, the biological category identification server returns biological category information for the identification object, and the biological category information is added to the initial preview image after being received, so that the target preview image is obtained. Therefore, the time for the user to carry out a plurality of operations such as photographing, logging in a picture recognition website, uploading pictures and the like and the operation is saved, and the efficiency of the user for obtaining information is improved.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a message transmission and reception process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 710; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.
The mobile terminal provides the user with wireless broadband internet access via the network module 702, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the mobile terminal 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.
The input unit 704 is used to receive audio or video signals. The input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics processor 7041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphic processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 701 in case of a phone call mode.
The mobile terminal 700 also includes at least one sensor 705, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7061 and/or a backlight when the mobile terminal 700 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 705 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 706 is used to display information input by the user or information provided to the user. The Display unit 706 may include a Display panel 7061, and the Display panel 7061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 707 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 7071 (e.g., operations by a user on or near the touch panel 7071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 7071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, receives a command from the processor 710, and executes the command. In addition, the touch panel 7071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, the other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 7071 may be overlaid on the display panel 7061, and when the touch panel 7071 detects a touch operation on or near the touch panel 7071, the touch operation is transmitted to the processor 710 to determine the type of the touch event, and then the processor 710 provides a corresponding visual output on the display panel 7061 according to the type of the touch event. Although the touch panel 7071 and the display panel 7061 are shown in fig. 10 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 7071 and the display panel 7061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 708 is an interface through which an external device is connected to the mobile terminal 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 700 or may be used to transmit data between the mobile terminal 700 and external devices.
The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 709 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 710 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby integrally monitoring the mobile terminal. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.
The mobile terminal 700 may also include a power supply 711 (e.g., a battery) for powering the various components, and the power supply 711 may be logically coupled to the processor 710 via a power management system that may enable managing charging, discharging, and power consumption by the power management system.
In addition, the mobile terminal 700 includes some functional modules that are not shown, and thus will not be described in detail herein.
Preferably, an embodiment of the present invention further provides a mobile terminal, including a processor 710, a memory 709, and a computer program stored in the memory 709 and capable of running on the processor 710, where the computer program is executed by the processor 710 to implement each process of the above-mentioned image processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor 710, the computer program implements each process of the image processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (11)
1. An image processing method applied to a mobile terminal is characterized by comprising the following steps:
receiving a shooting preview instruction, and acquiring an initial preview image;
identifying an identification object having a biometric feature in the initial preview image;
sending the identification object to a biological category identification server;
receiving biological category information fed back by the biological category identification server;
adding the biological category information to the initial preview image to obtain a target preview image;
wherein the initial preview image includes a plurality of image positions, the image positions have an association relationship, and the step of adding the biological category information to the initial preview image to obtain a target preview image includes:
determining a first image position of the biometric object in the initial preview image;
adding the biological category information to a second image location associated with the first image location;
taking the initial preview image added with the biological category information as the target preview image;
wherein after the step of adding the biological category information to the initial preview image to obtain a target preview image, the method further comprises:
adding a page search entry on the target preview image;
when receiving a page search operation aiming at the page search entry, sending a page search request to a page search server; the page search request includes the biological category information;
receiving a search result page fed back by the page search server aiming at the biological category information;
calling a browser of the mobile terminal and loading the search result page;
wherein after the step of adding the biological category information to the initial preview image to obtain a target preview image, the method further comprises:
and when the mobile terminal is detected to shake, acquiring an initial preview image of the next frame, and adding the biological category information to the initial preview image of the next frame to obtain a target preview image of the next frame.
2. The method of claim 1, wherein the step of sending the identification object to a biometric identification server comprises:
extracting a preview sub-image from the initial preview image; the preview sub-image contains the recognition object with the biological characteristics;
generating an object identification request;
sending the object identification request to the biometric class identification server.
3. The method of claim 1, wherein after the step of adding the biological category information to a second image location associated with the first image location, the method further comprises:
receiving a position moving operation instruction of a user;
moving the biological category information from the second image position to a third image position in the initial preview image.
4. The method of claim 1, wherein after the step of adding the biological category information to a second image location associated with the first image location, the method further comprises:
receiving an information editing request for the biological category information; the information editing request comprises user-defined biological category information;
and replacing the biological category information with the custom biological category information at a second image position of the initial preview image.
5. An image recognition method applied to a biological category recognition server, wherein the biological category recognition server includes a plurality of biological categories and biological category information respectively corresponding thereto, the method comprising:
receiving an identification object of a mobile terminal; the mobile terminal is used for determining a first image position of an identification object with biological characteristics in an initial preview image, adding the biological category information to a second image position associated with the first image position, using the initial preview image added with the biological category information as a target preview image, adding a page search entry on the target preview image, sending a page search request to a page search server when receiving a page search operation aiming at the page search entry, wherein the page search request comprises the biological category information, receiving a search result page fed back by the page search server aiming at the biological category information, calling a browser of the mobile terminal, and loading the search result page, when the mobile terminal is detected to shake, acquiring an initial preview image of a next frame, and adding the biological category information to the initial preview image of the next frame to obtain a target preview image of the next frame;
identifying a target biological category to which the identification object belongs;
extracting target biological category information corresponding to the target biological category;
and sending the target biological category information to the mobile terminal.
6. An image processing apparatus characterized by comprising:
the initial preview image acquisition module is used for receiving a shooting preview instruction and acquiring an initial preview image;
the identification object identification module is used for identifying an identification object with biological characteristics in the initial preview image;
the identification object sending module is used for sending the identification object to a biological category identification server;
the biological category information receiving module is used for receiving the biological category information fed back by the biological category identification server;
the biological category information adding module is used for adding the biological category information to the initial preview image to obtain a target preview image;
wherein, the initial preview image comprises a plurality of image positions, the image positions have an association relationship, the biological category information adding module comprises:
a first image position determination sub-module for determining a first image position of the biometric object in the initial preview image;
an information adding sub-module for adding the biological category information to a second image position associated with the first image position;
a target preview image generation sub-module configured to use the initial preview image to which the biological category information is added as the target preview image;
wherein the apparatus further comprises:
the page search entry adding module is used for adding a page search entry on the target preview image;
the search request sending module is used for sending a page search request to a page search server when receiving page search operation aiming at the page search entry; the page search request includes the biological category information;
the search result page receiving module is used for receiving a search result page fed back by the page search server aiming at the biological category information;
the search result page loading module is used for calling a browser of the mobile terminal and loading the search result page;
wherein the apparatus further comprises:
and the next frame image acquisition module is used for acquiring an initial preview image of the next frame when the mobile terminal is detected to shake, and adding the biological category information to the initial preview image of the next frame to obtain a target preview image of the next frame.
7. The apparatus of claim 6, wherein the identifying object sending module comprises:
the preview subimage extracting submodule is used for extracting a preview subimage from the initial preview image; the preview sub-image contains the recognition object with the biological characteristics;
the request generation submodule is used for generating an object identification request;
and the request sending submodule is used for sending the object identification request to the biological category identification server.
8. The apparatus of claim 6, wherein the biological category information adding module further comprises:
the operation receiving submodule is used for receiving a position moving operation instruction of a user;
and the information moving submodule is used for moving the biological category information from the second image position to a third image position in the initial preview image.
9. The apparatus of claim 6, wherein the biological category information adding module further comprises:
an information editing request receiving sub-module for receiving an information editing request for the biological category information; the information editing request comprises user-defined biological category information;
and the information replacement submodule is used for replacing the biological category information with the self-defined biological category information at a second image position of the initial preview image.
10. A server comprising a plurality of biometrics types and biometrics type information corresponding thereto, the server comprising:
the identification object receiving module is used for receiving an identification object of the mobile terminal; the mobile terminal is used for determining a first image position of an identification object with biological characteristics in an initial preview image, adding the biological category information to a second image position associated with the first image position, using the initial preview image added with the biological category information as a target preview image, adding a page search entry on the target preview image, sending a page search request to a page search server when receiving a page search operation aiming at the page search entry, wherein the page search request comprises the biological category information, receiving a search result page fed back by the page search server aiming at the biological category information, calling a browser of the mobile terminal, and loading the search result page, when the mobile terminal is detected to shake, acquiring an initial preview image of a next frame, and adding the biological category information to the initial preview image of the next frame to obtain a target preview image of the next frame;
the biological category identification module is used for identifying a target biological category to which the identification object belongs;
the biological category information extraction module is used for extracting target biological category information corresponding to the target biological category;
and the biological type information sending module is used for sending the target biological type information to the mobile terminal.
11. A mobile terminal, characterized in that it comprises a processor, a memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, implements the steps of the image processing method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711125033.9A CN108090126B (en) | 2017-11-14 | 2017-11-14 | Image processing method and device, mobile terminal, image identification method and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711125033.9A CN108090126B (en) | 2017-11-14 | 2017-11-14 | Image processing method and device, mobile terminal, image identification method and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108090126A CN108090126A (en) | 2018-05-29 |
| CN108090126B true CN108090126B (en) | 2021-09-24 |
Family
ID=62172609
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711125033.9A Active CN108090126B (en) | 2017-11-14 | 2017-11-14 | Image processing method and device, mobile terminal, image identification method and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108090126B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109033991A (en) * | 2018-07-02 | 2018-12-18 | 北京搜狗科技发展有限公司 | A kind of image-recognizing method and device |
| CN108924418A (en) * | 2018-07-02 | 2018-11-30 | 珠海市魅族科技有限公司 | A kind for the treatment of method and apparatus of preview image, terminal, readable storage medium storing program for executing |
| CN109255325A (en) * | 2018-09-05 | 2019-01-22 | 百度在线网络技术（北京）有限公司 | Image-recognizing method and device for wearable device |
| CN110941987B (en) * | 2019-10-10 | 2023-04-07 | 北京百度网讯科技有限公司 | Target object identification method and device, electronic equipment and storage medium |
| CN111343356A (en) * | 2020-03-11 | 2020-06-26 | Oppo广东移动通信有限公司 | Image processing method, image processing apparatus, storage medium, and electronic device |
| CN114726999B (en) * | 2021-01-05 | 2023-12-26 | 北京小米移动软件有限公司 | Image acquisition method, image acquisition device and storage medium |
| CN113038001A (en) * | 2021-02-26 | 2021-06-25 | 维沃移动通信有限公司 | Display method and device and electronic equipment |
| CN113111248A (en) * | 2021-03-16 | 2021-07-13 | 百度在线网络技术（北京）有限公司 | Search processing method and device, electronic equipment and storage medium |
| CN113111249A (en) * | 2021-03-16 | 2021-07-13 | 百度在线网络技术（北京）有限公司 | Search processing method and device, electronic equipment and storage medium |
| CN114629837A (en) * | 2022-03-18 | 2022-06-14 | 澜途集思(深圳)数字科技有限公司 | Ecological biological identification method based on NoC algorithm |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013012860A1 (en) * | 2011-07-19 | 2013-01-24 | Ball Horticultural Company | Seed classification using spectral analysis to determine existence of a seed structure |
| CN103605687A (en) * | 2013-11-01 | 2014-02-26 | 上海斐讯数据通信技术有限公司 | Photographing and image recognizing system and method of mobile terminal |
| CN103617430A (en) * | 2013-09-14 | 2014-03-05 | 西北农林科技大学 | Portable campus plant species recognition system based on plant leaf image information |
| CN104361348A (en) * | 2014-10-27 | 2015-02-18 | 华南理工大学 | Flower and plant recognition method on intelligent terminal |
| CN106529375A (en) * | 2015-09-11 | 2017-03-22 | 上海乐今通信技术有限公司 | Mobile terminal and object feature identification method for image of mobile terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533248A (en) * | 2013-10-24 | 2014-01-22 | 腾讯科技（上海）有限公司 | Image processing method, terminal and system |
| CN103942049B (en) * | 2014-04-14 | 2018-09-07 | 百度在线网络技术（北京）有限公司 | Implementation method, client terminal device and the server of augmented reality |
-
2017
- 2017-11-14 CN CN201711125033.9A patent/CN108090126B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013012860A1 (en) * | 2011-07-19 | 2013-01-24 | Ball Horticultural Company | Seed classification using spectral analysis to determine existence of a seed structure |
| CN103617430A (en) * | 2013-09-14 | 2014-03-05 | 西北农林科技大学 | Portable campus plant species recognition system based on plant leaf image information |
| CN103605687A (en) * | 2013-11-01 | 2014-02-26 | 上海斐讯数据通信技术有限公司 | Photographing and image recognizing system and method of mobile terminal |
| CN104361348A (en) * | 2014-10-27 | 2015-02-18 | 华南理工大学 | Flower and plant recognition method on intelligent terminal |
| CN106529375A (en) * | 2015-09-11 | 2017-03-22 | 上海乐今通信技术有限公司 | Mobile terminal and object feature identification method for image of mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108090126A (en) | 2018-05-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108090126B (en) | Image processing method and device, mobile terminal, image identification method and server | |
| CN110740259B (en) | Video processing method and electronic equipment | |
| CN109145142B (en) | Management method and terminal for shared information of pictures | |
| KR20220073843A (en) | Object tracking method and electronic device | |
| CN110674662B (en) | Scanning method and terminal equipment | |
| CN109862266B (en) | Image sharing method and terminal | |
| CN110933306A (en) | Method for sharing shooting parameters and electronic equipment | |
| CN108616448B (en) | Information sharing path recommendation method and mobile terminal | |
| CN107749046B (en) | Image processing method and mobile terminal | |
| CN109495616B (en) | Photographing method and terminal equipment | |
| CN111177420B (en) | Multimedia file display method, electronic equipment and medium | |
| CN108460817B (en) | Jigsaw puzzle method and mobile terminal | |
| CN108984143B (en) | Display control method and terminal equipment | |
| CN109448069B (en) | Template generation method and mobile terminal | |
| CN111163449B (en) | Application sharing method, first electronic device and computer-readable storage medium | |
| CN110650367A (en) | Video processing method, electronic device, and medium | |
| CN111182211B (en) | Shooting method, image processing method and electronic equipment | |
| CN110287719B (en) | File encryption method and mobile terminal | |
| CN109753202B (en) | Screen capturing method and mobile terminal | |
| CN110955793A (en) | Display control method and electronic equipment | |
| CN108958579B (en) | Red packet sending and receiving method and red packet sending and receiving device | |
| CN108924413B (en) | Shooting method and mobile terminal | |
| CN108243489B (en) | Photographing control method and mobile terminal | |
| CN111178306B (en) | Display control method and electronic equipment | |
| CN109857578B (en) | Text copying method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |