CN112035692B - Picture information searching method and device, computer system and readable storage medium - Google Patents
Picture information searching method and device, computer system and readable storage medium Download PDFInfo
- Publication number
- CN112035692B CN112035692B CN202010897010.5A CN202010897010A CN112035692B CN 112035692 B CN112035692 B CN 112035692B CN 202010897010 A CN202010897010 A CN 202010897010A CN 112035692 B CN112035692 B CN 112035692B
- Authority
- CN
- China
- Prior art keywords
- face image
- picture
- dimensional face
- expression
- person
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 230000014509 gene expression Effects 0.000 claims abstract description 165
- 230000004044 response Effects 0.000 claims abstract description 15
- 238000004590 computer program Methods 0.000 claims description 11
- 230000003993 interaction Effects 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Abstract
The embodiment of the disclosure discloses a picture information searching method and device, a computer system and a readable storage medium, and relates to the field of computer searching. The method comprises the following steps: judging whether a main body in the picture to be searched is a three-dimensional or two-dimensional face image; when the main body in the picture to be searched is a three-dimensional face image, judging whether the three-dimensional face image is a face image of any one of a plurality of known people; when the three-dimensional face image is the face image of the first specific person, judging whether an expression picture matched with the three-dimensional face image exists in the expression picture set of the first specific person or not; when the expression picture set of the first specific person has the expression picture matched with the three-dimensional face image, displaying a first switching guide for guiding a user to switch the picture to be searched into the expression picture matched with the three-dimensional face image; in response to detecting that the first switching guide is selected, related information of an expression picture matching the three-dimensional face image is searched.
Description
Technical Field
The present disclosure relates to the field of computer searching, and more particularly, to a picture information searching method and apparatus, a computer system, and a readable storage medium.
Background
The picture-identifying search engine is a search engine system for receiving pictures to be searched and providing relevant information of the pictures to be searched for a user, wherein the relevant information of the pictures to be searched for comprises at least one of the following items: related information of an image on the picture to be searched and a picture similar to the picture to be searched.
Currently, when a picture to be searched is a human picture (i.e., a main body in the picture to be searched is a three-dimensional human face image, for example, a real human image of a known human), the image recognition search engine can provide information such as video, picture, text introduction and the like of the human on the picture to be searched; when the picture to be searched is an expressive picture (i.e., the subject in the picture to be searched is a two-dimensional face image, for example, an expressive bag image), the image recognition search engine may provide a picture similar to the picture to be searched.
Generally, an expression picture is generated based on a character picture, and thus there is a correspondence relationship between the expression picture and the character picture on which it is generated. However, the existing image recognition search engine does not consider the correspondence between the expression images and the character images, and cannot provide the user with the related information of the expression images corresponding to the character images to be searched or the related information of the character images corresponding to the expression images to be searched, so that the diversified information requirements of the user cannot be satisfied.
Disclosure of Invention
According to a first aspect of the present disclosure, an embodiment of the present disclosure discloses a picture information searching method, including: judging whether a main body in the picture to be searched is a three-dimensional face image or a two-dimensional face image; when the main body in the picture to be searched is a three-dimensional face image, judging whether the three-dimensional face image is a face image of any one of a plurality of known people; when the three-dimensional face image is a face image of a first specific person in a plurality of known persons, judging whether an expression picture matched with the three-dimensional face image exists in an expression picture set of the first specific person; when the expression picture set of the first specific person has the expression picture matched with the three-dimensional face image, displaying a first switching guide for guiding a user to switch the picture to be searched into the expression picture matched with the three-dimensional face image; and searching for related information of the emotion picture matched with the three-dimensional face image in response to detecting that the first switching guide is selected.
According to a second aspect of the present disclosure, an embodiment of the present disclosure discloses a picture information search apparatus including: a guidance judgment unit configured to judge whether a subject in a picture to be searched is a three-dimensional face image or a two-dimensional face image, and when the subject in the picture to be searched is the three-dimensional face image, judge whether the three-dimensional face image is a face image of any one of a plurality of known persons, and when the three-dimensional face image is a face image of a first specific person among the plurality of known persons, judge whether an expression picture matched with the three-dimensional face image exists in an expression picture set of the first specific person; a guidance display unit configured to display a first switching guidance for guiding a user to switch a picture to be searched to an expression picture matching a three-dimensional face image when the expression picture matching the three-dimensional face image exists in the expression picture set of the first specific person; and a guide interaction unit configured to search for related information of an expression picture matched with the three-dimensional face image in response to detecting that the first switching guide is selected.
According to a third aspect of the present disclosure, embodiments of the present disclosure disclose a computer system comprising: a processor; and a memory storing a computer program which, when executed by the processor, causes the processor to perform the above-described picture information search method.
According to a fourth aspect of the present disclosure, an embodiment of the present disclosure discloses a computer-readable storage medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the above-described picture information search method.
According to one or more embodiments of the present disclosure, when a three-dimensional face image in a picture to be searched is a face image of a certain specific person and there is an expression picture matching the three-dimensional face image in an expression picture set of the specific person, information more conforming to a user's needs can be provided by displaying a first switching guide for guiding a user to switch the picture to be searched to an expression picture matching the three-dimensional face image and searching for related information of the expression picture matching the three-dimensional face image in response to detecting that the first switching guide is selected.
Drawings
The accompanying drawings illustrate exemplary embodiments and, together with the description, serve to explain exemplary implementations of the embodiments. The illustrated embodiments are for exemplary purposes only and do not limit the scope of the claims. Throughout the drawings, identical reference numerals designate similar, but not necessarily identical, elements.
Fig. 1 is a flowchart illustrating a picture information search method according to an embodiment of the present disclosure;
fig. 2 is a block diagram illustrating a picture information search apparatus according to an embodiment of the present disclosure;
FIG. 3 is a block diagram illustrating an exemplary computer system that can be used to implement embodiments of the present disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. In addition, for convenience of description, only a portion related to the related invention is shown in the drawings.
It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other. Unless the context clearly indicates otherwise, the elements may be one or more if the number of the elements is not specifically limited. In addition, the numbers of the steps or the functional modules used in the present disclosure are only used to identify the respective steps or the functional modules, and are not used to limit the execution order of the respective steps or the connection relationship of the respective functional modules to each other.
In the present disclosure, the use of the terms "first," "second," and the like to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of the elements, unless otherwise indicated, and such terms are merely used to distinguish one element from another element.
In view of the fact that the existing image recognition search engine does not consider the corresponding relation between the expression image and the character image, the related information of the expression image corresponding to the character image to be searched or the related information of the character image corresponding to the expression image to be searched cannot be provided for a user, and the embodiment of the disclosure provides a picture information searching method and device.
Fig. 1 is a flowchart illustrating a picture information search method 100 according to an embodiment of the present disclosure. As shown in fig. 1, the picture information search method 100 may include: step S102, judging whether a main body in a picture to be searched is a three-dimensional face image or a two-dimensional face image; step S104, when the main body in the picture to be searched is a three-dimensional face image, judging whether the three-dimensional face image is a face image of any one of a plurality of known people; step S106, when the three-dimensional face image is the face image of a first specific person in a plurality of known persons, judging whether an expression picture matched with the three-dimensional face image exists in the expression picture set of the first specific person; step S108, when the expression picture set of the first specific person has the expression picture matched with the three-dimensional face image, displaying a first switching guide for guiding the user to switch the picture to be searched into the expression picture matched with the three-dimensional face image; and step S110, searching the related information of the expression picture matched with the three-dimensional face image in response to the fact that the first switching guide is clicked.
According to the picture information searching method, the corresponding relation between the expression pictures and the character pictures is considered, and the related information of the character pictures to be searched or the related information of the expression pictures corresponding to the character pictures to be searched can be provided according to the selection of a user, so that the diversified information requirements of the user can be met.
In some embodiments, the picture information search method 100 may further include: step S112, judging whether expression pictures matched with the two-dimensional face images exist in expression picture sets of a plurality of known people when the main body in the pictures to be searched is the two-dimensional face images; step S114, when the expression picture set of the second specific person in the plurality of known persons has the expression picture matched with the two-dimensional face image, finding out the person picture matched with the two-dimensional face image in the person picture set of the second specific person and displaying a second switching guide for guiding the user to switch the picture to be searched into the person picture matched with the two-dimensional face image; and step S116, searching the related information of the second specific person in response to detecting that the second switching guide is clicked.
Similarly, according to the picture information searching method of the embodiment of the present disclosure, the correspondence between the expression picture and the character picture is considered, and the related information of the expression picture to be searched or the related information of the character picture corresponding to the expression picture to be searched can be provided according to the selection of the user, so that the diversified information requirements of the user can be satisfied.
For example, when it is determined that a three-dimensional face image in a picture to be searched is a face image of a known person "xxx" and there is an expression picture matching the three-dimensional face image in an expression picture set of the known person "xxx", a first switching guide ("switching guide" may be implemented as a region to be selected (for example, by clicking, touching, or the like user input means) of a key or button displayed on a screen, or the like, for example, the first switching guide herein may be a key or button named "cross to expression pack") to prompt the user to switch the picture to be searched to an expression picture matching the three-dimensional face image, and in response to detecting that the first switching guide is clicked, a similar expression picture of the expression picture matching the three-dimensional face image may be searched. When it is determined that the two-dimensional face image in the picture to be searched is an expression picture of the known person "xxx" and there is a person picture matching the two-dimensional face image in the person picture set of the known person "xxx", a second switching guide (for example, the second switching guide may be a button or a button named "through to reality") may be displayed on the picture to be searched to prompt the user to switch the picture to be searched to a person picture matching the two-dimensional face image, and in response to detecting the second switching guide, information such as video, picture, text introduction, etc. of the known person "xxx" may be selected.
In some embodiments, when the subject in the picture to be searched is a three-dimensional face image, it may be determined whether the three-dimensional face image is a face image of any one of the known persons by matching the three-dimensional face image with representative person pictures of various poses of each of the known persons. In most cases, by matching a three-dimensional face image with representative person pictures of various attitudes of a certain known person, it can be determined whether the three-dimensional face image is a face image of the known person. However, in the case where the human pose on the three-dimensional human face image is relatively unique, even if the three-dimensional human face image is a human face image of a certain known human, it may not be possible to judge that the three-dimensional human face image is a human face image of the known human by matching the three-dimensional human face image with representative human figures of various poses of the known human. In addition, since the human poses are diverse, the number of representative human figures of various poses of each known human figure is large, and it is not acceptable for an application scene with limited computational resources and high time-lapse requirements to judge whether the three-dimensional human face image is a human face image of any one of the plurality of known human figures by matching the three-dimensional human face image with the representative human figures of various poses of each of the plurality of known human figures.
Alternatively, in some embodiments, when the subject in the picture to be searched is a three-dimensional face image, it may be determined whether the three-dimensional face image is a face image of any one of the plurality of known persons by extracting face features from the three-dimensional face image and matching the extracted face features with a face feature set of each of the plurality of known persons. Here, since the face features do not greatly change due to the change in the pose of the person and each of the face feature sets of the known person includes various face features of the known person, it can be accurately determined whether the three-dimensional face image is a face image of the known person by extracting the face features from the three-dimensional face image and matching the extracted face features with the face feature set of the known person. In addition, since each known person generally has only one face feature set (or a small number of face feature sets), it takes relatively little computational resources and processing time to determine whether the three-dimensional face image is a face image of any one of the known persons by extracting face features from the three-dimensional face image and matching the extracted face features with the face feature set of each of the known persons.
In some embodiments, when the three-dimensional face image is a face image of a first particular person of the plurality of known persons, it may be determined whether or not there is an expression picture in the expression picture set of the first particular person that matches the three-dimensional face image by matching the three-dimensional face image with each of the expression pictures in the expression picture set of the first particular person. Generally, an expression picture set of a specific person includes one or more expression pictures generated based on a plurality of person pictures having characteristics of facial expressions of the specific person (but not including a huge number of expression pictures of the specific person), so that by matching a three-dimensional face image with each expression picture in the expression picture set of the specific person, it can be quickly and accurately determined whether or not there is an expression picture matched with the three-dimensional face image in the expression picture set of the specific person.
In some embodiments, when the subject in the picture to be searched is a two-dimensional face image, it may be determined whether there is an expression picture matching the two-dimensional face image in the expression picture set of the plurality of known people by matching the two-dimensional face image with each of the expression pictures in the expression picture set of the plurality of known people. Here, by judging whether or not there are expression pictures matching with the two-dimensional face image in the expression picture set of the plurality of known persons, a specific person whose expression picture matches with the two-dimensional face image can be found, so that the search range of the person picture matching with the two-dimensional face image can be limited to the person picture set of the specific person. In this way, the amount of computation and computation time required to find a person picture matching a two-dimensional face image can be reduced (compared to searching for a person picture matching a two-dimensional face image in a person picture set of a plurality of known persons).
In some embodiments, when there is an expression picture matching the two-dimensional face image in the expression picture set of the second specific person among the plurality of known persons, the corresponding relationship information between the expression picture of the second specific person and the person picture stored in advance may be used to find out the person picture matching the two-dimensional face image in the person picture set of the second specific person based on the expression picture matching the two-dimensional face image in the expression picture set of the second specific person. Specifically, by querying the correspondence information between the expression picture and the character picture of the second specific character, the character picture corresponding to the expression picture matched with the two-dimensional face image can be found out from the character picture set of the second specific character and used as the character picture matched with the two-dimensional face image. Thus, the amount of computation and the computation time required to find the figure matching the two-dimensional face image are small.
In some embodiments, the picture information search method 100 may further include: collecting character pictures, expression pictures and corresponding relation information between the character pictures and the expression pictures of a plurality of known characters; and storing the character pictures, the expression pictures and the corresponding relation information between the character pictures and the expression pictures of the plurality of known characters into an online database. Here, by periodically or in real time collecting character pictures, expression pictures, and correspondence information between character pictures and expression pictures of a plurality of known characters and storing them in an online database, the information searching ability of the picture information searching method 100 for these known characters can be improved. In addition, by periodically or in real time collecting the character pictures, the expression pictures, and the correspondence information between the character pictures and the expression pictures of more characters and storing them in an online database, the information search range of the picture information search method 100 can be expanded.
According to the picture information searching method, the corresponding relation between the expression pictures and the character pictures is considered, and the related information of the expression pictures corresponding to the character pictures to be searched or the related information of the character pictures corresponding to the expression pictures to be searched can be searched according to the selection of the user, so that the diversified information requirements of the user can be met.
Fig. 2 is a block diagram illustrating a picture information search apparatus 200 according to an embodiment of the present disclosure. As shown in fig. 2, the picture information search apparatus 200 may include a guidance judging unit 202, a guidance displaying unit 204, and a guidance interacting unit 206. The guidance judging unit 202 is configured to judge whether a subject in a picture to be searched is a three-dimensional face image or a two-dimensional face image, and when the subject in the picture to be searched is the three-dimensional face image, judge whether the three-dimensional face image is a face image of any one of a plurality of known persons, and when the three-dimensional face image is a face image of a first specific person among the plurality of known persons, judge whether there is an expression picture matching the three-dimensional face image in the expression picture set of the first specific person. The guidance display unit 204 is configured to display a first switching guidance for guiding the user to switch the picture to be searched to an expression picture matching the three-dimensional face image when there is an expression picture matching the three-dimensional face image in the expression picture set of the first specific person. The guide interaction unit 206 is configured to search for related information of an expression picture matching the three-dimensional face image in response to detecting that the first switching guide is selected.
In some implementations of the present embodiments, the guidance judging unit is further configured to judge whether or not there is an expression picture matching the two-dimensional face image in the expression picture set of the plurality of known persons when the subject in the picture to be searched is the two-dimensional face image, and wherein the guidance displaying unit is further configured to find a person picture matching the two-dimensional face image in the person picture set of the second specific person and display a second switching guidance for guiding the user to switch the picture to be searched to a person picture matching the two-dimensional face image when there is an expression picture matching the two-dimensional face image in the expression picture set of the second specific person in the plurality of known persons, and wherein the guidance interacting unit is further configured to search for related information of the second specific person in response to detecting that the second switching guidance is selected.
In some implementations of the present embodiment, the guidance judging unit is further configured to judge whether the three-dimensional face image is a face image of any one of the plurality of known persons by extracting face features from the three-dimensional face image and matching the extracted face features with a face feature set of each of the plurality of known persons.
In some implementations of this embodiment, the guidance judging unit is further configured to judge whether or not there is an expression picture matching the three-dimensional face image in the expression picture set of the first specific person by matching the three-dimensional face image with each expression picture in the expression picture set of the first specific person.
In some implementations of the present embodiment, the guidance judgment unit is further configured to judge whether or not there is an expression picture matching the two-dimensional face image in the expression picture set of the plurality of known persons by matching the two-dimensional face image with each of the expression pictures in the expression picture set of the plurality of known persons.
In some implementations of this embodiment, the guidance display unit is further configured to find out a person picture matching the two-dimensional face image in the person picture set of the second specific person based on the expression picture matching the two-dimensional face image in the expression picture set of the second specific person using the pre-stored correspondence information between the expression picture of the second specific person and the person picture.
In some embodiments of the present embodiment, the picture information search apparatus 200 may further include: a resource collection unit configured to collect character pictures, expression pictures, and correspondence information between the character pictures and the expression pictures of a plurality of known characters; and the resource warehousing unit is configured to store the character pictures, the expression pictures and the corresponding relation information between the character pictures and the expression pictures of the plurality of known characters into the online database.
In this embodiment, the specific implementation and technical effects of the picture information searching apparatus 200 and its corresponding functional units may refer to the related descriptions in the embodiment described in fig. 1, and are not repeated here.
FIG. 3 is a block diagram illustrating an exemplary computer system that can be used to implement embodiments of the present disclosure. A computer system 300 suitable for use in implementing embodiments of the present disclosure is described below in conjunction with fig. 3. It should be appreciated that the computer system 300 illustrated in FIG. 3 is only one example and should not be taken as limiting the functionality and scope of use of the embodiments of the present disclosure.
As shown in fig. 3, the computer system 300 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 301 that may perform various suitable actions and processes in accordance with programs stored in a Read Only Memory (ROM) 302 or loaded from a storage device 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the computer system 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
In general, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touchpad, camera, accelerometer, gyroscope, etc.; an output device 307 including, for example, a liquid crystal display (LCD, liquid Crystal Display), a speaker, a vibrator, and the like; storage 308 including, for example, flash memory (Flash Card) or the like; and communication means 309. The communication means 309 may allow the computer system 300 to communicate with other devices wirelessly or by wire to exchange data. While FIG. 3 illustrates a computer system 300 having various devices, it should be understood that not all illustrated devices are required to be implemented or provided. More or fewer devices may be implemented or provided instead. Each block shown in fig. 3 may represent one device or a plurality of devices as needed.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure provide a computer readable storage medium storing a computer program comprising program code for performing the method 100 shown in fig. 1. In such an embodiment, the computer program may be downloaded and installed from a network via a communication device 309, or installed from a storage device 308, or installed from a ROM 302. The above-described functions defined in the apparatus of the embodiments of the present disclosure are achieved when the computer program is executed by the processing apparatus 301.
It should be noted that, the computer readable medium according to the embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In an embodiment of the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. Whereas in embodiments of the present disclosure, the computer-readable signal medium may comprise a data signal propagated in baseband or as part of a carrier wave, with computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (Radio Frequency), and the like, or any suitable combination thereof.
The computer readable medium may be embodied in the computer system 300; or may exist alone without being assembled into the computer system 300. The computer readable medium carries one or more programs which, when executed by the computing device, cause the computer system to: judging whether a main body in the picture to be searched is a three-dimensional face image or a two-dimensional face image; when the main body in the picture to be searched is a three-dimensional face image, judging whether the three-dimensional face image is a face image of any one of a plurality of known people; when the three-dimensional face image is a face image of a first specific person in a plurality of known persons, judging whether an expression picture matched with the three-dimensional face image exists in an expression picture set of the first specific person; when the expression picture set of the first specific person has the expression picture matched with the three-dimensional face image, displaying a first switching guide for guiding a user to switch the picture to be searched into the expression picture matched with the three-dimensional face image; and searching for related information of the emotion picture matched with the three-dimensional face image in response to detecting that the first switching guide is selected.
Computer program code for carrying out operations of embodiments of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments described in the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The described units may also be provided in a processor, for example, described as: a processor includes a guidance judgment unit, a guidance display unit, and a guidance interaction unit. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above technical features, but encompasses other technical features formed by any combination of the above technical features or their equivalents without departing from the spirit of the invention. Such as the above-described features, are mutually substituted with (but not limited to) the features having similar functions disclosed in the embodiments of the present disclosure.
Claims (12)
1. A picture information search method, comprising:
judging whether a main body in the picture to be searched is a three-dimensional face image or a two-dimensional face image;
when the main body in the picture to be searched is a three-dimensional face image, judging whether the three-dimensional face image is a face image of any one of a plurality of known people;
when the three-dimensional face image is a face image of a first specific person in the plurality of known persons, judging whether an expression picture matched with the three-dimensional face image exists in an expression picture set of the first specific person;
when the expression picture set of the first specific person has the expression picture matched with the three-dimensional face image, displaying a first switching guide for guiding a user to switch the picture to be searched into the expression picture matched with the three-dimensional face image; and
in response to detecting that the first switching guide is selected, searching for related information of an emoticon matching the three-dimensional face image,
the picture information searching method further comprises the following steps:
when the main body in the picture to be searched is a two-dimensional face image, judging whether expression pictures matched with the two-dimensional face image exist in the expression picture sets of the known people or not;
when the expression picture set of the second specific person in the plurality of known persons has the expression picture matched with the two-dimensional face image, finding out the person picture matched with the two-dimensional face image in the person picture set of the second specific person and displaying a second switching guide for guiding the user to switch the picture to be searched into the person picture matched with the two-dimensional face image; and
in response to detecting that the second switch guide is selected, searching for related information of the second specific person,
the picture information searching method further comprises the following steps:
collecting character pictures, expression pictures and corresponding relation information between the character pictures and the expression pictures of the plurality of known characters; and
and storing the character pictures, the expression pictures and the corresponding relation information between the character pictures and the expression pictures of the plurality of known characters into an online database.
2. The picture information searching method according to claim 1, wherein whether the three-dimensional face image is a face image of any one of the plurality of known persons is determined by extracting a face feature from the three-dimensional face image and matching the extracted face feature with a face feature set of each of the plurality of known persons.
3. The picture information searching method of claim 1, wherein it is determined whether or not there is an expression picture matching the three-dimensional face image in the expression picture set of the first specific person by matching the three-dimensional face image with each expression picture in the expression picture set of the first specific person.
4. The picture information search method according to claim 1, wherein it is judged whether or not there is an expression picture matching the two-dimensional face image in the expression picture set of the plurality of known persons by matching the two-dimensional face image with each expression picture in the expression picture set of the plurality of known persons.
5. The picture information search method of claim 1, wherein the person picture matching the two-dimensional face image in the person picture set of the second specific person is found based on the expression picture matching the two-dimensional face image in the expression picture set of the second specific person using the correspondence information between the expression picture of the second specific person and the person picture stored in advance.
6. A picture information search apparatus comprising:
a guide judgment unit configured to
Judging whether the main body in the picture to be searched is a three-dimensional face image or a two-dimensional face image,
when the main body in the picture to be searched is a three-dimensional face image, judging whether the three-dimensional face image is a face image of any one of a plurality of known people,
when the three-dimensional face image is a face image of a first specific person in the plurality of known persons, judging whether an expression picture matched with the three-dimensional face image exists in an expression picture set of the first specific person;
a guidance display unit configured to display a first switching guidance for guiding a user to switch the picture to be searched to an expression picture matched with the three-dimensional face image when the expression picture matched with the three-dimensional face image exists in the expression picture set of the first specific person; and
a guidance interaction unit configured to search for related information of an emoticon matching the three-dimensional face image in response to detection that the first switching guidance is selected,
wherein the guidance judging unit is further configured to judge whether or not there is an expression picture matching with a two-dimensional face image in the expression picture set of the plurality of known persons when the subject in the picture to be searched is the two-dimensional face image, and wherein
The guidance display unit is further configured to find out, when there is an expression picture matching the two-dimensional face image in the expression picture set of a second specific person among the plurality of known persons, a person picture matching the two-dimensional face image in the person picture set of the second specific person and display a second switching guidance for guiding the user to switch the picture to be searched to a person picture matching the two-dimensional face image, and wherein
The guidance interaction unit is further configured to, in response to detecting that the second switching guidance is selected, search for relevant information of the second specific person,
and wherein the picture information search apparatus further comprises:
a resource collection unit configured to collect character pictures, expression pictures, and correspondence information between the character pictures and the expression pictures of the plurality of known characters; and
and the resource warehousing unit is configured to store the character pictures, the expression pictures and the corresponding relation information between the character pictures and the expression pictures of the plurality of known characters into an online database.
7. The picture information search apparatus according to claim 6, wherein the guidance judging unit is further configured to judge whether the three-dimensional face image is a face image of any one of the plurality of known persons by extracting a face feature from the three-dimensional face image and matching the extracted face feature with a face feature set of each of the plurality of known persons.
8. The picture information search apparatus according to claim 6, wherein the guidance judging unit is further configured to judge whether or not there is an expression picture matching the three-dimensional face image in the expression picture set of the first specific person by matching the three-dimensional face image with each expression picture in the expression picture set of the first specific person.
9. The picture information search apparatus according to claim 6, wherein the guidance judging unit is further configured to judge whether or not there is an expression picture matching the two-dimensional face image in the expression picture set of the plurality of known persons by matching the two-dimensional face image with each of the expression pictures in the expression picture set of the plurality of known persons.
10. The picture information search apparatus according to claim 6, wherein the guidance display unit is further configured to find a person picture in the person picture set of the second specific person that matches the two-dimensional face image based on an expression picture in the expression picture set of the second specific person that matches the two-dimensional face image, using correspondence information between the expression picture of the second specific person and the person picture stored in advance.
11. A computer system, comprising:
a processor; and
a memory storing a computer program which, when executed by the processor, causes the processor to perform the method according to any one of claims 1-5.
12. A computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the method according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010897010.5A CN112035692B (en) | 2020-08-31 | 2020-08-31 | Picture information searching method and device, computer system and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010897010.5A CN112035692B (en) | 2020-08-31 | 2020-08-31 | Picture information searching method and device, computer system and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112035692A CN112035692A (en) | 2020-12-04 |
| CN112035692B true CN112035692B (en) | 2023-11-03 |
Family
ID=73586443
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010897010.5A Active CN112035692B (en) | 2020-08-31 | 2020-08-31 | Picture information searching method and device, computer system and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112035692B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090003939A (en) * | 2007-07-05 | 2009-01-12 | 삼성테크윈 주식회사 | Method for managing character image files of computer |
| CN102902771A (en) * | 2012-09-27 | 2013-01-30 | 百度国际科技（深圳）有限公司 | Method, device and server for searching pictures |
| CN107729543A (en) * | 2017-10-31 | 2018-02-23 | 上海掌门科技有限公司 | Expression picture recommends method and apparatus |
| CN108259788A (en) * | 2018-01-29 | 2018-07-06 | 努比亚技术有限公司 | Video editing method, terminal and computer readable storage medium |
| CN108573527A (en) * | 2018-04-18 | 2018-09-25 | 腾讯科技（深圳）有限公司 | A kind of expression picture generation method and its equipment, storage medium |
| CN110489186A (en) * | 2018-05-15 | 2019-11-22 | 珠海格力电器股份有限公司 | A kind of method and device of replacement terminal wallpaper |
| KR20200062843A (en) * | 2018-11-27 | 2020-06-04 | 에스케이텔레콤 주식회사 | Apparatus for recommending contents based on facial expression, method thereof and computer recordable medium storing program to perform the method |
| CN111259697A (en) * | 2018-11-30 | 2020-06-09 | 百度在线网络技术（北京）有限公司 | Method and apparatus for transmitting information |
-
2020
- 2020-08-31 CN CN202010897010.5A patent/CN112035692B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090003939A (en) * | 2007-07-05 | 2009-01-12 | 삼성테크윈 주식회사 | Method for managing character image files of computer |
| CN102902771A (en) * | 2012-09-27 | 2013-01-30 | 百度国际科技（深圳）有限公司 | Method, device and server for searching pictures |
| CN107729543A (en) * | 2017-10-31 | 2018-02-23 | 上海掌门科技有限公司 | Expression picture recommends method and apparatus |
| CN108259788A (en) * | 2018-01-29 | 2018-07-06 | 努比亚技术有限公司 | Video editing method, terminal and computer readable storage medium |
| CN108573527A (en) * | 2018-04-18 | 2018-09-25 | 腾讯科技（深圳）有限公司 | A kind of expression picture generation method and its equipment, storage medium |
| CN110489186A (en) * | 2018-05-15 | 2019-11-22 | 珠海格力电器股份有限公司 | A kind of method and device of replacement terminal wallpaper |
| KR20200062843A (en) * | 2018-11-27 | 2020-06-04 | 에스케이텔레콤 주식회사 | Apparatus for recommending contents based on facial expression, method thereof and computer recordable medium storing program to perform the method |
| CN111259697A (en) * | 2018-11-30 | 2020-06-09 | 百度在线网络技术（北京）有限公司 | Method and apparatus for transmitting information |
Non-Patent Citations (2)
| Title |
|---|
| 基于新闻环境的人物肖像检索;王太峰;袁平波;荚济民;俞能海;;山东大学学报(理学版)(第03期);全文 * |
| 多模态人脸识别中的人脸特征定位;刘晓宁;周明全;耿国华;;计算机应用与软件(第04期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112035692A (en) | 2020-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109189879B (en) | Electronic book display method and device | |
| US9881084B1 (en) | Image match based video search | |
| KR101363559B1 (en) | Apparatus and Method for providing augment reality using additional information | |
| CN112015314B (en) | Information display method and device, electronic equipment and medium | |
| US20130229342A1 (en) | Information providing system, information providing method, information processing apparatus, method of controlling the same, and control program | |
| CN112306235B (en) | Gesture operation method, device, equipment and storage medium | |
| CN112395022B (en) | Information display method, information display device, electronic equipment and computer readable storage medium | |
| CN111339737B (en) | Entity linking method, device, equipment and storage medium | |
| CN111796925A (en) | Method and device for screening algorithm model, storage medium and electronic equipment | |
| CN111311358B (en) | Information processing method and device and electronic equipment | |
| CN111552620B (en) | Data acquisition method, device, terminal and storage medium | |
| CN112818080A (en) | Search method, device, equipment and storage medium | |
| CN112037305A (en) | Method, device and storage medium for reconstructing tree-like organization in image | |
| CN112035692B (en) | Picture information searching method and device, computer system and readable storage medium | |
| CN113987326B (en) | Resource recommendation method and device, computer equipment and medium | |
| CN114296627B (en) | Content display method, device, equipment and storage medium | |
| CN114995691B (en) | Document processing method, device, equipment and medium | |
| CN114912432A (en) | Data analysis method and device, electronic equipment and storage medium | |
| CN116560552A (en) | Information processing method, device, electronic equipment and medium | |
| CN110263743B (en) | Method and device for recognizing images | |
| CN112308678A (en) | Price information processing method, device, equipment and medium based on image recognition | |
| CN111049988A (en) | Intimacy prediction method, system, equipment and storage medium for mobile equipment | |
| CN112231023A (en) | Information display method, device, equipment and storage medium | |
| CN113760414B (en) | Method and device for drawing graph | |
| CN112884787B (en) | Image clipping method and device, readable medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |