CN106572268B - Information display method and device - Google Patents

Information display method and device Download PDF

Info

Publication number
CN106572268B
CN106572268B CN201611033650.1A CN201611033650A CN106572268B CN 106572268 B CN106572268 B CN 106572268B CN 201611033650 A CN201611033650 A CN 201611033650A CN 106572268 B CN106572268 B CN 106572268B
Authority
CN
China
Prior art keywords
information
face
echo signal
alternative
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611033650.1A
Other languages
Chinese (zh)
Other versions
CN106572268A (en
Inventor
周珏嘉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201611033650.1A priority Critical patent/CN106572268B/en
Publication of CN106572268A publication Critical patent/CN106572268A/en
Application granted granted Critical
Publication of CN106572268B publication Critical patent/CN106572268B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/018Input/output arrangements for oriental characters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • G06F3/0236Character input methods using selection techniques to select from displayed items

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Environmental & Geological Engineering (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure relates to an information display method and device, wherein the method comprises the following steps: when the input panel is displayed, a human face detection signal is emitted; receiving first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted; calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sequencing each piece of alternative information according to the matching degree, wherein the alternative information is information prompted to be selected by a user; and displaying each piece of sorted alternative information. Therefore, the alternative information which is most matched with the face echo signal can be ranked at the top in the method, the method is beneficial to quick selection of a user, and therefore the input efficiency of the user can be improved.

Description

Information display method and device
Technical Field
The present disclosure relates to the field of information technologies, and in particular, to an information display method and apparatus.
Background
With the wide application of smart phones, the importance of the input method of the mobile phone is also receiving more and more attention.
At present, many mobile phones adopt an intelligent input method, namely after a user inputs required characters, a screen can display some common characters for the user to select. And the common words are all the word selection possibilities given by the system according to a default order or priority given according to information such as using frequency and the like.
The nine-square pinyin input method is one of the most commonly used mobile phone pinyin input methods, when a user uses the nine-square pinyin input method, because the nine-square pinyin input panel is provided with 9 digital buttons, each digital button represents 3-4 letters, the input of the user can cause various pinyin combinations, and the pinyin combinations can be displayed on a screen for the user to select. Such as: when the user presses the buttons 9, 2 and 6, the pinyin combination may be: wan, yan, yao, zan, zao, etc., if the user exactly needs to input "like" words, he needs to select the correct pinyin combination "zan" and then select the words.
However, the existing intelligent input method cannot sense the input information exactly needed by the user, and the input efficiency is not high.
Disclosure of Invention
In order to solve the problems in the related art, embodiments of the present disclosure provide an information display method and apparatus, so as to solve the problems that an intelligent input method in the prior art cannot sense an input item exactly required by a user, and input efficiency is low.
According to a first aspect of the embodiments of the present disclosure, there is provided an information display method, which may include:
when the input panel is displayed, a human face detection signal is emitted;
receiving first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sequencing each piece of alternative information according to the matching degree, wherein the alternative information is information prompted to be selected by a user;
and displaying each piece of sorted alternative information.
In one embodiment, the emitting the face detection signal while displaying the input panel includes:
when the input panel is displayed, a face detection function is started;
setting the self front setting range as the detection direction and transmitting the human face detection signal with the set power.
In an embodiment, the calculating a matching degree between each candidate information corresponding to the first information and the face echo signal, and sorting each candidate information according to the matching degree includes:
acquiring each alternative information corresponding to the first information;
extracting first face characteristic information from the face echo signal;
acquiring second face feature information corresponding to each alternative information in a set information base;
calculating the matching degree between the first face feature information and second face feature information corresponding to each alternative information;
and sequencing the alternative information according to the calculated matching degrees, wherein the sequencing is performed in a descending order according to the matching degrees.
In one embodiment, the first facial feature information includes, but is not limited to, at least one of the following facial feature indicators:
maximum lip opening, minimum lip opening, maximum lip reflection intensity, minimum lip reflection intensity, rate of lip deformation, duration of lip deformation, chin position information, and cheek reflection intensity information.
In an embodiment, the calculating a matching degree between the first face feature information and the second face feature information corresponding to each candidate information includes:
if the first face feature information comprises at least two face feature indexes, acquiring a set weight value corresponding to each face feature index;
calculating the matching degree between each face characteristic index in the first face characteristic information and the face characteristic index corresponding to each alternative information;
and carrying out weighted summation on the matching degrees corresponding to the same candidate information obtained by calculation according to the set weight values to obtain the matching degree between the first face feature information and the second face feature information corresponding to the candidate information.
In an embodiment, the method further comprises:
and if the first information is received but the face echo signal is not received, adjusting the transmitting direction and/or transmitting power of the face detection signal until the face echo signal is received or the preset time period is exhausted, and stopping adjustment.
In an embodiment, the method further comprises:
and if the fact that the display screen does not display the input panel is detected, closing the human face detection signal.
According to a second aspect of the embodiments of the present disclosure, there is provided an information display device, which may include:
a transmitting module configured to transmit a face detection signal when the input panel is displayed;
a receiving module configured to receive first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
the sorting module is configured to calculate matching degrees between each piece of alternative information corresponding to the first information and the face echo signal, and sort each piece of alternative information according to the matching degrees, wherein the alternative information is information prompted to be selected by a user;
and the display module is configured to display the sorted alternative information.
In one embodiment, the transmission module comprises:
a promoter module configured to start a face detection function when the input panel is displayed;
and the transmitting submodule is configured to set the self front setting range as the detection direction and transmit the human face detection signal at the set power.
In one embodiment, the first ordering module comprises:
the first obtaining sub-module is configured to obtain each candidate information corresponding to the first information;
an extraction sub-module configured to extract first face feature information from the face echo signal;
the second acquisition sub-module is configured to acquire second face feature information corresponding to each piece of alternative information in the setting information base;
the first calculation sub-module is configured to calculate matching degrees between the first face feature information and second face feature information corresponding to the alternative information;
and the sorting submodule is configured to sort the alternative information according to the calculated matching degrees, and the sorting is performed in a descending order according to the matching degrees.
In one embodiment, the first facial feature information includes, but is not limited to, at least one of the following facial feature indicators:
maximum lip opening, minimum lip opening, maximum lip reflection intensity, minimum lip reflection intensity, rate of lip deformation, duration of lip deformation, chin position information, and cheek reflection intensity information.
In one embodiment, the first computation submodule includes:
a third obtaining sub-module, configured to obtain a set weight value corresponding to each face feature index if the first face feature information includes at least two face feature indexes;
the second calculation submodule is configured to calculate matching degrees between each face feature index in the first face feature information and the face feature index corresponding to each alternative information;
and the weighted summation sub-module is configured to perform weighted summation on the matching degrees corresponding to the same candidate information obtained by calculation according to the set weight values to obtain the matching degree between the first face feature information and the second face feature information corresponding to the candidate information.
In one embodiment, the apparatus further comprises:
and the adjusting module is configured to adjust the transmitting direction and/or transmitting power of the face detection signal if the first information is received but the face echo signal is not received, and stop adjusting until the face echo signal is received or a preset time period is exhausted.
In one embodiment, the apparatus further comprises:
and the closing module is configured to close the human face detection signal if the fact that the display screen does not display the input panel is detected.
According to a third aspect of the embodiments of the present disclosure, there is provided an information display device, which may include:
a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to:
when the input panel is displayed, a human face detection signal is emitted;
receiving first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sequencing each piece of alternative information according to the matching degree, wherein the alternative information is information prompted to be selected by a user;
and displaying each piece of sorted alternative information.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
the terminal can transmit the face detection signal and receive the face echo signal, and utilizes the face echo signal to participate in the sequencing of the alternative information corresponding to the first information, and sequences according to the matching degree between the face echo signal and the alternative information, and displays the alternative information sequenced according to the matching degree, so that the alternative information most matched with the face echo signal is easily ranked at the head, the quick selection of a user is facilitated, and the input efficiency of the user can be improved.
In the method, after the terminal can also receive the first information, the terminal can sort by utilizing the matching degree between the face echo signal and each alternative information, the sorting is performed in a descending order according to the size of the matching degree, and each alternative information after the descending order is displayed for a user to select, so that the sorted alternative information can be closer to the exact input information of the user, the user can conveniently and quickly select the alternative information, the input satisfaction of the user is improved, and the input efficiency of the user is also improved.
In the disclosure, the terminal can also receive the first information but not receive the face echo signal, and can display each alternative information sequenced according to the set rule, so that even if the face detection signal goes wrong, the normal display of the alternative information can be ensured, and the face detection signal is set to the sequencing of the auxiliary alternative information, thereby improving the practicability of information display.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic view of an application scenario of an information display method shown in the present disclosure according to an exemplary embodiment;
FIG. 2 is a flow chart illustrating an information display method according to an exemplary embodiment of the present disclosure;
FIG. 3 is a flow chart illustrating another method of displaying information according to an exemplary embodiment of the present disclosure;
FIG. 4 is a flow chart illustrating another method of displaying information according to an exemplary embodiment of the present disclosure;
FIG. 5 is a block diagram of an information display device shown in accordance with an exemplary embodiment of the present disclosure;
FIG. 6 is a block diagram of another information display device shown in accordance with an exemplary embodiment of the present disclosure;
FIG. 7 is a block diagram of another information display device shown in accordance with an exemplary embodiment of the present disclosure;
FIG. 8 is a block diagram of another information display device shown in accordance with an exemplary embodiment of the present disclosure;
FIG. 9 is a block diagram of another information display device shown in accordance with an exemplary embodiment of the present disclosure;
FIG. 10 is a block diagram of another information display device shown in accordance with an exemplary embodiment of the present disclosure;
fig. 11 is a schematic view illustrating a structure for an information display device according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Fig. 1 is a schematic view of an application scenario of an information display method shown in the present disclosure according to an exemplary embodiment. The application scene comprises a user and a smart phone. When a user needs to send a short message or browse an internet webpage, the user can operate the display screen of the smart phone to display the input panel through the thumb and input short message information or keyword information through the input panel.
When the smart phone detects that the input panel is displayed in the display screen, the smart phone indicates that the user may need to input information at the moment, and in order to sense the input information exactly needed by the user, the smart phone starts a face detection function and transmits a face detection signal.
In an embodiment, when the smart phone transmits the face detection signal, the smart phone turns on or changes the turned-on millimeter wave transmitting antenna and the turned-on radio frequency module, so that the smart phone sends the face detection signal with a certain power (such as the maximum power) by taking the default range of the front of the smart phone as the detection direction, and detects whether the corresponding echo signal is received.
When the smart phone receives information input by a user through an input panel and echo signals detected after the face detection signals are transmitted, the matching degree between each piece of alternative information corresponding to the information input by the user and the face echo signals is calculated, each piece of alternative information is sorted according to the matching degree, and each piece of ordered alternative information is displayed.
Therefore, the order of each piece of candidate information displayed in the embodiment is related to the matching degree, so that the candidate information most matched with the face echo signal is easily ranked at the top, and the method is beneficial to quick selection of a user, thereby improving the input efficiency of the user.
Fig. 2 is a flowchart illustrating an information display method according to an exemplary embodiment of the present disclosure, where the information display method may be applied to a terminal and may be implemented by installing corresponding information display software on the terminal, and as shown in fig. 2, the information display method may include the following steps 210 to 240:
in step 210, a face detection signal is transmitted while the input panel is displayed.
The terminal in the present disclosure may be any intelligent terminal having an internet access function, and may be specifically a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), or the like. The terminal can access the router through the wireless local area network and access the server on the public network through the router.
In this embodiment, when the input panel is displayed on the display screen of the terminal, it indicates that the user may need to input information at this time, and in order to sense the input information exactly needed by the user, the smart phone may start the face detection function, that is, turn on or change the turned-on millimeter wave transmitting antenna and radio frequency module, so that the smart phone sends a face detection signal with a certain power (such as maximum power) using the default range of the front of the smart phone as a detection direction, and detects whether a corresponding echo signal is received.
In an embodiment, the emitting the face detection signal while displaying the input panel may include:
when the input panel is displayed, a face detection function is started;
setting the self front setting range as the detection direction and transmitting the human face detection signal with the set power.
In an embodiment, if it is detected that the input panel is no longer displayed on the display screen, the face detection signal is turned off.
In this embodiment, if it is detected that the input panel is no longer displayed on the display screen, indicating that the user is no longer inputting information, the face detection signal may be stopped from being transmitted, so that energy consumption of the terminal may be reduced.
In step 220, first information and a face echo signal are received. The first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after the face detection signal is transmitted.
In this embodiment, the terminal receives the user input information and also receives the face echo signal detected for the user. By analyzing the echo signals of the face, the positions of the cheek and the lip of the user, namely the facial actions of the user, can be obtained, and the information which the user exactly needs to input is obtained from the facial actions of the user.
In an embodiment, if the first information is received but the face echo signal is not received, the transmitting direction and/or the transmitting power of the face detection signal are adjusted until the face echo signal is received or the preset time period is exhausted, and then the adjustment is stopped.
In this embodiment, if only the first information is received but the face echo signal is not received, which indicates that the transmission direction of the face detection signal is wrong or the transmission power is too small, the transmission direction, the transmission power, and the like of the face detection signal may be adjusted until the face echo signal is received or the preset time period is exhausted, and then the adjustment is stopped.
In addition, if a face echo signal is received, but the effect of the face echo signal is not good, the face features of the user cannot be extracted from the face echo signal, which indicates that the transmission power of the face detection signal at this time is too small, and the transmission power needs to be further increased, so that the terminal provides a signal adjustment function, and is convenient for obtaining the most accurate positions of the cheek and the lips of the user.
In step 230, the matching degree between each candidate information corresponding to the first information and the face echo signal is calculated, and each candidate information is sorted according to the matching degree. Wherein the alternative information is information that prompts the user to make a selection.
In this embodiment, if the input panel displayed on the display screen of the terminal is a nine-grid input panel, the nine-grid input panel has 9 number buttons, each number button represents 3-4 letters, and when a user inputs information, the user can click one or more number buttons of the nine-grid input panel to achieve the purpose of inputting information.
Such as: if the user needs to input the 'like' word, three digital buttons of 9, 2 and 6 can be pressed; after the user input information received by the terminal is "926", obtaining the pinyin combination corresponding to "926" may be: the method comprises the steps of wan, yan, yao, zan, zao and the like, calculating the matching degree of a face echo signal and alternative pinyins of wan, yan, yao, zan, zao and the like, if the fact that the face echo signal is most matched with the pronunciation action of zan is obtained from the calculated matching degrees, then arranging the alternative pinyins of zan at the top, and displaying the alternative pinyins sequenced through the matching degree, so that a user can find the words of 'liking' quickly, and the input efficiency of the user is improved.
In an embodiment, when calculating a matching degree between each candidate information corresponding to the first information and the face echo signal, and sorting each candidate information according to the matching degree, the method may include:
acquiring each alternative information corresponding to the first information;
extracting first face characteristic information from the face echo signal;
acquiring second face feature information corresponding to each alternative information in a set information base;
calculating the matching degree between the first face feature information and second face feature information corresponding to each alternative information;
and sequencing the alternative information according to the calculated matching degrees, wherein the sequencing is performed in a descending order according to the matching degrees.
See the embodiment shown in fig. 3 for details.
In step 240, the candidate information sorted according to the matching degree is displayed.
It can be seen from the above embodiments that, by transmitting the face detection signal, receiving the face echo signal, and using the face echo signal to participate in the sorting of the respective alternative information corresponding to the first information, and sorting according to the matching degree between the face echo signal and the respective alternative information, and displaying the respective alternative information sorted according to the matching degree, the alternative information most matched with the face echo signal is easily arranged at the top, which is beneficial for the user to select quickly, so that the input efficiency of the user can be improved.
Fig. 3 is a flowchart illustrating another information display method according to an exemplary embodiment of the present disclosure, where the information display method may be applied to a terminal and may be implemented by installing corresponding information display software on the terminal, and as shown in fig. 3, the information display method may include the following steps 300 to 390:
in step 300, a face detection function is activated while the input panel is displayed.
In step 310, the self front setting range is set as the detection direction, and the face detection signal is transmitted with the set power.
In step 320, first information and a face echo signal are received. The first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after the face detection signal is transmitted.
In this embodiment, the first information and the face echo signal are generally received at the same time, and the face echo signal is a sequence of each auxiliary information corresponding to the auxiliary first information. Even if the face echo signal is received later than the first information, the information sequencing is not delayed. However, if the face echo signal is not received after the first information is received, at this time, the input panel further needs to display the alternative information prompting the user, and at this time, the first sequencing information obtained in step 340 may be directly displayed, which is described in detail in the embodiment of fig. 4.
In step 330, each candidate information corresponding to the first information is obtained.
In this embodiment, after receiving the information input by the user, the terminal automatically obtains the standby information for prompting the user to select.
Such as: after the user inputs "xih" on the pinyin panel, the system obtains the following spare information: west ring, likes, refines, etc.
In step 340, first face feature information is extracted from the face echo signal.
In this embodiment, the first facial feature information mainly includes information of the cheeks and lips of the user.
In one embodiment, the first facial feature information includes, but is not limited to, at least one of the following facial feature indicators:
maximum lip opening, minimum lip opening, maximum lip reflection intensity, minimum lip reflection intensity, rate of lip deformation, duration of lip deformation, chin position information, and cheek reflection intensity information.
In step 350, second face feature information corresponding to each candidate information is obtained in the setting information base.
In this embodiment, the setting information base is an information base in which face features corresponding to common information are stored. Such as: the setting information base stores cheek feature information and lip feature information corresponding to the common information.
In step 360, a matching degree between the first face feature information and the second face feature information corresponding to each candidate information is calculated.
In this embodiment, if the first face feature information has only one face feature index, the matching degree between the face feature index and the same face feature index corresponding to each piece of alternative information may be directly calculated.
In an embodiment, if the first facial feature information includes at least two facial feature indexes, a set weight value corresponding to each facial feature index is obtained;
calculating the matching degree between each face characteristic index in the first face characteristic information and the face characteristic index corresponding to each alternative information;
and carrying out weighted summation on the matching degrees corresponding to the same candidate information obtained by calculation according to the set weight values to obtain the matching degree between the first face feature information and the second face feature information corresponding to the candidate information.
Such as: the first face feature information includes a cheek index 1 and a lip index 1, the alternative information includes alternative information 1 and alternative information 2, the weight of the cheek index 1 is weight 1, the lip index 1 is weight 2, the matching degree of the index corresponding to the cheek index 1 and the alternative information 1 is matching degree 1, the matching degree of the index corresponding to the lip index 1 and the alternative information 1 is matching degree 2, the matching degree of the index corresponding to the cheek index 1 and the alternative information 2 is matching degree 3, the matching degree of the index corresponding to the lip index 1 and the alternative information 2 is matching degree 4, then the matching degree 5 of the first face feature information and the alternative information 1 is shown in formula (1), and the matching degree 6 of the first face feature information and the alternative information 2 is shown in formula (2):
matching degree 5 ═ weight 1 × matching degree 1+ weight 2 × matching degree 2 … … … … … … … … formula (1)
Matching degree 6 ═ weight 1 × matching degree 3+ weight 2 × matching degree 4 … … … … … … … … equation (2)
In step 370, the candidate information is sorted according to the calculated matching degrees, and the sorting is performed in descending order according to the size of the matching degree.
In this embodiment, the candidate information corresponding to the maximum matching degree is the information closest to the exact input by the user, and all the information needs to be ranked first.
In step 380, the candidate information items are displayed in descending order according to the matching degree.
It can be seen from the above embodiments that, after receiving the first information, the first information may be sorted by using the matching degree between the face echo signal and each of the candidate information, the sorting may be performed in a descending order according to the size of the matching degree, and each of the candidate information after the descending order is displayed for the user to select, so that the sorted candidate information is closer to the exact input information of the user, the user can select quickly, the input satisfaction of the user is improved, and the input efficiency of the user is also improved.
Fig. 4 is a flowchart illustrating another information display method according to an exemplary embodiment of the present disclosure, where the information display method may be applied to a terminal and may be implemented by installing corresponding information display software on the terminal, and as shown in fig. 4, the information display method may include the following steps 400 to 490:
in step 400, a face detection signal is transmitted while the input panel is displayed.
In step 410, it is determined whether a first message and a face echo signal are received, where the first message is a message input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted. If the first information and the face echo signal are received, go to step 420; if the first information is received but the face echo signal is not received, step 440 is executed.
In step 420, the matching degree between the face echo signal and each candidate information corresponding to the first information is calculated, and each candidate information is sorted according to the matching degree. Wherein the alternative information is information that prompts the user to make a selection.
In step 430, the information alternatives sorted according to the matching degree are displayed, and the process ends.
In step 440, obtaining each candidate information corresponding to the first information;
in step 450, the respective candidate information is sorted according to a set rule, wherein the set rule includes that the candidate information with high use frequency is arranged in front of the candidate information with low use frequency is arranged in back of the candidate information with high use frequency.
In step 460, the information alternatives sorted according to the set rule are displayed, and the process ends.
It can be seen from the above embodiments that, if the first information is received, but the face echo signal is not received, the alternative information sorted according to the set rule can be displayed, so that even if the face detection signal is out of order, normal display of the alternative information can be guaranteed, and the face detection signal is set as the sort of the auxiliary alternative information, thereby improving the practicability of information display.
Corresponding to the embodiment of the information display method, the disclosure also provides an embodiment of an information display device.
As shown in fig. 5, fig. 5 is a block diagram of an information display apparatus shown in the present disclosure according to an exemplary embodiment, which may be applied to a terminal and used to perform the information display method shown in fig. 2, and which may include: a transmitting module 51, a receiving module 52, a sorting module 53 and a display module 54.
A transmitting module 51 configured to transmit a face detection signal when the input panel is displayed;
a receiving module 52 configured to receive first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
a sorting module 53, configured to calculate matching degrees between each piece of candidate information corresponding to the first information and the matching degree between the face echo signal, and sort each piece of candidate information according to the matching degrees, where the candidate information is information prompted to a user for selection;
a display module 54 configured to display the sorted candidate information.
It can be seen from the above embodiments that, by transmitting the face detection signal, receiving the face echo signal, and using the face echo signal to participate in the sorting of the respective alternative information corresponding to the first information, and sorting according to the matching degree between the face echo signal and the respective alternative information, and displaying the respective alternative information sorted according to the matching degree, the alternative information most matched with the face echo signal is easily arranged at the top, which is beneficial for the user to select quickly, so that the input efficiency of the user can be improved.
As shown in fig. 6, fig. 6 is a block diagram of another information display device shown in the present disclosure according to an exemplary embodiment, on the basis of the foregoing embodiment shown in fig. 5, the transmitting module 51 may include: a promoter module 61 and an emission submodule 62.
A sub-module 61 configured to start a face detection function when the input panel is displayed;
and a transmitting sub-module 62 configured to set a self front setting range as a detection direction and transmit a face detection signal at a set power.
As shown in fig. 7, fig. 7 is a block diagram of another information display device shown in the present disclosure according to an exemplary embodiment, on the basis of the foregoing embodiment shown in fig. 5, the sorting module 53 may include: a first acquisition submodule 71, an extraction submodule 72, a second acquisition submodule 73, a first calculation submodule 74 and a sorting submodule 75.
A first obtaining sub-module 71, configured to obtain each candidate information corresponding to the first information;
an extraction sub-module 72 configured to extract first face feature information from the face echo signal;
a second obtaining sub-module 73 configured to obtain second face feature information corresponding to each candidate information in the setting information base;
a first calculating submodule 74 configured to calculate a matching degree between the first face feature information and second face feature information corresponding to each candidate information;
and the sorting submodule 75 is configured to sort the candidate information according to the calculated matching degrees, and the sorting is performed in a descending order according to the matching degrees.
Wherein the first face feature information includes but is not limited to at least one of the following face feature indexes:
maximum lip opening, minimum lip opening, maximum lip reflection intensity, minimum lip reflection intensity, rate of lip deformation, duration of lip deformation, chin position information, and cheek reflection intensity information.
It can be seen from the above embodiments that, after receiving the first information, the first information may be sorted by using the matching degree between the face echo signal and each of the candidate information, the sorting may be performed in a descending order according to the size of the matching degree, and each of the candidate information after the descending order is displayed for the user to select, so that the sorted candidate information is closer to the exact input information of the user, the user can select quickly, the input satisfaction of the user is improved, and the input efficiency of the user is also improved.
As shown in fig. 8, fig. 8 is a block diagram of another information display device shown in the present disclosure according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 7, and the first calculating sub-module 74 may include: a third acquisition submodule 81, a second calculation submodule 82 and a weighted sum submodule 83.
A third obtaining sub-module 81 configured to obtain a set weight value corresponding to each face feature index if the first face feature information includes at least two face feature indexes;
a second calculating submodule 82 configured to calculate matching degrees between each face feature index in the first face feature information and a face feature index corresponding to each candidate information;
and a weighted summation sub-module 83 configured to perform weighted summation on the respective matching degrees corresponding to the same candidate information obtained by calculation according to the respective set weight values to obtain a matching degree between the first face feature information and the second face feature information corresponding to the candidate information.
As shown in fig. 9, fig. 9 is a block diagram of another information display device shown in the present disclosure according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 5, and the device may further include: and an adjustment module 91.
The adjusting module 91 is configured to, if the first information is received but the face echo signal is not received, adjust the transmitting direction and/or transmitting power of the face detection signal until the face echo signal is received or a preset time period expires, and then stop the adjustment.
As shown in fig. 10, fig. 10 is a block diagram of another information display device shown in the present disclosure according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 5, and the device may further include: the module 101 is shut down.
A closing module 101 configured to close the face detection signal if it is detected that the display screen no longer displays the input panel.
Corresponding to fig. 5, the present disclosure also provides another information display apparatus, which may be applied to a terminal, including:
a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to:
when the input panel is displayed, a human face detection signal is emitted;
receiving first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sequencing each piece of alternative information according to the matching degree, wherein the alternative information is information prompted to be selected by a user;
and displaying each piece of sorted alternative information.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
As shown in fig. 11, fig. 11 is a schematic structural view (terminal side) for an information display apparatus 1100 shown according to an exemplary embodiment of the present disclosure. For example, the apparatus 1100 may be a mobile phone with routing capability, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
Referring to fig. 11, apparatus 1100 may include one or more of the following components: processing component 1102, memory 1104, power component 1106, multimedia component 1108, audio component 1110, input/output (I/O) interface 1112, sensor component 1114, and communications component 1116.
The processing component 1102 generally controls the overall operation of the device 1100, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 1102 may include one or more processors 1120 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 1102 may include one or more modules that facilitate interaction between the processing component 1102 and other components. For example, the processing component 1102 may include a multimedia module to facilitate interaction between the multimedia component 1108 and the processing component 1102.
The memory 1104 is configured to store various types of data to support operations at the apparatus 1100. Examples of such data include instructions for any application or method operating on device 1100, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1104 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
A power component 1106 provides power to the various components of the device 1100. The power components 1106 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 1100.
The multimedia component 1108 includes a screen that provides an output interface between the device 1100 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1108 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1100 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 1110 is configured to output and/or input audio signals. For example, the audio component 1110 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 1100 is in operating modes, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio assembly 1110 further includes a speaker for outputting audio signals.
The I/O interface 1112 provides an interface between the processing component 1102 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 1114 includes one or more sensors for providing various aspects of state assessment for the apparatus 1100. For example, the sensor assembly 1114 may detect an open/closed state of the apparatus 1100, the relative positioning of components, such as a display and keypad of the apparatus 1100, the sensor assembly 1114 may also detect a change in position of the apparatus 1100 or a component of the apparatus 1100, the presence or absence of user contact with the apparatus 1100, orientation or acceleration/deceleration of the apparatus 1100, and a change in temperature of the apparatus 1100. The sensor assembly 1114 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1114 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1114 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, a microwave sensor, or a temperature sensor.
The communication component 1116 is configured to facilitate wired or wireless communication between the apparatus 1100 and other devices. The apparatus 1100 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1116 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1116 also includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 1100 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the following methods:
when the input panel is displayed, a human face detection signal is emitted;
receiving first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sequencing each piece of alternative information according to the matching degree, wherein the alternative information is information prompted to be selected by a user;
and displaying each piece of sorted alternative information.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 1104 comprising instructions, executable by the processor 1120 of the apparatus 1100 to perform the method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (11)

1. An information display method, characterized in that the method comprises:
when the input panel is displayed, a human face detection signal is emitted;
receiving first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sequencing each piece of alternative information according to the matching degree, wherein the alternative information is information prompted to be selected by a user;
displaying each sorted alternative information;
the calculating the matching degree between each piece of alternative information corresponding to the first information and the face echo signal, and sorting each piece of alternative information according to the matching degree includes:
acquiring each alternative information corresponding to the first information;
extracting first face characteristic information from the face echo signal;
acquiring second face feature information corresponding to each alternative information in a set information base;
calculating the matching degree between the first face feature information and second face feature information corresponding to each alternative information;
sorting the alternative information according to the calculated matching degrees, wherein the sorting is performed in a descending order according to the matching degrees;
the calculating the matching degree between the first face feature information and the second face feature information corresponding to each alternative information includes:
if the first face feature information comprises at least two face feature indexes, acquiring a set weight value corresponding to each face feature index;
calculating the matching degree between each face characteristic index in the first face characteristic information and the face characteristic index corresponding to each alternative information;
and carrying out weighted summation on the matching degrees corresponding to the same candidate information obtained by calculation according to the set weight values to obtain the matching degree between the first face feature information and the second face feature information corresponding to the candidate information.
2. The method of claim 1, wherein the emitting a face detection signal while displaying the input panel comprises:
when the input panel is displayed, a face detection function is started;
setting the self front setting range as the detection direction and transmitting the human face detection signal with the set power.
3. The method according to claim 1, wherein the first facial feature information includes but is not limited to at least one of the following facial feature indicators:
maximum lip opening, minimum lip opening, maximum lip reflection intensity, minimum lip reflection intensity, rate of lip deformation, duration of lip deformation, chin position information, and cheek reflection intensity information.
4. The method of claim 1, further comprising:
and if the first information is received but the face echo signal is not received, adjusting the transmitting direction and/or transmitting power of the face detection signal until the face echo signal is received or the preset time period is exhausted, and stopping adjustment.
5. The method of claim 1, further comprising:
and if the fact that the display screen does not display the input panel is detected, closing the human face detection signal.
6. An information display apparatus, characterized in that the apparatus comprises:
a transmitting module configured to transmit a face detection signal when the input panel is displayed;
a receiving module configured to receive first information and a face echo signal, wherein the first information is information input by a user through an input panel, and the face echo signal is an echo signal detected after a face detection signal is transmitted;
the sorting module is configured to calculate matching degrees between each piece of alternative information corresponding to the first information and the face echo signal, and sort each piece of alternative information according to the matching degrees, wherein the alternative information is information prompted to be selected by a user;
the display module is configured to display the sorted alternative information;
the sorting module comprises:
the first obtaining sub-module is configured to obtain each candidate information corresponding to the first information;
an extraction sub-module configured to extract first face feature information from the face echo signal;
the second acquisition sub-module is configured to acquire second face feature information corresponding to each piece of alternative information in the setting information base;
the first calculation sub-module is configured to calculate matching degrees between the first face feature information and second face feature information corresponding to the alternative information;
the sorting submodule is configured to sort the alternative information according to the calculated matching degrees, and the sorting is performed in a descending order according to the matching degrees;
the first computation submodule includes:
a third obtaining sub-module, configured to obtain a set weight value corresponding to each face feature index if the first face feature information includes at least two face feature indexes;
the second calculation submodule is configured to calculate matching degrees between each face feature index in the first face feature information and the face feature index corresponding to each alternative information;
and the weighted summation sub-module is configured to perform weighted summation on the matching degrees corresponding to the same candidate information obtained by calculation according to the set weight values to obtain the matching degree between the first face feature information and the second face feature information corresponding to the candidate information.
7. The apparatus of claim 6, wherein the transmitting module comprises:
a promoter module configured to start a face detection function when the input panel is displayed;
and the transmitting submodule is configured to set the self front setting range as the detection direction and transmit the human face detection signal at the set power.
8. The apparatus of claim 6, wherein the first facial feature information includes but is not limited to at least one of the following facial feature indicators:
maximum lip opening, minimum lip opening, maximum lip reflection intensity, minimum lip reflection intensity, rate of lip deformation, duration of lip deformation, chin position information, and cheek reflection intensity information.
9. The apparatus of claim 6, further comprising:
and the adjusting module is configured to adjust the transmitting direction and/or transmitting power of the face detection signal if the first information is received but the face echo signal is not received, and stop adjusting until the face echo signal is received or a preset time period is exhausted.
10. The apparatus of claim 6, further comprising:
and the closing module is configured to close the human face detection signal if the fact that the display screen does not display the input panel is detected.
11. An information display apparatus, characterized in that the apparatus comprises:
a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to perform the information display method according to any one of claims 1 to 5.
CN201611033650.1A 2016-11-14 2016-11-14 Information display method and device Active CN106572268B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611033650.1A CN106572268B (en) 2016-11-14 2016-11-14 Information display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611033650.1A CN106572268B (en) 2016-11-14 2016-11-14 Information display method and device

Publications (2)

Publication Number Publication Date
CN106572268A CN106572268A (en) 2017-04-19
CN106572268B true CN106572268B (en) 2020-07-03

Family

ID=58542891

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611033650.1A Active CN106572268B (en) 2016-11-14 2016-11-14 Information display method and device

Country Status (1)

Country Link
CN (1) CN106572268B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102522415B1 (en) 2018-05-15 2023-04-17 삼성전자주식회사 Apparatus and method for recognizing object in electronic device
CN109558715A (en) * 2018-10-31 2019-04-02 维沃移动通信有限公司 A kind of terminal device and face identification method
CN110290352A (en) * 2019-06-28 2019-09-27 Oppo广东移动通信有限公司 Monitoring method and device, electronic equipment and storage medium
CN110290353A (en) * 2019-06-28 2019-09-27 Oppo广东移动通信有限公司 Monitoring method and device, electronic equipment and storage medium
CN110610706A (en) * 2019-09-23 2019-12-24 珠海格力电器股份有限公司 Sound signal acquisition method and device, electrical equipment control method and electrical equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101334704A (en) * 2008-06-27 2008-12-31 中国科学院软件研究所 Multichannel Chinese input method facing to mobile equipment
CN101577115A (en) * 2008-05-09 2009-11-11 台达电子工业股份有限公司 Voice input system and voice input method
JP4407494B2 (en) * 2004-11-26 2010-02-03 株式会社日立製作所 Shorthanded character retranslation work support system using digital pen
CN101825953A (en) * 2010-04-06 2010-09-08 朱建政 Chinese character input product with combined voice input and Chinese phonetic alphabet input functions
CN102117115A (en) * 2009-12-31 2011-07-06 上海量科电子科技有限公司 System for realizing text entry selection by using lip-language and realization method thereof
CN103092329A (en) * 2011-10-31 2013-05-08 南开大学 Lip reading technology based lip language input method
CN103678404A (en) * 2012-09-21 2014-03-26 联想(北京)有限公司 Method and electronic device for identifying keyword
CN104217218A (en) * 2014-09-11 2014-12-17 广州市香港科大霍英东研究院 Lip language recognition method and system
CN104808794A (en) * 2015-04-24 2015-07-29 北京旷视科技有限公司 Method and system for inputting lip language

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4407494B2 (en) * 2004-11-26 2010-02-03 株式会社日立製作所 Shorthanded character retranslation work support system using digital pen
CN101577115A (en) * 2008-05-09 2009-11-11 台达电子工业股份有限公司 Voice input system and voice input method
CN101334704A (en) * 2008-06-27 2008-12-31 中国科学院软件研究所 Multichannel Chinese input method facing to mobile equipment
CN102117115A (en) * 2009-12-31 2011-07-06 上海量科电子科技有限公司 System for realizing text entry selection by using lip-language and realization method thereof
CN101825953A (en) * 2010-04-06 2010-09-08 朱建政 Chinese character input product with combined voice input and Chinese phonetic alphabet input functions
CN103092329A (en) * 2011-10-31 2013-05-08 南开大学 Lip reading technology based lip language input method
CN103678404A (en) * 2012-09-21 2014-03-26 联想(北京)有限公司 Method and electronic device for identifying keyword
CN104217218A (en) * 2014-09-11 2014-12-17 广州市香港科大霍英东研究院 Lip language recognition method and system
CN104808794A (en) * 2015-04-24 2015-07-29 北京旷视科技有限公司 Method and system for inputting lip language

Also Published As

Publication number Publication date
CN106572268A (en) 2017-04-19

Similar Documents

Publication Publication Date Title
US20180046336A1 (en) Instant Message Processing Method and Apparatus, and Storage Medium
CN106572268B (en) Information display method and device
CN105517112B (en) Method and device for displaying WiFi network information
US20160342858A1 (en) Method and device for recognizing object
US10379602B2 (en) Method and device for switching environment picture
US10268371B2 (en) Method, device and storage medium for inputting characters
US11335348B2 (en) Input method, device, apparatus, and storage medium
CN107454204B (en) User information labeling method and device
CN107423386B (en) Method and device for generating electronic card
CN106354504B (en) Message display method and device
CN107132769B (en) Intelligent equipment control method and device
JP2017534087A (en) Method and apparatus for setting a threshold
CN110618783B (en) Text broadcasting method, device and medium
CN109862169B (en) Electronic equipment control method, device and storage medium
CN112051949A (en) Content sharing method and device and electronic equipment
CN112434338A (en) Picture sharing method and device, electronic equipment and storage medium
CN112948704A (en) Model training method and device for information recommendation, electronic equipment and medium
US20170034347A1 (en) Method and device for state notification and computer-readable storage medium
US20160349947A1 (en) Method and device for sending message
CN105488074B (en) Photo clustering method and device
CN107734303B (en) Video identification method and device
CN107229707B (en) Method and device for searching image
CN106878654B (en) Video communication method and device
CN106506808B (en) Method and device for prompting communication message
CN106447747B (en) Image processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant