CN103136321A - Method and device of multimedia information processing and mobile terminal - Google Patents
Method and device of multimedia information processing and mobile terminal Download PDFInfo
- Publication number
- CN103136321A CN103136321A CN2012103287589A CN201210328758A CN103136321A CN 103136321 A CN103136321 A CN 103136321A CN 2012103287589 A CN2012103287589 A CN 2012103287589A CN 201210328758 A CN201210328758 A CN 201210328758A CN 103136321 A CN103136321 A CN 103136321A
- Authority
- CN
- China
- Prior art keywords
- information
- user
- facial characteristics
- expression
- multimedia
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a method and a system of multimedia information processing and a mobile terminal. The method of the multimedia information processing includes: obtaining facial feature information of a user; inquiring multimedia information corresponding to the facial feature information; and displaying the facial feature information. Through the method and the system of the multimedia information processing, the problem that multimedia files are not convenient to find for the mobile terminal is solved, and the mobile terminal can carry out fast search on the multimedia files according to the facial feature information of the user.
Description
Technical field
The present invention relates to the terminal field, in particular to a kind of method for processing multimedia information and device and mobile terminal.
Background technology
Photographer often utilizes electronic product at one's side that interested people and thing are taken, fast development along with electronic information technology, except camera, electronic equipment commonly used is such as video camera, all have shoot function with the mobile phone of camera and personal computer etc., with the multimedia information storage of taking in electronic product, in order to often check.
The memory capacity of electronic product is very large, makes photographer can store a large amount of videos and photo, and still, only according to the storage of classifying of the type of multimedia messages, the storage mode underaction has certain limitation to present storage mode.
The user is in storage, when taking these multimedia files, often with certain expression, perhaps there is certain relation in certain mood of these files meetings and user, want to see the e-book of a little amusement and recreation when happy, want when sad to see a little jokes, feel that admiration is excited when seeing the grand scenery of beauty.Existing scheme has been ignored these information, if the user wants to search the multimedia file relevant with certain mood, can only go to go to search by name or content with the memory of oneself.
For the search inconvenient problem of mobile terminal in correlation technique to multimedia file, effective solution is proposed not yet at present.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of method for processing multimedia information and device and mobile terminal, to solve mobile terminal to the inconvenient problem of searching of multimedia file.
To achieve these goals, according to an aspect of the present invention, provide a kind of method for processing multimedia information.This method for processing multimedia information comprises: the facial characteristics information of obtaining the user; Inquire about the multimedia messages corresponding with facial characteristics information; And demonstration multimedia messages.
Further, the inquiry multimedia messages corresponding with facial characteristics information comprises: inquire about the expression information corresponding with facial characteristics information; And the inquiry multimedia messages corresponding with expression information.
Further, this method for processing multimedia information also comprises: after the searching request that receives user's input, and prompting user input feelings information; Receive the expression information of user's input; And the inquiry multimedia messages corresponding with expression information.
Further, the method also comprises: the prompting user carries out related to expression information with facial characteristics information; Receive the expression information of user's input and the related information of facial characteristics information; And the expression information of preservation user input and the incidence relation of facial characteristics information.
Further, the facial characteristics information of obtaining the user comprises: judge that whether the user is in the view multimedia documents list; During in the view multimedia documents list, obtain user's facial characteristics information definite user, show that multimedia messages comprises: show the list of the multimedia messages corresponding with facial characteristics information.
Further, the method also comprises: judge whether to inquire the multimedia messages corresponding with facial characteristics information; In the time can't inquiring the multimedia messages corresponding with facial characteristics information, the prompting user inputs new multimedia messages; Receive the new multimedia messages of user's input; Set up the corresponding relation of new multimedia messages and facial characteristics information; And preservation corresponding relation.
Further, the inquiry multimedia messages corresponding with facial characteristics information comprises: inquire about the expression information corresponding with facial characteristics information; And, inquire about the multimedia messages corresponding with expression information, the method also comprises: judge whether to inquire the expression information corresponding with facial characteristics information; In the time can't inquiring the expression information corresponding with facial characteristics information, the prompting user inputs new expression information; Receive the new expression information of user's input; Set up the corresponding relation of new expression information and facial characteristics information; Judge whether to exist the multimedia messages corresponding with new expression information; When determining not have the multimedia messages corresponding with new expression information, the prompting user inputs new multimedia messages; Receive the new multimedia messages of user's input; Set up the corresponding relation of new multimedia messages and new expression information; And preservation corresponding relation.
Further, the facial characteristics information of obtaining the user comprises: the face-image that obtains the user; Face-image and the facial characteristics template that prestores are analyzed; And with information corresponding with the immediate facial characteristics template of face-image in the facial characteristics template that prestores as facial characteristics information.
To achieve these goals, according to a further aspect in the invention, provide a kind of device for processing muti-medium information.This device for processing muti-medium information comprises: acquiring unit, for the facial characteristics information of obtaining the user; Query unit is used for the inquiry multimedia messages corresponding with facial characteristics information; And display unit, be used for showing multimedia messages.
Further, query unit comprises: the first query unit is used for the inquiry expression information corresponding with facial characteristics information; And second query unit, be used for the inquiry multimedia messages corresponding with expression information.
Further, this device also comprises: judging unit is used for judging whether to inquire the multimedia messages corresponding with facial characteristics information; Tip element is used in the time can't inquiring the multimedia messages corresponding with facial characteristics information, and the prompting user inputs new multimedia messages; Receiving element is used for receiving the new multimedia messages that the user inputs; Set up the unit, be used for setting up the corresponding relation of new multimedia messages and facial characteristics information; And storage unit, be used for preserving corresponding relation.
Further, query unit comprises: the first query unit is used for the inquiry expression information corresponding with facial characteristics information; And second query unit, being used for the inquiry multimedia messages corresponding with expression information, device for processing muti-medium information also comprises: the first judging unit, for judging whether to inquire the expression information corresponding with facial characteristics information; The first Tip element is used in the time can't inquiring the expression information corresponding with facial characteristics information, and the prompting user inputs new expression information; The first receiving element is used for receiving the new expression information that the user inputs; First sets up the unit, is used for setting up the corresponding relation of new expression information and facial characteristics information; The first storage unit is used for preserving the corresponding relation of new expression information and facial characteristics information; The second judging unit is used for judging whether to exist the multimedia messages corresponding with new expression information; The second Tip element is used for when determining not have the multimedia messages corresponding with new expression information, and the prompting user inputs new multimedia messages; The second receiving element is used for receiving the new multimedia messages that the user inputs; Second sets up the unit, is used for setting up the corresponding relation of new multimedia messages and new expression information; And second storage unit, be used for preserving corresponding relation.
Further, acquiring unit comprises: acquisition module, for the face-image that obtains the user; Analysis module is used for face-image and the facial characteristics template that prestores are analyzed; And determination module, be used for the information that the facial characteristics template that prestores is corresponding with the immediate facial characteristics template of face-image as facial characteristics information.
To achieve these goals, according to a further aspect in the invention, provide a kind of mobile terminal, it is characterized in that, this mobile terminal comprises any one device for processing muti-medium information provided by the invention.
By the present invention, solved mobile terminal to the inconvenient problem of searching of multimedia file, and then reached and make the mobile terminal according to the effect of user's facial characteristics information to the multimedia file fast finding.
Description of drawings
The accompanying drawing that consists of the application's a part is used to provide a further understanding of the present invention, and illustrative examples of the present invention and explanation thereof are used for explaining the present invention, do not consist of improper restriction of the present invention.In the accompanying drawings:
Fig. 1 is the schematic diagram according to the device for processing muti-medium information of the embodiment of the present invention;
Fig. 2 is the schematic diagram according to the device for processing muti-medium information of first preferred embodiment of the invention;
Fig. 3 is the schematic diagram according to the device for processing muti-medium information of second preferred embodiment of the invention;
Fig. 4 is the schematic diagram according to the device for processing muti-medium information of third preferred embodiment of the invention;
Fig. 5 is the schematic diagram according to the device for processing muti-medium information of four preferred embodiment of the invention;
Fig. 6 is the process flow diagram according to the method for processing multimedia information of the embodiment of the present invention;
Fig. 7 is the process flow diagram according to the first preferred embodiment of method for processing multimedia information of the present invention; And
Fig. 8 is the process flow diagram according to the second preferred embodiment of method for processing multimedia information of the present invention.
Embodiment
Need to prove, in the situation that do not conflict, embodiment and the feature in embodiment in the application can make up mutually.Describe below with reference to the accompanying drawings and in conjunction with the embodiments the present invention in detail.
The embodiment of the present invention provides a kind of device for processing muti-medium information, and this device for processing muti-medium information can be mobile terminal, perhaps as the part of mobile terminal.
Fig. 1 is the schematic diagram according to the device for processing muti-medium information of the embodiment of the present invention.As shown in Figure 1, this device for processing muti-medium information comprises acquiring unit 10, query unit 20, display unit 30.
Acquiring unit 10 is used for obtaining user's facial characteristics information, for example, obtains user's facial characteristics information by being arranged on camera on mobile terminal.
Query unit 20 is used for the inquiry multimedia messages corresponding with facial characteristics information, wherein, can be provided with the different facial characteristics information multimedia messages of correspondence respectively in mobile terminal.
Display unit 30 is used for the multimedia messages that demonstration query unit 20 inquires.
Fig. 2 is the schematic diagram according to the device for processing muti-medium information of first preferred embodiment of the invention.This device for processing muti-medium information also comprises acquiring unit 10, query unit 20, display unit 30.Acquiring unit 10 comprises again the first query unit 201 and the second query unit 202.
The first query unit 201 is used for the inquiry expression information corresponding with facial characteristics information.
The second query unit 202 is used for the inquiry multimedia messages corresponding with expression information.
Acquiring unit 10 can obtain user's facial characteristics information by the expression monitoring modular, inquiry facial characteristics information is obtained corresponding with it expression information with the mapping table of expression, inquiry expression multimedia file mapping table obtains the multimedia messages with the expression information coupling.When obtaining user's facial characteristics information, can make the facial eye position information of user, the eye shape information obtained; Obtain the facial face positional information of user, face shape information; Obtain the facial face positional information of user and face shape information.
In mobile terminal, expression information corresponding to facial characteristics information can be set first, and then multimedia messages corresponding to expression information, like this is set, can be so that the user when terminal is further arranged, carries out self-defined more easily.
The user often is with espressiove on the face, such as happy, sad, excited etc., profile and shape in positions such as eyes, face, faces are understood some difference, by the device for processing muti-medium information that the embodiment of the present invention provides, distinguish with judging which type of expression the user is now from these.Obtain corresponding multimedia messages by the expression of determining, thereby can so that the user reduces input, omit even user's input fully.
Preferably, after the searching request that receives user's input, device for processing muti-medium information prompting user input feelings information.In the user gave process that information operates, device for processing muti-medium information received the expression information of user's input, then the inquiry multimedia messages corresponding with described expression information.Thereby improved the recall precision of user on multimedia information, and a kind of brand-new retrieval mode is provided.When user search, the user can input particular emotion information and search for, in order to find the user specifying all relevant multimedia messagess of expression; The user also can directly open face recognition function, automatic program identification user's expression, and search for the relevant multimedia messages of this expression, and obtain the multimedia file list, be shown to the user, and begin to play.
Fig. 3 is the schematic diagram according to the device for processing muti-medium information of second preferred embodiment of the invention.This device for processing muti-medium information also comprises judging unit 40, Tip element 50, receiving element 60, sets up unit 70 and storage unit 80 except comprising acquiring unit 10, query unit 20, display unit 30.
Judging unit 40 is used for judging whether to inquire the multimedia messages corresponding with facial characteristics information.
Tip element 50 is used in the time can't inquiring the multimedia messages corresponding with facial characteristics information, and the prompting user inputs new multimedia messages.That is, the guiding user carries out more Extraordinary setting.
Receiving element 60 is used for receiving the new multimedia messages of user's input.
Set up the corresponding relation that unit 70 is used for setting up new multimedia messages and facial characteristics information.
Storage unit 80 is used for preserving corresponding relation.
Fig. 4 is the schematic diagram according to the device for processing muti-medium information of third preferred embodiment of the invention.This device for processing muti-medium information comprises that also the first judging unit 401, the first Tip element 501, the first receiving element 601, first are set up unit 701 and the first storage unit 801 and the second judging unit 402, the second Tip element 502, the second receiving element 602, second is set up unit 702 and the second storage unit 802 except comprising acquiring unit 10, query unit 20, display unit 30.Wherein, query unit 20 comprises the first query unit 201 and the second query unit 202.
The first query unit 201 is used for the inquiry expression information corresponding with facial characteristics information.
The second query unit 202 is used for the inquiry multimedia messages corresponding with expression information.
The first judging unit 401 is used for judging whether to inquire the expression information corresponding with facial characteristics information.
The first Tip element 501 is used in the time can't inquiring the expression information corresponding with facial characteristics information, and the prompting user inputs new expression information.
The first receiving element 601 is used for receiving the new expression information of user's input.
First sets up the corresponding relation that unit 701 is used for setting up new expression information and facial characteristics information.
The first storage unit 801 is used for preserving the corresponding relation of new expression information and facial characteristics information.
The second judging unit 402 is used for judging whether to exist the multimedia messages corresponding with new expression information.
The second Tip element 502 is used for when determining not have the multimedia messages corresponding with new expression information, and the prompting user inputs new multimedia messages.
The second receiving element 602 is used for receiving the new multimedia messages of user's input.
Second sets up the corresponding relation that unit 702 is used for setting up new multimedia messages and new expression information.And
The second storage unit 802 is used for preserving corresponding relation.
Need to prove, the first judging unit 401 can be to judge when the first query unit 201 is carried out inquiry, can be also to judge in the facial characteristics information that acquiring unit 10 gets.
By this embodiment, can guide the user to define expression, the expression multimedia messages corresponding with mapping relations, the expression of facial characteristics, and guiding user oneself definition expression, such as happy, sad, excited, for each expression is distributed a unique ID, and the guiding user typing facial characteristics information corresponding with expression.
The definition of user's mood and identification have a lot of complicacy and otherness, have very big-difference between the performance that different people may be facial and actual mood.This programme is processed and the biostatistics principle by fusion calculation machine image, allows the corresponding relation between user oneself definition expression and facial characteristics information, improves the discrimination of individual character expression.Allow simultaneously the user that facial characteristics information corresponding to these expressions is set, such as allow the user when the definition expression by camera extracts the user when the characteristic information of front face as the foundation of identifying this expression.
In embodiments of the present invention, can identify in the following manner user's expression:
Mode one: automatic identifying schemes
In this scheme, after getting user's facial characteristics information, go out user's expression for user's facial characteristics information Auto-matching.
Mode two: self-defined identifying schemes
Different people may have same facial characteristics, but mood may be different.So allow the corresponding relation of user oneself definition expression and facial characteristics.Such as expression of oneself definition, name can arbitrarily be got, and then obtains the face-image of oneself by camera, and program is obtained the profile information of eyes, face, face etc. from image, this specific profile information and this expression are associated.Occur and during face-image that these contour feature information are complementary, think that namely user's face is this expression when the user is facial.
Main two implications of the permission here: allow user oneself to give a name to expression, not necessarily popular happiness, happy and so on; Allow the incidence relation between user oneself definition expression and facial characteristics.
Particularly, this scheme can realize in the following manner:
Receive the self-defined expression information of user's input;
Receive the user to the incidence relation between this self-defined expression information and facial characteristics information;
Preserve described incidence relation.
Like this, follow-up facial characteristic information is identified and when mating, can be mated and obtain the self-defined expression information corresponding with this facial characteristics information.
Then, can guide the user to expression, corresponding multimedia messages to be set.
Fig. 5 is the schematic diagram according to the device for processing muti-medium information of four preferred embodiment of the invention.This device for processing muti-medium information comprises acquiring unit 10, query unit 20, display unit 30, and wherein, acquiring unit 10 comprises again acquisition module 101, analysis module 102 and determination module 103.
Acquisition module 101 is used for obtaining user's face-image.
Analysis module 102 is used for face-image and the facial characteristics template that prestores are analyzed.
Determination module 103 is used for the information that the facial characteristics template that prestores is corresponding with the immediate facial characteristics template of face-image as facial characteristics information.
The user facial characteristics information of the described device for processing muti-medium information of the present embodiment by obtaining, obtain the expression with described facial characteristics information matches, inquire about corresponding with it multimedia messages according to expression, and can automatically generate the list that comprises described multimedia messages; Can solve existing method for processing multimedia information and can't according to the problem of the automatic processing of user's current status, automatically show the multimedia messages relevant to this expression of user preset by identification user's expression.
The device for processing muti-medium information that provides corresponding to the embodiment of the present invention, the embodiment of the present invention also provides a kind of method for processing multimedia information, the method for processing multimedia information of the embodiment of the present invention can be carried out based on the device for processing muti-medium information that the embodiment of the present invention provides, and the device for processing muti-medium information that the embodiment of the present invention provides also can be used for carrying out the method for processing multimedia information that the embodiment of the present invention provides.
Fig. 6 is the process flow diagram according to the method for processing multimedia information of the embodiment of the present invention.As shown in Figure 6, this method for processing multimedia information is characterized in that, comprising:
Step S602 obtains user's facial characteristics information.
When obtaining user's facial characteristics information, the information that acquisition for mobile terminal can be arrived also can get facial characteristics information in the following manner directly as facial characteristics information:
Obtain user's face-image;
Face-image and the facial characteristics template that prestores are analyzed; And
With information corresponding with the immediate facial characteristics template of face-image in the facial characteristics template that prestores as facial characteristics information.
When obtaining user's facial characteristics information, whether can first judge the user in the view multimedia documents list, definite user during in the view multimedia documents list, then obtain user's facial characteristics information, like this, can avoid in the situation that unnecessary obtaining facial characteristic information.
Step S604 inquires about the multimedia messages corresponding with facial characteristics information.
When inquiring about the multimedia messages corresponding with facial characteristics information, can be direct based on the facial characteristics information inquiry multimedia messages corresponding with it, can be also first to inquire about the expression information corresponding with facial characteristics information; Then inquire about the multimedia messages corresponding with expression information.As shown in Figure 7, show the process flow diagram of inquiring about in this kind situation.
When inquiring about the expression information corresponding with facial characteristics information, can be by inquiring about the first mapping table to obtain the expression information corresponding with facial characteristics information, wherein, the first mapping table is the mapping relations table of facial characteristics information and expression information.
When inquiring about the multimedia messages corresponding with expression information, can be by inquiring about the second mapping table to obtain the multimedia messages corresponding with expression information, wherein, the second mapping table is the mapping relations table of expression information and multimedia messages.
For expression inquiry: expression and the facial characteristics mapping relations table can search subscriber preserved, adopt existing face recognition technology (such as the regional characteristics analysis algorithm) to mate, utilize built skin detection and the user's facial characteristics information that gets to carry out signature analysis, provide a similar value according to the result of analyzing, can determine whether to be user-defined certain expression by this value.
For multi-medium file search: can obtain the ID of this expression according to the result of expression inquiry, by the mapping relations of middle expression and multimedia file are set, inquire about multimedia messages corresponding to this expression.
Step S606 shows the multimedia messages that inquires.
The multimedia messages at this place can be the title of the multimedia file that inquires, can be also the details of the multimedia file that inquires, or the list of a plurality of multimedia files.In this list, the multimedia file that inquires can be arranged in the foremost of all multimedia files.Preferably, show that described multimedia messages comprises: show the list of the multimedia messages corresponding with described facial characteristics information.Present by the mode with list, can be so that the user presents with mode classification the multimedia messages under current mood.
Preferably, can also comprise in order to make the user to carry out self-defined, above-mentioned method to multimedia messages in mobile terminal etc.:
Judge whether to inquire the multimedia messages corresponding with facial characteristics information.
In the time can't inquiring the multimedia messages corresponding with facial characteristics information, the prompting user inputs new multimedia messages.
Receive the new multimedia messages of user's input.
Set up the corresponding relation of new multimedia messages and facial characteristics information.
Preserve corresponding relation.
The prompting user, the multimedia messages in mobile terminal is carried out also can adopting such method when self-defined:
At first, the prompting user carries out related to expression information with facial characteristics information.
Then, receive the expression information of user's input and the related information of facial characteristics information.
At last, preserve the expression information of user's input and the incidence relation of facial characteristics information.
Like this, when get the expression information of facial characteristics information association of user and input next time, just can inquire corresponding expression information according to the incidence relation (being also corresponding relation) of preserving, then inquire again corresponding multimedia messages.
Further preferably, when comprising, step S604 inquires about the expression information corresponding with facial characteristics information; And when inquiring about the multimedia messages corresponding with expression information, above-mentioned method can also comprise:
Judge whether to inquire the expression information corresponding with facial characteristics information.
In the time can't inquiring the expression information corresponding with facial characteristics information, the prompting user inputs new expression information.
Receive the new expression information of user's input.
Set up the corresponding relation of new expression information and facial characteristics information.
Judge whether to exist the multimedia messages corresponding with new expression information.
When determining not have the multimedia messages corresponding with new expression information, the prompting user inputs new multimedia messages.
Receive the new multimedia messages of user's input.
Set up the corresponding relation of new multimedia messages and new expression information.
Preserve corresponding relation.
For example, as shown in Figure 8, show the guiding user to carrying out self-defining flow process.
For example, the device for processing muti-medium information or the mobile terminal that utilize the embodiment of the present invention to provide are received incoming call when the user is angry, directly hang up.System obtains the facial characteristics information such as the facial eye position information of user, eye shape information, face positional information, face shape information, face positional information, face shape information by camera when the user hangs up the telephone; According to the mapping relations of default user's facial characteristics information and user's expression, determine the user expression corresponding with described user's facial characteristics information; Inquiry obtains the user preset multimedia messages corresponding with this expression, then automatically the multimedia messages that inquires is play.
Except the above-mentioned prompting user who mentions carries out self-defining guiding the multimedia messages in mobile terminal, can also define expression information by the guiding user, the related information between expression and facial characteristics information is set, the clooating sequence of expression is set.
Guiding user-association expression and multimedia file can automatically be identified user's expression, and also be kept at the incidence relation of expression information and multimedia messages in database; Perhaps allow the user that the expression of multimedia file association manually is set, at this moment, receive the user to the related setting of certain multimedia file with expression, then, preserve the multimedia messages of setting and the incidence relation between expression information.
When the list of user's view multimedia documents, automatic acquisition is user's facial characteristics information this moment, expression according to the related information identification user of the expression of user preset and facial characteristics information, search for the relevant multimedia messages of this expression, generate the multimedia file list, be shown to the user, and begin to play.
When user search, the user can input particular emotion information and search for, in order to find the user specifying all relevant multimedia messagess of expression; The user also can directly open face recognition function, automatic program identification user's expression, and search for the relevant multimedia messages of this expression, and generate the multimedia file list, be shown to the user, and begin to play.
By the method for processing multimedia information of the embodiment of the present invention, when the list of user's view multimedia documents, obtaining current expression, and relevant multimedia messages of this expression of search subscriber setting, automatically generate the multimedia file list, and begin to play.
In the method for processing multimedia information of the embodiment of the present invention, when the user search song, prompting user input feelings information, that is, the prompting user can search for by expression, and it is selective to list the expression of all user adds.After the user selected, search arranged the expression of middle preservation and the mapping relations of multimedia file, and coupling expression information wherein is shown to the user to all multimedia messagess that meet customer requirements.
The method for processing multimedia information of the embodiment of the present invention also can provide a kind of automatic identification model, under this pattern, automatically identify the current expression of user, after the identification expression, automatic search arranges the expression of middle preservation and the mapping relations of multimedia file, coupling expression information wherein is shown to the user to all multimedia messagess that meet customer requirements.
As an optional embodiment of the present invention, can obtain user's expression information when preserving multimedia file, and the information of related this expression information and this multimedia file, and preserve this incidence relation; Perhaps, when preserving multimedia file, then the prompting user input expression information relevant to this multimedia file, preserve the incidence relation of this multimedia file and this expression information.
As another optional embodiment of the present invention, when the list of user's view multimedia documents, obtain the expression that the user checks certain multimedia file, and preserve the information of this multimedia file and expression information and the incidence relation thereof that the user checks this multimedia file, and show the multimedia file list by the clooating sequence that the user arranges, such as the preposition demonstration of multimedia file that current expression is correlated with, and the sortord sequencing display of every other multimedia file by user's setting.
When the user search multimedia file, the prompting user searches for by expression, and it is selective to list the expression of all user adds.The user searches for the multimedia file that all have been preserved after selecting, and the expression information in the coupling multimedia file is shown to the user to all multimedia files that meet customer requirements.
The user also can select automatically to identify current expression, at this moment, automatically identifies user's expression, then automatic search be associated with the expression of identification all preserved in multimedia file multimedia file with the expression coupling of identification, and be shown to the user.
During the method for processing multimedia information of the embodiment of the present invention can be applied to searching of a plurality of multimedia files and classifies.The device for processing muti-medium information of the embodiment of the present invention can be for storing the equipment of a plurality of multimedia files, mobile phone for example, and this device for processing muti-medium information also can for having the equipment of multi-media player function, have the equipment of shoot function.When the user uses this equipment view multimedia documents list, obtain user's facial characteristics information, wherein, the expression sign is in order to the identifying user expression information, expression information is the characteristic information of user's face during for certain mood, comprises the information such as eyes, face, face profile; Equipment is determined the multimedia file list corresponding with expression according to the characteristic information that prestores with the mapping relations of multimedia file list, obtain multimedia messages corresponding to this expression sign that the user arranges, and show the multimedia file list by expression search or sequence, and show the multimedia messages in the multimedia file list.Method for processing multimedia information and the equipment that stores a plurality of multimedia messagess by related expression provided by the invention, make the multimedia messages that the equipment that stores a plurality of multimedia messagess is play to realize the variation of mood and automatically switch, make the user can find fast maximally related multimedia messages under particular emotion, improve user's Experience Degree and the friendly of equipment.
For the equipment with shoot function, when the user uses shoot function to preserve multimedia file, automatic acquisition is user's facial characteristics information this moment, expression according to the related information identification user of the expression of user preset and facial characteristics information, when preserving multimedia file, preserve simultaneously the mapping relations of multimedia file and expression.
The method for processing multimedia information that the embodiment of the present invention provides and device, mobile terminal, the variation of expressing one's feelings by monitor user ', automatically generate the multimedia messages relevant to expression that the user arranges, solved existing method for processing multimedia information and had the slow and inefficient problem of multimedia messages formation speed.
In the mobile terminal that the embodiment of the present invention provides, can define expression, the expression multimedia messages corresponding with mapping relations, the expression of facial characteristics by the module booting user is set, obtain user's facial characteristics information by monitoring modular, inquiry facial characteristics information is obtained corresponding with it expression information with the mapping table of expression, inquiry expression multimedia messages mapping table, obtain the multimedia messages with the expression information coupling, and pass through the multimedia messages generation module according to described multimedia messages, generate the multimedia content that comprises described multimedia messages.
obviously, those skilled in the art should be understood that, above-mentioned each module of the present invention or each step can realize with general calculation element, they can concentrate on single calculation element, perhaps be distributed on the network that a plurality of calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in memory storage and be carried out by calculation element, perhaps they are made into respectively each integrated circuit modules, perhaps a plurality of modules in them or step being made into the single integrated circuit module realizes.Like this, the present invention is not restricted to any specific hardware and software combination.
The above is only the preferred embodiments of the present invention, is not limited to the present invention, and for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (10)
1. a method for processing multimedia information, is characterized in that, comprising:
Obtain user's facial characteristics information;
Inquire about the multimedia messages corresponding with described facial characteristics information; And
Show described multimedia messages.
2. method for processing multimedia information according to claim 1, is characterized in that, inquires about the multimedia messages corresponding with described facial characteristics information and comprise:
Inquire about the expression information corresponding with described facial characteristics information; And
Inquire about the multimedia messages corresponding with described expression information.
3. method for processing multimedia information according to claim 2, is characterized in that, described method also comprises:
After the searching request that receives user's input, prompting user input feelings information;
Receive the expression information of user's input; And
Inquire about the multimedia messages corresponding with described expression information.
4. method for processing multimedia information according to claim 1, is characterized in that, described method also comprises:
The prompting user carries out related to expression information with facial characteristics information;
Receive the expression information of user's input and the related information of facial characteristics information; And
Preserve the expression information of user's input and the incidence relation of facial characteristics information.
5. method for processing multimedia information according to claim 1, is characterized in that,
The facial characteristics information of obtaining the user comprises: judge that whether the user is in the view multimedia documents list; When checking described multimedia file list, obtain user's facial characteristics information definite user,
Show that described multimedia messages comprises: show the list of the multimedia messages corresponding with described facial characteristics information.
6. method for processing multimedia information according to claim 1, is characterized in that, described method also comprises:
Judge whether to inquire the multimedia messages corresponding with described facial characteristics information;
In the time can't inquiring the multimedia messages corresponding with described facial characteristics information, the prompting user inputs new multimedia messages;
Receive the new multimedia messages of user's input;
Set up the corresponding relation of described new multimedia messages and described facial characteristics information; And
Preserve described corresponding relation.
7. method for processing multimedia information according to claim 1, is characterized in that,
Inquiring about the multimedia messages corresponding with described facial characteristics information comprises:
Inquire about the expression information corresponding with described facial characteristics information; And,
Inquire about the multimedia messages corresponding with described expression information,
Described method also comprises:
Judge whether to inquire the expression information corresponding with described facial characteristics information;
In the time can't inquiring the expression information corresponding with described facial characteristics information, the prompting user inputs new expression information;
Receive the new expression information of user's input;
Set up the corresponding relation of described new expression information and described facial characteristics information;
Judge whether to exist the multimedia messages corresponding with described new expression information;
When determining not have the multimedia messages corresponding with described new expression information, the prompting user inputs new multimedia messages;
Receive the new multimedia messages of user's input;
Set up the corresponding relation of described new multimedia messages and described new expression information; And
Preserve described corresponding relation.
8. method for processing multimedia information according to claim 1, is characterized in that, the facial characteristics information of obtaining the user comprises:
Obtain user's face-image;
Described face-image and the facial characteristics template that prestores are analyzed; And
With information corresponding with the immediate facial characteristics template of described face-image in the described facial characteristics template that prestores as described facial characteristics information.
9. a device for processing muti-medium information, is characterized in that, comprising:
Acquiring unit is for the facial characteristics information of obtaining the user;
Query unit is used for the inquiry multimedia messages corresponding with described facial characteristics information; And
Display unit is used for showing described multimedia messages.
10. a mobile terminal, is characterized in that, comprises device for processing muti-medium information claimed in claim 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103287589A CN103136321A (en) | 2012-09-06 | 2012-09-06 | Method and device of multimedia information processing and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012103287589A CN103136321A (en) | 2012-09-06 | 2012-09-06 | Method and device of multimedia information processing and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103136321A true CN103136321A (en) | 2013-06-05 |
Family
ID=48496151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012103287589A Pending CN103136321A (en) | 2012-09-06 | 2012-09-06 | Method and device of multimedia information processing and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103136321A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103473040A (en) * | 2013-07-08 | 2013-12-25 | 北京百纳威尔科技有限公司 | Multimedia playing method and device |
| CN103530313A (en) * | 2013-07-08 | 2014-01-22 | 北京百纳威尔科技有限公司 | Searching method and device of application information |
| CN103700151A (en) * | 2013-12-20 | 2014-04-02 | 天津大学 | Morning run check-in method |
| CN105023591A (en) * | 2015-06-30 | 2015-11-04 | 广东欧珀移动通信有限公司 | Audio playing method and system, and user terminal |
| CN105095274A (en) * | 2014-05-09 | 2015-11-25 | 联想移动通信软件（武汉）有限公司 | Data retrieval method and apparatus and a terminal |
| CN105339926A (en) * | 2013-08-06 | 2016-02-17 | 英特尔公司 | Emotion-related query processing |
| CN105574478A (en) * | 2015-05-28 | 2016-05-11 | 宇龙计算机通信科技(深圳)有限公司 | Information processing method and apparatus |
| CN106156708A (en) * | 2015-04-15 | 2016-11-23 | 北京赛伯传奇科技有限公司 | Precise image identification system |
| CN106325501A (en) * | 2016-08-10 | 2017-01-11 | 合肥泰壤信息科技有限公司 | Game control method and system based on facial expression recognition technology |
| CN106341307A (en) * | 2016-08-31 | 2017-01-18 | 乐视控股（北京）有限公司 | Information processing method, sever, client and system |
| CN106792014A (en) * | 2016-11-25 | 2017-05-31 | 广州酷狗计算机科技有限公司 | A kind of method of recommendation of audio, apparatus and system |
| CN107804590A (en) * | 2017-10-26 | 2018-03-16 | 台山市彼思捷礼品有限公司 | One kind classification bonbon box |
| CN111652014A (en) * | 2019-03-15 | 2020-09-11 | 上海铼锶信息技术有限公司 | Eye spirit identification method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005238422A (en) * | 2004-02-27 | 2005-09-08 | Sony Corp | Robot device, its state transition model construction method and behavior control method |
| CN101836219A (en) * | 2007-11-01 | 2010-09-15 | 索尼爱立信移动通讯有限公司 | Generating music playlist based on facial expression |
| CN102541259A (en) * | 2011-12-26 | 2012-07-04 | 鸿富锦精密工业（深圳）有限公司 | Electronic equipment and method for same to provide mood service according to facial expression |
| CN102566740A (en) * | 2010-12-16 | 2012-07-11 | 富泰华工业（深圳）有限公司 | Electronic device with emotion recognition function, and output control method of such electronic device |
-
2012
- 2012-09-06 CN CN2012103287589A patent/CN103136321A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005238422A (en) * | 2004-02-27 | 2005-09-08 | Sony Corp | Robot device, its state transition model construction method and behavior control method |
| CN101836219A (en) * | 2007-11-01 | 2010-09-15 | 索尼爱立信移动通讯有限公司 | Generating music playlist based on facial expression |
| CN102566740A (en) * | 2010-12-16 | 2012-07-11 | 富泰华工业（深圳）有限公司 | Electronic device with emotion recognition function, and output control method of such electronic device |
| CN102541259A (en) * | 2011-12-26 | 2012-07-04 | 鸿富锦精密工业（深圳）有限公司 | Electronic equipment and method for same to provide mood service according to facial expression |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103530313A (en) * | 2013-07-08 | 2014-01-22 | 北京百纳威尔科技有限公司 | Searching method and device of application information |
| CN103473040A (en) * | 2013-07-08 | 2013-12-25 | 北京百纳威尔科技有限公司 | Multimedia playing method and device |
| CN105339926A (en) * | 2013-08-06 | 2016-02-17 | 英特尔公司 | Emotion-related query processing |
| CN103700151A (en) * | 2013-12-20 | 2014-04-02 | 天津大学 | Morning run check-in method |
| CN105095274A (en) * | 2014-05-09 | 2015-11-25 | 联想移动通信软件（武汉）有限公司 | Data retrieval method and apparatus and a terminal |
| CN106156708A (en) * | 2015-04-15 | 2016-11-23 | 北京赛伯传奇科技有限公司 | Precise image identification system |
| CN105574478A (en) * | 2015-05-28 | 2016-05-11 | 宇龙计算机通信科技(深圳)有限公司 | Information processing method and apparatus |
| CN105023591A (en) * | 2015-06-30 | 2015-11-04 | 广东欧珀移动通信有限公司 | Audio playing method and system, and user terminal |
| CN105023591B (en) * | 2015-06-30 | 2018-03-02 | 广东欧珀移动通信有限公司 | A kind of audio frequency playing method and system, user terminal |
| CN106325501A (en) * | 2016-08-10 | 2017-01-11 | 合肥泰壤信息科技有限公司 | Game control method and system based on facial expression recognition technology |
| CN106341307A (en) * | 2016-08-31 | 2017-01-18 | 乐视控股（北京）有限公司 | Information processing method, sever, client and system |
| CN106792014A (en) * | 2016-11-25 | 2017-05-31 | 广州酷狗计算机科技有限公司 | A kind of method of recommendation of audio, apparatus and system |
| CN106792014B (en) * | 2016-11-25 | 2019-02-26 | 广州酷狗计算机科技有限公司 | A kind of method, apparatus and system of recommendation of audio |
| CN107804590A (en) * | 2017-10-26 | 2018-03-16 | 台山市彼思捷礼品有限公司 | One kind classification bonbon box |
| CN111652014A (en) * | 2019-03-15 | 2020-09-11 | 上海铼锶信息技术有限公司 | Eye spirit identification method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103136321A (en) | Method and device of multimedia information processing and mobile terminal | |
| CN104615769B (en) | Picture classification method and device | |
| CN109816441B (en) | Policy pushing method, system and related device | |
| CN106126687A (en) | Recommendation method, device, terminal and the server of interface subject | |
| CN104820675A (en) | Photo album displaying method and device | |
| CN102880388A (en) | Music processing method, music processing device and mobile terminal | |
| CN106250553A (en) | A kind of service recommendation method and terminal | |
| CN105472583B (en) | Message treatment method and device | |
| CN106355429A (en) | Image material recommendation method and device | |
| CN110266879A (en) | Broadcast interface display methods, device, terminal and storage medium | |
| CN105302315A (en) | Image processing method and device | |
| CN109918669A (en) | Entity determines method, apparatus and storage medium | |
| CN105404878A (en) | Photo classification method and apparatus | |
| CN108038102A (en) | Recommendation method, apparatus, terminal and the storage medium of facial expression image | |
| CN106789551B (en) | Conversation message methods of exhibiting and device | |
| CN102905233A (en) | Method and device for recommending terminal function | |
| CN104951443A (en) | Wallpaper downloading method, wallpaper uploading method, server and terminal | |
| US9380257B2 (en) | Portable electronic equipment and method of recording media using a portable electronic equipment | |
| CN106407358B (en) | Image searching method and device and mobile terminal | |
| CN103139348A (en) | Method and device for linkman information processing and mobile terminal | |
| CN106777016B (en) | Method and device for information recommendation based on instant messaging | |
| CN102955569A (en) | Method and device for text input | |
| CN106128440A (en) | A kind of lyrics display processing method, device, terminal unit and system | |
| CN105335714A (en) | Photograph processing method, device and apparatus | |
| CN106547850A (en) | Expression annotation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130605 |