CN103823898A

CN103823898A - Data processing method, device and electronic equipment

Info

Publication number: CN103823898A
Application number: CN201410096003.XA
Authority: CN
Inventors: 付旭松; 秦丽君; 李斌
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2014-03-14
Filing date: 2014-03-14
Publication date: 2014-05-28

Abstract

The embodiment of the invention provides a data processing method, device and electronic equipment. The data processing method includes the first step of collecting first selection movements of a first operating body to obtain a first multimedia selected in the first operating body, the second step of obtaining first feature information of a first object from the first multimedia, wherein the first feature information is used for recognizing whether a multimedia to be matched includes the first object, the third step of obtaining second feature information of a second object, and the fourth step of carrying out feature matching on the multimedia to be matched in order to obtain a target multimedia according to the first feature information and the second feature information. The data processing method can be used for matching to obtain the matched target multimedia according to the first feature information and the second feature information, and the combination of the first feature information and the second feature information can accord with user intentions better than single information, so the target multimedia obtained based on matching of the first feature information and the second feature information can accord with the user intentions better compared with a target multimedia obtained based on single information matching, and search accuracy can be improved.

Description

A kind of data processing method, device and electronic equipment

Technical field

The present invention relates to technical field of information retrieval, particularly a kind of data processing method, device and electronic equipment.

Background technology

Electronic equipment is in the time carrying out information search at present, and electronic equipment can gather the search information of being inputted by user in search column, and searches for and obtain a series of Search Results based on this search information.For example, while searching the information of Zhang Baizhi and Xie Ting cutting edge of a knife or a sword, can gather in search column and input " Zhang Baizhi and Xie Ting cutting edge of a knife or a sword " this keyword as search information, after getting the click action of index button, electronic equipment generates search instruction, open search application with indication electronic equipment and carry out the search of matching content, obtain Search Results.

Certainly electronic equipment also can be by gathering an object information in certain image or carrying out the search of related content by identifying one section of music rhythm.But the way of search of electronic equipment is all generally to search for based on single piece of information at present.

Summary of the invention

Technical matters to be solved by this invention is to provide a kind of data processing method, device and electronic equipment, and First Characteristic information that can be based on the first object and the Second Characteristic information of second object are mated, and obtains the target multimedia of coupling.Technical scheme is as follows:

The embodiment of the present invention provides a kind of data processing method, is applied to electronic equipment, and described method comprises:

Gather first of the first operating body and select action, the first multimedia of choosing to obtain described the first operating body;

From described the first multimedia, obtain the First Characteristic information of the first object, described First Characteristic information is used for identifying multimedia to be matched and whether comprises described the first object;

Obtain the Second Characteristic information of second object;

According to described First Characteristic information and described Second Characteristic information, described multimedia to be matched is carried out to characteristic matching, obtain target multimedia, the 3rd characteristic information in wherein said target multimedia and described First Characteristic information matches, the 4th characteristic information in described target multimedia and described Second Characteristic information matches.

Preferably, the Second Characteristic information of obtaining second object described in comprises:

Gather by the sound transducer of described electronic equipment the sound that the second operating body produces, and the sound that utilizes speech recognition technology to produce described the second operating body is identified, obtain corresponding keyword, the object that described keyword is corresponding is described second object, the Second Characteristic information that described keyword is described second object;

Or

Obtain by the sensing unit of described electronic equipment at least one position that described the first operating body produces, based on word corresponding to described at least one location lookup, and the word finding is combined and obtains keyword, the object that described keyword is corresponding is described second object, the Second Characteristic information that described keyword is described second object.

Preferably, described in obtain the Second Characteristic information of second object, comprising:

Gather second of the first operating body and select action, the second multimedia of choosing to obtain described the first operating body;

From described the second multimedia, obtain the Second Characteristic information of described second object, described Second Characteristic information is used for identifying multimedia to be matched and whether comprises described second object.

Preferably, described the second multimedia is the second image, and described the second image comprises at least one object, described electronic equipment shows multiple described the second images in viewing area simultaneously, and in described electronic equipment, records the position of each described the second image in described viewing area;

Second of described collection the first operating body is selected action, and the second multimedia of choosing to obtain described the first operating body, comprising:

Obtaining described the first operating body by the sensing unit of electronic equipment carries out described second select when action, the second operating point forming on the viewing area of described electronic equipment;

Obtain the position of described the second operating point in viewing area;

Mate with the position of described the second image position by described the second operating point in viewing area, and described the second image that the match is successful is described the second multimedia.

Preferably, from described the second multimedia, obtain the Second Characteristic information of described second object, comprising:

Obtain by described sensing unit multiple the 3rd operating points that described the first operating body generates on described the second image, described multiple the 3rd operating points form the first shape;

Obtain the second object in described the first shape;

Obtain the Second Characteristic information of second object by image recognition technology.

Preferably, described the second multimedia is the 3rd image, and described the 3rd image comprises at least one object, described electronic equipment shows successively described multiple the 3rd image in described viewing area according to preset order, and in each described viewing area, only shows described the 3rd image;

Obtaining described the first operating body by the sensing unit of electronic equipment carries out described second select when action, at least one formation the 4th operating point on the viewing area of described electronic equipment;

Obtain while forming described at least one the 4th operating point, described the 3rd image showing on described viewing area, described the 3rd image is described the second multimedia.

Obtain the first track that described at least one the 4th operating point forms;

Obtain the position of described the first track in viewing area;

The position of described the first track is mated with the position of each object in described the 3rd image, and the object that the match is successful is second object;

Preferably, described second object is the 4th image, and in described the 4th image, records the geographical location information in described the 4th image taking place, obtains the Second Characteristic information of described second object, comprising:

Described Second Characteristic information using the geographical location information of described the 4th image as second object.

Preferably, from described the first multimedia, obtain the First Characteristic information of the first object, comprising:

By the first recognition method, from the First Characteristic information as obtaining the first object the first multimedia image;

The Second Characteristic information of obtaining second object, comprising: by the second recognition method, from the Second Characteristic information as obtaining described second object described the second multimedia image, described the second recognition method is different from described the first recognition method.

Preferably, described electronic equipment comprises multiple described multimedias to be matched, and described multiple multimedias to be matched are closed to tie up on electronic equipment with predefined procedure and shown, and indication range exceeds the scope of the viewing area of described electronic equipment;

Described method also comprises:

Obtain as the multimedia described multimedia display position to be matched of described target;

Search is as the multimedia described multimedia to be matched of described target;

In the situation that maintaining described predefined procedure and being related to, in described viewing area, show described target multimedia.

Preferably, described First Characteristic information is the first image feature information, and described Second Characteristic information is the second image feature information, and described multimedia to be matched comprises N two field picture;

According to described First Characteristic information and described Second Characteristic information, described multimedia to be matched is carried out to characteristic matching, obtain target multimedia, comprising:

By image recognition technology, obtain the 3rd characteristic information and the 4th characteristic information of any two field picture;

Described the 3rd characteristic information is mated with described the first image feature information, described the 4th characteristic information is mated with described the second image feature information;

Described the 3rd characteristic information mates with described the first image feature information, and at least one two field picture that described the 4th characteristic information mates with described the second image feature information is the matching image in target multimedia.

Preferably, described N two field picture is the parts of images in the video play of described electronic equipment, and described method also comprises:

Obtain video corresponding with described matching image in electronic equipment;

From electronic equipment, choose the broadcasting application corresponding with described video, and indicate electronic equipment to call described broadcasting application;

Described video is loaded in described broadcasting application, plays described video.

Preferably, described method also comprises:

From at least one frame matching image, obtain matching image described in a frame;

Obtaining after a frame matching image, calling the quick broadcasting application of described broadcasting application;

Carry out described quick broadcasting application, described video-frequency playing content is jumped to the described matching image getting;

In the viewing area of described electronic equipment, show the described matching image getting.

The embodiment of the present invention also provides a kind of data processing equipment, is applied to electronic equipment, and described device comprises:

Collecting unit, selects action, the first multimedia of choosing to obtain described the first operating body for gathering first of the first operating body;

The first acquiring unit, for obtain the First Characteristic information of the first object from described the first multimedia, described First Characteristic information is used for identifying multimedia to be matched and whether comprises described the first object;

Second acquisition unit, for obtaining the Second Characteristic information of second object;

Matching unit, for the described First Characteristic information of foundation and described Second Characteristic information, described multimedia to be matched is carried out to characteristic matching, obtain target multimedia, the 3rd characteristic information in wherein said target multimedia and described First Characteristic information matches, the 4th characteristic information in described target multimedia and described Second Characteristic information matches.

Preferably, the Second Characteristic information that described second acquisition unit obtains second object comprises:

Or

Preferably, described second acquisition unit obtains the Second Characteristic information of second object, comprising:

Gather second of the first operating body and select action, the second multimedia of choosing to obtain described the first operating body, from described the second multimedia, obtain the Second Characteristic information of described second object, described Second Characteristic information is used for identifying multimedia to be matched and whether comprises described second object.

Described second acquisition unit, comprising: first obtains subelement, second obtains subelement and the first coupling subelement;

Described first obtains subelement, while carrying out described the second selection action for obtain described the first operating body by the sensing unit of electronic equipment, and the second operating point forming on the viewing area of described electronic equipment;

Described second obtains subelement, for obtaining the position of described the second operating point in viewing area;

Described first coupling subelement, for by described the second operating point the position in viewing area mate with the position of described the second image, described the second image that the match is successful is described the second multimedia.

Preferably, described second acquisition unit also comprises:

The 3rd obtains subelement, multiple the 3rd operating points that generate on described the second image for obtain described the first operating body by described sensing unit, and described multiple the 3rd operating points form the first shape;

The 4th obtains subelement, for obtaining the second object in described the first shape;

The first recognin unit, for obtaining the Second Characteristic information of second object by image recognition technology.

Described second acquisition unit comprises: the 4th obtains subelement and the 5th obtains subelement, wherein,

The described the 4th obtains subelement, while carrying out described the second selection action for obtain described the first operating body by the sensing unit of electronic equipment, and at least one formation on the viewing area of described electronic equipment the 4th operating point;

The described the 5th obtains subelement, while forming described at least one the 4th operating point for obtaining, and described the 3rd image showing on described viewing area, described the 3rd image is described the second multimedia.

Preferably, described second acquisition unit also comprises:

The 6th obtains subelement, the first track forming for obtaining described at least one the 4th operating point;

The 7th obtains subelement, for obtaining the position of described the first track in viewing area;

The second coupling subelement, for the position of described the first track is mated with the position of the each object of described the 3rd image, the object that the match is successful is second object;

The second recognin unit, for obtaining the Second Characteristic information of second object by image recognition technology.

Preferably, described second object is the 4th image, and in described the 4th image, records the geographical location information in described the 4th image taking place, and described second acquisition unit obtains the Second Characteristic information of described second object, comprising:

Preferably, described the first acquiring unit obtains the First Characteristic information of the first object from described the first multimedia, comprising: by the first recognition method, from the First Characteristic information as obtaining the first object the first multimedia image;

Described second acquisition unit obtains the Second Characteristic information of second object, comprise: by the second recognition method, from the Second Characteristic information as obtaining described second object described the second multimedia image, described the second recognition method is different from described the first recognition method.

Described device also comprises:

The 3rd acquiring unit, for obtaining as the multimedia described multimedia display position to be matched of described target;

Search unit, for searching for as the multimedia described multimedia to be matched of described target;

Display unit in the situation that maintaining described predefined procedure and being related to, shows described target multimedia in described viewing area.

Described matching unit comprises: acquisition of information subelement and information matches subelement, wherein,

Described acquisition of information subelement, for by image recognition technology, obtains the 3rd characteristic information and the 4th characteristic information of any two field picture;

Described information matches subelement, for described the 3rd characteristic information is mated with described the first image feature information, described the 4th characteristic information is mated with described the second image feature information, described the 3rd characteristic information mates with described the first image feature information, and at least one two field picture that described the 4th characteristic information mates with described the second image feature information is the matching image in target multimedia.

Preferably, described N two field picture is the parts of images in the video play of described electronic equipment, and described device also comprises:

The 4th acquiring unit, for obtaining the video that electronic equipment is corresponding with described matching image;

Call unit, for choose the broadcasting application corresponding with described video from electronic equipment, and indicates electronic equipment to call described broadcasting application;

Broadcast unit, for described video being loaded on to described broadcasting application, plays described video.

Preferably, described device also comprises:

The 5th acquiring unit, for obtaining matching image described in a frame from least one frame matching image;

Application call unit, for obtaining after a frame matching image, calls the quick broadcasting application of described broadcasting application;

Performance element, for carrying out described quick broadcasting application, jumps to described video-frequency playing content the described matching image getting;

Image-display units, for showing the described matching image getting in the viewing area of described electronic equipment.

The embodiment of the present invention also provides a kind of electronic equipment, comprises above-mentioned data processing equipment.

Known by technique scheme, with respect to the single piece of information coupling of prior art, the data processing method that the embodiment of the present invention provides can be mated based on First Characteristic information and these two information of Second Characteristic information, obtains the target multimedia of coupling.

And those skilled in the art are known, the combination of First Characteristic information and Second Characteristic information more can meet user view than single piece of information, therefore mate based on First Characteristic information and Second Characteristic information the target multimedia obtaining simultaneously, more can meet user view with respect to mating based on single piece of information the target multimedia obtaining, improve searching accuracy.

Accompanying drawing explanation

In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing of required use during embodiment is described is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those skilled in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.

Fig. 1 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention 1;

Fig. 2 is the first display mode schematic diagram of the electronic equipment that provides of the embodiment of the present invention;

Fig. 3 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention 2;

Fig. 4 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention 3;

Fig. 5 is a kind of process flow diagram based on the second multimedia in Fig. 2 embodiment of the present invention and Second Characteristic acquisition of information mode;

Fig. 6 is a kind of schematic diagram of Second Characteristic acquisition of information mode;

Fig. 7 is second display mode schematic diagram of the electronic equipment that provides of the embodiment of the present invention;

Fig. 8 is the another kind of process flow diagram based on the second multimedia in Fig. 7 embodiment of the present invention and Second Characteristic acquisition of information mode;

Fig. 9 is the first schematic diagram that the multimedia that provides of the embodiment of the present invention and characteristic information obtain;

Figure 10 is the second schematic diagram that the multimedia that provides of the embodiment of the present invention and characteristic information obtain;

Figure 11 is the third schematic diagram that the multimedia that provides of the embodiment of the present invention and characteristic information obtain;

Figure 12 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention 4;

Figure 13 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention 5;

Figure 14 shows to Fig. 2 the schematic diagram of adjusting;

Figure 15 is the process flow diagram of a kind of data processing method of providing of the embodiment of the present invention 6;

Figure 16 is the another kind of process flow diagram of the data processing method that provides based on Figure 15 embodiment of the present invention;

Figure 17 is a kind of schematic diagram of the electronic equipment displaying video that provides of the embodiment of the present invention;

Figure 18 is a kind of structural representation of a kind of data processing equipment of providing of the embodiment of the present invention;

Figure 19 is a kind of structural representation of second acquisition unit in Figure 18;

Figure 20 is the another kind of structural representation of second acquisition unit in Figure 18;

Figure 21 is the another kind of structural representation of the data processing equipment that provides based on Figure 18 embodiment of the present invention;

Figure 22 is the structural representation of matching unit in Figure 18;

Figure 23 is another structural representation of the data processing equipment that provides based on Figure 18 embodiment of the present invention;

Figure 24 is the structural representation of the data processing equipment that provides based on Figure 23 embodiment of the present invention.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Based on the embodiment in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.

Refer to Fig. 1, the process flow diagram that it shows the embodiment of the present invention 1 and be applied to the data processing method in electronic equipment, is applied in electronic equipment, can comprise the following steps:

101: gather first of the first operating body and select action, the first multimedia of choosing to obtain the first operating body.

In embodiments of the present invention, electronic equipment comprises a sensing unit, when the first operating body carried out for first selection when action on electronic equipment, sensing unit can determine that first selects to move by responding to the operating point that the first operating body produces in the viewing area of electronic equipment.And by sensing the coordinate of operating point in viewing area, choose first multimedia at this coordinate place.

For example: in the viewing area of electronic equipment, show multiple the first multimedias, multiple the first multimedias adopt mode shown in Fig. 2, are sequentially arranged in viewing area.When the first operating body, while carrying out the first selection action as finger on the viewing area of electronic equipment, sensing unit can determine that by the coordinate of the operating point that produces in viewing area current first selects the first multimedia corresponding to action, and to be the first operating body choose while selecting action carrying out first this first multimedia.

Certainly, in embodiments of the present invention, the first operating body can also be mouse or the electronic pen that user operates, and determines the first multimedia of choosing by detecting mouse or electronic pen at the coordinate of the operating point of viewing area formation.

102: the First Characteristic information of obtaining the first object from the first multimedia.

Wherein in first pair as if the embodiment of the present invention for mate first with reference to body, and First Characteristic information is the key feature information of the first object, it can characterize the first object, can identify in multimedia to be matched, whether to comprise the first object by First Characteristic information.

In examples more of the present invention, the first multimedia can record the First Characteristic information of an object and this object, electronic equipment can be directly using the object of the first multimedia recording as the first object, and the First Characteristic information of the object of its record is First Characteristic information.

In other examples of the present invention, the first multimedia comprises multiple objects, and electronic equipment need to therefrom be chosen one as the first object, is then obtaining the First Characteristic information of this first object.Wherein electronic equipment choose an object be the first object can by induction the first operating body Action Selection, can adopt select the first multimedia mode, this is no longer set forth.

In these two kinds of examples, the first object can be the first image or be the first audio frequency.Such as, the first multimedia comprises the personal images of a sheet by a sheet Bai Zhi, electronic equipment can be using the personal images of Zhang Baizhi as the first object, and the shape of face of obtaining Zhang Baizhi by face recognition technology is as First Characteristic information.

Certain the first multimedia can also be an audio frequency, comprise representational accompaniment fragment in a complete song and this song at this audio frequency, electronic equipment can be using complete song as the first object, and representational accompaniment fragment is as First Characteristic information.If only comprise a complete song in audio frequency, electronic equipment can be chosen the most manifold accompaniment of multiplicity as First Characteristic information from this full songs.

103: the Second Characteristic information of obtaining second object.

Wherein second object be in the embodiment of the present invention for mate second with reference to body, and the key feature information that Second Characteristic information is second object, it can characterize second object, can identify in multimedia to be matched, whether to comprise second object by Second Characteristic information.

In embodiments of the present invention, First Characteristic information and Second Characteristic information can be same type information, mate the characteristic information coupling with respect to an object like this by the characteristic information of two same types, and its accuracy is improved.Such as First Characteristic information is to obtain face information from an image as the first object, Second Characteristic information is the texture information of the object that obtains from image of the volume as second object, First Characteristic information and Second Characteristic information belong to the information of image type, and can be same image as the image of the first object and second object, can be also different images.

In addition, First Characteristic information and Second Characteristic information can be also dissimilar information, can match the multimedia of certain type based on these two kinds of dissimilar information, the multimedia type wherein matching can be identical with the type of First Characteristic information or Second Characteristic information, also can be different from the type of these two information.Such as First Characteristic information is face information, the title (Word message) that Second Characteristic information is the corresponding personage of this face, what match is the character image in multimedia with this person names, matching result type is identical with First Characteristic information type.

Certainly can also from multimedia, match the video with these two information by face information and these two characteristic informations of Word message.That is to say, the data processing method that the embodiment of the present invention provides not only can realize single type coupling, can also match by different types of information the multimedia of certain type, makes way of search variation.

And can the selection based on the first operating body obtain First Characteristic information in the time of search, in conjunction with after First Characteristic information and Second Characteristic information more can meet user view than single piece of information, therefore mate based on First Characteristic information and Second Characteristic information the target multimedia obtaining simultaneously, more can meet user view with respect to mating based on single piece of information the target multimedia obtaining, improve searching accuracy.

Above-mentioned single type coupling refers to by certain type information and matches the multimedia identical with the type, as image information matching image of the prior art.But the embodiment of the present invention is in the time mating based on single type, is that the First Characteristic information of same type and Second Characteristic information are mated as coupling basis.Its accuracy will be higher than adopting a characteristic information to multimedia description in the time describing same multimedia for First Characteristic information and Second Characteristic information, the multimedia quantity searching is less than the multimedia quantity searching based on a characteristic information, thereby has accelerated search speed.

104: according to First Characteristic information and Second Characteristic information, multimedia to be matched is carried out to characteristic matching, obtain target multimedia, wherein the 3rd characteristic information and the First Characteristic information matches in target multimedia, the 4th characteristic information and Second Characteristic information matches in target multimedia.

Electronic equipment, in the time carrying out characteristic matching, can mate the 3rd characteristic information in each multimedia to be matched based on First Characteristic information, and Second Characteristic information is mated with the 4th characteristic information in each multimedia to be matched.When the 3rd characteristic information and First Characteristic information matches in some multimedias to be matched, and when the 4th characteristic information and Second Characteristic information matches, using this multimedia to be matched as target multimedia.

From the foregoing, the data processing method that the embodiment of the present invention provides can be mated based on First Characteristic information and these two information of Second Characteristic information, obtains the target multimedia of coupling.And in conjunction with after First Characteristic information and Second Characteristic information more can meet user view than single piece of information, therefore mate based on First Characteristic information and Second Characteristic information the target multimedia obtaining simultaneously, more can meet user view with respect to mating based on single piece of information the target multimedia obtaining, improve searching accuracy.

In addition for describing same multimedia, its accuracy will be higher than adopting a characteristic information to multimedia description in the time describing same multimedia for First Characteristic information and Second Characteristic information, the multimedia quantity searching is less than the multimedia quantity searching based on a characteristic information, thereby has accelerated search speed.In actual search process, the data processing method that the embodiment of the present invention provides not only can realize single type coupling, can also match by different types of information the multimedia of certain type, makes way of search variation.

Refer to Fig. 3, it shows a kind of process flow diagram of the data processing method that the embodiment of the present invention 2 provides, and has set forth a kind of feasible pattern that obtains Second Characteristic information, can comprise the following steps:

301: gather first of the first operating body and select action, the first multimedia of choosing to obtain the first operating body.

302: from the first multimedia, obtain the First Characteristic information of the first object, First Characteristic information is used for identifying multimedia to be matched and whether comprises the first object.

Step 301 and step 302: identical with step 101 and step 102, this is not being set forth.

303: obtain the keyword of describing second object, the Second Characteristic information that this keyword of describing second object is second object.

In embodiments of the present invention, the mode of obtaining keyword can include but not limited to following two kinds of modes:

On electronic equipment, comprise a sound transducer, in the time that the second operating body aligning electronic equipment is sounded, this sound transducer can gather the sound that the second operating body produces, then the sound that electronic equipment utilizes speech recognition technology to produce the second operating body is identified, and can obtain corresponding keyword.Wherein, the second operating body can be user oral cavity, and sound can be for to collide from lips the sound sending, and can be also the sound that vocal cord vibration produces.

Certainly, the sound that the second operating body of electronic equipment identification produces can also be sent by other equipment, as electronic equipment comprises a main body and carries out the remote control equipment of information interaction with main body, this remote control equipment comprises a sound transducer, the sound producing for gathering the second operating body, then utilize the communication module in remote control equipment to send to main body, the sound that utilizes speech recognition technology to produce the second operating body by main body is identified.

In other examples, electronic equipment comprises a sensing unit, this sensing unit can obtain at least one position that the first operating body produces, while touching the importation (hardware button or virtual key) of electronic equipment as the first operating body, and at least one position of generation.At least one position that the first operating body produces can be that the first operating body repeatedly touches multiple positions that importation obtains, and can be also the first operating body touches a time generation track in importation.

Electronic equipment is by determining corresponding button to multiple positions or track, and the input method of enabling in conjunction with current electronic device, obtains corresponding word.Then electronic equipment combines the word finding to obtain keyword.

304: according to First Characteristic information and Second Characteristic information, multimedia to be matched is carried out to characteristic matching, obtain target multimedia, wherein the 3rd characteristic information and the First Characteristic information matches in target multimedia, the 4th characteristic information and Second Characteristic information matches in target multimedia.

Refer to Fig. 4, it shows the process flow diagram of the data processing method that the embodiment of the present invention 3 provides, and has set forth the feasible pattern that obtains Second Characteristic information, can comprise the following steps:

401: gather first of the first operating body and select action, the first multimedia of choosing to obtain the first operating body.

402: from the first multimedia, obtain the First Characteristic information of the first object, First Characteristic information is used for identifying multimedia to be matched and whether comprises the first object.

Step 401 and step 402: identical with step 101 and step 102, this is not being set forth.

403: gather second of the first operating body and select action, the second multimedia of choosing to obtain the first operating body.

In embodiments of the present invention, electronic equipment comprises a sensing unit, when the first operating body carried out for second selection when action on electronic equipment, sensing unit can determine that second selects to move by responding to the operating point that the first operating body produces in the viewing area of electronic equipment.And by sensing the coordinate of operating point in viewing area, choose second multimedia at this coordinate place.

Wherein the first operating body can be finger, points the coordinate of the operating point forming in viewing area determine the second multimedia of choosing by detection.Certainly, in embodiments of the present invention, the first operating body can also be mouse or the electronic pen that user operates, and determines the first multimedia of choosing by detecting mouse or electronic pen at the coordinate of the operating point of viewing area formation.

404: from the second multimedia, obtain the Second Characteristic information of second object, Second Characteristic information is used for identifying multimedia to be matched and whether comprises second object.

Wherein second object be in the embodiment of the present invention for mate first with reference to body, and the key feature information that Second Characteristic information is second object, it can characterize second object, can identify in multimedia to be matched, whether to comprise second object by Second Characteristic information.

In embodiments of the present invention, the second multimedia can record the Second Characteristic information of an object and this object, electronic equipment can be directly using the object of the second multimedia recording as second object, and the Second Characteristic information of the object of its record is Second Characteristic information.

The second multimedia also can comprise multiple objects simultaneously, and electronic equipment need to therefrom be chosen one as second object, is then obtaining the Second Characteristic information of this second object.Wherein electronic equipment choose an object be second object can by induction the first operating body Action Selection, can adopt select the second multimedia mode, this is no longer set forth.

In these two kinds of examples, second object can be the first image or be the first audio frequency.Such as, the second multimedia comprises the personal images of a sheet by a sheet Bai Zhi, electronic equipment can be using the personal images of Zhang Baizhi as second object, and the shape of face of obtaining Zhang Baizhi by face recognition technology is as Second Characteristic information.

Certain the second multimedia can also be an audio frequency, comprise representational accompaniment fragment in a complete song and this song at this audio frequency, electronic equipment can be using complete song as second object, and representational accompaniment fragment is as Second Characteristic information.If only comprise a complete song in audio frequency, electronic equipment can be chosen the most manifold accompaniment of multiplicity as Second Characteristic information from this full songs.

405: according to First Characteristic information and Second Characteristic information, multimedia to be matched is carried out to characteristic matching, obtain target multimedia, wherein the 3rd characteristic information and the First Characteristic information matches in target multimedia, the 4th characteristic information and Second Characteristic information matches in target multimedia.

In the embodiment of the present invention 3, when in electronic equipment, the second multimedia shows by different way, the mode of obtaining the second multimedia and Second Characteristic information is also different, second multimedia a kind of display mode can be consulted shown in Fig. 2, in Fig. 2, the second multimedia is the second image, in the viewing area of electronic equipment, show multiple the second images simultaneously, viewing area is divided into the region unit being equal to the second image number, in each region unit, show second image, and electronic equipment can record the position of each the second image in viewing area.

Based on the display mode shown in Fig. 2, first electronic equipment chooses second image, and then from the second image, selects the Second Characteristic information of second object, and process as shown in Figure 5, can comprise the following steps:

5031: while obtaining first operating body execution the second selection action by the sensing unit of electronic equipment, the second operating point forming on the viewing area of electronic equipment.

In embodiments of the present invention, in the time that the first operating body is carried out the second selection action on electronic equipment, the first operating body, in the time contacting with viewing area, can form at least one second operating point on viewing area, can get the second operating point by sensing unit electronic equipment.

5032: obtain the position of the second operating point in viewing area.

5033: mate with the position of the second image the position by the second operating point in viewing area, the second image that the match is successful is the second multimedia.

In Fig. 2, each the second image independently shows in region unit at one respectively, shows that so the position of the region unit of the second image is the position of the second corresponding image, and this position can represent by the coordinate in viewing area by four of a region unit summit.

When the first operating body is carried out the second selection action in first region unit, the sensing unit of electronic equipment can sense at least one second operating point of formation in the piece of first area, then the coordinate matching of the coordinate based on this second operating point and each region unit, can show that the second multimedia that the second operating body is chosen is the second image being presented in first region unit.

5034: obtain by sensing unit multiple the 3rd operating points that the first operating body generates on the second image, multiple the 3rd operating points form the first shape.

5035: obtain the second object in the first shape.

After obtaining as second multimedia the second image, need to from the second image, obtain second object, then identifying the Second Characteristic information of second object.In the time choosing second object, multiple the 3rd operating points that the first operating body that electronic equipment can obtain based on sensing unit generates, these the 3rd operating points form first shape, and the first shape frame lives certain object in the second image, and the object that institute's frame is lived is second object.Multiple the 3rd operating points are that the first operating body is carried out the operating point generating while selecting action on the second image.

As shown in Figure 6, the first operating body is carried out while selecting action on the second image of choosing, sensing unit can obtain the first operating body and carry out multiple the 3rd operating points that generate while selecting action, multiple the 3rd operating points form a rectangle on the second image, this rectangle frame is lived face in the second image, and this face is the second object that the first operating body is chosen.

5036: the Second Characteristic information of obtaining second object by image recognition technology.

Wherein image recognition technology comprises: it is Second Characteristic information that face recognition technology, image are cut apart the image feature information that obtains second object with mode identification technology, specifically need to call corresponding recognition technology according to the type of second object, when the second object of choosing as Fig. 6 is face, it is Second Characteristic information that electronic equipment can adopt face recognition technology to obtain face characteristic.

Flow process shown in electronic apparatus application Fig. 5, after obtaining as second multimedia the second image, is obtained second object from the second image, and obtains the Second Characteristic information of second object by image recognition technology.

Certainly when electronic equipment can also be realized the second multimedia and second object, obtain, in order to realize this purpose, electronic equipment need to be changed the display mode shown in Fig. 2.Display mode after change as shown in Figure 7, electronic equipment arranges viewing area and shows the preset order as the second multimedia the 3rd image, this preset order is used to indicate electronic equipment and in viewing area, shows which the 3rd image at every turn, and electronic equipment shows with large figure browsing mode, in viewing area, only shows the 3rd image at every turn.

Based on this display mode, electronic equipment obtains the process of the Second Characteristic information of the second multimedia and second object and can consult shown in Fig. 8, comprises the following steps:

5037: while obtaining first operating body execution the second selection action by the sensing unit of electronic equipment, at least one formation on the viewing area of electronic equipment the 4th operating point.

In embodiments of the present invention, in the time that the first operating body is carried out the second selection action on electronic equipment, the first operating body, in the time contacting with viewing area, can form at least one the 4th operating point on viewing area, can get the 4th operating point by sensing unit electronic equipment.

5038: obtain while forming at least one the 4th operating point, the 3rd image showing on viewing area, the 3rd image is the second multimedia.

In the time that electronic equipment senses the 4th operating point, which the 3rd image what it can know that current display area showing by inquiry preset order is, using the 3rd image showing as the second multimedia.

And the 3rd image comprises at least one object, electronic equipment need to be in obtaining the 3rd image, certain object of determining the 3rd image of choosing is second object, therefore electronic equipment also needs to obtain the relation of the 4th operating point and the 3rd objects in images, select the second object mating with the 4th operating point, feasible pattern is consulted step 5039 to 5041.

5039: obtain the first track that at least one the 4th operating point forms.

In embodiments of the present invention, the first operating body is in the time carrying out the second selection action, at least one the 4th operating point that sensing unit gets forms the first track, and this first track can be the figure of any one shape, for selecting the 3rd image to can be used as the object of second object.

5040: obtain the position of the first track in viewing area.

5041: the position of the first track is mated with the position of each object in the 3rd image, and the object that the match is successful is second object.

Wherein the position of the first track in viewing area is with startup operation point and the terminating operation point of the first track, pixel value in the 3rd image represents, in same the 3rd image, the position of each object represents with the pixel value of the unique point of the marginal portion of this object, unique point be from composition marginal portion institute a little selection a series of more outstanding point, as turning point, summit etc.

Electronic equipment mates the pixel value that represents the first track position with the pixel value of the unique point that is arranged in the each object of the 3rd image, the pixel value object that the match is successful is the 3rd object.

As shown in Figure 7, the first operating body is in the time carrying out the second selection action, in choosing the 3rd image, sensing unit obtains the first track that the 4th operating point forms to position 2 from position 1, from finding out shown in Fig. 7 that the first track is a rectangle, this rectangle frame is lived an object---the face in the 3rd image, electronic equipment, by the position of this rectangle is mated with the position of face, is determined both location matches, and this face is the 3rd object.

5042: the Second Characteristic information of obtaining second object by image recognition technology.

The selection of the obtain manner of above-mentioned two kind of second multimedia and Second Characteristic information based on the first operating body moved, and the selection of the first operating body action is to carry out under certain requirement of user, so the Second Characteristic information that the selection action based on the first operating body obtains more can meet user view, therefore mate based on First Characteristic information and Second Characteristic information the target multimedia obtaining simultaneously, more can meet user view with respect to mating based on single piece of information the target multimedia obtaining, improve searching accuracy.

Here it should be noted is that: the first multimedia can be also an image, from this image, obtain the First Characteristic information of the first object, the obtain manner of the first multimedia and First Characteristic information also can adopt obtain manner shown in above-mentioned Fig. 5 and Fig. 8, like this, First Characteristic information and Second Characteristic information can have been moved in the selection based on the first operating body, make these two characteristic informations more can meet user view, target multimedia based on these two characteristic information couplings more can meet user view, improves search precision.

Selection Action Selection based on the first operating body goes out two images as the first multimedia and the second multimedia, and the schematic diagram that obtains First Characteristic information and Second Characteristic information can be consulted shown in Fig. 9 to Figure 11, wherein Fig. 9 shows and obtains after the first multimedia and the second multimedia, then from as obtaining First Characteristic information and Second Characteristic information the first multimedia and second multimedia two images;

Figure 10 shows obtaining the first multimedia and the second multimedia while, gets First Characteristic information and Second Characteristic information; Figure 11 show obtain an image as the first multimedia after, from this image, obtain First Characteristic information, and show and obtaining the second multimedia Second Characteristic information that simultaneously gets.

Also should be noted that a bit: in the time that the first multimedia and the second multimedia are two images, electronic equipment can pass through the first recognition method, from the First Characteristic information as obtaining the first object the first multimedia image; Corresponding electronic equipment can pass through the second recognition method, from the Second Characteristic information as obtaining second object the second multimedia image, and the first recognition method can be different from the second recognition method, electronic equipment can utilize these two kinds of recognition method to get dissimilar characteristic information like this.Corresponding employing same identification mode is obtained the characteristic information of same kind, and dissimilar characteristic information is more accurate to the description of object, to improve the precision of search.

If the first object is face, the first recognition method can be for face recognition method be to obtain the profile of face; Second object is handbag, and the second recognition method can be cut apart and pattern-recognition mode for image, to obtain the texture information of handbag.

Refer to Figure 12, the process flow diagram that it shows the data processing method that the embodiment of the present invention 4 provides, can comprise the following steps:

601: gather first of the first operating body and select action, the first multimedia of choosing to obtain the first operating body.

602: the First Characteristic information of obtaining the first object from the first multimedia.

It should be noted is that: when the first multimedia is a certain image, electronic equipment is to multiple the first multimedia display modes, and the obtain manner of first multimedia and First Characteristic information its demonstration and the obtain manner during for certain image about the second multimedia that can consult that Fig. 2 to Fig. 8 sets forth, this embodiment of the present invention is no longer set forth.

603: obtain the geographical location information as the 4th image of second object, this geographical location information is Second Characteristic information.

Electronic equipment, in the time of storage the 4th image, can be recorded in the geographical location information in the 4th image taking place in the 4th image at present, and therefore the embodiment of the present invention can be obtained geographical location information as Second Characteristic information from the 4th image.

Wherein geographical location information can be longitude and the latitude of spot for photography, and certainly, geographical location information also can adopt the name identification of spot for photography.If the 4th image is the West Lake scene photographing at Hangzhou West Lake, geographical location information can be longitude and the latitude of Hangzhou West Lake, also can Hangzhou West Lake as geographical location information.

604: according to First Characteristic information and Second Characteristic information, multimedia to be matched is carried out to characteristic matching, obtain target multimedia, wherein the 3rd characteristic information and the First Characteristic information matches in target multimedia, the 4th characteristic information and Second Characteristic information matches in target multimedia.

In the time that Second Characteristic information is geographical location information, First Characteristic information can be the image information of certain object in an image, and the target multimedia matching can be image or the video that comprises this image information under this geographic position.If First Characteristic information is a representational accompaniment fragment, the target multimedia matching can be the video that comprises this geographic position and accompaniment fragment.

Application technique scheme, by the 4th image increase a characteristic information---geographical location information is applied in matching process, realized based on geographical location information and these two different types of information of First Characteristic information and carried out characteristic matching.

Electronic equipment is matching after target multimedia, can also carry out subsequent treatment to target multimedia, refer to Figure 13, it shows the process flow diagram of the data processing method that the embodiment of the present invention 5 provides, and has set forth electronic equipment and has matched after target multimedia, how automatically to jump to target multimedia.Can comprise the following steps:

701: gather first of the first operating body and select action, the first multimedia of choosing to obtain the first operating body.

702: from the first multimedia, obtain the First Characteristic information of the first object, First Characteristic information is used for identifying multimedia to be matched and whether comprises the first object;

703: the Second Characteristic information of obtaining second object.

704: according to First Characteristic information and Second Characteristic information, multimedia to be matched is carried out to characteristic matching, obtain target multimedia, wherein the 3rd characteristic information and the First Characteristic information matches in target multimedia, the 4th characteristic information and Second Characteristic information matches in target multimedia.

Step 701, to the executive mode of step 704, can be consulted the mode that above-described embodiment 1 to embodiment 4 any embodiment is set forth, and this embodiment of the present invention is no longer set forth.

705: obtain as the multimedia multimedia display position to be matched of target.

In embodiments of the present invention, electronic equipment comprises multiple multimedias to be matched, and multiple multimedia to be matched closes and tie up on electronic equipment and show with predefined procedure, and indication range exceeds the scope of the viewing area of electronic equipment, as shown in Figure 2.Be image in Fig. 2 multimedia to be matched, in the viewing area of electronic equipment, shown multiple images, and not complete being presented in viewing area of parts of images.

When matching after target multimedia, need to obtain the multimedia display position of this target, wherein display position is the coordinate of target multimedia in viewing area, just can the in the situation that predefined procedure being related to, realize automatic redirect not changing.

706: search is as the multimedia multimedia to be matched of target.

707: in the situation that maintaining predefined procedure and being related to, display-object multimedia in viewing area.

What is called maintains predefined procedure relation and refers to and do not upset electronic equipment DISPLAY ORDER, electronic equipment can be adjusted viewing area automatically in this case, with display-object multimedia in viewing area, especially target multimedia not in viewing area in the situation that, can realize the multimedia in electronic equipment automatic switchover viewing area before cursor is adjusted.

Wherein automatically switching can be that cursor is moved downward to target multimedia position, realizes the automatic down sliding in viewing area.Certainly automatic switchover can be also the automatic sliding screen of viewing area, switches the shown multimedia of fixed display area.As shown in figure 14, it shows on Fig. 2 basis, and cursor is displaced downwardly to target multimedia position.

Application technique scheme, is matching after target multimedia, can also, by searching the multimedia position of target, realize the automatic adjustment to displaying contents in viewing area.

In addition, First Characteristic information can be the first image feature information in embodiments of the present invention, Second Characteristic information can be the second image feature information, multimedia to be matched can comprise N two field picture, carry out accordingly characteristic matching and can from certain multimedia to be matched, match at least one two field picture, its matching process can be consulted shown in Figure 15, shows the data processing method that the embodiment of the present invention 6 provides, and can comprise the following steps:

801: gather first of the first operating body and select action, the first multimedia of choosing to obtain the first operating body.

802: from the first multimedia, obtain the First Characteristic information of the first object, First Characteristic information is used for identifying multimedia to be matched and whether comprises the first object;

803: the Second Characteristic information of obtaining second object.

First Characteristic information can be the first image feature information in embodiments of the present invention, Second Characteristic information can be the second image feature information, its acquisition process can be consulted the image recognition technology of utilizing of setting forth in said method embodiment and obtain the process of image feature information, and this is no longer set forth.

804: by image recognition technology, obtain the 3rd characteristic information and the 4th characteristic information of any two field picture.

805: the 3rd characteristic information is mated with the first image feature information, the 4th characteristic information is mated with the second image feature information.

Because multimedia to be matched comprises N two field picture, so electronic equipment finding a target multimedia to mate the every two field picture in each multimedia to be matched from multimedia to be matched.In the time that every two field picture is mated, first electronic equipment will obtain the 3rd characteristic information and the 4th characteristic information of every two field picture, then the 3rd characteristic information is mated with the first image feature information, the 4th characteristic information is mated with the second image feature information, obtain matching image, this matching image place multimedia to be matched is target multimedia.

Within 806: the, three characteristic informations mate with the first image feature information, and at least one two field picture that the 4th characteristic information mates with the second image feature information is the matching image in target multimedia.

In examples more of the present invention, N two field picture be electronic equipment play video in parts of images, when getting after matching image from N two field picture, the data processing method that the embodiment of the present invention provides can also be obtained video and play, as shown in figure 16, on Figure 15 basis, can also comprise:

807: obtain video corresponding with matching image in electronic equipment.

In embodiments of the present invention, electronic equipment can record the video name that every two field picture is corresponding, when getting after matching image, can find the video corresponding with matching image by video name.

808: from electronic equipment, choose the broadcasting application corresponding with video, and indicate electronic equipment to call and play application.Wherein play application for displaying video.

809: video is loaded on and is play in application, displaying video.

Based on such scheme, electronic equipment can get after matching image, transfers the video corresponding with it, and enables to play to apply and carry out video playback, different based on keyword search from existing video playback, the embodiment of the present invention realizes based on images match and obtains video and automatically play.

And the embodiment of the present invention can be play from the starting position of video in the time of displaying video.Certainly it can also the play position from the video of matching image place start, and continues displaying video.

In addition, electronic equipment can also obtain a frame matching image from least one frame matching image, calls the quick broadcasting application of playing application, and electronic equipment can be carried out quick broadcasting application like this, video-frequency playing content is jumped to the matching image getting.At electronic equipment, video-frequency playing content is jumped to after the matching image getting, carry out to suspend and play application, now in the viewing area of electronic equipment, can show the matching image getting.

Because matching image can be multiframe, can be through but not limited to degree of correlation coupling or these two kinds of matching ways of time match obtain a frame matching image from this multiframe matching image time, wherein the degree of correlation is the whether relevant degree of content that the content of every frame matching image represents to First Characteristic information and Second Characteristic information, chooses the matching image that matching degree is the highest from the degree of correlation; And time match can be the reproduction time in video by contrast multiframe matching image, choose reproduction time matching image the earliest.

Certainly showing when matching image in viewing area, can also be directly to call the broadcasting application that matching image place video is corresponding, video-frequency playing content is directly jumped to the matching image getting, and skips video playback and directly shows matching image thereby realize.

As shown in figure 17, electronic equipment gets after the matching image of video 1, calls " MPC " this broadcasting application video-frequency playing content is jumped to matching image automatically, and carry out and suspend playing function, shows this matching image on viewing area.If electronic equipment gets continue-to-play instruction, can, from matching image place play position, continue displaying video, if matching image place play position in Figure 17 is 01:07, electronic equipment continues to continue displaying video from this position of 01:07.

Corresponding with embodiment of the method, the embodiment of the present invention 7 provides a kind of data processing equipment, is applied to electronic equipment, its structural representation as shown in figure 18, can comprise: collecting unit 11, the first acquiring unit 12, second acquisition unit 13 and matching unit 14, wherein

Collecting unit 11, selects action, the first multimedia of choosing to obtain the first operating body for gathering first of the first operating body.

In embodiments of the present invention, electronic equipment comprises a sensing unit, in the time that the first operating body is carried out the first selection action on electronic equipment, the operating point that collecting unit 11 can produce by sensing units sense the first operating body in the viewing area of electronic equipment determines that first selects action.And by sensing the coordinate of operating point in viewing area, choose first multimedia at this coordinate place.

For example: in the viewing area of electronic equipment, show multiple the first multimedias, multiple the first multimedias adopt mode shown in Fig. 2, are sequentially arranged in viewing area.When the first operating body, while carrying out the first selection action as finger on the viewing area of electronic equipment, collecting unit 11 can determine that current first selects the first multimedia corresponding to action by the coordinate of the operating point that produces in viewing area, and to be the first operating body choose while selecting action carrying out first this first multimedia.

The first acquiring unit 12, for obtain the First Characteristic information of the first object from the first multimedia, First Characteristic information is used for identifying multimedia to be matched and whether comprises the first object.

In examples more of the present invention, the first multimedia can record the First Characteristic information of an object and this object, the first acquiring unit 12 can be directly using the object of the first multimedia recording as the first object, and the First Characteristic information of the object of its record is First Characteristic information.

In other examples of the present invention, the first multimedia comprises multiple objects, and the first acquiring unit 12 need to therefrom be chosen one as the first object, is then obtaining the First Characteristic information of this first object.Wherein the first acquiring unit 12 choose an object be the first object can by induction the first operating body Action Selection, can adopt select the first multimedia mode, this is no longer set forth.

In these two kinds of examples, the first object can be the first image or be the first audio frequency.Such as, the first multimedia comprises the personal images of a sheet by a sheet Bai Zhi, the first acquiring unit 12 can be using the personal images of Zhang Baizhi as the first object, and the shape of face of obtaining Zhang Baizhi by face recognition technology is as First Characteristic information.

Certain the first multimedia can also be an audio frequency, comprise representational accompaniment fragment in a complete song and this song at this audio frequency, the first acquiring unit 12 can be using complete song as the first object, and representational accompaniment fragment is as First Characteristic information.If only comprise a complete song in audio frequency, the first acquiring unit 12 can be chosen the most manifold accompaniment of multiplicity as First Characteristic information from this full songs.

Second acquisition unit 13, for obtaining the Second Characteristic information of second object.

Matching unit 14, be used for according to First Characteristic information and Second Characteristic information, multimedia to be matched is carried out to characteristic matching, obtain target multimedia, wherein the 3rd characteristic information and the First Characteristic information matches in target multimedia, the 4th characteristic information and Second Characteristic information matches in target multimedia.

In embodiments of the present invention, matching unit 14 is in the time carrying out characteristic matching, can mate the 3rd characteristic information in each multimedia to be matched based on First Characteristic information, Second Characteristic information is mated with the 4th characteristic information in each multimedia to be matched.When the 3rd characteristic information and First Characteristic information matches in some multimedias to be matched, and when the 4th characteristic information and Second Characteristic information matches, using this multimedia to be matched as target multimedia.

From the foregoing, the data processing equipment that the embodiment of the present invention provides can mate based on First Characteristic information and these two information of Second Characteristic information, obtains the target multimedia of coupling.And in conjunction with after First Characteristic information and Second Characteristic information more can meet user view than single piece of information, therefore mate based on First Characteristic information and Second Characteristic information the target multimedia obtaining simultaneously, more can meet user view with respect to mating based on single piece of information the target multimedia obtaining, improve searching accuracy.

In addition for describing same multimedia, its accuracy will be higher than adopting a characteristic information to multimedia description in the time describing same multimedia for First Characteristic information and Second Characteristic information, the multimedia quantity searching is less than the multimedia quantity searching based on a characteristic information, thereby has accelerated search speed.In actual search process, the data processing equipment that the embodiment of the present invention provides not only can be realized single type coupling, can also match by different types of information the multimedia of certain type, makes way of search variation.

In said apparatus embodiment, second acquisition unit can have the multiple mode of obtaining Second Characteristic information, wherein the first feasible pattern is: second acquisition unit 13 gathers by the sound transducer of electronic equipment the sound that the second operating body produces, and the sound that utilizes speech recognition technology to produce the second operating body is identified, obtain corresponding keyword, the object that keyword is corresponding is second object, the Second Characteristic information that keyword is second object.

The second feasible pattern is: second acquisition unit 13 obtains by the sensing unit of electronic equipment at least one position that the first operating body produces, based on word corresponding at least one location lookup, and the word finding is combined and obtains keyword, the object that keyword is corresponding is second object, the Second Characteristic information that keyword is second object.

The third feasible pattern is: second acquisition unit 13 gathers second of the first operating body and selects action, the second multimedia of choosing to obtain the first operating body, the Second Characteristic information that obtains second object from the second multimedia, Second Characteristic information is used for identifying multimedia to be matched and whether comprises second object.

Accordingly in the third feasible pattern, the second multimedia is the second image, and the second image comprises at least one object, electronic equipment shows multiple the second images in viewing area simultaneously, and in electronic equipment, record the position of each the second image in viewing area, second acquisition unit 13 can first obtain the second multimedia and obtain Second Characteristic information again, its structural representation can be consulted shown in Figure 19, comprise: first obtains subelement 131, second obtains subelement 132, the first coupling subelement 133, the 3rd obtains subelement 134, the 4th obtains subelement 135 and the first recognin unit 136.Wherein,

First obtains subelement 131, while carrying out the second selection action for obtain the first operating body by the sensing unit of electronic equipment, and the second operating point forming on the viewing area of electronic equipment.

In embodiments of the present invention, in the time that the first operating body is carried out the second selection action on electronic equipment, the first operating body, in the time contacting with viewing area, can form at least one second operating point on viewing area, obtains subelement 131 can get the second operating point by sensing unit first.

Second obtains subelement 132, for obtaining the position of the second operating point in viewing area.

First coupling subelement 133, for by the second operating point the position in viewing area mate with the position of the second image, the second image that the match is successful is the second multimedia.

When the first operating body is carried out the second selection action in first region unit, first obtains subelement 131 can be sensed and in the piece of first area, be formed at least one second operating point by sensing unit, then the coordinate matching of the coordinate based on this second operating point and each region unit, can show that the second multimedia that the second operating body is chosen is the second image being presented in first region unit.

The 3rd obtains subelement 134, multiple the 3rd operating points that generate on the second image for obtain the first operating body by sensing unit, and multiple the 3rd operating points form the first shape.

The 4th obtains subelement 135, for obtaining the second object in the first shape.

After obtaining as second multimedia the second image, need to from the second image, obtain second object, then identifying the Second Characteristic information of second object.In the time choosing second object, the 3rd obtain subelement 134 can based on sensing unit obtain first operating body generate multiple the 3rd operating points, these the 3rd operating points form first shape, and the first shape frame lives certain object in the second image, and the object that institute's frame is lived is second object.Multiple the 3rd operating points are that the first operating body is carried out the operating point generating while selecting action on the second image.

The first recognin unit 136, for obtaining the Second Characteristic information of second object by image recognition technology.Wherein image recognition technology comprises: it is Second Characteristic information that face recognition technology, image are cut apart the image feature information that obtains second object with mode identification technology, specifically need to call corresponding recognition technology according to the type of second object, when the second object of choosing as Fig. 6 is face, it is Second Characteristic information that electronic equipment can adopt face recognition technology to obtain face characteristic.

Certainly second acquisition unit 13 also can obtain the second multimedia Second Characteristic information of simultaneously obtaining second object, wherein the second multimedia can be the 3rd image, and the 3rd image comprises at least one object, electronic equipment shows successively multiple the 3rd images in viewing area according to preset order, and only shows the 3rd image in each viewing area.

In order to realize the second multimedia and Second Characteristic information is obtained simultaneously, the structural representation of second acquisition unit 13 can be consulted shown in Figure 20, can comprise: the 4th obtains subelement 201, the 5th obtains subelement 202, the 6th and obtain subelement 203, the 7th and obtain subelement 204, the second coupling subelement 205 and the second recognin unit 206, wherein

The 4th obtains subelement 201, while carrying out the second selection action for obtain the first operating body by the sensing unit of electronic equipment, and at least one formation on the viewing area of electronic equipment the 4th operating point.

In embodiments of the present invention, in the time that the first operating body is carried out the second selection action on electronic equipment, the first operating body is in the time contacting with viewing area, can on viewing area, form at least one the 4th operating point, the 4th obtains subelement 201 can get the 4th operating point by sensing unit electronic equipment.

The 5th obtains subelement 202, while forming at least one the 4th operating point for obtaining, and the 3rd image showing on viewing area, the 3rd image is the second multimedia.

In the time that the 4th obtains subelement 201 and sense the 4th operating point, triggering the 5th, which the 3rd image what obtain that subelement 202 knows by inquiry preset order that current display area showing be, using the 3rd image showing as the second multimedia.

The 6th obtains subelement 203, the first track forming for obtaining at least one the 4th operating point.Because the 3rd image comprises at least one object, electronic equipment need to be in obtaining the 3rd image, certain object of determining the 3rd image of choosing is second object, therefore electronic equipment also needs to obtain the relation of the 4th operating point and the 3rd objects in images, selects the second object mating with the 4th operating point.

The 7th obtains subelement 204, for obtaining the position of the first track in viewing area.

The second coupling subelement 205, for the position of the first track is mated with the position of the each object of the 3rd image, the object that the match is successful is second object.

The second coupling subelement 205 mates the pixel value that represents the first track position with the pixel value of the unique point that is arranged in the each object of the 3rd image, the pixel value object that the match is successful is the 3rd object.

As shown in Figure 7, the first operating body is in the time carrying out the second selection action, in choosing the 3rd image, sensing unit obtains the first track that the 4th operating point forms, from finding out shown in Fig. 7 that the first track is a rectangle, this rectangle frame is lived an object---the face in the 3rd image, the second coupling subelement 205, by the position of this rectangle is mated with the position of face, is determined both location matches, and this face is the 3rd object.

The second recognin unit 206, for obtaining the Second Characteristic information of second object by image recognition technology.

Here it should be noted is that: the first multimedia can be also an image, from this image, obtain the First Characteristic information of the first object, the first multimedia and First Characteristic information also can adopt second acquisition unit shown in Figure 19 or Figure 20 to obtain, like this, First Characteristic information and Second Characteristic information can have been moved in the selection based on the first operating body, make these two characteristic informations more can meet user view, target multimedia based on these two characteristic information couplings more can meet user view, improves search precision.

Also should be noted that a bit: in the time that the first multimedia and the second multimedia are two images, the first acquiring unit 12 can pass through the first recognition method, from the First Characteristic information as obtaining the first object the first multimedia image; Corresponding second acquisition unit 13 can pass through the second recognition method, from the Second Characteristic information as obtaining second object the second multimedia image, and the first recognition method can be different from the second recognition method, matching unit 14 can utilize these two kinds of recognition method to get dissimilar characteristic information like this.Corresponding employing same identification mode is obtained the characteristic information of same kind, and dissimilar characteristic information is more accurate to the description of object, to improve the precision of search.

In addition current electronic equipment is in the time of memory image, the geographical location information in this image taking place can be recorded in image, therefore in the embodiment of the present invention, second acquisition unit 13 can obtain geographical location information as Second Characteristic information from the 4th image as second object.The data processing equipment that the embodiment of the present invention provides like this can carry out characteristic matching based on geographical location information and these two different types of information of First Characteristic information.

In embodiments of the present invention, electronic equipment can comprise multiple multimedias to be matched, and multiple multimedias to be matched are closed and tied up on electronic equipment and show with predefined procedure, and indication range exceeds the scope of the viewing area of electronic equipment, as shown in Figure 2.Be image in Fig. 2 multimedia to be matched, in the viewing area of electronic equipment, shown multiple images, and not complete being presented in viewing area of parts of images.Based on this kind of electronic equipment, the data processing equipment that the embodiment of the present invention provides, on Figure 18 basis, can also comprise: the 3rd acquiring unit 15, search unit 16 and display unit 17, as shown in figure 21, wherein,

The 3rd acquiring unit 15, for obtaining as the multimedia multimedia display position to be matched of target.

At existing electronic equipment showing when multimedia to be matched because viewing area is limited in scope, cause that part multimedia to be matched is not complete to be presented in viewing area, therefore when not showing as the multimedia multimedia to be matched of target or complete while being presented in viewing area, the 3rd acquiring unit 15 can obtain the multimedia display position of this target, to make electronic equipment realize automatic redirect in the situation that predefined procedure being related to not changing.Wherein display position can be the coordinate of target multimedia in viewing area.

Search unit 16, for searching for as the multimedia multimedia to be matched of target.

Display unit 17, in the situation that maintaining predefined procedure and being related to, display-object multimedia in viewing area.

What is called maintains predefined procedure relation and refers to and do not upset electronic equipment DISPLAY ORDER, display unit 17 can be adjusted viewing area automatically in this case, with display-object multimedia in viewing area, especially target multimedia not in viewing area in the situation that, can realize the multimedia in automatic switchover viewing area before cursor is adjusted.

In addition, First Characteristic information can be the first image feature information in embodiments of the present invention, Second Characteristic information can be the second image feature information, multimedia to be matched can comprise N two field picture, when matching unit 14 carries out characteristic matching, can from certain multimedia to be matched, match at least one two field picture, its structural representation as shown in figure 22, can comprise: acquisition of information subelement 251 and information matches subelement 252, wherein

Acquisition of information subelement 251, for by image recognition technology, obtains the 3rd characteristic information and the 4th characteristic information of any two field picture.

Information matches subelement 252, for the 3rd characteristic information is mated with the first image feature information, the 4th characteristic information is mated with the second image feature information, the 3rd characteristic information mates with the first image feature information, and at least one two field picture that the 4th characteristic information mates with the second image feature information is the matching image in target multimedia.

Because multimedia to be matched comprises N two field picture, so information matches subelement 252 finding a target multimedia to mate the every two field picture in each multimedia to be matched from multimedia to be matched.

In the time that every two field picture is mated, first information matches subelement 252 will obtain the 3rd characteristic information and the 4th characteristic information of every two field picture, then the 3rd characteristic information is mated with the first image feature information, the 4th characteristic information is mated with the second image feature information, obtain matching image, this matching image place multimedia to be matched is target multimedia.

In examples more of the present invention, N two field picture be electronic equipment play video in parts of images, when getting after matching image from N two field picture, the data processing equipment that the embodiment of the present invention provides can also obtain video and play, as shown in figure 23, on Figure 18 basis, can also comprise: the 4th acquiring unit 18, call unit 19 and broadcast unit 20.Wherein,

The 4th acquiring unit 18, for obtaining the video that electronic equipment is corresponding with matching image.In embodiments of the present invention, matching unit 14 can also record the video name that every two field picture is corresponding, and when getting after matching image, the 4th acquiring unit 18 can find the video corresponding with matching image by video name.

Call unit 19, for choose the broadcasting application corresponding with video from electronic equipment, and indicates electronic equipment to call and plays application.

Broadcast unit 20, plays application, displaying video for video is loaded on.

Based on such scheme, electronic apparatus application data processing equipment can get after matching image, transfer the video corresponding with it, and enable to play to apply and carry out video playback, different based on keyword search from existing video playback, the embodiment of the present invention realizes based on images match and obtains video and automatically play.

Refer to Figure 24, another structural representation that it shows the data processing equipment that the embodiment of the present invention provides, on Figure 23 basis, can also comprise: the 5th acquiring unit 21, application call unit 22, performance element 23 and image-display units 24.Wherein,

The 5th acquiring unit 21, for obtaining a frame matching image from least one frame matching image.Because matching image can be multiframe, can be through but not limited to degree of correlation coupling or these two kinds of matching ways of time match obtain a frame matching image from this multiframe matching image time, wherein the degree of correlation is the whether relevant degree of content that the content of every frame matching image represents to First Characteristic information and Second Characteristic information, chooses the matching image that matching degree is the highest from the degree of correlation; And time match can be the reproduction time in video by contrast multiframe matching image, choose reproduction time matching image the earliest.

Application call unit 22, for obtaining after a frame matching image, calls the quick broadcasting application of playing application.This is play fast application and is used for video-frequency playing content rapid adjustment to matching image.

Performance element 23, for carrying out quick broadcasting application, jumps to video-frequency playing content the matching image getting.

Image-display units 24, for showing the matching image getting in the viewing area of electronic equipment.

Based on such scheme, data processing equipment obtains a frame matching image from least one frame matching image, call the quick broadcasting application of playing application, data processing equipment can be carried out quick broadcasting application like this, video-frequency playing content is jumped to the matching image getting.Video-frequency playing content is being jumped to after the matching image getting, carrying out to suspend and play application, now in the viewing area of electronic equipment, can show the matching image getting.

It should be noted that, each embodiment in this instructions all adopts the mode of going forward one by one to describe, and what each embodiment stressed is and the difference of other embodiment, between each embodiment identical similar part mutually referring to.For device class embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.

Finally, also it should be noted that, in this article, relational terms such as the first and second grades is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply and between these entities or operation, have the relation of any this reality or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the equipment that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or equipment.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.

For convenience of description, while describing above device, being divided into various unit with function describes respectively.Certainly, in the time that enforcement is of the present invention, the function of each unit can be realized in same or multiple software and/or hardware.

Above a kind of data processing method provided by the present invention, device and electronic equipment are described in detail, applied specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment is just for helping to understand method of the present invention and core concept thereof; , for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention meanwhile.

Claims

1. a data processing method, is applied to electronic equipment, it is characterized in that, described method comprises:

Obtain the Second Characteristic information of second object;

2. method according to claim 1, is characterized in that, described in obtain second object Second Characteristic information comprise:

Or

3. method according to claim 1, is characterized in that, described in obtain the Second Characteristic information of second object, comprising:

4. method according to claim 3, it is characterized in that, described the second multimedia is the second image, and described the second image comprises at least one object, described electronic equipment shows multiple described the second images in viewing area simultaneously, and in described electronic equipment, records the position of each described the second image in described viewing area;

Obtain the position of described the second operating point in viewing area;

5. method according to claim 4, is characterized in that, obtains the Second Characteristic information of described second object from described the second multimedia, comprising:

Obtain the second object in described the first shape;

6. method according to claim 3, it is characterized in that, described the second multimedia is the 3rd image, and described the 3rd image comprises at least one object, described electronic equipment shows successively described multiple the 3rd image in described viewing area according to preset order, and in each described viewing area, only shows described the 3rd image;

7. method according to claim 6, is characterized in that, obtains the Second Characteristic information of described second object from described the second multimedia, comprising:

Obtain the position of described the first track in viewing area;

8. method according to claim 1, is characterized in that, described second object is the 4th image, and in described the 4th image, records the geographical location information in described the 4th image taking place, obtains the Second Characteristic information of described second object, comprising:

9. method according to claim 1, is characterized in that, obtains the First Characteristic information of the first object from described the first multimedia, comprising:

10. according to the method described in claim 1 to 9 any one, it is characterized in that, described electronic equipment comprises multiple described multimedias to be matched, described multiple multimedia to be matched is closed to tie up on electronic equipment with predefined procedure and is shown, and indication range exceeds the scope of the viewing area of described electronic equipment;

Described method also comprises:

11. according to the method described in claim 1 to 9 any one, it is characterized in that, described First Characteristic information is the first image feature information, and described Second Characteristic information is the second image feature information, and described multimedia to be matched comprises N two field picture;

12. methods according to claim 11, is characterized in that, described N two field picture is the parts of images in the video play of described electronic equipment, and described method also comprises:

13. methods according to claim 12, is characterized in that, described method also comprises:

14. 1 kinds of data processing equipments, are applied to electronic equipment, it is characterized in that, described device comprises:

15. devices according to claim 14, it is characterized in that, described the second multimedia is the second image, and described the second image comprises at least one object, described electronic equipment shows multiple described the second images in viewing area simultaneously, and in described electronic equipment, records the position of each described the second image in described viewing area;

Described second acquisition unit, comprising: first obtains that subelement, second obtains subelement, the first coupling subelement, the 3rd obtains subelement, the 4th and obtains subelement and the first recognin unit; Wherein,

Described first coupling subelement, for by described the second operating point the position in viewing area mate with the position of described the second image, described the second image that the match is successful is described the second multimedia;

The described the 3rd obtains subelement, multiple the 3rd operating points that generate on described the second image for obtain described the first operating body by described sensing unit, and described multiple the 3rd operating points form the first shape;

The described the 4th obtains subelement, for obtaining the second object in described the first shape;

Described the first recognin unit, for obtaining the Second Characteristic information of second object by image recognition technology.

16. devices according to claim 14, it is characterized in that, described the second multimedia is the 3rd image, and described the 3rd image comprises at least one object, described electronic equipment shows successively described multiple the 3rd image in described viewing area according to preset order, and in each described viewing area, only shows described the 3rd image;

Described second acquisition unit comprises: the 4th obtains subelement, the 5th obtains subelement, the 6th and obtain subelement, the 7th and obtain subelement, the second coupling subelement and the second recognin unit, wherein,

The described the 5th obtains subelement, while forming described at least one the 4th operating point for obtaining, and described the 3rd image showing on described viewing area, described the 3rd image is described the second multimedia;

The described the 6th obtains subelement, the first track forming for obtaining described at least one the 4th operating point;

The described the 7th obtains subelement, for obtaining the position of described the first track in viewing area;

Described the second coupling subelement, for the position of described the first track is mated with the position of the each object of described the 3rd image, the object that the match is successful is second object;

Described the second recognin unit, for obtaining the Second Characteristic information of second object by image recognition technology.

17. according to claim 14 to the device described in 16 any one, it is characterized in that, described electronic equipment comprises multiple described multimedias to be matched, described multiple multimedia to be matched is closed to tie up on electronic equipment with predefined procedure and is shown, and indication range exceeds the scope of the viewing area of described electronic equipment;

Described device also comprises:

18. according to claim 14 to the device described in 16 any one, it is characterized in that, described First Characteristic information is the first image feature information, described Second Characteristic information is the second image feature information, described multimedia to be matched comprises N two field picture, and described N two field picture is the parts of images in the video play of described electronic equipment;

Described information matches subelement, for described the 3rd characteristic information is mated with described the first image feature information, described the 4th characteristic information is mated with described the second image feature information, described the 3rd characteristic information mates with described the first image feature information, and at least one two field picture that described the 4th characteristic information mates with described the second image feature information is the matching image in target multimedia; Described device also comprises:

19. devices according to claim 18, is characterized in that, described device also comprises:

20. 1 kinds of electronic equipments, is characterized in that, comprise the data processing equipment as described in claim 14 to 19 any one.