CN103888423A - Information processing method and information processing device - Google Patents

Information processing method and information processing device Download PDF

Info

Publication number
CN103888423A
CN103888423A CN201210560705.XA CN201210560705A CN103888423A CN 103888423 A CN103888423 A CN 103888423A CN 201210560705 A CN201210560705 A CN 201210560705A CN 103888423 A CN103888423 A CN 103888423A
Authority
CN
China
Prior art keywords
information
handling object
electronic equipment
processing method
information processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210560705.XA
Other languages
Chinese (zh)
Other versions
CN103888423B (en
Inventor
杨元庆
张磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201210560705.XA priority Critical patent/CN103888423B/en
Priority to PCT/CN2013/089778 priority patent/WO2014094614A1/en
Priority to DE112013006130.9T priority patent/DE112013006130T5/en
Priority to US14/388,722 priority patent/US10126821B2/en
Publication of CN103888423A publication Critical patent/CN103888423A/en
Application granted granted Critical
Publication of CN103888423B publication Critical patent/CN103888423B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Telephonic Communication Services (AREA)

Abstract

The invention provides an information processing method and an information processing device. The information processing method is applied to a first electronic device. The information processing method includes: in a process in which a call is made between the first electronic device and a second electronic device, a process object is determined on the basis of call information generated in the call; correlation information correlated with the process object is obtained; and operations based on the correlation information are executed.

Description

Information processing method and messaging device
Technical field
The present invention relates to the field of information processing, more specifically, the present invention relates to a kind of information processing method and messaging device.
Background technology
Along with the development of the communication technology, comprise that the communications applications of textcommunication, voice communication, video communication etc. is more and more extensive.In these communication processs, can produce a large amount of data, as text data, speech data, video data etc.
In the prior art, except simply by these data retransmissions to corresponding correspondent in communication process with realize communication objective, these data are not further utilized.
Summary of the invention
Because above-mentioned situation, the invention provides a kind of information processing method and messaging device, it can utilize the call-information producing in communication process, for example, produce the related information that is suitable for correspondent, thereby further promote the using value of call, enrich user's experience.
According to one embodiment of the invention, a kind of information processing method is provided, has been applied to the first electronic equipment, described information processing method comprises: in the process that described the first electronic equipment and the second electronic equipment are conversed, the call-information producing based on described call, determines handling object; Obtain the related information associated with described handling object; And the operation of execution based on described related information.
Describedly obtain the related information associated with described handling object and comprise: described handling object is sent to remote server; And receive related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
Describedly obtain the related information associated with described handling object and comprise: described handling object is analyzed, to determine described related information.
Described call-information is the information of video pictures, and described definite handling object comprises: detect user's input operation; And based on described input operation, from described video pictures, determine handling object.
Described detection user's input operation comprises: detect the input operation for a region of selected described video pictures; And described definite handling object comprises: will be defined as handling object with the corresponding partial video picture in described region in described video pictures.
Described detection user's input operation comprises: detect the clicking operation for clicking described video pictures; And described definite handling object comprises: based on the ad-hoc location in described video pictures corresponding to described clicking operation, described video pictures is carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location; And described partial video picture is defined as to handling object.
Described detection user's input operation comprises: described video pictures is carried out to image recognition, to determine multiple candidate targets; Detect the selection operation of user at least one candidate target in described multiple candidate targets; And described definite handling object comprises: based on described selection operation, selected described at least one candidate target is defined as to described handling object.
Described call-information is the information of tableaux, and described definite handling object also comprises: described tableaux is carried out to image recognition, so that described tableaux is divided into multiple regions; Based on preassigned, from described multiple regions, determine target area; And based on described target area, determine described handling object.
Described call-information is the information of dynamic menu, and described definite handling object also comprises: described dynamic menu is identified to the specific action of making in described communication process to identify user; And based on described specific action, determine described handling object.
Described call-information is the information of audio frequency, and described definite handling object comprises: described audio frequency is carried out to audio identification, to determine handling object.
Described definite handling object also comprises: based on described call-information, determine multiple candidate targets; Detect user at least one the selection operation in described multiple candidate targets; And based on described selection operation, selected described at least one candidate target is defined as to described handling object.
According to another embodiment of the present invention, a kind of messaging device is provided, be applied to the first electronic equipment, described messaging device comprises: determining unit, in the process that described the first electronic equipment and the second electronic equipment are conversed, the call-information producing based on described call, determines handling object; Acquiring unit, obtains the related information associated with described handling object; And performance element, carry out the operation based on described related information.
Described acquiring unit comprises: transmitting element, is sent to remote server by described handling object; And receiving element, receive related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
Described acquiring unit comprises: analytic unit, described handling object is analyzed, to determine described related information.
Described call-information is the information of video pictures, and described determining unit comprises: detecting unit, detects user's input operation; And the first handling object determining unit, based on described input operation, from described video pictures, determine handling object.
Described detecting unit is configured to detect the input operation for a region of selected described video pictures; And described the first handling object determining unit is configured to be defined as handling object with the corresponding partial video picture in described region in described video pictures.
Described detecting unit is configured to detect for clicking the clicking operation of described video pictures; And, described the first handling object determining unit comprises: image cutting unit, based on the ad-hoc location in described video pictures corresponding to described clicking operation, described video pictures is carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location; And object determining unit, described partial video picture is defined as to handling object.
Described detecting unit comprises: recognition unit, carries out image recognition to described video pictures, to determine multiple candidate targets; Select detecting unit, detect the selection operation of user at least one candidate target in described multiple candidate targets; And described the first handling object determining unit is configured to, based on described selection operation, selected described at least one candidate target is defined as to described handling object.
Described call-information is the information of tableaux, and described determining unit also comprises: tableaux recognition unit, carries out image recognition to described tableaux, so that described tableaux is divided into multiple regions; Target area determining unit based on preassigned, is determined target area from described multiple regions; And the second handling object determining unit, based on described target area, determine described handling object.
Described call-information is the information of dynamic menu, and described determining unit also comprises: dynamic menu recognition unit, described dynamic menu is identified to the specific action of making to identify user in described communication process; And the 3rd handling object determining unit, based on described specific action, determine described handling object.
Described call-information is the information of audio frequency, and described determining unit comprises: audio identification unit, carries out audio identification to described audio frequency, to determine handling object.
Described determining unit also comprises: candidate target determining unit, based on described call-information, determine multiple candidate targets; Select detecting unit, detect user at least one the selection operation in described multiple candidate targets; And the 4th handling object determining unit, based on described selection operation, will be selected described at least one candidate target be defined as described handling object.
According to another embodiment of the present invention, a kind of information processing method is provided, be applied to a server, described information processing method comprises: in the process that the first electronic equipment and the second electronic equipment are conversed, obtain from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces; Based on described call-information, determine handling object; Described handling object is analyzed, to obtain the related information being associated with described handling object; And the operation of execution based on described related information.
Described call-information is the information of video pictures, and described definite handling object comprises: receive the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation; And based on described input trajectory information, determine handling object.
Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one obtain by detecting for the input operation in a region of selected described video pictures; And described definite handling object comprises: will be defined as handling object with the corresponding partial video picture in described region in described video pictures.
Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one by detect obtain for the clicking operation of clicking described video pictures; And described definite handling object comprises: based on the ad-hoc location in described video pictures corresponding to described clicking operation, described video pictures is carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location; And described partial video picture is defined as to handling object.
Described information processing method also comprises: described video pictures is carried out to image recognition, to determine multiple candidate targets; And by multiple candidate targets be sent in described the first electronic equipment and described the second electronic equipment described at least one; And, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one by detecting user, the selection operation of at least one candidate target in described multiple candidate targets is obtained; Described definite handling object also comprises: based on described selection operation, selected described at least one candidate target is defined as to described handling object.
Described call-information is the information of video pictures, and described definite handling object comprises: described video pictures is carried out to image recognition, so that described tableaux is divided into multiple regions; Based on preassigned, from described multiple regions, determine target area; And based on described target area, determine described handling object.
Described call-information is the information of dynamic menu, and described definite handling object also comprises: described dynamic menu is identified to the specific action of making in described communication process with the object identifying in described dynamic menu; And based on described specific action, determine described handling object.
Described call-information is the information of audio frequency, and described definite handling object comprises: described audio frequency is carried out to audio identification, to determine handling object.
Described definite handling object also comprises: based on described call-information, determine multiple candidate targets; Described multiple candidate targets are sent to at least one in described the first electronic equipment and described the second electronic equipment; Receive described at least one user in described the first electronic equipment and described the second electronic equipment for selecting the selection information of at least one candidate target; And based on described selection information, selected described at least one candidate target is defined as to described handling object.
The pre-stored object information of multiple objects in described server, and the object information of each object is stored explicitly with the attribute information of the attribute for representing described object; And, described in obtain the related information being associated with described handling object and comprise: described handling object is analyzed, to determine the attribute of described handling object; Based on the attribute of described handling object, determine attribute information corresponding in the attribute information of storing; And the object information associated with described corresponding attribute information is defined as to described related information.
According to another embodiment of the present invention, a kind of messaging device is provided, be applied to a server, described messaging device comprises: call-information acquiring unit, in the process that the first electronic equipment and the second electronic equipment are conversed, obtain from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces; Determining unit, based on described call-information, determines handling object; Related information acquiring unit, analyzes described handling object, to obtain the related information being associated with described handling object; And performance element is carried out the operation based on described related information.
Described call-information is the information of video pictures, and described determining unit comprises: receiving element, receive the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation; And the first handling object determining unit, based on described input trajectory information, determine handling object.
Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one obtain by detecting for the input operation in a region of selected described video pictures; And described the first handling object determining unit is configured to be defined as handling object with the corresponding partial video picture in described region in described video pictures.
Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one by detect obtain for the clicking operation of clicking described video pictures; And, described the first handling object determining unit comprises: image cutting unit, based on the ad-hoc location in described video pictures corresponding to described clicking operation, described video pictures is carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location; And object determining unit, described partial video picture is defined as to handling object.
Described messaging device also comprises: recognition unit, carries out image recognition to described video pictures, to determine multiple candidate targets; And transmitting element, by multiple candidate targets be sent in described the first electronic equipment and described the second electronic equipment described at least one; And, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one by detecting user, the selection operation of at least one candidate target in described multiple candidate targets is obtained; Described the first handling object determining unit is configured to, based on described selection operation, selected described at least one candidate target is defined as to described handling object.
Described call-information is the information of video pictures, and described determining unit comprises: tableaux recognition unit, carries out image recognition to described video pictures, so that described tableaux is divided into multiple regions; Target area determining unit based on preassigned, is determined target area from described multiple regions; And the second handling object determining unit, based on described target area, determine described handling object.
Described call-information is the information of dynamic menu, and described determining unit comprises: dynamic menu recognition unit, described dynamic menu is identified to the specific action made from the object identifying in described dynamic menu in described communication process; And the 3rd handling object determining unit, based on described specific action, determine described handling object.
Described call-information is the information of audio frequency, and described determining unit comprises: audio identification unit, carries out audio identification to described audio frequency, to determine handling object.
Described determining unit comprises: candidate target determining unit, based on described call-information, determine multiple candidate targets; Transmitting element, is sent at least one in described the first electronic equipment and described the second electronic equipment by described multiple candidate targets; Receiving element, receives described at least one user in described the first electronic equipment and described the second electronic equipment for selecting the selection information of at least one candidate target; And the 4th handling object determining unit, based on described selection information, selected described at least one candidate target is defined as to described handling object.
The pre-stored object information of multiple objects in described server, and the object information of each object is stored explicitly with the attribute information of the attribute for representing described object; And described related information acquiring unit comprises: attribute determining unit, described handling object is analyzed, to determine the attribute of described handling object; Attribute information determining unit, based on the attribute of described handling object, determines attribute information corresponding in the attribute information of storing; And object information determining unit, the object information associated with described corresponding attribute information is defined as to described related information.
According to another embodiment of the present invention, a kind of information processing method is provided, be applied to the first electronic equipment, described information processing method comprises: carry out in the process of multimedia session at described the first electronic equipment and described the second electronic equipment, the call-information producing based on described call, determines handling object; Obtain the related information associated with described handling object; And the operation of execution based on described related information.
Obtaining the related information associated with described handling object comprises: described handling object is sent to remote server; And receive related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
Obtaining the related information associated with described handling object comprises: described handling object is analyzed, to determine described related information.
The operation of carrying out based on described related information comprises: generate the prompting icon for pointing out user to check, described prompting icon is used for linking to described related information; And show described prompting icon.
Whether described call is voice-frequency telephony, and the operation of carrying out based on described related information comprises: detect described the first electronic equipment and be connected with a display device; And in the time detecting that described the first electronic equipment is connected with a display device, exporting described related information to described display device, described display device shows based on described related information.
Described call is video calling, and the operation of carrying out based on described related information comprises: the image of the image based on described related information and described video calling is combined, to generate combination image; And show described combination image.
Carrying out operation based on described related information comprises with lower at least one: show described related information; Store described related information; And described related information is sent to at least one in remote server and described the second electronic equipment.
After the described related information of storage, described information processing method also comprises: judge whether first predetermined condition of current time; And in the time judging current time first predetermined condition, carry out the demonstration based on described related information.
After the described related information of storage, described information processing method also comprises: in the time that described the first electronic equipment carries out access to netwoks, judge whether second predetermined condition of described access to netwoks; And in the time of described access to netwoks second predetermined condition, carry out the demonstration based on described related information.
After the described related information of storage, described information processing method also comprises: the environmental information that detects described the first electronic equipment; Judge whether described environmental information meets the 3rd predetermined condition; And in the time that described environmental information meets the 3rd predetermined condition, carry out the demonstration based on described related information.
The demonstration of carrying out based on described related information comprises: show at least one in described related information and prompting icon, wherein, described prompting icon is used for linking to described related information.
According to another embodiment of the present invention, a kind of messaging device is provided, be applied to the first electronic equipment, described messaging device comprises: determining unit, carry out in the process of multimedia session at described the first electronic equipment and described the second electronic equipment, the call-information producing based on described call, determines handling object; Acquiring unit, obtains the related information associated with described handling object; And performance element, carry out the operation based on described related information.
Described acquiring unit comprises: transmitting element, is sent to remote server by described handling object; And receiving element, receive related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
Described acquiring unit comprises: analytic unit, described handling object is analyzed, to determine described related information.
Described performance element comprises: icon generation unit, generate the prompting icon for pointing out user to check, and described prompting icon is used for linking to described related information; And icon display unit, show described prompting icon.
Described call is voice-frequency telephony, and described performance element comprises: whether the first detecting unit, detect described the first electronic equipment and be connected with a display device; And output unit, in the time detecting that described the first electronic equipment is connected with a display device, exporting described related information to described display device, described display device shows based on described related information.
Described call is video calling, and described performance element comprises: assembled unit, combines the image of the image based on described related information and described video calling, to generate combination image; And combination image display unit, show described combination image.
Described performance element is configured to carry out with lower at least one: show described related information; Store described related information; And described related information is sent to at least one in remote server and described the second electronic equipment.
In the situation that described performance element is configured to store described related information, described performance element also comprises: the first judging unit, after the described related information of storage, judges whether first predetermined condition of current time; And described performance element is configured in the time judging current time first predetermined condition, carry out the demonstration based on described related information.
In the situation that described performance element is configured to store described related information, described performance element also comprises: the second judging unit, after the described related information of storage, in the time that described the first electronic equipment carries out access to netwoks, judge whether second predetermined condition of described access to netwoks; And described performance element is configured in the time of described access to netwoks second predetermined condition, carry out the demonstration based on described related information.
In the situation that described performance element is configured to store described related information, described messaging device also comprises: environmental information detecting unit, after the described related information of storage, detects the environmental information of described the first electronic equipment; And the 3rd judging unit, judge whether described environmental information meets the 3rd predetermined condition; And described performance element is configured to, in the time that described environmental information meets the 3rd predetermined condition, carry out the demonstration based on described related information.
Described performance element is configured to show at least one in described related information and prompting icon, and described prompting icon is used for linking to described related information.
According to another embodiment of the present invention, a kind of information processing method is provided, be applied to a server, described information processing method comprises: in the process that the first electronic equipment and the second electronic equipment are conversed, obtain from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces; Based on described call-information, determine handling object; Described handling object is analyzed, to obtain the related information being associated with described handling object; And the operation of execution based on described related information.
Carry out operation based on described related information comprise following one of at least: store described related information; Based on predetermined policy, described related information is sent to at least one in described the first electronic equipment and described the second electronic equipment.
Describedly be sent to described the first electronic equipment based on predetermined policy, by described related information or described the second electronic equipment comprises: receive at least one the request coming from described the first electronic equipment and described the second electronic equipment; And in response to described request, described related information is sent to the electronic equipment of asking in described the first electronic equipment and described the second electronic equipment.
Describedly be sent to described the first electronic equipment based on predetermined policy, by described related information or described the second electronic equipment comprises: described related information is sent to the electronic equipment that sends call-information in described the first electronic equipment and described the second electronic equipment.
Described call-information comprises the information of audio frequency, describedly be sent to described the first electronic equipment based on predetermined policy, by described related information or described the second electronic equipment comprises: described audio frequency is carried out to semantic analysis, to determine which in described the first electronic equipment and described the second electronic equipment described related information be suitable for; And described related information is sent in described the first electronic equipment and described the second electronic equipment and is confirmed as applicable electronic equipment.
The pre-stored object information of multiple objects in described server, and the object information of each object is stored explicitly with the attribute information of the attribute for representing described object; And, described in obtain the related information being associated with described handling object and comprise: described handling object is analyzed, to determine the attribute of described handling object; Based on the attribute of described handling object, determine attribute information corresponding in the attribute information of storing; And the object information associated with described corresponding attribute information is defined as to described related information.
According to another embodiment of the present invention, a kind of messaging device is provided, be applied to a server, described messaging device comprises: acquiring unit, in the process that the first electronic equipment and the second electronic equipment are conversed, obtain from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces; Determining unit, based on described call-information, determines handling object; Analytic unit, analyzes described handling object, to obtain the related information being associated with described handling object; And performance element, carry out the operation based on described related information.
Described performance element be configured to carry out following one of at least: store described related information; Based on predetermined policy, described related information is sent to at least one in described the first electronic equipment and described the second electronic equipment.
Be configured to based on predetermined policy at described performance element, described related information is sent to described the first electronic equipment or described the second electronic equipment in the situation that, described performance element comprises: receiving element, receives at least one the request coming from described the first electronic equipment and described the second electronic equipment; And transmitting element, in response to described request, described related information is sent to the electronic equipment of asking in described the first electronic equipment and described the second electronic equipment.
Be configured to based on predetermined policy at described performance element, described related information is sent to described the first electronic equipment or described the second electronic equipment in the situation that, described performance element is configured to described related information to be sent to the electronic equipment that sends call-information in described the first electronic equipment and described the second electronic equipment.
Described call-information comprises the information of audio frequency, be configured to based on predetermined policy at described performance element, described related information is sent to described the first electronic equipment or described the second electronic equipment in the situation that, described performance element comprises: semantic analysis unit, described audio frequency is carried out to semantic analysis, to determine which in described the first electronic equipment and described the second electronic equipment described related information be suitable for; And transmitting element, described related information is sent in described the first electronic equipment and described the second electronic equipment and is confirmed as applicable electronic equipment.
The pre-stored object information of multiple objects in described server, and the object information of each object is stored explicitly with the attribute information of the attribute for representing described object; And described acquiring unit comprises: attribute determining unit, described handling object is analyzed, to determine the attribute of described handling object; Attribute information determining unit, based on the attribute of described handling object, determines attribute information corresponding in the attribute information of storing; And object information determining unit, the object information associated with described corresponding attribute information is defined as to described related information.
In the information processing method and messaging device of the embodiment of the present invention, the call-information producing based on call is determined handling object, and obtain the related information associated with described handling object, thereby can carry out the operation based on described related information, such as demonstration, storage or forwarding etc.Thereby, by information processing method and the messaging device of the embodiment of the present invention, can utilize the call-information producing in communication process, thereby except realize communication objective, can also further promote the using value of call, greatly enrich user's experience.
Accompanying drawing explanation
Fig. 1 is that diagram is according to the flow chart of the information processing method of first embodiment of the invention;
Fig. 2 is that diagram is according to the block diagram of the main configuration of the messaging device of first embodiment of the invention;
Fig. 3 is that diagram is according to the flow chart of the information processing method of second embodiment of the invention;
Fig. 4 is that diagram is according to the block diagram of the main configuration of the messaging device of second embodiment of the invention;
Fig. 5 A-5C is the demonstration schematic diagram that diagram has been applied the first electronic equipment of the information processing method of the embodiment of the present invention; And
Fig. 6 is another demonstration schematic diagram that illustrates the first electronic equipment of the information processing method of having applied the embodiment of the present invention.
Embodiment
Describe the embodiment of the present invention in detail below with reference to accompanying drawing.
The information processing method of the embodiment of the present invention and messaging device are applied to the environment that the first electronic equipment and the second electronic equipment are conversed.Described the first electronic equipment and described the second electronic equipment can be the electronic equipments that such as landline telephone, mobile phone, panel computer, personal computer etc. has communication function.Described communication can be traditional voice communication (as via landline telephone), can be also video communication (as via Video chat application), can also be textcommunication (as via instant message (text chat) application).Described the first electronic equipment can be identical with the kind of described the second electronic equipment, also can be different.
In addition, the call between described the first electronic equipment and described the second electronic equipment can be via the network such as internet, is undertaken by server (below, suitably time also referred to as remote server).That is to say, call-information is sent to described server by one of described the first electronic equipment and described second electronic equipment, and described call-information is forwarded to another of described the first electronic equipment and described the second electronic equipment by described server.Certainly, the call between described the first electronic equipment and described the second electronic equipment also can directly not carried out via the forwarding of server.
In the following description, take communicating by letter as example between the first electronic equipment and these two electronic equipments of the second electronic equipment, the embodiment of the present invention has been described.But, it will be appreciated by those skilled in the art that the information processing method of the embodiment of the present invention and messaging device can be applied to the scene communicating more than between the electronic equipment of two.
In addition, the information processing method of the embodiment of the present invention and messaging device can be applied to any in described the first electronic equipment and described the second electronic equipment, also can be applied to described server.Below, by the information processing method and the messaging device that are described in respectively in above-mentioned various situation.
(the first execution mode)
In first embodiment of the invention, described information processing method is applied to any or both in described the first electronic equipment and described the second electronic equipment.Below, suppose that described information processing method is applied to described the first electronic equipment.
The information processing method of this embodiment according to the present invention is described with reference to Fig. 1 below.In the time that the information processing method of the embodiment of the present invention starts, described the first electronic equipment and described the second electronic equipment are in the process of conversing.
As shown in Figure 1, first, at step S101, the call-information that described information processing method produces based on described call, determines handling object.
The input operation that can initiatively carry out by detection user of determining of described handling object realizes, and also can automatically be analyzed and identify and realize call-information by described information processing method.
Particularly, in one embodiment, described call comprises video calling, and the described call-information information that comprises video pictures.In the case, user is by carrying out input operation and designated treatment object to described video pictures.Correspondingly, the handling object that user is specified is determined in the input operation that the information processing method of the embodiment of the present invention carries out described video pictures by detection user.
More specifically, for example, in the first example, user can select a region in described video pictures.Correspondingly, the information processing method of the embodiment of the present invention detects the input operation for a region of selected described video pictures.After this, described information processing method will be defined as handling object with the corresponding partial video picture in described region in described video pictures.
In the second example, user can click the ad-hoc location in described video pictures.Correspondingly, the information processing method of the embodiment of the present invention detects the clicking operation for clicking described video pictures.
After this, the ad-hoc location of described information processing method based in described video pictures corresponding to described clicking operation, carries out image to described video pictures and cuts apart, to obtain the partial video picture that comprises described ad-hoc location.It is known to those skilled in the art that described information processing method carries out to described video pictures the technology that image cuts apart, and is not described in detail in this.
After the partial video picture that comprises ad-hoc location described in obtaining, described partial video picture is defined as handling object by described information processing method.
In the 3rd example, first described information processing method can carry out image recognition to described video pictures, to determine multiple candidate targets.Described information processing method can adopt various image recognition algorithm known in the art to determine described candidate target, is not described in detail in this.
After having determined described multiple candidate target, described information processing method can be presented to user by the information about described candidate target, selects for user.After this, described information processing method detects the selection operation of user at least one candidate target in described multiple candidate targets.And in the time detecting that user operates the selection of described at least one candidate target, described information processing method operates based on described selection, selected described at least one candidate target is defined as to described handling object.
Describe the input operation of initiatively carrying out by user above and determined the various examples of handling object.Below, will describe by automatically call-information being analyzed and identified the situation of determining handling object.
More specifically, in the first example, the information that described call-information comprises tableaux.In the case, described information processing method carries out image recognition to described tableaux, so that described tableaux is divided into multiple regions.For example, described information processing method is divided into several mutually disjoint regions according to features such as gray scale, colour, spatial texture, geometries by described tableaux, make these features in the same area, show consistency or similitude, and between zones of different, show obvious difference.Described information processing method can adopt and carry out image such as the various algorithms of the method based on threshold value, the method based on cluster, the method based on region and edge, method based on global optimization etc. and cut apart.Certainly, the algorithm that above-mentioned image is cut apart is only for example, and those skilled in the art can adopt various algorithms to carry out image to cut apart, be not described in detail in this.
After this, described information processing method, based on preassigned, is determined target area from described multiple regions.For example, the standard of the significance that described information processing method can be based on multiple regions, user's degree interested of training in advance, regional location, region area etc. is determined target area from described multiple regions.Certainly, the standard of above-mentioned definite target area and respective algorithms are only example.The information processing method of the embodiment of the present invention can adopt other various standards well known by persons skilled in the art and respective algorithms to determine target area, is not described in detail in this.
After determining described target area, described information processing method, based on described target area, is determined described handling object.Particularly, for example, described information processing method can be analyzed the video pictures of described target area, to determine handling object.For example, the video pictures that described information processing method can be by identifying described target area to be to determine its object kind, thereby determines handling object.Again for example, described information processing method can be by the image in the video pictures of described target area and pre-stored information bank is carried out to fuzzy matching, thereby determine handling object.Certainly, above-mentioned based target region determines that the method for handling object is only example.The information processing method of the embodiment of the present invention can adopt other the whole bag of tricks well known by persons skilled in the art to determine handling object, is not described in detail in this.
In the second example, described call-information comprises the information of dynamic menu.In the case, described information processing method can be identified described dynamic menu, the specific action of making in described communication process to identify user.For example, described information processing method can be by the dynamic menu being made up of multiple frames continuous in time being carried out and described similar identification above, thereby identify the action that user makes in section at this moment.
After this, described information processing method can, based on described specific action, be determined described handling object.For example, the table of the incidence relation of described information processing method between can action and handling object based on pre-stored, determines handling object according to described specific action.
In the 3rd example, described call-information comprises the information of audio frequency.In the case, described information processing method can carry out audio identification to described audio frequency, to determine handling object.
More specifically, for example, described information processing method can judge in described audio frequency, whether there is the audio fragment mating with predetermined keyword.In the time judging the audio fragment that in described audio frequency, existence is mated with predetermined keyword, described information processing method will be defined as handling object with described audio fragment.
Again for example, described information processing method can carry out semantic analysis to described audio frequency, and result based on semantic analysis is determined handling object.
Certainly, described information processing method can utilize various algorithm known in the art to carry out audio identification to described audio frequency, is not described in detail in this.
In addition,, with above-mentioned same, the information processing method of the embodiment of the present invention can combine user's active input with the automatic identification of described electronic equipment.Particularly, in the 4th example, described information processing method can, based on described call-information, be determined multiple candidate targets.After this, described information processing method can be presented to user by described multiple candidate targets, and detects user at least one the selection operation in described multiple candidate targets.Next, described information processing method operates based on described selection, and selected described at least one candidate target is defined as to described handling object.
In addition,, in the 5th example, described call-information comprises text message.In the case, described information processing method can carry out text identification to described text, to determine handling object.
More specifically, for example, described information processing method can judge in described text, whether there is the text fragments mating with predetermined keyword.In the time judging the text fragments that in described text, existence is mated with predetermined keyword, described information processing method will be defined as handling object with described text fragments.
Again for example, described information processing method can carry out semantic analysis to described text, and result based on semantic analysis is determined handling object.
Certainly, described information processing method can utilize various algorithm known in the art to carry out text identification to described text, is not described in detail in this.
By processing as above, at step S101, the call-information that described information processing method produces based on described call, has determined handling object.
After this,, at step S102, described information processing method obtains the related information associated with described handling object.
Particularly, in one embodiment, described information processing method can be sent to remote server by described handling object, by described remote server, described handling object is analyzed.After this, described information processing method receives related information from described remote server.Described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
Described remote server can obtain described related information by the whole bag of tricks.As an example, object information that can pre-stored multiple objects in described remote server, and the object information of each object and attribute information are stored explicitly.Described attribute information is for representing the attribute of described object, such as clothing, building etc.
After receiving the handling object that described information processing method sends, described remote server is analyzed described handling object, to determine the attribute of described handling object.After this, the attribute of described remote server based on described handling object, determines attribute information corresponding in the attribute information of storing, and the object information associated with described corresponding attribute information is defined as to described related information.
In another embodiment, described information processing method can be analyzed described handling object in this locality, to determine described related information.In the case, described information processing method can be in this locality the described object information of the multiple objects of association store and described attribute information in advance.
After having determined handling object, described information processing method can be analyzed described handling object, to determine the attribute of described handling object.After this, the attribute of described information processing method based on described handling object, determines attribute information corresponding in the attribute information of storing, and the object information associated with described corresponding attribute information is defined as to described related information.
After having determined described related information, at step S103, described information processing method is carried out the operation based on described related information.
Above, the information processing method according to first embodiment of the invention has been described.
According in the information processing method of first embodiment of the invention, the call-information producing based on described call is determined handling object, obtains the related information associated with described handling object, and carries out the operation based on described related information.
Therefore, by the information processing method of first embodiment of the invention, can utilize the call-information producing in communication process, thus except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the information processing method of first embodiment of the invention, in end side (, described the first electronic equipment and/or described the second electronic equipment side), based on described call-information, can determine in response to user's input operation handling object, also can automatically determine handling object, above-mentioned two kinds of modes can also be combined.
Therefore, by the information processing method of first embodiment of the invention, provide various ways to utilize described call-information, thereby further enriched user's experience.
With reference to Fig. 2, at least one the messaging device being applied in described the first electronic equipment and described the second electronic equipment is described below.In the following description, suppose that described messaging device is applied to described the first electronic equipment.
As shown in Figure 2, comprise according to the messaging device 200 of first embodiment of the invention: determining unit 201, acquiring unit 202 and performance element 203.
Described determining unit 201 is in the process that described the first electronic equipment and the second electronic equipment are conversed, and the call-information producing based on described call, determines handling object.Described acquiring unit 202 obtains the related information associated with described handling object.Described performance element 203 is carried out the operation based on described related information.
Particularly, in one embodiment, described acquiring unit 202 comprises transmitting element and receiving element (not shown).Described handling object is sent to remote server by described transmitting element.Described receiving element receives related information from described remote server.Described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
In another embodiment, described acquiring unit 202 comprises analytic unit (not shown), and it is analyzed described handling object, to determine described related information.
In addition, in one embodiment, handling object is determined in the input operation that described messaging device 200 initiatively carries out by detection user.
Particularly, described call-information comprises the information of video pictures, and described determining unit 201 comprises detecting unit and the first handling object determining unit (not shown).Described detecting unit detects user's input operation.Described the first handling object determining unit, based on described input operation, is determined handling object from described video pictures.
More specifically, in the first example, described detecting unit is configured to detect the input operation for a region of selected described video pictures.And described the first handling object determining unit is configured to be defined as handling object with the corresponding partial video picture in described region in described video pictures.
In the second example, described detecting unit is configured to detect for clicking the clicking operation of described video pictures.And, described the first handling object determining unit comprises: image cutting unit, based on the ad-hoc location in described video pictures corresponding to described clicking operation, described video pictures is carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location; And object determining unit, described partial video picture is defined as to handling object.
In the 3rd example, described messaging device 200 also comprises recognition unit (not shown), and it carries out image recognition to described video pictures, to determine multiple candidate targets.In addition, described detecting unit comprises: select detecting unit, detect the selection operation of user at least one candidate target in described multiple candidate targets.And described the first handling object determining unit is configured to, based on described selection operation, selected described at least one candidate target is defined as to described handling object.
In another embodiment, described messaging device 200 is by automatically analyzing and determine handling object call-information.
Particularly, in the first example, described call-information comprises the information of tableaux.Described determining unit 201 also comprises tableaux recognition unit, target area determining unit and the second handling object determining unit (not shown).Described tableaux recognition unit carries out image recognition to described tableaux, so that described tableaux is divided into multiple regions.Described target area determining unit, based on preassigned, is determined target area from described multiple regions.Described the second handling object determining unit, based on described target area, is determined described handling object.
In the second example, described call-information comprises the information of dynamic menu.Described determining unit 201 also comprises dynamic menu recognition unit and the 3rd handling object determining unit (not shown).Described dynamic menu recognition unit is identified described dynamic menu, the specific action of making in described communication process to identify user.Described the 3rd handling object determining unit, based on described specific action, is determined described handling object.
In the 3rd example, described call-information comprises the information of audio frequency.Described determining unit 201 comprises audio identification unit, and it carries out audio identification to described audio frequency, to determine handling object.
In the 4th example, described messaging device 200 is by detecting the input operation that user initiatively carries out and call-information automatically be analyzed and determined handling object.
Particularly, in this embodiment, described determining unit 201 also comprises candidate target determining unit, selects detecting unit and the 4th handling object determining unit.Described candidate target determining unit, based on described call-information, is determined multiple candidate targets.Described selection detecting unit, detects user at least one the selection operation in described multiple candidate targets.Described the 4th handling object determining unit operates based on described selection, and selected described at least one candidate target is defined as to described handling object.
In the 5th example, described call-information comprises text message.In the case, described messaging device 200 can carry out text identification to described text, to determine handling object.
The concrete configuration of each unit of the messaging device of first embodiment of the invention and operation describe in detail in the description of the information processing method of the first embodiment of the invention with reference to Fig. 1, no longer repeat at this.
Above, the messaging device according to first embodiment of the invention has been described.
By the messaging device of first embodiment of the invention, can utilize the call-information producing in communication process, thereby except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the messaging device of first embodiment of the invention, in end side (, described the first electronic equipment and/or described the second electronic equipment side), based on described call-information, can determine in response to user's input operation handling object, also can automatically determine handling object, above-mentioned two kinds of modes can also be combined.
Therefore, by the messaging device of first embodiment of the invention, provide various ways to utilize described call-information, thereby further enriched user's experience.
(the second execution mode)
In second embodiment of the invention, a kind of information processing method and messaging device are provided.Different from information processing method and the messaging device of first embodiment of the invention, in second embodiment of the invention, described information processing method and messaging device are applied to server side, but not end side.
The information processing method of second embodiment of the invention is described with reference to Fig. 3 below.In the time that the information processing method of the embodiment of the present invention starts, described the first electronic equipment and described the second electronic equipment are in the process of conversing.
As shown in Figure 3, first, at step S301, described information processing method obtains from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces.
Described call-information is to produce in the process that described the first electronic equipment and described the second electronic equipment are conversed, and is sent to described server by least one in described the first electronic equipment and described the second electronic equipment.Described call-information can be audio-frequency information, video information, text message etc., can be also the combination in any of above-mentioned information.
Next,, at step S302, described information processing method, based on described call-information, is determined handling object.
Same with above-mentioned the first execution mode, the input operation that can initiatively carry out by detection user of determining of described handling object realizes, and also can automatically be analyzed and identify and realize call-information by described information processing method.
Particularly, in one embodiment, described call comprises video calling, and the described call-information information that comprises video pictures.In the case, user is by carrying out input operation and designated treatment object to described video pictures.The information of the input operation that correspondingly, the information processing method of the embodiment of the present invention carries out described video pictures by acquisition user is determined the handling object that user is specified.
More specifically, described information processing method receives the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment.The electronic equipment that sends described input trajectory information and the electronic equipment that sends call-information in above-mentioned steps S301 can be identical electronic equipments, can be also different electronic equipments.
Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation.Described input trajectory information both can comprise the information of a series of track being formed by multiple tracing points, also can comprise the information of the track being formed by single tracing point.For example, in the situation that described electronic equipment comprises that touch control unit and user carry out input operation by described touch control unit, described input trajectory information can be the information that the slip gesture by detecting user produces, and can be also the information that the clicking operation by detecting user produces.
In addition the electronic equipment that, sends described input trajectory information in described the first electronic equipment and described the second electronic equipment also can send the information such as size of the display frame of described electronic equipment etc.
After this, described information processing method, based on described input trajectory information, is determined handling object.
More specifically, for example, in the first example, for example user of the first electronic equipment can select a region in described video pictures.Correspondingly, the input operation that described the first electronic equipment is used for a region of selected described video pictures by detection forms input trajectory information.After this, the electronic equipment parameter information of described input trajectory information and described the first electronic equipment is sent to described server by described the first electronic equipment.Next, described information processing method will be defined as handling object with the corresponding partial video picture in described region in described video pictures.
In the second example, for example the user of the first electronic equipment can click the ad-hoc location in described video pictures.Correspondingly, the clicking operation that described the first electronic equipment is used for clicking described video pictures by detection forms input trajectory information.After this, described input trajectory information is sent to described server by described the first electronic equipment.
Next, described information processing method, based on described input trajectory information, determines that described input trajectory information is corresponding to which position in described video pictures (, above-mentioned ad-hoc location).After this, described information processing method carries out image to described video pictures to be cut apart, and to obtain the partial video picture that comprises described ad-hoc location, and described partial video picture is defined as to handling object.Equally, described information processing method can carry out aforesaid operations based on various image segmentation algorithms known in the art, is not described in detail in this.
In the 3rd example, described information processing method can be by combining user's active input to determine handling object with the automatic analysis of server.
Particularly, described information processing method can carry out image recognition to described video pictures, to determine multiple candidate targets.After this, described information processing method can be sent to multiple candidate targets at least one in described the first electronic equipment and described the second electronic equipment, selects for user.The selection operation of described at least one detection user in described the first electronic equipment and described the second electronic equipment at least one candidate target in described multiple candidate targets, produces corresponding input trajectory information and is sent to described server.
Thus, described server, based on operating by detecting described selection the selection information (, input trajectory information as above) obtaining, is defined as described handling object by selected described at least one candidate target.
Below, will describe by automatically call-information being analyzed and identified the situation of determining handling object.
Particularly, in the first example, the information that described call-information comprises tableaux.In the case, described information processing method carries out image recognition to described tableaux, so that described tableaux is divided into multiple regions.Same with above-mentioned the first execution mode, those skilled in the art can adopt various algorithms to carry out image to cut apart, be not described in detail in this.
After this, described information processing method, based on preassigned, is determined target area from described multiple regions.Same with above-mentioned the first execution mode, those skilled in the art can adopt various standards and respective algorithms to determine target area, are not described in detail in this.
After determining described target area, described information processing method, based on described target area, is determined described handling object.Particularly, for example, described information processing method can be analyzed the video pictures of described target area, to determine handling object.For example, the video pictures that described information processing method can be by identifying described target area to be to determine its object kind, thereby determines handling object.Again for example, described information processing method can be by the image in the video pictures of described target area and pre-stored information bank is carried out to fuzzy matching, thereby determine handling object.Certainly, above-mentioned based target region determines that the method for handling object is only example.The information processing method of the embodiment of the present invention can adopt other the whole bag of tricks well known by persons skilled in the art to determine handling object, is not described in detail in this.
In the second example, described call-information comprises the information of dynamic menu.In the case, described information processing method can be identified described dynamic menu, the specific action of making in described communication process to identify user.For example, described information processing method can be by the dynamic menu being made up of multiple frames continuous in time being carried out and described similar identification above, thereby identify the action that user makes in section at this moment.
After this, described information processing method can, based on described specific action, be determined described handling object.For example, the table of the incidence relation of described information processing method between can action and handling object based on pre-stored, determines handling object according to described specific action.
In the 3rd example, described call-information comprises the information of audio frequency.In the case, described information processing method can carry out audio identification to described audio frequency, to determine handling object.
More specifically, for example, described information processing method can judge in described audio frequency, whether there is the audio fragment mating with predetermined keyword.In the time judging the audio fragment that in described audio frequency, existence is mated with predetermined keyword, described information processing method will be defined as handling object with described audio fragment.
Again for example, described information processing method can carry out semantic analysis to described audio frequency, and result based on semantic analysis is determined handling object.
Certainly, described information processing method can utilize various algorithm known in the art to carry out audio identification to described audio frequency, is not described in detail in this.
In addition,, with above-mentioned same, the information processing method of the embodiment of the present invention can combine user's active input with the automatic identification of described electronic equipment.Particularly, in the 4th example, described information processing method, based on described call-information, is determined multiple candidate targets, and described multiple candidate targets are sent to at least one in described the first electronic equipment and described the second electronic equipment.The electronic equipment that receives described candidate target detects user for selecting the selection operation of at least one candidate target, and described selection is operated to the selection information producing is sent to described server.Described information processing method receives described selection information, and based on described selection information, selected described at least one candidate target is defined as to described handling object.
In the 5th example, described call-information comprises text message.In the case, described information processing method can carry out text identification to described text, to determine handling object.
More specifically, for example, described information processing method can judge in described text, whether there is the text fragments mating with predetermined keyword.In the time judging the text fragments that in described text, existence is mated with predetermined keyword, described information processing method will be defined as handling object with described text fragments.
Again for example, described information processing method can carry out semantic analysis to described text, and result based on semantic analysis is determined handling object.
Certainly, described information processing method can utilize various algorithm known in the art to carry out text identification to described text, is not described in detail in this.
By processing as above, at step S302, the call-information of described information processing method based on received, has determined handling object.
Next, at step S303, described information processing method is analyzed described handling object, to obtain the related information being associated with described handling object.
Particularly, in one embodiment, the pre-stored object information of multiple objects in described server, and the object information of each object and attribute information are stored explicitly.Described attribute information is for representing the attribute of described object.
Thus, described information processing method is the incidence relation based between described object information and attribute information for example, described handling object is analyzed, to determine the attribute of described handling object.After this, the attribute of described information processing method based on described handling object, determines attribute information corresponding in the attribute information of storing.For example, described attribute information can be divided into different classes of.Described information processing method can be defined as corresponding attribute information by the attribute information that belongs to same classification or respective classes with the attribute of described handling object in stored attribute information.Next, the object information associated with described corresponding attribute information is defined as described related information by described information processing method.
In another embodiment, the information that described attribute information comprises multiple attribute.Described information processing method, after having determined a certain attribute of described handling object, can directly be defined as described related information by other attribute informations of described handling object.
It is pointed out that the mode that above-described described information processing method is determined related information is only example.Those skilled in the art can adopt other variety of ways to obtain described related information.
After this,, at step S304, described information processing method is carried out the operation based on described related information.Particularly, for example, described information processing method can be stored described related information, described related information can be sent to at least one in described the first electronic equipment and described the second electronic equipment.Certainly, described information processing method can also utilize described related information with other variety of ways, and it all within the scope of the invention.
Above, the information processing method according to second embodiment of the invention has been described.
According in the information processing method of second embodiment of the invention, the call-information producing based on described call is determined handling object, obtains the related information associated with described handling object, and carries out the operation based on described related information.
Therefore, by the information processing method of second embodiment of the invention, can utilize the call-information producing in communication process, thus except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the information processing method of second embodiment of the invention, at server side, based on described call-information, can determine in response to user's input operation handling object, also can automatically determine handling object, above-mentioned two kinds of modes can also be combined.
Therefore, by the information processing method of second embodiment of the invention, provide various ways to utilize described call-information, thereby further enriched user's experience.In addition,, in the case of the disposal ability of electronic equipment side is limited, the information processing method of second embodiment of the invention can alleviate the processing load of electronic equipment side, thereby particularly favourable.
The messaging device that is applied to server of second embodiment of the invention is described with reference to Fig. 4 below.
As shown in Figure 4, the messaging device 400 of the embodiment of the present invention comprises call-information acquiring unit 401, determining unit 402, related information acquiring unit 403 and performance element 404.
Described call-information acquiring unit 401, in the process that the first electronic equipment and the second electronic equipment are conversed, obtains from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces.Described determining unit 402, based on described call-information, is determined handling object.Described related information acquiring unit 403 is analyzed described handling object, to obtain the related information being associated with described handling object.Described performance element 404 is carried out the operation based on described related information.
Particularly, in one embodiment, the information that described call-information is video pictures.Described determining unit 402 comprises receiving element and the first handling object determining unit (not shown).Described receiving element receives electronic equipment parameter information and the input trajectory information of at least one transmission in described the first electronic equipment and described the second electronic equipment.Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one produce by detecting user's input operation.Described the first handling object determining unit, based on described electronic equipment parameter information and described input trajectory information, is determined handling object.
More specifically, in the first example, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one obtain by detecting for the input operation in a region of selected described video pictures.Described the first handling object determining unit is configured to based on described electronic equipment parameter information, will in described video pictures, be defined as handling object with the corresponding partial video picture in described region.
In the second example, described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one by detect obtain for the clicking operation of clicking described video pictures.Described the first handling object determining unit comprises image cutting unit and object determining unit.Described image cutting unit is based on described electronic equipment parameter information, and ad-hoc location based in described video pictures corresponding to described clicking operation, described video pictures carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location.Described partial video picture is defined as handling object by described object determining unit.
In the 3rd example, described messaging device 400 also comprises recognition unit and transmitting element (not shown).Described recognition unit carries out image recognition to described video pictures, to determine multiple candidate targets.Described transmitting element by multiple candidate targets be sent in described the first electronic equipment and described the second electronic equipment described at least one.Described input trajectory information be in described the first electronic equipment and described the second electronic equipment described at least one by detecting user, the selection operation of at least one candidate target in described multiple candidate targets is obtained.In addition, described the first handling object determining unit is configured to based on described electronic equipment parameter information, and based on described selection operation, selected described at least one candidate target is defined as to described handling object.
In another embodiment, the information that described call-information is video pictures.Described determining unit 402 comprises tableaux recognition unit, target area determining unit and the second handling object determining unit.Described tableaux recognition unit carries out image recognition to described video pictures, so that described tableaux is divided into multiple regions.Described target area determining unit, based on preassigned, is determined target area from described multiple regions.Described the second handling object determining unit, based on described target area, is determined described handling object.
In another embodiment, the information that described call-information is dynamic menu.Described determining unit 402 comprises dynamic menu recognition unit and the 3rd handling object determining unit.Described dynamic menu recognition unit is identified described dynamic menu, the specific action of making in described communication process with the object identifying in described dynamic menu.Described the 3rd handling object determining unit, based on described specific action, is determined described handling object.
In another embodiment, the information that described call-information is audio frequency.Described determining unit 402 comprises audio identification unit, and it carries out audio identification to described audio frequency, to determine handling object.
In addition, in another embodiment, described determining unit 402 comprises candidate target determining unit, transmitting element, receiving element and the 4th handling object determining unit (not shown).
Particularly, described candidate target determining unit, based on described call-information, is determined multiple candidate targets.Described multiple candidate targets are sent at least one in described the first electronic equipment and described the second electronic equipment by described transmitting element.Described receiving element receives described at least one user in described the first electronic equipment and described the second electronic equipment for selecting the selection information of at least one candidate target.Described the 4th handling object determining unit, based on described selection information, is defined as described handling object by selected described at least one candidate target.
In addition, in one embodiment, the pre-stored object information of multiple objects in described server.The object information of each object is stored explicitly with the attribute information of the attribute for representing described object.In this embodiment, described related information acquiring unit 403 comprises attribute determining unit, attribute information determining unit and object information determining unit (not shown).
Particularly, described attribute determining unit is analyzed described handling object, to determine the attribute of described handling object.The attribute of described attribute information determining unit based on described handling object, determines attribute information corresponding in the attribute information of storing.The object information associated with described corresponding attribute information is defined as described related information by described object information determining unit.
The concrete configuration of each unit of the messaging device of second embodiment of the invention and operation describe in detail in the description of the information processing method of the second embodiment of the invention with reference to Fig. 3, no longer repeat at this.
Above, the messaging device according to second embodiment of the invention has been described.
By the messaging device of second embodiment of the invention, can utilize the call-information producing in communication process, thereby except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the messaging device of second embodiment of the invention, at server side, based on described call-information, can determine in response to user's input operation handling object, also can automatically determine handling object, above-mentioned two kinds of modes can also be combined.
Therefore, by the messaging device of second embodiment of the invention, provide various ways to utilize described call-information, thereby further enriched user's experience.In addition,, in the case of the disposal ability of electronic equipment side is limited, the messaging device of second embodiment of the invention can alleviate the processing load of electronic equipment side, thereby particularly favourable.
(the 3rd execution mode)
In third embodiment of the invention, a kind of information processing method and messaging device that is applied to end side is provided, its after obtaining related information as above, can carry out comprise immediately export, store, the various operations of forwarding etc.
First, will the information processing method of third embodiment of the invention be described.Equally, in the following description, suppose that described information processing method is applied to described the first electronic equipment.
The flow process of the flow process of the information processing method of third embodiment of the invention and the information processing method of first embodiment of the invention is similar.That is, described information processing method comprises equally: carry out in the process of multimedia session at described the first electronic equipment and described the second electronic equipment, the call-information producing based on described call, determines handling object; Obtain the related information associated with described handling object; And the operation of execution based on described related information.
In addition, similarly, in the information processing method of third embodiment of the invention, described information processing method can be sent to remote server by described handling object, by described handling object analysis is obtained to described related information, and described related information is sent to described the first electronic equipment by described remote server.On the other hand, described information processing method also can be analyzed described handling object in this locality, to determine described related information.
To described information processing method mainly be described carry out the details of the operation based on described related information below.
In the first embodiment, described information processing method is exported described related information in described communication process, or after described end of conversation, exports at once described related information.
In the case, for example, in the first example, described information processing method can generate the prompting icon for pointing out user to check, and shows described prompting icon.Described prompting icon is used for linking to described related information.After this,, in the time detecting that user clicks described prompting icon, described information processing method will be accessed described related information.
In the second example, described call is voice-frequency telephony.In the case, whether described information processing method detects described the first electronic equipment and is connected with a display device.It is pointed out that described display device can be external display device, can be also that described the first electronic equipment self comprises but display unit in disabled status.Described information processing method for example can obtain the information about above-mentioned connection by the corresponding connection pin that detects described the first electronic equipment.
In the time detecting that described the first electronic equipment is connected with a display device, described information processing method exports described related information to described display device.Thus, carry out the demonstration based on described related information by described display device.
In the 3rd example, described call is video calling.In the case, described information processing method combines the image of the image based on related information and described video calling, to generate combination image, and shows described combination image.The described image based on related information can be Show Picture, the image of the various forms of contents such as word.
In a second embodiment, described information processing method is not exported described related information immediately in described communication process and after end of conversation.Alternatively, described information processing method is stored in described related information in for example local memory.After this, only, in the time that judgement meets predetermined condition, described information processing method is just exported described related information.
Particularly, in the first example, described information processing method judges whether first predetermined condition of current time.For example, described information processing method judges whether current time is the time of described electronic equipment or user preset.Again for example, described information processing method judges whether current time and the time interval between the end of conversation time are the time interval of described electronic equipment or user preset.Again for example, described information processing method judges whether current time and the time interval between the end of conversation time are greater than the time interval of described electronic equipment or user preset.After this,, in the time judging current time first predetermined condition, described information processing method is carried out the demonstration based on described related information.Certainly, the first predetermined condition recited above is only example.Those skilled in the art completely can be as required, designs other various conditions as described the first predetermined condition.
In the second example, described information processing method, in the time that described the first electronic equipment carries out access to netwoks, judges whether second predetermined condition of described access to netwoks.For example, described information processing method judges whether the destination of described access to netwoks is the destination of described electronic equipment or user preset.Again for example, described information processing method in this locality the pre-stored table of comparisons between related information and access to netwoks destination.Described information processing method judges whether the destination of described access to netwoks is the destination corresponding with described related information.After this,, in the time judging described access to netwoks second predetermined condition, described information processing method is carried out the demonstration based on described related information.Certainly, the second predetermined condition recited above is only example.Those skilled in the art completely can be as required, designs other various conditions as described the second predetermined condition.
In the 3rd example, described information processing method can also detect the environmental information of described the first electronic equipment.Described environmental information for example comprises Weather information, the temperature information etc. of the residing positional information of described the first electronic equipment, environment of living in.Next, described information processing method judges whether described environmental information meets the 3rd predetermined condition.The in the situation that of positional information, for example, described information processing method judges whether described the first electronic equipment arrives the position of described electronic equipment or user preset.Again for example, described information processing method in this locality the pre-stored table of comparisons between related information and positional information.Described information processing method, based on described positional information, judges that whether described the first electronic equipment is in the position corresponding with described related information.The judgement of the environmental information of other kinds similarly, is not described in detail in this.After this,, in the time that described environmental information meets the 3rd predetermined condition, described information processing method is carried out the demonstration based on described related information.Certainly, the 3rd predetermined condition recited above is only example.Those skilled in the art completely can be as required, designs other various conditions as described the 3rd predetermined condition.
In the 3rd embodiment, same, described information processing method is not exported described related information immediately in described communication process and after end of conversation.Different from the second embodiment, described related information is sent at least one in remote server and described the second electronic equipment by described information processing method.Described remote server and/or described the second electronic equipment for example can be stored described related information or export described related information.
In addition, in each example as above, described Graphics Processing both can show described related information itself, also can show the prompting icon for being connected to described related information.
The information processing method of third embodiment of the invention has been described above.
According in the information processing method of third embodiment of the invention, the call-information producing based on described call is determined handling object, obtains the related information associated with described handling object, and carries out the operation based on described related information.
Therefore, by the information processing method of third embodiment of the invention, can utilize the call-information producing in communication process, thus except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the information processing method of third embodiment of the invention, in electronic equipment side, can in communication process or after end of conversation, show at once described related information and/or prompting icon, also can store described related information, and in the time that time judgement after a while meets predetermined condition, just trigger the output of related information, described related information can also be outputed to server and/or the second electronic equipment to process.
Therefore, by the information processing method of third embodiment of the invention, provide various ways to export described related information, facilitated user according to circumstances to carry out different customizations, thereby further enriched user's experience.
To the messaging device of third embodiment of the invention be described below.The configuration of the configuration of described messaging device and the messaging device of first embodiment of the invention is similar,, comprises equally determining unit, acquiring unit and performance element that is.
Described determining unit is carried out in the process of multimedia session at described the first electronic equipment and described the second electronic equipment, and the call-information producing based on described call, determines handling object.Described acquiring unit obtains the related information associated with described handling object.Described performance element is carried out the operation based on described related information.
With same in the first execution mode, in one embodiment, described acquiring unit can comprise: transmitting element, is sent to remote server by described handling object; And receiving element, receive related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
In another embodiment, described acquiring unit can comprise: analytic unit, described handling object is analyzed, to determine described related information.
In addition, in the present embodiment, described performance element is configured to carry out with lower at least one: show described related information; Store described related information; And described related information is sent to at least one in remote server and described the second electronic equipment.
Particularly, in one embodiment, described performance element can comprise icon generation unit and icon display unit.Described icon generation unit generates the prompting icon for pointing out user to check, described prompting icon is used for linking to described related information.Described icon display unit shows described prompting icon.
In addition, in another embodiment, described call is voice-frequency telephony.Described performance element can comprise the first detecting unit and output unit.Whether described the first detecting unit detects described the first electronic equipment and is connected with a display device.Described output unit, in the time detecting that described the first electronic equipment is connected with a display device, exports described related information to described display device, and described display device shows based on described related information.
In another embodiment, described call is video calling.Described performance element can comprise assembled unit and combination image display unit.Described assembled unit combines the image of the image based on described related information and described video calling, to generate combination image.Described combination image display unit shows described combination image.
In the situation that described performance element is configured to store described related information, described messaging device also comprises the first judging unit, after the described related information of storage, judges whether first predetermined condition of current time.Described performance element is configured in the time judging current time first predetermined condition, carries out the demonstration based on described related information.
In another embodiment, in the situation that described performance element is configured to store described related information, described messaging device also comprises: the second judging unit, after the described related information of storage, in the time that described the first electronic equipment carries out access to netwoks, judge whether second predetermined condition of described access to netwoks.Described performance element is configured in the time of described access to netwoks second predetermined condition, carries out the demonstration based on described related information.
In another embodiment, in the situation that described performance element is configured to store described related information, described messaging device also comprises: environmental information detecting unit, after the described related information of storage, detects the environmental information of described the first electronic equipment; And the 3rd judging unit, judge whether described environmental information meets the 3rd predetermined condition.Described performance element is configured to, in the time that described environmental information meets the 3rd predetermined condition, carry out the demonstration based on described related information.
In addition, in third embodiment of the invention, described performance element can be configured to show at least one in described related information and prompting icon, and described prompting icon is used for linking to described related information.
The concrete configuration of each unit of the messaging device of third embodiment of the invention and operation describe in detail in the description of the information processing method of third embodiment of the invention, no longer repeat at this.
The messaging device of third embodiment of the invention has been described above.
By the messaging device of third embodiment of the invention, can utilize the call-information producing in communication process, thereby except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the messaging device of third embodiment of the invention, in electronic equipment side, can in communication process or after end of conversation, show at once described related information and/or prompting icon, also can store described related information, and in the time that time judgement after a while meets predetermined condition, just trigger the output of related information, described related information can also be outputed to server and/or the second electronic equipment to process.
Therefore, by the messaging device of third embodiment of the invention, provide various ways to export described related information, facilitated user according to circumstances to carry out different customizations, thereby further enriched user's experience.
(the 4th execution mode)
In four embodiment of the invention, a kind of information processing method and messaging device that is applied to server is provided, its after obtaining related information as above, can carry out comprise immediately export, store, the various operations of forwarding etc.
First, will the information processing method of four embodiment of the invention be described.
The flow process of the flow process of the information processing method of four embodiment of the invention and the information processing method of second embodiment of the invention is similar.That is, described information processing method comprises equally: in the process that the first electronic equipment and the second electronic equipment are conversed, obtain from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces; Based on described call-information, determine handling object; Described handling object is analyzed, to obtain the related information being associated with described handling object; And the operation of execution based on described related information.
In addition, same with described the second execution mode, also can be pre-stored in described server the object information of multiple objects, and the object information of each object is stored explicitly with the attribute information for the attribute that represents described object.Described information processing method can be analyzed described handling object, to determine the attribute of described handling object, attribute based on described handling object is determined attribute information corresponding in the attribute information of storing, and the object information associated with described corresponding attribute information is defined as to described related information.
To described information processing method mainly be described carry out the details of the operation based on described related information below.
Particularly, in the information processing method of four embodiment of the invention, after having obtained related information as mentioned above, can store described related information, for example, for exporting after a while.
In another embodiment, described information processing method also can, based on predetermined policy, be sent at least one in described the first electronic equipment and described the second electronic equipment by described related information.
More specifically, in the first example, described information processing method receives at least one the request coming from described the first electronic equipment and described the second electronic equipment.Described request is used for asking described server to send described related information.In this example, suppose that described information processing method receives the request from the first electronic equipment.Thus, described information processing method, in response to described request, is sent to described related information the electronic equipment of asking in described the first electronic equipment and described the second electronic equipment, that is, and and the first electronic equipment in this example.
In the second example, described information processing method needn't be in response to sending related information from the additional request of the first electronic equipment or the second electronic equipment.In the case, described information processing method is sent to described related information the electronic equipment that sends call-information in described the first electronic equipment and described the second electronic equipment acquiescently.
In the 3rd example, described call-information comprises the information of audio frequency.Described information processing method carries out semantic analysis to described audio frequency, to determine which in described the first electronic equipment and described the second electronic equipment described related information be suitable for.It is known to those skilled in the art that described information processing method carries out the technology of semantic analysis, is not described in detail in this.Obtain definite result by semantic analysis after, described information processing method is sent to described related information in described the first electronic equipment and described the second electronic equipment and is confirmed as applicable electronic equipment.
In the 4th example, described call-information comprises the information of text.Equally, described information processing method carries out semantic analysis to described text, to determine which in described the first electronic equipment and described the second electronic equipment described related information be suitable for.It is known to those skilled in the art that described information processing method carries out the technology of semantic analysis, is not described in detail in this.Obtain definite result by semantic analysis after, same, described information processing method is sent to described related information in described the first electronic equipment and described the second electronic equipment and is confirmed as applicable electronic equipment.
It is pointed out that various strategies described above are only example.Those skilled in the art can design other various strategies completely as required, so that described related information is sent to suitable electronic equipment.
The information processing method of four embodiment of the invention has been described above.
According in the information processing method of four embodiment of the invention, the call-information producing based on described call is determined handling object, obtains the related information associated with described handling object, and carries out the operation based on described related information.
Therefore, by the information processing method of four embodiment of the invention, can utilize the call-information producing in communication process, thus except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the information processing method of four embodiment of the invention, at server side, can store described related information to delay output, also can described related information be sent to suitable electronic equipment according to various strategy, to be further processed by the electronic equipment that receives described related information.
Therefore, by the information processing method of four embodiment of the invention, provide various ways to export described related information, and provide various ways to export described related information to different electronic equipment, convenient service supplier according to circumstances carries out different customizations, and has further enriched user's experience.
The messaging device of four embodiment of the invention is described below.
The configuration of the configuration of described messaging device and the messaging device of second embodiment of the invention is similar,, comprises equally acquiring unit, determining unit, analytic unit and performance element that is.
Described acquiring unit, in the process that the first electronic equipment and the second electronic equipment are conversed, obtains from described the first electronic equipment and/or described the second electronic equipment the call-information that call produces.Described determining unit, based on described call-information, is determined handling object.Described analytic unit is analyzed described handling object, to obtain the related information being associated with described handling object.Described performance element is carried out the operation based on described related information.
With same in the second execution mode, can be pre-stored in described server the object information of multiple objects, and the object information of each object is stored explicitly with the attribute information for the attribute that represents described object.Described acquiring unit comprises attribute determining unit, attribute information determining unit and object information determining unit.
Described attribute determining unit is analyzed described handling object, to determine the attribute of described handling object.The attribute of described attribute information determining unit based on described handling object, determines attribute information corresponding in the attribute information of storing.Described object information determining unit, is defined as described related information by the object information associated with described corresponding attribute information.
In the messaging device of the 4th execution mode, described performance element be configured to carry out following one of at least: store described related information; Based on predetermined policy, described related information is sent to at least one in described the first electronic equipment and described the second electronic equipment.
Based on predetermined policy, described related information is sent to described the first electronic equipment or described the second electronic equipment in the situation that, in the first example, described performance element comprises: receiving element, receives at least one the request coming from described the first electronic equipment and described the second electronic equipment; And transmitting element, in response to described request, described related information is sent to the electronic equipment of asking in described the first electronic equipment and described the second electronic equipment.
In the second example, described performance element is configured to described related information to be sent to the electronic equipment that sends call-information in described the first electronic equipment and described the second electronic equipment.
In the 3rd example, described call-information comprises the information of audio frequency.Described performance element comprises: semantic analysis unit, carries out semantic analysis to described audio frequency, to determine which in described the first electronic equipment and described the second electronic equipment described related information be suitable for; And transmitting element, described related information is sent in described the first electronic equipment and described the second electronic equipment and is confirmed as applicable electronic equipment.
In the 4th example, described call-information comprises the information of text.Described performance element comprises: semantic analysis unit, carries out semantic analysis to described text, to determine which in described the first electronic equipment and described the second electronic equipment described related information be suitable for; And transmitting element, described related information is sent in described the first electronic equipment and described the second electronic equipment and is confirmed as applicable electronic equipment.
The concrete configuration of each unit of the messaging device of four embodiment of the invention and operation describe in detail in the description of the information processing method of four embodiment of the invention, no longer repeat at this.
The messaging device of four embodiment of the invention has been described above.
By the messaging device of four embodiment of the invention, can utilize the call-information producing in communication process, thereby except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the messaging device of four embodiment of the invention, at server side, can store described related information to delay output, also can described related information be sent to suitable electronic equipment according to various strategy, to be further processed by the electronic equipment that receives described related information.
Therefore, by the messaging device of four embodiment of the invention, provide various ways to export described related information, and provide various ways to export described related information to different electronic equipment, convenient service supplier according to circumstances carries out different customizations, and has further enriched user's experience.
Above, information processing method and the messaging device of first to fourth execution mode have been described according to the present invention.
The application of information processing method and the messaging device of the embodiment of the present invention is described in connection with some concrete scenes below.
First, information processing method and the messaging device of the embodiment of the present invention are described with reference to Fig. 5 A-5C.In the scene shown in Fig. 5 A-5C, the first electronic equipment and long-range the second electronic equipment are carrying out video calling.Fig. 5 A-5C is the demonstration schematic diagram on the display screen 500 of the first electronic equipment of the diagram information processing method of having applied the embodiment of the present invention.
Described display screen 500 is divided into two regions: first area 501 and second area 502.In first area 501, show user's's (following, to be called first user suitably time) of the first electronic equipment that described the first electronic equipment gathers by the image acquisition units of for example front-facing camera image.In second area 502, show user's's (following, to be called the second user suitably time) of the second electronic equipment that described the second electronic equipment gathers by the image acquisition units of for example camera image.
In the following description, the display screen 500 of supposing described the first electronic equipment is touch display screen.But, it will be appreciated by those skilled in the art that the information processing method of the embodiment of the present invention and messaging device also can similarly be applied to the electronic equipment that non-touch-control is inputted.
In the scene of Fig. 5 A, first user with the second user's video communication in, the second user's upper garment has been produced to interest, and has irised out region 503 corresponding with described upper garment on described display screen 500 by gesture.Described information processing method detects user's aforesaid operations, and will in described video pictures, be defined as handling object with the corresponding partial video picture in described region 503.
Alternatively, first user also can be clicked the arbitrary position in the residing region of described upper garment on described display screen 500 by gesture.Described information processing method is cut apart by video pictures is carried out to image, to obtain the partial video picture that comprises described position, equally as shown in 503.
Alternatively, described information processing method also can carry out image recognition to described video pictures automatically, so that described video pictures is divided into multiple regions, for example the region 503 corresponding with upper garment, with region 504 corresponding to trousers, with region 505 corresponding to footwear, with region 506 corresponding to face and the region 507 corresponding with background.After this, described information processing method is based on preassigned, and for example significance based on region, is defined as handling object by the region in multiple regions 503.
Alternatively, described information processing method also can combine above-mentioned user's input with automatically definite mode.That is, described information processing method can carry out image recognition to described video pictures first automatically, to determine multiple candidate targets, and for example upper garment 503, trousers 504 and footwear 505, and described multiple candidate targets are presented to first user.The described mode presenting is not limit.For example, described information processing method can be presented at the appropriate location in described display screen 500 with the form of thumbnail by the partial video picture of region 503,504 and 505 correspondences.Again for example, described information processing method can be near described region 503,504 and 505 display reminding mark, etc.After this, described information processing method detects the selection operation of user at least one candidate target in described multiple candidate targets, and based on described selection operation, selected described at least one candidate target is defined as to described handling object.
Thereby described information processing method obtains the related information associated with described handling object and carries out the operation based on described related information.Particularly, in this scene, for example, described information processing method is determined the brand of described upper garment by graphical analysis, obtains thus the attribute informations such as the price, fabric, the place of production of described upper garment as related information.Again for example, described information processing method is determined the brand of described upper garment by graphical analysis, and obtains thus with the information of other upper garments of the same brand of described upper garment etc. as related information.Certainly, information processing method described above determines that the mode of related information is only example.
After having obtained described related information, in one embodiment, described information processing method generates the prompting icon for pointing out user to check, described prompting icon is used for linking to described related information, and show described prompting icon, as shown in the icon 508 in Fig. 5 B.
In another embodiment, described information processing method generates the image based on described related information, as shown in 509 in Fig. 5 C, the image of itself and described video calling is combined to generate combination image, and show described combination image.
In another embodiment, described information processing method, after obtaining described related information, is not exported at once, but is stored in local storage, or be sent at least one in server and described the second electronic equipment.
In the situation that being stored in local storage, in one embodiment, described information processing method can be in the time judging current time first predetermined condition, show described related information or for point out access described related information icon.
In another embodiment, described information processing method can be judging that described access to netwoks is whether when second predetermined condition, for example, while being shopping website in the destination that judges described access to netwoks, show described related information or for point out access described related information icon.
In another embodiment, described information processing method can detect the environmental information of described the first electronic equipment, for example the positional information of described the first electronic equipment.Meet when the 3rd predetermined condition when described information processing method judges described environmental information, for example, judge when described the first electronic equipment is positioned at shopping center, show described related information or for pointing out the icon of accessing described related information.
It is pointed out that Fig. 5 A-5C illustrates that first user carries out video calling by the front-facing camera of the first electronic equipment and the second user of described the second electronic equipment and handling object is the situation of the object in video pictures corresponding to described the second user.
Alternatively, the information processing method of the embodiment of the present invention and messaging device also can be applicable to that first user carries out video calling by the post-positioned pick-up head of the first electronic equipment and the second user of described the second electronic equipment and handling object is the situation of the object in the video pictures that described first user is corresponding.Fig. 6 illustrates demonstration schematic diagram in the case.
As shown in Figure 6, described display screen 600 is divided into two regions: first area 601 and second area 602.In first area 601, show the image of the first electronic equipment side that described the first electronic equipment gathers by the image acquisition units of for example post-positioned pick-up head.In second area 502, show the image of the second electronic equipment side that described the second electronic equipment gathers by the image acquisition units of for example camera.
Under this scene, suppose that first user wishes near the building its residing region of the second user profile, but and do not know the various information of title of described building etc.Now, first user can be by the information processing method of the embodiment of the present invention, knows the various related informations in such as title, the building age etc. of described building, and its processing is similar to the above, is not described in detail in this.
It is pointed out that above, be described as an example of the situation of the still image identification in video communication example.It will be appreciated by those skilled in the art that the information processing method of the embodiment of the present invention and messaging device can similarly be applied to the dynamic image identification in video communication, or voice communication, textcommunication etc.
In addition, it is pointed out that the above situation that is applied to the first electronic equipment take described information processing method and described messaging device is described as example.The information processing method and the messaging device that it will be appreciated by those skilled in the art that the embodiment of the present invention can similarly be applied to described the second electronic equipment and described server.
The application example of information processing method and the messaging device of the embodiment of the present invention has been described with reference to figure 5 and Fig. 6 above.
By information processing method and the messaging device of the embodiment of the present invention, can utilize the call-information producing in communication process, thereby except realize communication objective, can also further promote the using value of call, greatly enriched user's experience.
In addition, in the information processing method and messaging device of the embodiment of the present invention, can determine in response to user's input operation handling object in electronic equipment side, also can automatically determine handling object, above-mentioned two kinds of modes can also be combined.Therefore, the information processing method of the embodiment of the present invention and messaging device provide various ways to utilize described call-information, thereby have further enriched user's experience.
In addition, in the information processing method and messaging device of the embodiment of the present invention, the process of above-mentioned definite handling object also can be carried out at server side, thereby, in the case of the disposal ability of electronic equipment side is limited, can alleviate the processing load of electronic equipment side, improve the treatment effeciency of electronic equipment side.
In addition, in the information processing method and messaging device of the embodiment of the present invention, in electronic equipment side, can in communication process or after end of conversation, show at once described related information and/or prompting icon, also can store described related information, and in the time that time judgement after a while meets predetermined condition, just trigger the output of related information, described related information can also be outputed to server and/or the second electronic equipment to process.Therefore, facilitate user according to circumstances to carry out different customizations, thereby further enriched user's experience.
In addition, in the information processing method and messaging device of the embodiment of the present invention, at server side, can store described related information to delay output, also can described related information be sent to suitable electronic equipment according to various strategy, to be further processed by the electronic equipment that receives described related information.Therefore, provide various ways to export described related information to different electronic equipment, convenient service supplier according to circumstances carries out different customizations.
Above, described according to the information processing method of the embodiment of the present invention and messaging device referring to figs. 1 through Fig. 6.
It should be noted that, in this manual, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the equipment that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or equipment.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
In addition, it should be noted that, in this manual, the statement of similar " first ... unit ", " second ... unit " is only for convenient differentiation in the time describing, and and do not mean that it must be embodied as two or more unit of physical separation.In fact, as required, described unit can entirety be embodied as a unit, also can be implemented as multiple unit.
Finally, also it should be noted that, above-mentioned a series of processing not only comprise the processing of carrying out by time series with order described here, and comprise processing parallel or that carry out respectively rather than in chronological order.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that the present invention can add essential hardware platform by software and realize, and can certainly all implement by hardware.Based on such understanding, what technical scheme of the present invention contributed to background technology can embody with the form of software product in whole or in part, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out the method described in some part of each embodiment of the present invention or embodiment.
In embodiments of the present invention, units/modules can realize with software, to carried out by various types of processors.For instance, the executable code module of a mark can comprise one or more physics or the logical block of computer instruction, and for instance, it can be built as object, process or function.However, the executable code of institute's identification module is without being physically located in together, but can comprise the different instruction on being stored in coordination not, and in the time combining in these command logics, its Component units/module and realize the regulation object of this units/modules.
In the time that units/modules can utilize software to realize, consider the level of existing hardware technique, so units/modules that can realize with software, in the situation that not considering cost, those skilled in the art can build corresponding hardware circuit and realize corresponding function, and described hardware circuit comprises conventional ultra-large integrated (VLSI) circuit or gate array and the existing semiconductor such as logic chip, transistor or other discrete element.Module can also be used programmable hardware device, realizations such as field programmable gate array, programmable logic array, programmable logic device.
Above the present invention is described in detail, has applied specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment is just for helping to understand method of the present invention and core concept thereof; , for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention meanwhile.

Claims (22)

1. an information processing method, is applied to the first electronic equipment, and described information processing method comprises:
In the process that described the first electronic equipment and the second electronic equipment are conversed, the call-information producing based on described call, determines handling object;
Obtain the related information associated with described handling object; And
Carry out the operation based on described related information.
2. information processing method as claimed in claim 1, wherein, obtains the related information associated with described handling object and comprises:
Described handling object is sent to remote server; And
Receive related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
3. information processing method as claimed in claim 1, wherein, obtains the related information associated with described handling object and comprises:
Described handling object is analyzed, to determine described related information.
4. information processing method as claimed in claim 1, wherein, the information that described call-information is video pictures, and described definite handling object comprises:
Detect user's input operation; And
Based on described input operation, from described video pictures, determine handling object.
5. information processing method as claimed in claim 4, wherein,
The input operation that detects user comprises:
Detect the input operation for a region of selected described video pictures;
And described definite handling object comprises:
To in described video pictures, be defined as handling object with the corresponding partial video picture in described region.
6. information processing method as claimed in claim 4, wherein,
The input operation that detects user comprises:
Detect the clicking operation for clicking described video pictures;
And described definite handling object comprises:
Based on the ad-hoc location in described video pictures corresponding to described clicking operation, described video pictures is carried out to image and cut apart, to obtain the partial video picture that comprises described ad-hoc location; And
Described partial video picture is defined as to handling object.
7. information processing method as claimed in claim 4, also comprises:
Described video pictures is carried out to image recognition, to determine multiple candidate targets;
Described detection user's input operation comprises:
Detect the selection operation of user at least one candidate target in described multiple candidate targets;
And described definite handling object comprises:
Based on described selection operation, selected described at least one candidate target is defined as to described handling object.
8. information processing method as claimed in claim 1, wherein, the information that described call-information is tableaux, described definite handling object also comprises:
Described tableaux is carried out to image recognition, so that described tableaux is divided into multiple regions;
Based on preassigned, from described multiple regions, determine target area; And
Based on described target area, determine described handling object.
9. information processing method as claimed in claim 1, wherein, the information that described call-information is dynamic menu, described definite handling object also comprises:
Described dynamic menu is identified to the specific action of making to identify user in described communication process; And
Based on described specific action, determine described handling object.
10. information processing method as claimed in claim 1, wherein, the information that described call-information is audio frequency, and described definite handling object comprises:
Described audio frequency is carried out to audio identification, to determine handling object.
11. information processing methods as claimed in claim 1, wherein, described definite handling object also comprises:
Based on described call-information, determine multiple candidate targets;
Detect user at least one the selection operation in described multiple candidate targets; And
Based on described selection operation, selected described at least one candidate target is defined as to described handling object.
12. 1 kinds of messaging devices, are applied to the first electronic equipment, and described messaging device comprises:
Determining unit, in the process that described the first electronic equipment and the second electronic equipment are conversed, the call-information producing based on described call, determines handling object;
Acquiring unit, obtains the related information associated with described handling object; And
Performance element, carries out the operation based on described related information.
13. messaging devices as claimed in claim 12, wherein, described acquiring unit comprises:
Transmitting element, is sent to remote server by described handling object; And
Receiving element, receives related information from described remote server, described related information by described remote server by the information that described handling object analysis is obtained, be associated with described handling object.
14. messaging devices as claimed in claim 12, wherein, described acquiring unit comprises:
Analytic unit, analyzes described handling object, to determine described related information.
15. messaging devices as claimed in claim 2, wherein, the information that described call-information is video pictures, and described determining unit comprises:
Detecting unit, detects user's input operation; And
The first handling object determining unit based on described input operation, is determined handling object from described video pictures.
16. messaging devices as claimed in claim 15, wherein,
Described detecting unit is configured to detect the input operation for a region of selected described video pictures;
And described the first handling object determining unit is configured to be defined as handling object with the corresponding partial video picture in described region in described video pictures.
17. messaging devices as claimed in claim 15, wherein,
Described detecting unit is configured to detect for clicking the clicking operation of described video pictures;
And described the first handling object determining unit comprises:
Image cutting unit, based on the ad-hoc location in described video pictures corresponding to described clicking operation, carries out image to described video pictures and cuts apart, to obtain the partial video picture that comprises described ad-hoc location; And
Object determining unit, is defined as handling object by described partial video picture.
18. messaging devices as claimed in claim 15, also comprise:
Recognition unit, carries out image recognition to described video pictures, to determine multiple candidate targets;
And described detecting unit comprises:
Select detecting unit, detect the selection operation of user at least one candidate target in described multiple candidate targets;
And described the first handling object determining unit is configured to, based on described selection operation, selected described at least one candidate target is defined as to described handling object.
19. messaging devices as claimed in claim 12, wherein, the information that described call-information is tableaux, described determining unit also comprises:
Tableaux recognition unit, carries out image recognition to described tableaux, so that described tableaux is divided into multiple regions;
Target area determining unit based on preassigned, is determined target area from described multiple regions; And
The second handling object determining unit, based on described target area, determines described handling object.
20. messaging devices as claimed in claim 11, wherein, the information that described call-information is dynamic menu, described determining unit also comprises:
Dynamic menu recognition unit, identifies described dynamic menu, the specific action of making in described communication process to identify user; And
The 3rd handling object determining unit, based on described specific action, determines described handling object.
21. messaging devices as claimed in claim 12, wherein, the information that described call-information is audio frequency, and described determining unit comprises:
Audio identification unit, carries out audio identification to described audio frequency, to determine handling object.
22. messaging devices as claimed in claim 12, wherein, described determining unit also comprises:
Candidate target determining unit, based on described call-information, determines multiple candidate targets;
Select detecting unit, detect user at least one the selection operation in described multiple candidate targets; And
The 4th handling object determining unit, based on described selection operation, is defined as described handling object by selected described at least one candidate target.
CN201210560705.XA 2012-12-20 2012-12-20 Information processing method and information processing equipment Active CN103888423B (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201210560705.XA CN103888423B (en) 2012-12-20 2012-12-20 Information processing method and information processing equipment
PCT/CN2013/089778 WO2014094614A1 (en) 2012-12-20 2013-12-18 Information processing method and information processing device
DE112013006130.9T DE112013006130T5 (en) 2012-12-20 2013-12-18 Information processing method and information processing apparatus
US14/388,722 US10126821B2 (en) 2012-12-20 2013-12-18 Information processing method and information processing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210560705.XA CN103888423B (en) 2012-12-20 2012-12-20 Information processing method and information processing equipment

Publications (2)

Publication Number Publication Date
CN103888423A true CN103888423A (en) 2014-06-25
CN103888423B CN103888423B (en) 2019-01-15

Family

ID=50957145

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210560705.XA Active CN103888423B (en) 2012-12-20 2012-12-20 Information processing method and information processing equipment

Country Status (1)

Country Link
CN (1) CN103888423B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412415A (en) * 2015-07-29 2017-02-15 Lg电子株式会社 Mobile terminal and method of controlling the same
CN107408396A (en) * 2015-03-27 2017-11-28 索尼公司 Information processor, information processing method and program
CN110177250A (en) * 2019-04-30 2019-08-27 上海掌门科技有限公司 A kind of method and apparatus for the offer procurement information in video call process
CN110311945A (en) * 2019-04-30 2019-10-08 上海掌门科技有限公司 A kind of method and apparatus for the presentation resource supplying information in live video stream
CN110944139A (en) * 2019-11-29 2020-03-31 维沃移动通信有限公司 Display control method and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101015208A (en) * 2004-09-09 2007-08-08 松下电器产业株式会社 Communication terminal and communication method thereof
CN101296450A (en) * 2008-05-27 2008-10-29 深圳华为通信技术有限公司 Communication information management method and terminal thereof
CN102479024A (en) * 2010-11-24 2012-05-30 国基电子（上海）有限公司 Handheld device and user interface construction method thereof
CN102655544A (en) * 2011-03-01 2012-09-05 联想(北京)有限公司 Method for issuing communication, and communication terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101015208A (en) * 2004-09-09 2007-08-08 松下电器产业株式会社 Communication terminal and communication method thereof
CN101296450A (en) * 2008-05-27 2008-10-29 深圳华为通信技术有限公司 Communication information management method and terminal thereof
CN102479024A (en) * 2010-11-24 2012-05-30 国基电子（上海）有限公司 Handheld device and user interface construction method thereof
CN102655544A (en) * 2011-03-01 2012-09-05 联想(北京)有限公司 Method for issuing communication, and communication terminal

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107408396A (en) * 2015-03-27 2017-11-28 索尼公司 Information processor, information processing method and program
CN106412415A (en) * 2015-07-29 2017-02-15 Lg电子株式会社 Mobile terminal and method of controlling the same
CN106412415B (en) * 2015-07-29 2020-11-06 Lg电子株式会社 Mobile terminal and control method thereof
CN110177250A (en) * 2019-04-30 2019-08-27 上海掌门科技有限公司 A kind of method and apparatus for the offer procurement information in video call process
CN110311945A (en) * 2019-04-30 2019-10-08 上海掌门科技有限公司 A kind of method and apparatus for the presentation resource supplying information in live video stream
CN110944139A (en) * 2019-11-29 2020-03-31 维沃移动通信有限公司 Display control method and electronic equipment
CN110944139B (en) * 2019-11-29 2022-04-22 维沃移动通信有限公司 Display control method and electronic equipment

Also Published As

Publication number Publication date
CN103888423B (en) 2019-01-15

Similar Documents

Publication Publication Date Title
US9621950B2 (en) TV program identification method, apparatus, terminal, server and system
US11153430B2 (en) Information presentation method and device
CN103888423A (en) Information processing method and information processing device
CN103986845A (en) Information processing method and information processing device
CN105814587A (en) Local real-time facial recognition
CN105095227A (en) Method and apparatus for preloading webpage
WO2022063123A1 (en) Interface displaying method, device, and electronic device
JP2021516501A (en) Information acquisition method and equipment based on video
CN104102328B (en) Information processing method and message processing device
US20210150243A1 (en) Efficient image sharing
CN103888425A (en) Information processing method and information processing device
CN103905629B (en) Display processing method and display processing device
US10126821B2 (en) Information processing method and information processing device
CN104038513A (en) Information processing device and information processing method
CN115017340A (en) Multimedia resource generation method and device, electronic equipment and storage medium
CN104065614B (en) Information processing method and message processing device
CN103888426A (en) Information processing method and information processing device
CN103888494A (en) Information processing method and information processing device
CN103888426B (en) Information processing method and information processing equipment
CN112241317A (en) Information processing method and device
CN113886674A (en) Resource recommendation method and device, electronic equipment and storage medium
CN114115524B (en) Interaction method of intelligent water cup, storage medium and electronic device
CN113300943B (en) Information sending method, device, equipment and readable storage medium
US20230096129A1 (en) Hologram communication continuity
CN114764418A (en) Risk detection method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant