WO2014094614A1 - 信息处理方法和信息处理设备 - Google Patents

信息处理方法和信息处理设备 Download PDF

Info

Publication number
WO2014094614A1
WO2014094614A1 PCT/CN2013/089778 CN2013089778W WO2014094614A1 WO 2014094614 A1 WO2014094614 A1 WO 2014094614A1 CN 2013089778 W CN2013089778 W CN 2013089778W WO 2014094614 A1 WO2014094614 A1 WO 2014094614A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
electronic device
call
processing object
determining
Prior art date
Application number
PCT/CN2013/089778
Other languages
English (en)
French (fr)
Inventor
杨元庆
尉伟东
张磊
石东海
Original Assignee
北京联想软件有限公司
联想(北京)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201210560705.XA external-priority patent/CN103888423B/zh
Priority claimed from CN201210559888.3A external-priority patent/CN103888494B/zh
Priority claimed from CN201210560726.1A external-priority patent/CN103888425B/zh
Priority claimed from CN201210560832.XA external-priority patent/CN103888426B/zh
Application filed by 北京联想软件有限公司, 联想(北京)有限公司 filed Critical 北京联想软件有限公司
Priority to US14/388,722 priority Critical patent/US10126821B2/en
Priority to DE112013006130.9T priority patent/DE112013006130T5/de
Publication of WO2014094614A1 publication Critical patent/WO2014094614A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour

Definitions

  • the present invention relates to the field of information processing, and more particularly, to an information processing method and an information processing apparatus. Background technique
  • the present invention provides an information processing method and an information processing device, which can utilize call information generated during a call, for example, generate associated information suitable for a caller, thereby further enhancing the application value of the call, enriching User experience.
  • an information processing method is provided, which is applied to a first electronic device, where the information processing method includes: during a process in which the first electronic device and the second electronic device make a call, Call information generated by the call, determining a processing object; acquiring association information associated with the processing object; and performing an operation based on the association information.
  • And acquiring the association information associated with the processing object includes: sending the processing object to a remote server; and receiving association information from the remote server, where the association information is processed by the remote server Information obtained in association with the processing object obtained by the analysis.
  • the acquiring the association information associated with the processing object includes: analyzing the processing object to determine the association information.
  • the call information is information of a video screen
  • the determining the processing object includes: detecting an input operation of the user; and determining a processing object from the video screen based on the input operation.
  • the detecting an input operation of the user includes: detecting an input operation for selecting an area in the video screen; and determining the processing object includes: placing the video screen with the area The corresponding partial video picture is determined as the processing object.
  • the detecting the input operation of the user includes: detecting a click operation for clicking on the video screen; and determining the processing object includes: the video based on a specific location in the video screen corresponding to the click operation
  • the picture is subjected to image segmentation to obtain a partial video picture including the specific position; and the partial video picture is determined as a processing object.
  • the detecting an input operation of the user includes: performing image recognition on the video screen to determine a plurality of candidate objects; detecting a user selecting operation of at least one of the plurality of candidate objects; and determining the processing
  • the object includes: determining the selected at least one candidate object as the processing object based on the selection operation.
  • the call information is information of a static picture
  • the determining the processing object further includes: performing image recognition on the static picture to divide the static picture into a plurality of areas; and from the plurality of areas based on a predetermined criterion Determining the target area; and determining, according to the target area, the information that the call information is a dynamic picture, the determining the processing object further includes: identifying the dynamic picture to identify that the user is in the call a specific action made in the process; and determining the process object based on the particular action.
  • the call information is information of audio
  • the determining the processing object comprises: performing audio recognition on the audio to determine a processing object.
  • the determining the processing object further includes: determining a plurality of candidate objects based on the call information; detecting a user selecting operation of at least one of the plurality of candidate objects; and selecting the selected one based on the selecting operation At least one candidate object is determined as the processing object.
  • an information processing device which is applied to a first electronic device, where the information processing device includes: a determining unit, in a process in which the first electronic device and the second electronic device make a call Determining a processing object based on the call information generated by the call; acquiring unit, acquiring association information associated with the processing object; and executing unit, performing an operation based on the association information.
  • the obtaining unit includes: a sending unit that sends the processing object to a remote server; and a receiving unit that receives related information from the remote server, where the related information is analyzed by the remote server by processing the processing object And the obtained information associated with the processing object.
  • the obtaining unit includes: an analyzing unit, analyzing the processing object to determine the Associated information.
  • the call information is information of a video screen
  • the determining unit includes: a detecting unit that detects an input operation of the user; and a first processing object determining unit that determines a processing object from the video screen based on the input operation.
  • the detecting unit is configured to detect an input operation for selecting an area in the video picture; and, the first processing object determining unit is configured to display a part of the video corresponding to the area The screen is determined to be the processing object.
  • the detecting unit is configured to detect a click operation for clicking on the video screen; and the first processing object determining unit includes: an image dividing unit, based on a specific position in the video screen corresponding to the click operation, Performing image segmentation on the video picture to obtain a partial video picture including the specific position; and an object determining unit that determines the partial video picture as a processing object.
  • the detecting unit includes: an identifying unit, performing image recognition on the video screen to determine a plurality of candidate objects; and selecting a detecting unit to detect a user selecting operation of at least one of the plurality of candidate objects; and
  • the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the selecting operation.
  • the determining unit further includes: a static picture identifying unit, performing image recognition on the still picture to divide the static picture into a plurality of areas; the target area determining unit, based on the predetermined a criterion of determining a target area from the plurality of areas; and a second processing object determining unit that determines the processing object based on the target area.
  • the call information is information of a dynamic picture
  • the determining unit further includes: a dynamic picture recognition unit, identifying the dynamic picture to identify a specific action made by the user during the call; and a third process
  • the object determining unit determines, based on the specific action, the information that the processing is audio for the call information, and the determining unit comprises: an audio recognition unit that performs audio recognition on the audio to determine a processing object.
  • the determining unit further includes: a candidate object determining unit, determining a plurality of candidate objects based on the call information; selecting a detecting unit, detecting a user selecting operation of at least one of the plurality of candidate objects; and fourth processing object a determining unit that determines the selected at least one candidate object as the processing object based on the selecting operation.
  • an information processing method is provided, which is applied to a server.
  • the information processing method includes: acquiring, during the conversation between the first electronic device and the second electronic device, the call information generated by the call from the first electronic device and/or the second electronic device; Calling information, determining a processing object; analyzing the processing object to acquire association information associated with the processing object; and performing an operation based on the association information.
  • the call information is information of a video screen
  • the determining the processing object includes: receiving input trajectory information sent by at least one of the first electronic device and the second electronic device, where the input trajectory information is The at least one of the first electronic device and the second electronic device is generated by detecting an input operation of the user; and determining a processing object based on the input trajectory information.
  • the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting an input operation for selecting an area in the video screen; Determining the processing object includes: determining a partial video picture corresponding to the area in the video picture as a processing object.
  • the input trajectory information is obtained by detecting a click operation for clicking on the video screen by the at least one of the first electronic device and the second electronic device; and the determining processing object includes: Performing image segmentation on the video frame to obtain a partial video frame including the specific location based on a specific position in the video screen corresponding to the click operation; and determining the partial video image as a processing target.
  • the information processing method further includes: performing image recognition on the video screen to determine a plurality of candidate objects; and transmitting the plurality of candidate objects to the at least the first electronic device and the second electronic device And the input trajectory information is obtained by the at least one of the first electronic device and the second electronic device by detecting a user selecting operation of at least one of the plurality of candidate objects
  • the determining the processing object further includes: determining the selected at least one candidate object as the processing object based on the selecting operation.
  • the call information is information of a video screen
  • the determining processing object includes: performing image recognition on the video screen to divide the static picture into a plurality of regions; and from the plurality of regions based on a predetermined criterion Determining the target area; and determining, according to the target area, the information that the processing is the dynamic picture of the call information, the determining the processing object further comprising: performing the specific action; and determining, according to the specific action
  • the processing object is audio information
  • the determining the processing object comprises: performing audio recognition on the audio to determine a processing object.
  • the determining the processing object further includes: determining a plurality of candidate objects based on the call information; transmitting the plurality of candidate objects to at least one of the first electronic device and the second electronic device; receiving the A user of the at least one of the first electronic device and the second electronic device is configured to select selection information of the at least one candidate object; and determine the selected at least one candidate object as the based based on the selection information The processing object.
  • Object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with attribute information for indicating an attribute of the object; and the acquisition is associated with the processing object
  • the associated information includes: analyzing the processing object to determine an attribute of the processing object; determining, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and determining an attribute corresponding to the The object information associated with the information is determined as the associated information.
  • an information processing device which is applied to a server, and the information processing device includes: a call information acquiring unit, in a process of a call between the first electronic device and the second electronic device, The first electronic device and/or the second electronic device acquires call information generated by the call; the determining unit determines a processing object based on the call information; and the associated information acquiring unit analyzes the processed object to Acquiring association information associated with the processing object; and an execution unit performing an operation based on the association information.
  • the call information is information of a video screen
  • the determining unit includes: a receiving unit, receiving input track information sent by at least one of the first electronic device and the second electronic device, where the input track information is The at least one of the first electronic device and the second electronic device is generated by detecting an input operation of a user; and the first processing object determining unit determines a processing object based on the input trajectory information.
  • the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting an input operation for selecting an area in the video screen;
  • the first processing object determining unit is configured to determine a partial video picture corresponding to the area in the video picture as a processing object.
  • the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting a click operation for clicking on the video screen; and, the first processing object is determined
  • the unit includes: an image segmentation unit, based on the view corresponding to the click operation a specific position in the frequency picture, image segmentation of the video picture to obtain a partial video picture including the specific position; and an object determining unit that determines the partial video picture as a processing object.
  • the information processing device further includes: an identification unit that performs image recognition on the video screen to determine a plurality of candidate objects; and a transmitting unit that transmits the plurality of candidate objects to the first electronic device and the second electronic The at least one of the devices; and the input trajectory information is that the at least one of the first electronic device and the second electronic device detects at least one candidate of the plurality of candidate objects by detecting a user Obtained by the selection operation of the object; the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the selecting operation.
  • the call information is information of a video screen
  • the determining unit comprises: a static picture recognition unit that performs image recognition on the video picture to divide the static picture into multiple regions; a target area determining unit, based on the predetermined a criterion of determining a target area from the plurality of areas; and a second processing object determining unit that determines the processing object based on the target area.
  • the call information is information of a dynamic picture
  • the determining unit includes: a dynamic picture recognition unit that identifies the dynamic picture to identify a specificity made by an object in the dynamic picture during the call And a third processing object determining unit that determines the processing object based on the specific motion.
  • the call information is audio information
  • the determining unit comprises: an audio recognition unit that performs audio recognition on the audio to determine a processing object.
  • the determining unit includes: a candidate object determining unit, determining a plurality of candidate objects based on the call information; and sending, by the sending unit, the plurality of candidate objects to the first electronic device and the second electronic device At least one; a receiving unit, a user receiving the at least one of the first electronic device and the second electronic device for selecting selection information of at least one candidate object; and a fourth processing object determining unit, based on the Selecting information, and determining the selected at least one candidate object as the processing object.
  • Object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with attribute information for indicating an attribute of the object; and the association information acquiring unit includes: attribute determination a unit, the processing object is analyzed to determine an attribute of the processing object; the attribute information determining unit determines, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and an object information determining unit, Corresponding genus The object information associated with the sex information is determined as the associated information.
  • an information processing method is provided, which is applied to a first electronic device, where the information processing method includes: in a process of performing a multimedia call between the first electronic device and the second electronic device Determining a processing object based on the call information generated by the call; acquiring association information associated with the processing object; and performing an operation based on the association information.
  • Acquiring the association information associated with the processing object includes: transmitting the processing object to a remote server; and receiving association information from the remote server, the association information being analyzed by the remote server by processing the processing object And the obtained information associated with the processing object.
  • Obtaining the association information associated with the processing object includes: analyzing the processing object to determine the association information.
  • Performing the operation based on the association information includes: generating a prompt icon for prompting the user to view, the prompt icon for linking to the associated information; and displaying the prompt icon.
  • the call is an audio call
  • performing the operation based on the associated information includes: detecting whether the first electronic device is connected to a display device; and when detecting that the first electronic device is connected to a display device, The association information is output to the display device, and the display device performs display based on the associated information.
  • the call is a video call
  • performing the operation based on the associated information includes: combining an image based on the associated information with an image of the video call to generate a combined image; and displaying the combined image.
  • the performing the operation based on the association information includes at least one of: displaying the association information; storing the association information; and transmitting the association information to at least one of a remote server and the second electronic device.
  • the information processing method further includes: determining whether the current time satisfies the first predetermined condition; and when determining that the current time satisfies the first predetermined condition, performing display based on the associated information.
  • the information processing method further includes: determining, when the first electronic device performs network access, whether the network access satisfies a second predetermined condition; and when the network access satisfies a second predetermined In the case of a condition, display based on the associated information is performed.
  • the information processing method further includes: detecting environment information of the first electronic device; determining whether the environment information satisfies a third predetermined condition; When the environmental information satisfies the third predetermined condition, display based on the related information is performed.
  • Performing the display based on the associated information includes: displaying at least one of the associated information and a prompt icon, wherein the prompt icon is used to link to the associated information.
  • an information processing device which is applied to a first electronic device, where the information processing device includes: a determining unit, where the first electronic device performs a multimedia call with the second electronic device And determining, according to the call information generated by the call, the processing object; the acquiring unit, acquiring the association information associated with the processing object; and the executing unit, performing the operation based on the association information.
  • the obtaining unit includes: a sending unit that sends the processing object to a remote server; and a receiving unit that receives related information from the remote server, where the related information is analyzed by the remote server by processing the processing object And the obtained information associated with the processing object.
  • the obtaining unit includes: an analyzing unit that analyzes the processing object to determine the related information.
  • the execution unit includes: an icon generating unit that generates a prompt icon for prompting the user to view, the prompt icon is used to link to the associated information; and an icon display unit that displays the prompt icon.
  • the call is an audio call
  • the execution unit includes: a first detecting unit, detecting whether the first electronic device is connected to a display device; and an output unit, when detecting the first electronic device and a display device When connected, the related information is output to the display device, and the display device performs display based on the related information.
  • the call is a video call
  • the execution unit includes: a combining unit that combines an image based on the associated information with an image of the video call to generate a combined image; and a combined image display unit that displays the combination image.
  • the execution unit is configured to perform at least one of: displaying the associated information; storing the associated information; and transmitting the associated information to at least one of a remote server and the second electronic device.
  • the execution unit further includes: a first determining unit, after storing the association information, determining whether the current time meets the first predetermined condition; The execution unit is configured to perform display based on the association information when it is determined that the current time satisfies the first predetermined condition.
  • the execution unit further includes: a second determining unit, after storing the association information, when the first electronic device performs network access, determining the location Whether the network access satisfies the second predetermined condition; and, the execution unit is configured to perform display based on the association information when the network access satisfies the second predetermined condition.
  • the information processing device further includes: an environment information detection unit, after storing the association information, detecting environment information of the first electronic device; a third determining unit, determining whether the environmental information satisfies a third predetermined condition; and, the executing unit is configured to perform display based on the related information when the environmental information satisfies a third predetermined condition.
  • the execution unit is configured to display at least one of the associated information and a prompt icon for linking to the associated information.
  • an information processing method is provided, which is applied to a server, where the information processing method includes: during a call between a first electronic device and a second electronic device, from the first electronic Obtaining, by the device and/or the second electronic device, call information generated by the call; determining a processing object based on the call information; analyzing the processing object to acquire associated information associated with the processing object; An operation based on the associated information is performed.
  • Performing the operation based on the association information includes at least one of: storing the association information; transmitting the association information to at least one of the first electronic device and the second electronic device based on a predetermined policy.
  • the transmitting the association information to the first electronic device or the second electronic device based on a predetermined policy comprises: receiving a request from at least one of the first electronic device and the second electronic device And transmitting the association information to the electronic device in the first electronic device and the second electronic device for request in response to the request.
  • Sending the association information to the first electronic device or the second electronic device based on a predetermined policy includes: transmitting the association information to the first electronic device and the second electronic device to send Electronic device for call information.
  • the call information includes audio information
  • the sending the association information to the first electronic device or the second electronic device based on a predetermined policy includes: performing semantic analysis on the audio to determine the association Which one of the first electronic device and the second electronic device is suitable for the information; and transmitting the associated information to the electronic device determined to be suitable in the first electronic device and the second electronic device .
  • Object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with attribute information for indicating an attribute of the object; and the acquisition is associated with the processing object
  • the associated information includes: analyzing the processing object to determine an attribute of the processing object; determining, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and determining an attribute corresponding to the The object information associated with the information is determined as the associated information.
  • an information processing device which is applied to a server, where the information processing device includes: an acquiring unit, in a process of a call between a first electronic device and a second electronic device, Receiving, by the first electronic device and/or the second electronic device, call information generated by the call; determining unit, determining a processing object based on the call information; analyzing unit, analyzing the processed object, to obtain the Processing associated information associated with the object; and an execution unit that performs an operation based on the associated information.
  • the execution unit is configured to perform at least one of: storing the association information; transmitting the association information to at least one of the first electronic device and the second electronic device based on a predetermined policy.
  • the execution unit includes: a receiving unit, receiving the a request of at least one of an electronic device and the second electronic device; and a transmitting unit, responsive to the request, transmitting the association information to the first electronic device and the second electronic device for request Electronic equipment.
  • the execution unit is configured to transmit the association information to the first electronic device or the second electronic device based on a predetermined policy
  • the execution unit is configured to send the association information to the An electronic device that transmits call information in the first electronic device and the second electronic device.
  • the call information includes information of the audio, where the execution unit is configured to send the association information to the first electronic device or the second electronic device based on a predetermined policy, the execution unit includes: a semantic analysis unit, performing semantic analysis on the audio to determine which one of the first electronic device and the second electronic device is suitable for the associated information; and transmitting unit, sending the associated information to the The first electronic device and the second electronic device are determined to be suitable electronic devices.
  • Object information of a plurality of objects is pre-stored in the server, and object information of each object The information is stored in association with the attribute information for indicating the attribute of the object; and the acquiring unit includes: an attribute determining unit that analyzes the processing object to determine an attribute of the processing object; And determining, according to an attribute of the processing object, corresponding attribute information in the stored attribute information; and the object information determining unit determining the object information associated with the corresponding attribute information as the related information.
  • the processing object is determined based on the call information generated by the call, and the association information associated with the processing object is acquired, thereby enabling an operation based on the associated information, such as Display, store or forward, etc. Therefore, the information processing method and the information processing device of the embodiment of the present invention can utilize the call information generated during the call, thereby further improving the application value of the call and greatly enriching the user experience in addition to the communication purpose. . DRAWINGS
  • FIG. 1 is a flowchart illustrating an information processing method according to a first embodiment of the present invention
  • FIG. 2 is a block diagram illustrating a main configuration of an information processing device according to a first embodiment of the present invention
  • FIG. 3 is a flowchart illustrating an information processing method according to a second embodiment of the present invention
  • FIG. 4 is a block diagram illustrating a main configuration of an information processing device according to a second embodiment of the present invention
  • 5A-5C are schematic diagrams showing the display of a first electronic device to which the information processing method of the embodiment of the present invention is applied;
  • Fig. 6 is another schematic diagram showing the first electronic device to which the information processing method of the embodiment of the present invention is applied. detailed description
  • the information processing method and the information processing device of the embodiment of the present invention are applied to an environment in which the first electronic device and the second electronic device make a call.
  • the first electronic device and the second electronic device may be electronic devices having communication functions such as a fixed telephone, a mobile phone, a tablet computer, a personal computer, and the like.
  • the communication may be conventional voice communication (such as via a fixed telephone), video communication (such as via a video chat application), or text communication (such as via an instant message (text chat) application).
  • the types of the first electronic device and the second electronic device may be the same or different.
  • the call between the first electronic device and the second electronic device can be performed by a server (hereinafter, also referred to as a remote server as appropriate) via a network such as the Internet. That is, the first electronic device and one of the second electronic devices send call information to the server, and the server forwards the call information to the first electronic device and the second Another of the electronic devices.
  • a server hereinafter, also referred to as a remote server as appropriate
  • the conversation between the first electronic device and the second electronic device can also be directly performed without forwarding via the server.
  • an embodiment of the present invention is described by taking communication between two electronic devices of a first electronic device and a second electronic device as an example.
  • the information processing method and the information processing apparatus of the embodiments of the present invention can be applied to a scenario in which communication is performed between more than two electronic devices.
  • the information processing method and the information processing device of the embodiments of the present invention may be applied to any one of the first electronic device and the second electronic device, and may also be applied to the server.
  • information processing methods and information processing apparatuses in the above various cases will be separately described.
  • the information processing method is applied to either or both of the first electronic device and the second electronic device.
  • the information processing method is applied to the first electronic device.
  • the first electronic device and the second electronic device are in the process of making a call.
  • step S101 the information processing method determines a processing target based on call information generated by the call.
  • the determination of the processing object may be implemented by detecting an input operation actively performed by the user, or may be realized by automatically analyzing and identifying the call information by the information processing method.
  • the call includes a video call
  • the call information includes information of a video picture.
  • the user specifies the processing object by performing an input operation on the video screen.
  • the information processing method of the embodiment of the present invention determines the processing object specified by the user by detecting an input operation performed by the user on the video screen. More specifically, for example, in the first example, the user can select an area in the video picture. Accordingly, the information processing method of the embodiment of the present invention detects an input operation for selecting an area in the video picture. Thereafter, the information processing method determines a partial video picture corresponding to the area in the video picture as a processing target.
  • a user may click on a particular location in the video frame. Accordingly, the information processing method of the embodiment of the present invention detects a click operation for clicking on the video screen.
  • the information processing method performs image segmentation on the video screen based on a specific position in the video picture corresponding to the click operation to obtain a partial video picture including the specific position.
  • the technique of image segmentation of the video image by the information processing method is known to those skilled in the art and will not be described in detail herein.
  • the information processing method determines the partial video picture as a processing object.
  • the information processing method of the first video picture may be an image recognition another 1 J, to determine a plurality of candidate objects.
  • the information processing method may determine the candidate objects using various image recognition algorithms known in the art, and will not be described in detail herein.
  • the information processing method may present information about the candidate object to the user for selection by the user. Thereafter, the information processing method detects a user's selection operation of at least one of the plurality of candidate objects. And, when detecting a user's selection operation on the at least one candidate object, the information processing method determines the selected at least one candidate object as the processing object based on the selection operation.
  • the call information includes information of a still picture.
  • the information processing method performs image recognition on the still picture to divide the still picture into a plurality of areas.
  • the information processing method divides the static picture into a plurality of mutually disjoint areas according to features such as gray scale, color, space texture, geometry, etc., so that the features exhibit consistency or similarity in the same area. And there are significant differences between different regions.
  • the information processing method may perform image segmentation using various algorithms such as a threshold-based method, a cluster-based method, a region- and edge-based method, a global optimization-based method, and the like.
  • the information processing method determines a target area from the plurality of areas based on a predetermined criterion.
  • the information processing method may determine a target area from the plurality of areas based on criteria of a plurality of areas of saliency, pre-trained user interest, area position, area size, and the like.
  • the above criteria for determining the target area and the corresponding algorithms are merely examples.
  • the information processing method of the embodiment of the present invention can determine the target area by using various other standards and corresponding algorithms known to those skilled in the art, and will not be described herein.
  • the information processing method determines the processing object based on the target area. Specifically, for example, the information processing method may analyze a video picture of the target area to determine a processing object. For example, the information processing method may determine a processing object by identifying a video picture of the target area to determine its object type. For another example, the image is subjected to fuzzy matching to determine a processing object.
  • the above method of determining an object to be processed based on the target area is merely an example.
  • the information processing method of the embodiment of the present invention can determine the processing object by using various other methods known to those skilled in the art, and will not be described in detail herein.
  • the call information includes information of a dynamic picture.
  • the information processing method may identify the dynamic picture to identify a specific action made by the user during the call. For example, the information processing method can recognize an action made by the user during this time period by performing recognition similar to that described above on a dynamic picture composed of a plurality of temporally consecutive frames.
  • the information processing method may determine the processing object based on the specific action. For example, the information processing method may determine a processing object based on the specific action based on a table of association relationships between the action and the processing object stored in advance.
  • the call information includes information of audio.
  • the information processing method may perform audio recognition on the audio to determine a processing object.
  • the information processing method may determine whether there is an audio clip matching the predetermined keyword in the audio. When it is judged that there is an audio segment matching the predetermined keyword in the audio, the information processing method determines the audio segment as the processing target.
  • the information processing method may perform semantic analysis on the audio and determine a processing object based on a result of the semantic analysis.
  • the information processing method can perform audio recognition on the audio by various algorithms known in the art, and will not be described in detail herein.
  • the information processing method of the embodiment of the present invention can combine the active input of the user with the automatic identification of the electronic device.
  • the information processing method may determine a plurality of candidate objects based on the call information. Thereafter, the information processing method may present the plurality of candidate objects to the user, and detect a user's selection operation on at least one of the plurality of candidate objects. Next, the information processing method determines the selected at least one candidate object as the processing object based on the selection operation.
  • the call information includes text information.
  • the information processing method may perform text recognition on the text to determine a processing object.
  • the information processing method may determine whether there is a text segment matching the predetermined keyword in the text. When it is judged that there is a text segment matching the predetermined keyword in the text, the information processing method determines the text segment as the processing object.
  • the information processing method may perform semantic analysis on the text and determine a processing object based on a result of the semantic analysis.
  • the information processing method can perform text recognition on the text using various algorithms known in the art, and will not be described in detail herein.
  • step S101 the information processing method determines the processing target based on the call information generated by the call.
  • step S102 the information processing method acquires association information associated with the processing object.
  • the information processing method may send the processing object to a remote server, and the remote server analyzes the processing object. Thereafter, the information processing method receives the associated information from the remote server.
  • the association information is information associated with the processing object obtained by the remote server by analyzing the processing object.
  • the remote server can obtain the associated information by various methods.
  • object information of a plurality of objects may be stored in advance in the remote server, and object information of each object is stored in association with the attribute information.
  • the attribute information is used to represent attributes of the object, such as clothing, buildings, and the like.
  • the remote server After receiving the processing object sent by the information processing method, the remote server analyzes the processing object to determine an attribute of the processing object. Thereafter, the remote server determines corresponding attribute information in the stored attribute information based on the attribute of the processing object, and determines object information associated with the corresponding attribute information as the related information.
  • the information processing method may locally analyze the processing object to determine the associated information. In this case, the information processing method may locally store the object information of the plurality of objects and the attribute information in advance.
  • the information processing method may analyze the processing object to determine an attribute of the processing object. Thereafter, the information processing method determines corresponding attribute information in the stored attribute information based on the attribute of the processed object, and determines object information associated with the corresponding attribute information as the associated information.
  • the information processing method After the association information is determined, the information processing method performs an operation based on the association information in step S103.
  • the processing object is determined based on the call information generated by the call, the association information associated with the processing object is acquired, and an operation based on the association information is performed.
  • the information processing method of the first embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the terminal side ie, the first electronic device and/or the second electronic device side
  • the terminal side can respond to the user based on the call information.
  • the input operation determines the processing object, and the processing object can be automatically determined, and the above two methods can also be combined.
  • an information processing apparatus 200 includes: a determining unit 201, an obtaining unit 202, and an executing unit 203.
  • the determining unit 201 determines a processing target based on the call information generated by the call during the call between the first electronic device and the second electronic device.
  • the obtaining unit 202 acquires association information associated with the processing object.
  • the execution unit 203 performs execution based on the associated letter Interest operation.
  • the acquisition unit 202 includes a transmitting unit and a receiving unit (not shown).
  • the transmitting unit transmits the processing object to a remote server.
  • the receiving unit receives associated information from the remote server.
  • the association information is information associated with the processing object obtained by the remote server by analyzing the processing object.
  • the acquisition unit 202 includes an analysis unit (not shown) that analyzes the processing object to determine the associated information.
  • the information processing device 200 determines a processing object by detecting an input operation actively performed by the user.
  • the call information includes information of a video screen
  • the determining unit 201 includes a detecting unit and a first processing object determining unit (not shown).
  • the detecting unit detects an input operation of the user.
  • the first processing object determining unit determines a processing object from the video screen based on the input operation.
  • the detecting unit is configured to detect an input operation for selecting an area in the video picture.
  • the first processing target determining unit is configured to determine a partial video screen corresponding to the region in the video screen as a processing target.
  • the detection unit is configured to detect a click operation for clicking on the video frame.
  • the first processing object determining unit includes: an image dividing unit that performs image segmentation on the video image to obtain a portion including the specific location based on a specific position in the video screen corresponding to the click operation a video screen; and an object determining unit that determines the partial video picture as a processing object.
  • the information processing device 200 further includes an identification unit (not shown) that performs image recognition on the video screen to determine a plurality of candidate objects.
  • the detecting unit includes: a selection detecting unit that detects a user's selection operation of at least one of the plurality of candidate objects.
  • the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the selection operation.
  • the information processing device 200 determines a processing object by automatically analyzing the call information.
  • the call information includes information of a still picture.
  • the determining unit 201 further includes a still picture recognizing unit, a target area determining unit, and a second processing object determining unit (not shown).
  • the static picture recognition unit performs image recognition on the static picture to The static picture is divided into a plurality of areas.
  • the target area determining unit determines a target area from the plurality of areas based on a predetermined criterion.
  • the second processing object determining unit determines the processing object based on the target area.
  • the call information includes information of a dynamic picture.
  • the determining unit 201 further includes a dynamic picture recognizing unit and a third processing object determining unit (not shown).
  • the dynamic picture recognition unit identifies the dynamic picture to identify a specific action made by the user during the call.
  • the third processing object determining unit determines the processing pair based on the specific action.
  • the call information includes information of audio.
  • the determining unit 201 includes an audio recognizing unit that performs audio recognition on the audio to determine a processing object.
  • the information processing device 200 determines a processing object by detecting an input operation actively performed by the user and automatically analyzing the call information.
  • the determining unit 201 further includes a candidate object determining unit, a selection detecting unit, and a fourth processing object determining unit.
  • the candidate object determining unit determines a plurality of candidate objects based on the call information.
  • the selection detecting unit detects a user's selection operation of at least one of the plurality of candidate objects.
  • the fourth processing object determining unit determines the selected at least one candidate object as the processing object based on the selecting operation.
  • the call information includes text information.
  • the information processing device 200 can perform text recognition on the text to determine a processing object.
  • the information processing device of the first embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the information processing device of the first embodiment of the present invention on the terminal side (ie, the first electronic device and/or the second electronic device side), based on the call information, it is responsive to the user.
  • the input operation determines the processing object, and the processing object can be automatically determined, and the above two methods can also be combined.
  • the information processing apparatus provides various ways to benefit
  • the call information is used to further enrich the user experience.
  • an information processing method and an information processing apparatus are provided. Unlike the information processing method and the information processing device according to the first embodiment of the present invention, in the second embodiment of the present invention, the information processing method and the information processing device are applied to the server side instead of the terminal side.
  • the first electronic device and the second electronic device are in the process of making a call.
  • step S301 the information processing method acquires call information generated by a call from the first electronic device and/or the second electronic device.
  • the call information is generated during a call between the first electronic device and the second electronic device, and is sent by the at least one of the first electronic device and the second electronic device to the server.
  • the call information may be audio information, video information, text information, or the like, or may be any combination of the above information.
  • step S302 the information processing method determines a processing object based on the call information.
  • the determination of the processing target can be realized by detecting an input operation actively performed by the user, or can be realized by automatically analyzing and recognizing the call information by the information processing method.
  • the call includes a video call
  • the call information includes information of a video picture.
  • the user specifies the processing object by performing an input operation on the video screen.
  • the information processing method of the embodiment of the present invention determines the processing object specified by the user by obtaining information of the input operation performed by the user on the video screen.
  • the information processing method receives input trajectory information transmitted by at least one of the first electronic device and the second electronic device.
  • the electronic device that transmits the input track information and the electronic device that sends the call information in the above step S301 may be the same electronic device or different electronic devices.
  • the input trajectory information is generated by detecting at least one of the first electronic device and the second electronic device by detecting an input operation of a user.
  • the input trajectory information may include The information of a series of tracks formed by a plurality of track points may also include information of tracks formed by a single track point.
  • the input trajectory information may be information generated by detecting a sliding gesture of the user, or may be detected by Information generated by the user's click operation.
  • the electronic device transmitting the input track information in the first electronic device and the second electronic device may also transmit information such as the size of a display screen of the electronic device.
  • the information processing method determines a processing object based on the input trajectory information.
  • a user such as the first electronic device can select an area in the video picture. Accordingly, the first electronic device forms input trajectory information by detecting an input operation for selecting an area in the video picture. Thereafter, the first electronic device determines that the input track information and the electronic device parameter information of the first electronic device are transmitted to the partial video picture to be the processing object.
  • a user such as a first electronic device, can click on a particular location in the video frame. Accordingly, the first electronic device forms input trajectory information by detecting a click operation for clicking on the video screen. Thereafter, the first electronic device transmits the input track information to the server.
  • the information processing method determines, based on the input trajectory information, which position (i.e., the specific position) the input trajectory information corresponds to in the video picture. Thereafter, the information processing method performs image segmentation on the video picture to obtain a partial video picture including the specific position, and determines the partial video picture as a processing object. Also, the information processing method can perform the above operations based on various image segmentation algorithms known in the art, and will not be described in detail herein.
  • the information processing method can determine the processing object by combining the user's active input with the automatic analysis of the server.
  • the information processing method may perform image recognition on the video screen to determine a plurality of candidate objects. Thereafter, the information processing method may transmit a plurality of candidate objects to at least one of the first electronic device and the second electronic device for selection by a user. The at least one of the first electronic device and the second electronic device detects a user selection operation of at least one of the plurality of candidate objects, generates corresponding input trajectory information, and sends the information to the server .
  • the server is based on selection information obtained by detecting the selection operation (ie, The input trajectory information as described above) determines the selected at least one candidate object as the processing object.
  • the call information includes information of a static picture.
  • the information processing method performs image recognition on the still picture to divide the still picture into a plurality of areas.
  • those skilled in the art can use various algorithms to perform image segmentation, which will not be described in detail herein.
  • the information processing method determines a target area from the plurality of areas based on a predetermined criterion.
  • a target area from the plurality of areas based on a predetermined criterion.
  • those skilled in the art can use various standards and corresponding algorithms to determine the target area, which will not be described in detail herein.
  • the information processing method determines the processing object based on the target area. Specifically, for example, the information processing method may analyze a video picture of the target area to determine a processing object. For example, the information processing method may determine a processing object by identifying a video picture of the target area to determine its object type. For another example, the image is subjected to fuzzy matching to determine a processing object.
  • the above method of determining an object to be processed based on the target area is merely an example.
  • the information processing method of the embodiment of the present invention can determine the processing object by using various other methods known to those skilled in the art, and will not be described in detail herein.
  • the call information includes information of a dynamic picture.
  • the information processing method may identify the dynamic picture to identify a specific action made by the user during the call. For example, the information processing method can recognize an action made by the user during this time period by performing recognition similar to that described above on a dynamic picture composed of a plurality of temporally consecutive frames.
  • the information processing method may determine the processing object based on the specific action. For example, the information processing method may determine a processing object based on the specific action based on a table of association relationships between the action and the processing object stored in advance.
  • the call information includes information of audio.
  • the information processing method may perform audio recognition on the audio to determine a processing object.
  • the information processing method may determine whether there is an audio clip matching the predetermined keyword in the audio. When it is judged that there is an audio piece matching the predetermined keyword in the audio In the case of a segment, the information processing method determines the audio segment as a processing object.
  • the information processing method may perform semantic analysis on the audio and determine a processing object based on a result of the semantic analysis.
  • the information processing method can perform audio recognition on the audio using various algorithms known in the art, and will not be described in detail herein.
  • the information processing method of the embodiment of the present invention can combine the active input of the user with the automatic recognition of the electronic device.
  • the information processing method determines a plurality of candidate objects based on the call information, and sends the plurality of candidate objects to the first electronic device and the second electronic device. At least one of them.
  • the electronic device receiving the candidate object detects a selection operation by the user for selecting at least one candidate object, and transmits selection information generated by the selection operation to the server.
  • the information processing method receives the selection information, and determines the selected at least one candidate object as the processing object based on the selection information.
  • the call information includes text information.
  • the information processing method may perform text recognition on the text to determine a processing object.
  • the information processing method may determine whether there is a text segment matching the predetermined keyword in the text. When it is judged that there is a text segment matching the predetermined keyword in the text, the information processing method determines the text segment as the processing object.
  • the information processing method may perform semantic analysis on the text and determine a processing object based on a result of the semantic analysis.
  • the information processing method can perform text recognition on the text using various algorithms known in the art, and will not be described in detail herein.
  • step S302 the information processing method determines the processing target based on the received call information.
  • step S303 the information processing method analyzes the processing object to acquire association information associated with the processing object.
  • object information of a plurality of objects is pre-stored in the server, and object information of each object is stored in association with the attribute information.
  • the attribute information is used to represent an attribute of the object.
  • the information processing method analyzes the processing object based on an association relationship between the object information and the attribute information, for example, to determine an attribute of the processing object. Thereafter, the The information processing method determines corresponding attribute information in the stored attribute information based on an attribute of the processing object. For example, the attribute information can be divided into different categories. The information processing method may determine attribute information of the stored attribute information that belongs to the same category or a corresponding category as the attribute of the processing object as the corresponding attribute information. Next, the information processing method determines object information associated with the corresponding attribute information as the association information.
  • the attribute information includes information of a plurality of attributes. After the information processing method determines a certain attribute of the processing object, other attribute information of the processing object may be directly determined as the related information.
  • step S304 the information processing method performs an operation based on the associated information.
  • the information processing method may store the association information, and the association information may be sent to at least one of the first electronic device and the second electronic device.
  • the information processing method may store the association information, and the association information may be sent to at least one of the first electronic device and the second electronic device.
  • the processing object is determined based on the call information generated by the call, the association information associated with the processing object is acquired, and an operation based on the association information is performed.
  • the information processing method of the second embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the processing target on the server side, based on the call information, the processing target can be determined in response to an input operation by the user, and the processing target can be automatically determined, and the above-described A combination of the two approaches.
  • the information processing method of the second embodiment of the present invention a plurality of ways are provided to utilize the call information, thereby further enriching the user experience. Further, in the case where the processing capability on the electronic device side is limited, the information processing method according to the second embodiment of the present invention can reduce the processing load on the electronic device side, which is particularly advantageous.
  • information processing applied to a server according to a second embodiment of the present invention will be described with reference to FIG. Equipment.
  • the information processing apparatus 400 of the embodiment of the present invention includes a call information acquisition unit 401, a determination unit 402, an association information acquisition unit 403, and an execution unit 404.
  • the call information acquiring unit 401 acquires call information generated by the call from the first electronic device and/or the second electronic device during a call between the first electronic device and the second electronic device.
  • the determining unit 402 determines a processing object based on the call information.
  • the association information acquisition unit 403 analyzes the processing object to acquire association information associated with the processing object.
  • the execution unit 404 performs an operation based on the associated information.
  • the call information is information of a video screen.
  • the determining unit 402 includes a receiving unit and a first processing object determining unit (not shown).
  • the receiving unit receives electronic device parameter information and input trajectory information transmitted by at least one of the first electronic device and the second electronic device.
  • the input trajectory information is generated by detecting at least one of the first electronic device and the second electronic device by detecting an input operation of the user.
  • the first processing object determining unit determines a processing object based on the electronic device parameter information and the input trajectory information.
  • the input trajectory information is that the at least one of the first electronic device and the second electronic device detects for selecting an area in the video picture Enter the operation and get it.
  • the first processing object determining unit is configured to determine, as the processing object, a partial video picture corresponding to the area in the video picture based on the electronic device parameter information.
  • the input trajectory information is obtained by detecting at least one of the first electronic device and the second electronic device by detecting a click operation for clicking on the video screen.
  • the first processing object determining unit includes an image dividing unit and an object determining unit.
  • the image segmentation unit performs image segmentation on the video image based on the electronic device parameter information and based on a specific position in the video image corresponding to the click operation to obtain a partial video image including the specific location .
  • the object determining unit determines the partial video picture as a processing pair.
  • the information processing apparatus 400 further includes an identifying unit and a transmitting unit (not shown).
  • the identification unit performs image recognition on the video screen to determine a plurality of candidate objects.
  • the transmitting unit transmits a plurality of candidate objects to the at least one of the first electronic device and the second electronic device.
  • the input trajectory information is that the at least one of the first electronic device and the second electronic device detects at least one candidate of the plurality of candidate objects by detecting a user Obtained by the selection operation of the object.
  • the first processing object determining unit is configured to determine the selected at least one candidate object as the processing object based on the electronic device parameter information and based on the selecting operation.
  • the call information is information of a video picture.
  • the determining unit 402 includes a still picture recognizing unit, a target area determining unit, and a second processing object determining unit.
  • the still picture recognition unit performs image recognition on the video picture to divide the still picture into a plurality of areas.
  • the target area determining unit determines a target area from the plurality of areas based on a predetermined criterion.
  • the second processing object determining unit determines the processing object based on the target area.
  • the call information is information of a dynamic picture.
  • the determining unit 402 includes a dynamic picture recognition unit and a third processing object determination unit.
  • the dynamic picture recognition unit identifies the dynamic picture to identify a specific action made by an object in the dynamic picture during the call.
  • the third processing object determining unit determines the processing object based on the specific action.
  • the call information is information of audio.
  • the determining unit 402 includes an audio recognizing unit that performs audio recognition on the audio to determine a processing object.
  • the determining unit 402 includes a candidate object determining unit, a transmitting unit, a receiving unit, and a fourth processing object determining unit (not shown).
  • the candidate object determining unit determines a plurality of candidate objects based on the call information.
  • the transmitting unit transmits the plurality of candidate objects to at least one of the first electronic device and the second electronic device.
  • the receiving unit receives a selection information of a user of the at least one of the first electronic device and the second electronic device for selecting at least one candidate object.
  • the fourth processing object determining unit determines the selected at least one candidate object as the processing object based on the selection information.
  • the object information of the plurality of objects is pre-stored in the server.
  • the object information of each object is stored in association with the attribute information for indicating the attribute of the object.
  • the association information acquisition unit 403 includes an attribute determination unit, an attribute information determination unit, and an object information determination unit (not shown).
  • the attribute determining unit analyzes the processing object to determine an attribute of the processing object.
  • the attribute information determining unit determines the attribute information corresponding to the stored attribute information based on the attribute of the processing object.
  • the object information determining unit determines object information associated with the corresponding attribute information as the related information.
  • the information processing device of the second embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the processing target on the server side, based on the call information, the processing target can be determined in response to the input operation of the user, and the processing target can be automatically determined, and the above-described A combination of the two approaches.
  • the information processing apparatus of the second embodiment of the present invention a plurality of ways are provided to utilize the call information, thereby further enriching the user experience. Further, in the case where the processing capability on the electronic device side is limited, the information processing device according to the second embodiment of the present invention can reduce the processing load on the electronic device side, which is particularly advantageous.
  • an information processing method and an information processing device applied to a terminal side which, after acquiring the association information as described above, can perform various types including immediate output, storage, forwarding, and the like. operating.
  • the flow of the information processing method of the third embodiment of the present invention is similar to the flow of the information processing method of the first embodiment of the present invention. That is, the information processing method also includes: determining, in the process of the multimedia call between the first electronic device and the second electronic device, the processing object based on the call information generated by the call; acquiring and processing Association information associated with the object; and performing an operation based on the associated information.
  • the information processing method may transmit the processing object to a remote server, and the remote server obtains the analysis by analyzing the processing object.
  • the associated information is described, and the associated information is sent to the first electronic device.
  • the information processing method may also analyze the processing object locally to determine the associated information.
  • the information processing method outputs the associated information during the call, or outputs the associated information immediately after the call ends.
  • the information processing method may generate a prompt icon for prompting the user to view, and display the prompt icon.
  • the prompt icon is used to link to the associated information. Thereafter, when it is detected that the user clicks on the prompt icon, the information processing method accesses the associated information.
  • the call is an audio call.
  • the information processing method detects whether the first electronic device is connected to a display device.
  • the display device may be an external display device, or may be a display unit included in the first electronic device itself but in a disabled state.
  • the information processing method can obtain information about the above connection, for example, by detecting a corresponding connection pin of the first electronic device.
  • the information processing method outputs the association information to the display device when detecting that the first electronic device is connected to a display device. Thereby, display based on the associated information is performed by the display device.
  • the call is a video call.
  • the information processing method combines an image based on the associated information with an image of the video call to generate a combined image, and displays the combined image.
  • the image based on the associated information may be an image displaying various forms of content such as a picture, a text, and the like.
  • the associated information is not immediately output.
  • the information processing method stores the associated information in, for example, a local memory. Thereafter, the information processing method outputs the association information only when it is judged that the predetermined condition is satisfied.
  • the information processing method determines whether the current time satisfies the first predetermined condition. For example, the information processing method determines whether the current time is a time preset by the electronic device or the user. For another example, the information processing method determines whether the time interval between the current time and the call end time is a time interval preset by the electronic device or the user. For another example, the information processing method determines whether the time interval between the current time and the call end time is greater than a time interval preset by the electronic device or the user. Thereafter, when it is judged that the current time satisfies the first predetermined condition, the information processing method performs display based on the association information.
  • the first pre-described above The conditions are only examples. Those skilled in the art can completely design other various conditions as the first predetermined condition as needed.
  • the information processing method determines whether the network access satisfies a second predetermined condition when the first electronic device performs network access. For example, the information processing method determines that the information processing method locally stores in advance a correspondence destination between the association information and the network access destination. Thereafter, when it is judged that the network access satisfies the second predetermined condition, the information processing method performs display based on the association information.
  • the second predetermined condition described above is merely an example. Those skilled in the art can design other various conditions as the second predetermined condition as needed.
  • the information processing method may further detect environmental information of the first electronic device.
  • the environmental information includes, for example, location information of the first electronic device, weather information of the environment in which it is located, temperature information, and the like.
  • the information processing method determines whether the environmental information satisfies a third predetermined condition.
  • location information for example, the information processing method determines whether the first electronic device arrives at the electronic device or a location preset by the user.
  • the information processing method locally stores a comparison table between the related information and the location information in advance. The information processing method determines whether the first electronic device is in a position corresponding to the associated information based on the location information. The judgment of other kinds of environmental information is similar to this and will not be described in detail here.
  • the information processing method performs display based on the associated information.
  • the third predetermined condition described above is merely an example. Those skilled in the art can design other various conditions as the third predetermined condition as needed.
  • the information processing method does not immediately output the associated information during the call and after the call ends.
  • the information processing method transmits the association information to at least one of a remote server and the second electronic device.
  • the remote server and/or the second electronic device may, for example, store the associated information or output the associated information.
  • the display processing may display the related information itself or a prompt icon for connecting to the related information.
  • the call information determines a processing object, acquires association information associated with the processing object, and performs an operation based on the association information.
  • the information processing method of the third embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the association information may be stored, and when the predetermined condition is satisfied at a later time, the output of the association information is triggered, and the The associated information is output to the server and/or the second electronic device for processing.
  • the configuration of the information processing device is similar to that of the information processing device of the first embodiment of the present invention, that is, it also includes a determining unit, an obtaining unit, and an executing unit.
  • the determining unit determines the processing object based on the call information generated by the call during the multimedia call between the first electronic device and the second electronic device.
  • the acquiring unit acquires association information associated with the processing object.
  • the execution unit performs an operation based on the associated information.
  • the obtaining unit may include: a sending unit that sends the processing object to a remote server; and a receiving unit that receives related information from the remote server, where the association The information is information associated with the processing object obtained by the remote server by analyzing the processing object.
  • the obtaining unit may include: an analyzing unit, analyzing the processing object to determine the related information.
  • the execution unit is configured to perform at least one of: displaying the associated information; storing the associated information; and transmitting the associated information to a remote server and the second electronic device At least one of them.
  • the execution unit may include an icon generating unit and an icon display unit.
  • the icon generating unit generates a prompt icon for prompting the user to view, and the prompt icon is used to link to the related information.
  • the icon display unit displays the prompt icon.
  • the call is an audio call.
  • the execution unit may include a first detection unit and an output unit. The first detecting unit detects whether the first electronic device is connected to a display device. The output unit outputs the related information to the display device when detecting that the first electronic device is connected to a display device, and the display device performs display based on the related information.
  • the call is a video call.
  • the execution unit may include a combination unit and a combined image display unit.
  • the combining unit combines an image based on the associated information with an image of the video call to generate a combined image.
  • the combined image display unit displays the combined image.
  • the information processing device further includes a first determination unit that, after storing the association information, determines whether the current time satisfies the first predetermined condition.
  • the execution unit is configured to perform display based on the associated information when it is determined that the current time satisfies the first predetermined condition.
  • the information processing device further includes: a second determining unit, after storing the associated information, when the first electronic When the device performs network access, it is determined whether the network access meets the second predetermined condition.
  • the execution unit is configured to perform display based on the association information when the network access satisfies a second predetermined condition.
  • the information processing device further includes: an environment information detecting unit, after storing the association information, detecting the first electronic Environmental information of the device; and a third determining unit that determines whether the environmental information satisfies a third predetermined condition.
  • the execution unit is configured to perform display based on the association information when the environmental information satisfies a third predetermined condition.
  • the execution unit may be configured to display at least one of the association information and a prompt icon for linking to the association information.
  • the information processing device of the third embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the association information may be stored, and when the predetermined condition is satisfied at a later time, the output of the association information is triggered, and the The associated information is output to the server and/or the second electronic device for processing.
  • the information processing apparatus provides a plurality of ways to output the related information, which facilitates the user to customize differently according to the situation, thereby further enriching the user's body.
  • an information processing method and an information processing apparatus applied to a server which can perform various operations including immediate output, storage, forwarding, and the like after acquiring the association information as described above.
  • the flow of the information processing method of the fourth embodiment of the present invention is similar to the flow of the information processing method of the second embodiment of the present invention. That is, the information processing method also includes: acquiring, during the conversation between the first electronic device and the second electronic device, the call information generated by the call from the first electronic device and/or the second electronic device; Determining a processing object based on the call information; analyzing the processing object to acquire association information associated with the processing object; and performing an operation based on the association information.
  • the server may store object information of a plurality of objects in advance, and the object information of each object is stored in association with attribute information for indicating attributes of the object.
  • the information processing method may analyze the processing object to determine an attribute of the processing object, determine corresponding attribute information in the stored attribute information based on an attribute of the processing object, and compare the attribute with the corresponding attribute The object information associated with the information is determined as the associated information.
  • the association information may be stored, for example, for output later.
  • the information processing method may also send the association information to at least one of the first electronic device and the second electronic device based on a predetermined policy. More specifically, in the first example, the information processing method receives a request from at least one of the first electronic device and the second electronic device. The request is for requesting the server to send the association information. In this example, it is assumed that the information processing method receives a request from a first electronic device. Thus, the information processing method transmits the association information to the electronic device in the first electronic device and the second electronic device for request, in response to the request, that is, the first in this example Electronic equipment.
  • the information processing method does not have to transmit the associated information in response to an additional request from the first electronic device or the second electronic device.
  • the information processing method arbitrarily transmits the association information to the electronic device that transmits the call information in the first electronic device and the second electronic device.
  • the call information includes information of audio.
  • the information processing method performs semantic analysis on the audio to determine which of the first electronic device and the second electronic device the associated information is suitable for.
  • the techniques for performing semantic analysis by the information processing method are known to those skilled in the art and will not be described in detail herein.
  • the information processing method transmits the association information to the electronic device determined to be suitable among the first electronic device and the second electronic device.
  • the call information includes information of text.
  • the information processing method performs semantic analysis on the text to determine which of the first electronic device and the second electronic device the associated information is suitable for.
  • the techniques for performing semantic analysis by the information processing method are known to those skilled in the art and will not be described in detail herein.
  • the information processing method transmits the association information to the electronic device determined to be suitable among the first electronic device and the second electronic device.
  • the processing object is determined based on the call information generated by the call, the association information associated with the processing object is acquired, and an operation based on the association information is performed.
  • the information processing method of the fourth embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the related information may be stored to be delayed, or the related information may be sent to an appropriate electronic device according to various different policies. Further processing is performed by the electronic device that received the associated information.
  • the configuration of the information processing apparatus is similar to that of the information processing apparatus of the second embodiment of the present invention, that is, it also includes an acquisition unit, a determination unit, an analysis unit, and an execution unit.
  • the acquiring unit acquires call information generated by the call from the first electronic device and/or the second electronic device during a call between the first electronic device and the second electronic device.
  • the determining unit determines a processing object based on the call information.
  • the analysis unit analyzes the processing object to acquire association information associated with the processing object.
  • the execution unit performs an operation based on the associated information.
  • object information of a plurality of objects may be stored in advance in the server, and object information of each object is stored in association with attribute information for indicating attributes of the object.
  • the acquisition unit includes an attribute determination unit, an attribute information determination unit, and an object information determination unit.
  • the attribute determining unit analyzes the processing object to determine a property of the processing object.
  • the attribute information determining unit determines corresponding attribute information in the stored attribute information based on the attribute of the processing object.
  • the object information determining unit determines object information associated with the corresponding attribute information as the related information.
  • the execution unit is configured to perform at least one of: storing the association information; transmitting the association information to the first electronic device and the At least one of the second electronic devices.
  • the execution unit includes: a receiving unit, receiving the a request of at least one of an electronic device and the second electronic device; and a transmitting unit that transmits the associated information to the first electronic device and the first in response to the request The electronic device that makes the request in the two electronic devices.
  • the execution unit is configured to transmit the association information to an electronic device that transmits call information in the first electronic device and the second electronic device.
  • the call information includes information of audio.
  • the execution unit includes: a semantic analysis unit that performs semantic analysis on the audio to determine which one of the first electronic device and the second electronic device is suitable for the associated information; and a sending unit The association information is sent to the electronic device determined to be suitable among the first electronic device and the second electronic device.
  • the call information includes information of text.
  • the execution unit includes: a semantic analysis unit, performing semantic analysis on the text to determine which one of the first electronic device and the second electronic device is suitable for the associated information; and a sending unit The association information is sent to the electronic device determined to be suitable among the first electronic device and the second electronic device.
  • the information processing device of the fourth embodiment of the present invention it is possible to utilize the call information generated during the call, thereby further enhancing the application value of the call in addition to the communication purpose, and greatly enriching the user experience.
  • the related information may be stored to delay output, or the related information may be sent to an appropriate electronic device according to various different policies. Further processing is performed by the electronic device that received the associated information.
  • FIGS. 5A to 5C are diagrams showing the display on the display screen 500 of the first electronic device to which the information processing method of the embodiment of the present invention is applied.
  • the display screen 500 is divided into two areas: a first area 501 and a second area 502.
  • An image of a user (hereinafter, referred to as a first user as appropriate) of the first electronic device that is gathered by the first electronic device by, for example, an image collection unit of a front camera is displayed in the first area 501.
  • the second area 502 displays an image of a user (hereinafter, referred to as a second user as appropriate) of the second electronic device that the second electronic device has gathered by, for example, an image collection unit of the camera.
  • the display screen 500 of the first electronic device is a touch display screen.
  • the information processing method and the information processing device of the embodiments of the present invention can be equally applied to electronic devices that are not touch input.
  • the first user has an interest in the top of the second user in the video communication with the second user, and circled the area 503 corresponding to the top on the display screen 500 by gesture .
  • the information processing method detects the above operation of the user, and determines a part of the video picture corresponding to the area 503 in the video picture as a processing target.
  • the first user can also click on any of the areas in the display on the display screen 500 by the gesture.
  • the information processing method performs image segmentation on a video picture to obtain a partial video picture including the position, as also shown in 503.
  • the information processing method may also automatically perform image recognition on the video screen to divide the video screen into a plurality of regions, for example, an area 503 corresponding to the top, an area 504 corresponding to the pants, and a shoe.
  • the information processing method determines the region 503 in the plurality of regions as the processing target based on a predetermined criterion, for example, based on the saliency of the region.
  • the information processing method may also combine the above-described user input with the manner of automatic determination. That is, the information processing method may first automatically perform image recognition on the video screen to determine a plurality of candidate objects, such as a top 503, pants 504, and shoes 505, and present the plurality of candidate objects to the first user.
  • the manner of presentation is not limited.
  • the information processing method may display a partial video picture corresponding to the areas 503, 504, and 505 in a thumbnail form in an appropriate position in the display screen 500.
  • the information processing method may be in the area 503, A cue mark is displayed near 504 and 505, and so on. Thereafter, the information processing method detects a user's selection operation of at least one of the plurality of candidate objects, and determines the selected at least one candidate object as the processing object based on the selection operation.
  • the information processing method acquires association information associated with the processing object and performs an operation based on the association information. Specifically, in this scenario, for example, the information processing method determines the brand of the top by image analysis, thereby obtaining attribute information such as the price, fabric, and origin of the top as related information. Further, for example, the information processing method determines the brand of the top by image analysis, and thereby obtains information such as other tops of the same brand as the top as related information.
  • the manner in which the information processing method described above determines the associated information is merely an example.
  • the information processing method After the association information is obtained, in an embodiment, the information processing method generates a prompt icon for prompting the user to view, the prompt icon is used to link to the associated information, and the prompt icon is displayed. This is shown as icon 508 in Figure 5B.
  • the information processing method generates an image based on the association information, as shown by 509 in FIG. 5C, combining it with an image of the video call to generate a combined image, and displaying the image Combine images.
  • the information processing method does not output the information immediately, but stores it in the local storage, or sends it to at least the server and the second electronic device.
  • the information processing method may display the association information or an icon for prompting access to the associated information when it is determined that the current time satisfies the first predetermined condition.
  • the information processing method may display the related information or use when determining whether the network access meets a second predetermined condition, for example, when determining that the destination of the network access is a shopping website.
  • a second predetermined condition for example, when determining that the destination of the network access is a shopping website.
  • the information processing method may detect environmental information of the first electronic device, such as location information of the first electronic device.
  • environmental information such as location information of the first electronic device.
  • the information processing method determines that the environmental information satisfies a third predetermined condition, for example, when it is determined that the first electronic device is located in a shopping mall, the associated information or an icon for prompting access to the associated information is displayed.
  • FIGS. 5A-5C illustrate that the first user performs a video call with the second user of the second electronic device through the front camera of the first electronic device, and the processing object corresponds to the second user.
  • the information processing method and the information processing device of the embodiment of the present invention are also applicable to the first user performing a video call with the second user of the second electronic device through the rear camera of the first electronic device, and the processing object is The case of an object in the video screen corresponding to the first user.
  • Figure 6 shows the display diagram in this case.
  • the display screen 600 is divided into two areas: a first area 601 and a second area 602.
  • the first area 601 displays an image of the first electronic device side that is collected by the first electronic device through, for example, an image capturing unit of the rear camera.
  • the second area 602 displays an image of the second electronic device side collected by the second electronic device through, for example, an image collection unit of the camera.
  • the first user wishes to describe to the second user the building in the vicinity of the area in which it is located, but does not know various information such as the name of the building.
  • the first user can obtain various related information such as the name, the building age, and the like of the building through the information processing method of the embodiment of the present invention, and the processing thereof is similar to the above, and will not be described in detail herein.
  • the information processing method and the information processing device in the embodiment of the present invention can utilize the call information generated during the call, thereby further improving the application value of the call and greatly enriching the user experience.
  • the processing object can be determined in response to the input operation of the user on the electronic device side, and the processing object can be automatically determined, and the above two modes can also be combined. . Therefore, the information processing method and the information processing apparatus of the embodiments of the present invention provide various ways to utilize the call information, thereby further enriching the user's experience.
  • the above determination The process of the object can also be performed on the server side, so that when the processing capability on the electronic device side is limited, the processing load on the electronic device side can be reduced, and the processing efficiency on the electronic device side can be improved.
  • the electronic device may also store the related information, and trigger the output of the related information when the predetermined condition is satisfied at a later time, and may also The associated information is output to the server and/or the second electronic device for processing. Therefore, it is convenient for users to customize differently according to the situation, thereby further enriching the user experience.
  • the related information may be stored to delay output, or the related information may be sent to an appropriate electronic according to various different policies.
  • the device performs further processing by the electronic device that receives the associated information. Therefore, various ways are provided to output the related information to different electronic devices, so that the service provider can customize differently according to the situation.
  • FIGS. 1 through 6 an information processing method and an information processing apparatus according to an embodiment of the present invention have been described with reference to FIGS. 1 through 6.
  • first ... unit and second unit are merely convenient for distinguishing in description, and do not mean that they must be realized as physically separated two. Or multiple units. In fact, the unit may be implemented as a unit as a whole or as a plurality of units, as needed.
  • the unit/module can be implemented in software for execution by various types of processors.
  • an identified executable code module can comprise one or more physical or logical blocks of computer instructions, which can be constructed, for example, as an object, procedure, or function. Nonetheless, the executable code of the identified modules need not be physically located together, but may include different instructions stored in different bits. When these instructions are logically combined, they constitute the unit/module and implement the unit. / Module's stated purpose.
  • the unit/module can be implemented by software, considering the level of the existing hardware process, the unit/module that can be implemented by software can be constructed by a person skilled in the art without considering the cost.
  • the hardware circuit includes conventional Very Large Scale Integration (VLSI) circuits or gate arrays and existing semiconductors such as logic chips, transistors, or other discrete components. Modules can also be implemented with programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, and the like.
  • VLSI Very Large Scale Integration

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明的实施例提供了一种信息处理方法和信息处理设备,应用于一服务器,所述信息处理方法包括:在第一电子设备与第二电子设备进行通话的过程中,从所述第一电子设备和/或所述第二电子设备获取通话所产生的通话信息;基于所述通话信息,确定处理对象;对所述处理对象进行分析,以获取与所述处理对象相关联的关联信息;以及执行基于所述关联信息的操作。

Description

信息处理方法和信息处理设备 技术领域
本发明涉及信息处理的领域, 更具体地, 本发明涉及一种信息处理方法 和信息处理设备。 背景技术
随着通信技术的发展, 包括文本通信、 语音通信、 视频通信等的通信应 用越来越广泛。 在这些通信过程中, 会产生大量的数据, 如文本数据、 语音 数据、 视频数据等。
在现有技术中, 除了简单地将这些数据转发至通信过程中相应的通话方 以实现通信目的之外, 并未对这些数据进行进一步的利用。 发明内容
有鉴于上述情况, 本发明提供了一种信息处理方法和信息处理设备, 其 能够利用通话过程中所产生的通话信息, 例如产生适于通话方的关联信息, 从而进一步提升通话的应用价值, 丰富用户的体验。
根据本发明一实施例,提供了一种信息处理方法,应用于第一电子设备, 所述信息处理方法包括: 在所述第一电子设备与第二电子设备进行通话的过 程中, 基于所述通话所产生的通话信息, 确定处理对象; 获取与所述处理对 象关联的关联信息; 以及执行基于所述关联信息的操作。
所述获取与所述处理对象关联的关联信息包括: 将所述处理对象发送至 远程服务器; 以及从所述远程服务器接收关联信息, 所述关联信息是由所述 远程服务器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联 的信息。
所述获取与所述处理对象关联的关联信息包括: 对所述处理对象进行分 析, 以确定所述关联信息。
所述通话信息为视频画面的信息, 并且所述确定处理对象包括: 检测用 户的输入操作; 以及基于所述输入操作, 从所述视频画面中确定处理对象。
所述检测用户的输入操作包括: 检测用于选定所述视频画面中的一区域 的输入操作; 并且, 所述确定处理对象包括: 将所述视频画面中与所述区域 所对应的部分视频画面确定为处理对象。
所述检测用户的输入操作包括:检测用于点击所述视频画面的点击操作; 并且, 所述确定处理对象包括: 基于所述点击操作对应的所述视频画面中的 特定位置, 对所述视频画面进行图像分割, 以获得包含所述特定位置的部分 视频画面; 以及将所述部分视频画面确定为处理对象。
所述检测用户的输入操作包括: 对所述视频画面进行图像识别, 以确定 多个候选对象; 检测用户对所述多个候选对象中的至少一个候选对象的选择 操作; 并且, 所述确定处理对象包括: 基于所述选择操作, 将所选择的所述 至少一个候选对象确定为所述处理对象。
所述通话信息为静态画面的信息, 所述确定处理对象还包括: 对所述静 态画面进行图像识别, 以将所述静态画面分割为多个区域; 基于预定标准, 从所述多个区域中确定目标区域; 以及基于所述目标区域, 确定所述处理对 所述通话信息为动态画面的信息, 所述确定处理对象还包括: 对所述动 态画面进行识别, 以识别出用户在所述通话过程中做出的特定动作; 以及基 于所述特定动作, 确定所述处理对象。
所述通话信息为音频的信息, 并且所述确定处理对象包括: 对所述音频 进行音频识别, 以确定处理对象。
所述确定处理对象还包括: 基于所述通话信息, 确定多个候选对象; 检 测用户对所述多个候选对象中的至少一个的选择操作; 以及基于所述选择操 作, 将所选择的所述至少一个候选对象确定为所述处理对象。
根据本发明另一实施例, 提供了一种信息处理设备, 应用于第一电子设 备, 所述信息处理设备包括: 确定单元, 在所述第一电子设备与第二电子设 备进行通话的过程中, 基于所述通话所产生的通话信息, 确定处理对象; 获 取单元, 获取与所述处理对象关联的关联信息; 以及执行单元, 执行基于所 述关联信息的操作。
所述获取单元包括: 发送单元, 将所述处理对象发送至远程服务器; 以 及接收单元, 从所述远程服务器接收关联信息, 所述关联信息是由所述远程 服务器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联的信 息。
所述获取单元包括: 分析单元, 对所述处理对象进行分析, 以确定所述 关联信息。
所述通话信息为视频画面的信息, 并且所述确定单元包括: 检测单元, 检测用户的输入操作; 以及第一处理对象确定单元, 基于所述输入操作, 从 所述视频画面中确定处理对象。
所述检测单元配置为检测用于选定所述视频画面中的一区域的输入操 作; 并且, 所述第一处理对象确定单元配置为将所述视频画面中与所述区域 所对应的部分视频画面确定为处理对象。
所述检测单元配置为检测用于点击所述视频画面的点击操作; 并且, 所 述第一处理对象确定单元包括: 图像分割单元, 基于所述点击操作对应的所 述视频画面中的特定位置, 对所述视频画面进行图像分割, 以获得包含所述 特定位置的部分视频画面; 以及对象确定单元, 将所述部分视频画面确定为 处理对象。
所述检测单元包括: 识别单元, 对所述视频画面进行图像识别, 以确定 多个候选对象; 选择检测单元, 检测用户对所述多个候选对象中的至少一个 候选对象的选择操作; 并且, 所述第一处理对象确定单元配置为基于所述选 择操作, 将所选择的所述至少一个候选对象确定为所述处理对象。
所述通话信息为静态画面的信息, 所述确定单元还包括: 静态画面识别 单元, 对所述静态画面进行图像识别, 以将所述静态画面分割为多个区域; 目标区域确定单元, 基于预定标准, 从所述多个区域中确定目标区域; 以及 第二处理对象确定单元, 基于所述目标区域, 确定所述处理对象。
所述通话信息为动态画面的信息, 所述确定单元还包括: 动态画面识别 单元, 对所述动态画面进行识别, 以识别出用户在所述通话过程中做出的特 定动作; 以及第三处理对象确定单元, 基于所述特定动作, 确定所述处理对 所述通话信息为音频的信息, 并且所述确定单元包括: 音频识别单元, 对所述音频进行音频识别, 以确定处理对象。
所述确定单元还包括: 候选对象确定单元, 基于所述通话信息, 确定多 个候选对象; 选择检测单元, 检测用户对所述多个候选对象中的至少一个的 选择操作; 以及第四处理对象确定单元, 基于所述选择操作, 将所选择的所 述至少一个候选对象确定为所述处理对象。
根据本发明另一实施例, 提供了一种信息处理方法, 应用于一服务器, 所述信息处理方法包括:在第一电子设备与第二电子设备进行通话的过程中, 从所述第一电子设备和 /或所述第二电子设备获取通话所产生的通话信息; 基 于所述通话信息, 确定处理对象; 对所述处理对象进行分析, 以获取与所述 处理对象相关联的关联信息; 以及执行基于所述关联信息的操作。
所述通话信息为视频画面的信息, 并且所述确定处理对象包括: 接收所 述第一电子设备和所述第二电子设备中的至少一个发送的输入轨迹信息, 所 述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至少一个 通过检测用户的输入操作而产生的; 以及基于所述输入轨迹信息, 确定处理 对象。
所述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至 少一个通过检测用于选定所述视频画面中的一区域的输入操作而得到的; 并 且, 所述确定处理对象包括: 将所述视频画面中与所述区域所对应的部分视 频画面确定为处理对象。
所述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至 少一个通过检测用于点击所述视频画面的点击操作而得到的; 并且, 所述确 定处理对象包括: 基于所述点击操作对应的所述视频画面中的特定位置, 对 所述视频画面进行图像分割, 以获得包含所述特定位置的部分视频画面; 以 及将所述部分视频画面确定为处理对象。
所述信息处理方法还包括: 对所述视频画面进行图像识别, 以确定多个 候选对象; 以及将多个候选对象发送至所述第一电子设备和所述第二电子设 备中的所述至少一个; 并且, 所述输入轨迹信息是所述第一电子设备和所述 第二电子设备中的所述至少一个通过检测用户对所述多个候选对象中的至少 一个候选对象的选择操作而获得的; 所述确定处理对象还包括: 基于所述选 择操作, 将所选择的所述至少一个候选对象确定为所述处理对象。
所述通话信息为视频画面的信息, 并且所述确定处理对象包括: 对所述 视频画面进行图像识别, 以将所述静态画面分割为多个区域; 基于预定标准, 从所述多个区域中确定目标区域; 以及基于所述目标区域, 确定所述处理对 所述通话信息为动态画面的信息, 所述确定处理对象还包括: 对所述动 特定动作; 以及基于所述特定动作, 确定所述处理对象。 所述通话信息为音频的信息, 并且所述确定处理对象包括: 对所述音频 进行音频识别, 以确定处理对象。
所述确定处理对象还包括: 基于所述通话信息, 确定多个候选对象; 将 所述多个候选对象发送至所述第一电子设备和所述第二电子设备中的至少一 个; 接收所述第一电子设备和所述第二电子设备中的所述至少一个的用户用 于选择至少一个候选对象的选择信息; 以及基于所述选择信息, 将所选择的 所述至少一个候选对象确定为所述处理对象。
所述服务器中预先存储了多个对象的对象信息, 并且每个对象的对象信 息与用于表示所述对象的属性的属性信息相关联地存储; 并且, 所述获取与 所述处理对象相关联的关联信息包括: 对所述处理对象进行分析, 以确定所 述处理对象的属性; 基于所述处理对象的属性, 确定所存储的属性信息中对 应的属性信息; 以及将与所述对应的属性信息关联的对象信息确定为所述关 联信息。
根据本发明另一实施例, 提供了一种信息处理设备, 应用于一服务器, 所述信息处理设备包括: 通话信息获取单元, 在第一电子设备与第二电子设 备进行通话的过程中, 从所述第一电子设备和 /或所述第二电子设备获取通话 所产生的通话信息; 确定单元, 基于所述通话信息, 确定处理对象; 关联信 息获取单元, 对所述处理对象进行分析, 以获取与所述处理对象相关联的关 联信息; 以及执行单元执行基于所述关联信息的操作。
所述通话信息为视频画面的信息, 并且所述确定单元包括: 接收单元, 接收所述第一电子设备和所述第二电子设备中的至少一个发送的输入轨迹信 息, 所述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至 少一个通过检测用户的输入操作而产生的; 以及第一处理对象确定单元, 基 于所述输入轨迹信息, 确定处理对象。
所述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至 少一个通过检测用于选定所述视频画面中的一区域的输入操作而得到的; 并 且, 所述第一处理对象确定单元配置为将所述视频画面中与所述区域所对应 的部分视频画面确定为处理对象。
所述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至 少一个通过检测用于点击所述视频画面的点击操作而得到的; 并且, 所述第 一处理对象确定单元包括: 图像分割单元, 基于所述点击操作对应的所述视 频画面中的特定位置, 对所述视频画面进行图像分割, 以获得包含所述特定 位置的部分视频画面; 以及对象确定单元, 将所述部分视频画面确定为处理 对象。
所述信息处理设备还包括: 识别单元, 对所述视频画面进行图像识别, 以确定多个候选对象; 以及发送单元, 将多个候选对象发送至所述第一电子 设备和所述第二电子设备中的所述至少一个; 并且, 所述输入轨迹信息是所 述第一电子设备和所述第二电子设备中的所述至少一个通过检测用户对所述 多个候选对象中的至少一个候选对象的选择操作而获得的; 所述第一处理对 象确定单元配置为基于所述选择操作, 将所选择的所述至少一个候选对象确 定为所述处理对象。
所述通话信息为视频画面的信息, 并且所述确定单元包括: 静态画面识 别单元, 对所述视频画面进行图像识别, 以将所述静态画面分割为多个区域; 目标区域确定单元, 基于预定标准, 从所述多个区域中确定目标区域; 以及 第二处理对象确定单元, 基于所述目标区域, 确定所述处理对象。
所述通话信息为动态画面的信息, 并且所述确定单元包括: 动态画面识 别单元, 对所述动态画面进行识别, 以识别出所述动态画面中的物体在所述 通话过程中做出的特定动作; 以及第三处理对象确定单元, 基于所述特定动 作, 确定所述处理对象。
所述通话信息为音频的信息, 并且所述确定单元包括: 音频识别单元, 对所述音频进行音频识别, 以确定处理对象。
所述确定单元包括: 候选对象确定单元, 基于所述通话信息, 确定多个 候选对象; 发送单元, 将所述多个候选对象发送至所述第一电子设备和所述 第二电子设备中的至少一个; 接收单元, 接收所述第一电子设备和所述第二 电子设备中的所述至少一个的用户用于选择至少一个候选对象的选择信息; 以及第四处理对象确定单元, 基于所述选择信息, 将所选择的所述至少一个 候选对象确定为所述处理对象。
所述服务器中预先存储了多个对象的对象信息, 并且每个对象的对象信 息与用于表示所述对象的属性的属性信息相关联地存储; 并且, 所述关联信 息获取单元包括: 属性确定单元, 对所述处理对象进行分析, 以确定所述处 理对象的属性; 属性信息确定单元, 基于所述处理对象的属性, 确定所存储 的属性信息中对应的属性信息; 以及对象信息确定单元, 将与所述对应的属 性信息关联的对象信息确定为所述关联信息。
根据本发明另一实施例, 提供了一种信息处理方法, 应用于第一电子设 备, 所述信息处理方法包括: 在所述第一电子设备与所述第二电子设备进行 多媒体通话的过程中, 基于所述通话所产生的通话信息, 确定处理对象; 获 取与所述处理对象关联的关联信息; 以及执行基于所述关联信息的操作。
获取与所述处理对象关联的关联信息包括: 将所述处理对象发送至远程 服务器; 以及从所述远程服务器接收关联信息, 所述关联信息是由所述远程 服务器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联的信 息。
获取与所述处理对象关联的关联信息包括: 对所述处理对象进行分析, 以确定所述关联信息。
执行基于所述关联信息的操作包括:生成用于提示用户查看的提示图标, 所述提示图标用于链接至所述关联信息; 以及显示所述提示图标。
所述通话为音频通话, 并且执行基于所述关联信息的操作包括: 检测所 述第一电子设备是否与一显示设备连接; 以及当检测到所述第一电子设备与 一显示设备连接时, 将所述关联信息输出至所述显示设备, 所述显示设备基 于所述关联信息进行显示。
所述通话为视频通话, 并且执行基于所述关联信息的操作包括: 将基于 所述关联信息的图像与所述视频通话的图像进行组合, 以生成组合图像; 以 及显示所述组合图像。
执行基于所述关联信息的操作包括以下中的至少一个: 显示所述关联信 息; 存储所述关联信息; 以及将所述关联信息发送至远程服务器和所述第二 电子设备中的至少一个。
在存储所述关联信息之后, 所述信息处理方法还包括: 判断当前时间是 否满足第一预定条件; 以及当判断当前时间满足第一预定条件时, 执行基于 所述关联信息的显示。
在存储所述关联信息之后, 所述信息处理方法还包括: 当所述第一电子 设备进行网络访问时, 判断所述网络访问是否满足第二预定条件; 以及当所 述网络访问满足第二预定条件时, 执行基于所述关联信息的显示。
在存储所述关联信息之后, 所述信息处理方法还包括: 检测所述第一电 子设备的环境信息; 判断所述环境信息是否满足第三预定条件; 以及当所述 环境信息满足第三预定条件时, 执行基于所述关联信息的显示。
执行基于所述关联信息的显示包括: 显示所述关联信息以及提示图标中 的至少一个, 其中, 所述提示图标用于链接至所述关联信息。
根据本发明另一实施例, 提供了一种信息处理设备, 应用于第一电子设 备, 所述信息处理设备包括: 确定单元, 在所述第一电子设备与所述第二电 子设备进行多媒体通话的过程中, 基于所述通话所产生的通话信息, 确定处 理对象; 获取单元, 获取与所述处理对象关联的关联信息; 以及执行单元, 执行基于所述关联信息的操作。
所述获取单元包括: 发送单元, 将所述处理对象发送至远程服务器; 以 及接收单元, 从所述远程服务器接收关联信息, 所述关联信息是由所述远程 服务器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联的信 息。
所述获取单元包括: 分析单元, 对所述处理对象进行分析, 以确定所述 关联信息。
所述执行单元包括: 图标生成单元,生成用于提示用户查看的提示图标, 所述提示图标用于链接至所述关联信息; 以及图标显示单元, 显示所述提示 图标。
所述通话为音频通话, 并且所述执行单元包括: 第一检测单元, 检测所 述第一电子设备是否与一显示设备连接; 以及输出单元, 当检测到所述第一 电子设备与一显示设备连接时, 将所述关联信息输出至所述显示设备, 所述 显示设备基于所述关联信息进行显示。
所述通话为视频通话, 并且所述执行单元包括: 组合单元, 将基于所述 关联信息的图像与所述视频通话的图像进行组合, 以生成组合图像; 以及组 合图像显示单元, 显示所述组合图像。
所述执行单元配置为执行以下中的至少一个: 显示所述关联信息; 存储 所述关联信息; 以及将所述关联信息发送至远程服务器和所述第二电子设备 中的至少一个。
在所述执行单元配置为存储所述关联信息的情况下, 所述执行单元还包 括: 第一判断单元, 在存储所述关联信息之后, 判断当前时间是否满足第一 预定条件; 并且, 所述执行单元配置为当判断当前时间满足第一预定条件时, 执行基于所述关联信息的显示。 在所述执行单元配置为存储所述关联信息的情况下, 所述执行单元还包 括: 第二判断单元, 在存储所述关联信息之后, 当所述第一电子设备进行网 络访问时, 判断所述网络访问是否满足第二预定条件; 并且, 所述执行单元 配置为当所述网络访问满足第二预定条件时,执行基于所述关联信息的显示。
在所述执行单元配置为存储所述关联信息的情况下, 所述信息处理设备 还包括: 环境信息检测单元, 在存储所述关联信息之后, 检测所述第一电子 设备的环境信息; 以及第三判断单元, 判断所述环境信息是否满足第三预定 条件; 并且, 所述执行单元配置为当所述环境信息满足第三预定条件时, 执 行基于所述关联信息的显示。
所述执行单元配置为显示所述关联信息以及提示图标中的至少一个, 所 述提示图标用于链接至所述关联信息。
根据本发明另一实施例, 提供了一种信息处理方法, 应用于一服务器, 所述信息处理方法包括:在第一电子设备与第二电子设备进行通话的过程中, 从所述第一电子设备和 /或所述第二电子设备获取通话所产生的通话信息; 基 于所述通话信息, 确定处理对象; 对所述处理对象进行分析, 以获取与所述 处理对象相关联的关联信息; 以及执行基于所述关联信息的操作。
执行基于所述关联信息的操作包括以下的至少之一:存储所述关联信息; 基于预定策略, 将所述关联信息发送至所述第一电子设备和所述第二电子设 备中的至少一个。
所述基于预定策略、 将所述关联信息发送至所述第一电子设备或所述第 二电子设备包括: 接收来自于所述第一电子设备和所述第二电子设备中的至 少一个的请求; 以及响应于所述请求, 将所述关联信息发送至所述第一电子 设备和所述第二电子设备中进行请求的电子设备。
所述基于预定策略、 将所述关联信息发送至所述第一电子设备或所述第 二电子设备包括: 将所述关联信息发送至所述第一电子设备和所述第二电子 设备中发送通话信息的电子设备。
所述通话信息包括音频的信息, 所述基于预定策略、 将所述关联信息发 送至所述第一电子设备或所述第二电子设备包括:对所述音频进行语义分析, 以确定所述关联信息适合于所述第一电子设备和所述第二电子设备中的哪一 个; 以及将所述关联信息发送至所述第一电子设备和所述第二电子设备中被 确定为适合的电子设备。 所述服务器中预先存储了多个对象的对象信息, 并且每个对象的对象信 息与用于表示所述对象的属性的属性信息相关联地存储; 并且, 所述获取与 所述处理对象相关联的关联信息包括: 对所述处理对象进行分析, 以确定所 述处理对象的属性; 基于所述处理对象的属性, 确定所存储的属性信息中对 应的属性信息; 以及将与所述对应的属性信息关联的对象信息确定为所述关 联信息。
根据本发明另一实施例, 提供了一种信息处理设备, 应用于一服务器, 所述信息处理设备包括: 获取单元, 在第一电子设备与第二电子设备进行通 话的过程中, 从所述第一电子设备和 /或所述第二电子设备获取通话所产生的 通话信息; 确定单元, 基于所述通话信息, 确定处理对象; 分析单元, 对所 述处理对象进行分析, 以获取与所述处理对象相关联的关联信息; 以及执行 单元, 执行基于所述关联信息的操作。
所述执行单元配置为执行以下的至少之一: 存储所述关联信息; 基于预 定策略, 将所述关联信息发送至所述第一电子设备和所述第二电子设备中的 至少一个。
在所述执行单元配置为基于预定策略、 将所述关联信息发送至所述第一 电子设备或所述第二电子设备的情况下, 所述执行单元包括: 接收单元, 接 收来自于所述第一电子设备和所述第二电子设备中的至少一个的请求; 以及 发送单元, 响应于所述请求, 将所述关联信息发送至所述第一电子设备和所 述第二电子设备中进行请求的电子设备。
在所述执行单元配置为基于预定策略、 将所述关联信息发送至所述第一 电子设备或所述第二电子设备的情况下, 所述执行单元配置为将所述关联信 息发送至所述第一电子设备和所述第二电子设备中发送通话信息的电子设 备。
所述通话信息包括音频的信息, 在所述执行单元配置为基于预定策略、 将所述关联信息发送至所述第一电子设备或所述第二电子设备的情况下, 所 述执行单元包括: 语义分析单元, 对所述音频进行语义分析, 以确定所述关 联信息适合于所述第一电子设备和所述第二电子设备中的哪一个; 以及发送 单元, 将所述关联信息发送至所述第一电子设备和所述第二电子设备中被确 定为适合的电子设备。
所述服务器中预先存储了多个对象的对象信息, 并且每个对象的对象信 息与用于表示所述对象的属性的属性信息相关联地存储; 并且, 所述获取单 元包括: 属性确定单元, 对所述处理对象进行分析, 以确定所述处理对象的 属性; 属性信息确定单元, 基于所述处理对象的属性, 确定所存储的属性信 息中对应的属性信息; 以及对象信息确定单元, 将与所述对应的属性信息关 联的对象信息确定为所述关联信息。
在本发明实施例的信息处理方法和信息处理设备中, 基于通话所产生的 通话信息确定处理对象, 并获取与所述处理对象关联的关联信息, 从而能够 执行基于所述关联信息的操作, 诸如显示、 存储或转发等。 从而, 通过本发 明实施例的信息处理方法和信息处理设备, 能够利用通话过程中所产生的通 话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应用价值, 极 大地丰富了用户的体验。 附图说明
图 1是图示根据本发明第一实施方式的信息处理方法的流程图; 图 2是图示根据本发明第一实施方式的信息处理设备的主要配置的框 图;
图 3是图示根据本发明第二实施方式的信息处理方法的流程图; 图 4是图示根据本发明第二实施方式的信息处理设备的主要配置的框 图;
图 5A-5C是图示应用了本发明实施例的信息处理方法的第一电子设备的 显示示意图; 以及
图 6是图示应用了本发明实施例的信息处理方法的第一电子设备的另一 显示示意图。 具体实施方式
以下将参考附图详细描述本发明实施例。
本发明实施例的信息处理方法和信息处理设备应用于第一电子设备与第 二电子设备进行通话的环境。 所述第一电子设备与所述第二电子设备可以是 诸如固定电话、 手机、 平板电脑、 个人计算机等具有通信功能的电子设备。 所述通信可以是传统的语音通信 (如经由固定电话), 也可以是视频通信 (如 经由视频聊天应用),还可以是文本通信(如经由即时消息(文本聊天)应用)。 所述第一电子设备与所述第二电子设备的种类可以相同, 也可以不同。
此外, 所述第一电子设备与所述第二电子设备之间的通话可以经由诸如 因特网的网络, 通过服务器(下文, 适当时也称为远程服务器)进行。 也就 是说, 所述第一电子设备与所述第二电子设备之一将通话信息发送到所述服 务器, 并且所述服务器将所述通话信息转发到所述第一电子设备与所述第二 电子设备的另一个。 当然, 所述第一电子设备与所述第二电子设备之间的通 话也可以不经由服务器的转发而直接进行。
在下面的描述中, 以第一电子设备与第二电子设备这两个电子设备之间 的通信为例描述了本发明实施例。 然而, 本领域技术人员能够理解, 本发明 实施例的信息处理方法和信息处理设备可以应用于多于两个的电子设备之间 进行通信的场景。
此外, 本发明实施例的信息处理方法和信息处理设备可以应用于所述第 一电子设备与所述第二电子设备中的任一个, 也可以应用于所述服务器。 以 下, 将分别描述在上述各种情况下的信息处理方法和信息处理设备。
(第一实施方式)
在本发明第一实施方式中, 所述信息处理方法应用于所述第一电子设备 与所述第二电子设备中的任一个或两者。 以下, ^^设所述信息处理方法应用 于所述第一电子设备。
下面, 参照图 1描述根据本发明此实施例的信息处理方法。 在本发明实 施例的信息处理方法开始时, 所述第一电子设备与所述第二电子设备在进行 通话的过程中。
如图 1所示, 首先, 在步骤 S101 , 所述信息处理方法基于所述通话所产 生的通话信息, 确定处理对象。
所述处理对象的确定可以通过检测用户主动进行的输入操作而实现, 也 可以通过所述信息处理方法自动地对通话信息进行分析和识别而实现。
具体地, 在一实施例中, 所述通话包含视频通话, 并且所述通话信息包 含视频画面的信息。 在此情况下, 用户通过对所述视频画面进行输入操作而 指定处理对象。 相应地, 本发明实施例的信息处理方法通过检测用户对所述 视频画面进行的输入操作而确定用户所指定的处理对象。 更具体地, 例如, 在第一示例中, 用户可选定所述视频画面中的一个区 域。 相应地, 本发明实施例的信息处理方法检测用于选定所述视频画面中的 一区域的输入操作。 此后, 所述信息处理方法将所述视频画面中与所述区域 所对应的部分视频画面确定为处理对象。
在第二示例中, 用户可点击所述视频画面中的特定位置。 相应地, 本发 明实施例的信息处理方法检测用于点击所述视频画面的点击操作。
此后, 所述信息处理方法基于所述点击操作对应的所述视频画面中的特 定位置, 对所述视频画面进行图像分割, 以获得包含所述特定位置的部分视 频画面。 所述信息处理方法对所述视频画面进行图像分割的技术为本领域技 术人员所知, 在此不再详述。
在获得所述包含特定位置的部分视频画面之后, 所述信息处理方法将所 述部分视频画面确定为处理对象。
在第三示例中, 所述信息处理方法可以首先对所述视频画面进行图像识 另1 J , 以确定多个候选对象。 所述信息处理方法可釆用本领域已知的各种图像 识别算法来确定所述候选对象, 在此不再详述。
在确定了所述多个候选对象之后, 所述信息处理方法可以将关于所述候 选对象的信息呈现给用户, 以供用户选择。 此后, 所述信息处理方法检测用 户对所述多个候选对象中的至少一个候选对象的选择操作。 并且, 当检测到 用户对所述至少一个候选对象的选择操作时, 所述信息处理方法基于所述选 择操作, 将所选择的所述至少一个候选对象确定为所述处理对象。
上面描述了通过用户主动进行的输入操作而确定处理对象的各种示例。 下面,将描述通过自动地对通话信息进行分析和识别而确定处理对象的情况。
更具体地, 在第一示例中, 所述通话信息包含静态画面的信息。 在此情 况下, 所述信息处理方法对所述静态画面进行图像识别, 以将所述静态画面 分割为多个区域。 例如, 所述信息处理方法根据灰度、 彩色、 空间纹理、 几 何形状等特征将所述静态画面划分成若干个互不相交的区域, 使得这些特征 在同一区域内表现出一致性或相似性, 而在不同区域间表现出明显的不同。 所述信息处理方法可以釆用诸如基于阈值的方法、 基于聚类的方法、 基于区 域和边缘的方法、基于全局优化的方法等的各种算法来进行图像分割。 当然, 上述图像分割的算法仅为示例, 本领域技术人员可以釆用各种算法来进行图 像分割, 在此不再详述。 此后, 所述信息处理方法基于预定标准, 从所述多个区域中确定目标区 域。 例如, 所述信息处理方法可以基于多个区域的显著度、 预先训练的用户 感兴趣度、 区域位置、 区域面积等的标准, 从所述多个区域中确定目标区域。 当然, 上述确定目标区域的标准和相应算法仅为示例。 本发明实施例的信息 处理方法可以釆用本领域技术人员已知的其他各种标准和相应算法来确定目 标区域, 在此不再伴述。
在确定所述目标区域之后, 所述信息处理方法基于所述目标区域, 确定 所述处理对象。 具体地, 例如, 所述信息处理方法可对所述目标区域的视频 画面进行分析, 以确定处理对象。 例如, 所述信息处理方法可通过识别所述 目标区域的视频画面以确定其对象种类, 从而确定处理对象。 又例如, 所述 像进行模糊匹配, 从而确定处理对象。 当然, 上述基于目标区域确定处理对 象的方法仅为示例。 本发明实施例的信息处理方法可以釆用本领域技术人员 已知的其他各种方法来确定处理对象, 在此不再详述。
在第二示例中, 所述通话信息包括动态画面的信息。 在此情况下, 所述 信息处理方法可对所述动态画面进行识别, 以识别出用户在所述通话过程中 做出的特定动作。 例如, 所述信息处理方法可通过对由多个时间上连续的帧 组成的动态画面进行与上面所述类似的识别, 从而识别出用户在此时间段内 做出的动作。
此后, 所述信息处理方法可以基于所述特定动作, 确定所述处理对象。 例如, 所述信息处理方法可以基于预先存储的动作与处理对象之间的关联关 系的表, 才艮据所述特定动作而确定处理对象。
在第三示例中, 所述通话信息包括音频的信息。 在此情况下, 所述信息 处理方法可对所述音频进行音频识别, 以确定处理对象。
更具体地, 例如, 所述信息处理方法可判断所述音频中是否存在与预定 关键词匹配的音频片段。 当判断所述音频中存在与预定关键词匹配的音频片 段时, 所述信息处理方法将与所述音频片段确定为处理对象。
又例如, 所述信息处理方法可对所述音频进行语义分析, 并基于语义分 析的结果来确定处理对象。
当然, 所述信息处理方法可利用本领域已知的各种算法来对所述音频进 行音频识别, 在此不再详述。 此外, 与上述同样, 本发明实施例的信息处理方法可以将用户的主动输 入与所述电子设备的自动识别相结合。 具体地, 在第四示例中, 所述信息处 理方法可以基于所述通话信息, 确定多个候选对象。 此后, 所述信息处理方 法可以将所述多个候选对象呈现给用户, 并检测用户对所述多个候选对象中 的至少一个的选择操作。 接下来, 所述信息处理方法基于所述选择操作, 将 所选择的所述至少一个候选对象确定为所述处理对象。
此外, 在第五示例中, 所述通话信息包括文本信息。 在此情况下, 所述 信息处理方法可对所述文本进行文本识别, 以确定处理对象。
更具体地, 例如, 所述信息处理方法可判断所述文本中是否存在与预定 关键词匹配的文本片段。 当判断所述文本中存在与预定关键词匹配的文本片 段时, 所述信息处理方法将与所述文本片段确定为处理对象。
又例如, 所述信息处理方法可对所述文本进行语义分析, 并基于语义分 析的结果来确定处理对象。
当然, 所述信息处理方法可利用本领域已知的各种算法来对所述文本进 行文本识别, 在此不再详述。
通过如上所述的处理, 在步骤 S101 , 所述信息处理方法基于所述通话所 产生的通话信息, 确定了处理对象。
此后, 在步骤 S102, 所述信息处理方法获取与所述处理对象关联的关联 信息。
具体地, 在一实施例中, 所述信息处理方法可以将所述处理对象发送至 远程服务器, 由所述远程服务器对所述处理对象进行分析。 此后, 所述信息 处理方法从所述远程服务器接收关联信息。 所述关联信息是由所述远程服务 器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联的信息。
所述远程服务器可通过各种方法来获取所述关联信息。 作为一例, 所述 远程服务器中可预先存储多个对象的对象信息, 并且每个对象的对象信息与 属性信息相关联地存储。 所述属性信息用于表示所述对象的属性, 诸如衣物、 建筑等。
在接收到所述信息处理方法发送来的处理对象之后, 所述远程服务器对 所述处理对象进行分析, 以确定所述处理对象的属性。 此后, 所述远程服务 器基于所述处理对象的属性, 确定所存储的属性信息中对应的属性信息, 并 将与所述对应的属性信息关联的对象信息确定为所述关联信息。 在另一实施例中 ,所述信息处理方法可在本地对所述处理对象进行分析, 以确定所述关联信息。 在此情况下, 所述信息处理方法可以在本地预先关联 存储多个对象的所述对象信息与所述属性信息。
在确定了处理对象之后, 所述信息处理方法可以对所述处理对象进行分 析, 以确定所述处理对象的属性。 此后, 所述信息处理方法基于所述处理对 象的属性, 确定所存储的属性信息中对应的属性信息, 并将与所述对应的属 性信息关联的对象信息确定为所述关联信息。
在确定了所述关联信息之后, 在步骤 S103 , 所述信息处理方法执行基于 所述关联信息的操作。
以上, 描述了根据本发明第一实施方式的信息处理方法。
在根据本发明第一实施方式的信息处理方法中, 基于所述通话所产生的 通话信息确定处理对象, 获取与所述处理对象关联的关联信息, 并执行基于 所述关联信息的操作。
因此, 通过本发明第一实施方式的信息处理方法, 能够利用通话过程中 所产生的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应 用价值, 极大地丰富了用户的体验。
此外, 在本发明第一实施方式的信息处理方法中, 在终端侧 (即, 所述 第一电子设备和 /或所述第二电子设备侧), 基于所述通话信息, 既能响应于 用户的输入操作而确定处理对象, 也能够自动地确定处理对象, 还能够将上 述两种方式相结合。
因此, 通过本发明第一实施方式的信息处理方法, 提供了多种方式来利 用所述通话信息, 从而进一步丰富了用户的体验。 下面, 将参考图 2描述应用于所述第一电子设备和所述第二电子设备中 的至少一个的信息处理设备。 在下面的描述中, 假设所述信息处理设备应用 于所述第一电子设备。
如图 2所示, 根据本发明第一实施方式的信息处理设备 200包括: 确定 单元 201、 获取单元 202和执行单元 203。
所述确定单元 201在所述第一电子设备与第二电子设备进行通话的过程 中, 基于所述通话所产生的通话信息, 确定处理对象。 所述获取单元 202获 取与所述处理对象关联的关联信息。 所述执行单元 203执行基于所述关联信 息的操作。
具体地,在一实施例中,所述获取单元 202包括发送单元和接收单元(未 示出)。 所述发送单元将所述处理对象发送至远程服务器。 所述接收单元从所 述远程服务器接收关联信息。 所述关联信息是由所述远程服务器通过对所述 处理对象进行分析而获得的、 与所述处理对象相关联的信息。
在另一实施例中, 所述获取单元 202包括分析单元(未示出), 其对所述 处理对象进行分析, 以确定所述关联信息。
此外, 在一实施例中, 所述信息处理设备 200通过检测用户主动进行的 输入操作而确定处理对象。
具体地, 所述通话信息包括视频画面的信息, 并且所述确定单元 201包 括检测单元和第一处理对象确定单元 (未示出)。 所述检测单元检测用户的输 入操作。 所述第一处理对象确定单元基于所述输入操作, 从所述视频画面中 确定处理对象。
更具体地, 在第一示例中, 所述检测单元配置为检测用于选定所述视频 画面中的一区域的输入操作。 并且, 所述第一处理对象确定单元配置为将所 述视频画面中与所述区域所对应的部分视频画面确定为处理对象。
在第二示例中, 所述检测单元配置为检测用于点击所述视频画面的点击 操作。 并且, 所述第一处理对象确定单元包括: 图像分割单元, 基于所述点 击操作对应的所述视频画面中的特定位置, 对所述视频画面进行图像分割, 以获得包含所述特定位置的部分视频画面; 以及对象确定单元, 将所述部分 视频画面确定为处理对象。
在第三示例中, 所述信息处理设备 200还包括识别单元(未示出), 其对 所述视频画面进行图像识别, 以确定多个候选对象。 此外, 所述检测单元包 括: 选择检测单元, 检测用户对所述多个候选对象中的至少一个候选对象的 选择操作。 并且, 所述第一处理对象确定单元配置为基于所述选择操作, 将 所选择的所述至少一个候选对象确定为所述处理对象。
在另一实施例中, 所述信息处理设备 200通过对通话信息自动进行分析 而确定处理对象。
具体地, 在第一示例中, 所述通话信息包括静态画面的信息。 所述确定 单元 201还包括静态画面识别单元、 目标区域确定单元和第二处理对象确定 单元(未示出)。 所述静态画面识别单元对所述静态画面进行图像识别, 以将 所述静态画面分割为多个区域。 所述目标区域确定单元基于预定标准, 从所 述多个区域中确定目标区域。所述第二处理对象确定单元基于所述目标区域, 确定所述处理对象。
在第二示例中, 所述通话信息包括动态画面的信息。 所述确定单元 201 还包括动态画面识别单元和第三处理对象确定单元(未示出)。 所述动态画面 识别单元对所述动态画面进行识别, 以识别出用户在所述通话过程中做出的 特定动作。 所述第三处理对象确定单元基于所述特定动作, 确定所述处理对 在第三示例中, 所述通话信息包括音频的信息。 所述确定单元 201包括 音频识别单元, 其对所述音频进行音频识别, 以确定处理对象。
在第四示例中, 所述信息处理设备 200通过将检测用户主动进行的输入 操作和对通话信息自动进行分析而确定处理对象。
具体地, 在此实施例中, 所述确定单元 201还包括候选对象确定单元、 选择检测单元和第四处理对象确定单元。 所述候选对象确定单元基于所述通 话信息, 确定多个候选对象。 所述选择检测单元, 检测用户对所述多个候选 对象中的至少一个的选择操作。 所述第四处理对象确定单元基于所述选择操 作, 将所选择的所述至少一个候选对象确定为所述处理对象。
在第五示例中, 所述通话信息包括文本信息。 在此情况下, 所述信息处 理设备 200可对所述文本进行文本识别, 以确定处理对象。
本发明第一实施方式的信息处理设备的各单元的具体配置和操作已经在 参照图 1的本发明第一实施方式的信息处理方法的描述中详细说明, 在此不 再重复。
以上, 描述了根据本发明第一实施方式的信息处理设备。
通过本发明第一实施方式的信息处理设备, 能够利用通话过程中所产生 的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应用价值, 极大地丰富了用户的体验。
此外, 在本发明第一实施方式的信息处理设备中, 在终端侧 (即, 所述 第一电子设备和 /或所述第二电子设备侧), 基于所述通话信息, 既能响应于 用户的输入操作而确定处理对象, 也能够自动地确定处理对象, 还能够将上 述两种方式相结合。
因此, 通过本发明第一实施方式的信息处理设备, 提供了多种方式来利 用所述通话信息, 从而进一步丰富了用户的体验。 (第二实施方式)
在本发明第二实施方式中, 提供了一种信息处理方法和信息处理设备。 与本发明第一实施方式的信息处理方法和信息处理设备不同的是, 在本发明 第二实施方式中, 所述信息处理方法和信息处理设备应用于服务器侧, 而非 终端侧。
下面, 将参考图 3描述本发明第二实施方式的信息处理方法。 在本发明 实施例的信息处理方法开始时, 所述第一电子设备与所述第二电子设备在进 行通话的过程中。
如图 3所示, 首先, 在步骤 S301 , 所述信息处理方法从所述第一电子设 备和 /或所述第二电子设备获取通话所产生的通话信息。
所述通话信息是在所述第一电子设备与所述第二电子设备进行通话的过 程中产生的, 并由所述第一电子设备与所述第二电子设备中的至少一个发送 至所述服务器。 所述通话信息可以是音频信息、 视频信息、 文本信息等, 也 可以是上述信息的任意组合。
接下来, 在步骤 S302, 所述信息处理方法基于所述通话信息, 确定处理 对象。
与上述第一实施方式同样, 所述处理对象的确定可以通过检测用户主动 进行的输入操作而实现, 也可以通过所述信息处理方法自动地对通话信息进 行分析和识别而实现。
具体地, 在一实施例中, 所述通话包含视频通话, 并且所述通话信息包 含视频画面的信息。 在此情况下, 用户通过对所述视频画面进行输入操作而 指定处理对象。 相应地, 本发明实施例的信息处理方法通过获得用户对所述 视频画面进行的输入操作的信息而确定用户所指定的处理对象。
更具体地, 所述信息处理方法接收所述第一电子设备和所述第二电子设 备中的至少一个发送的输入轨迹信息。 发送所述输入轨迹信息的电子设备与 上述步骤 S301中发送通话信息的电子设备可以是相同的电子设备,也可以是 不同的电子设备。
所述输入轨迹信息是所述第一电子设备和所述第二电子设备中的所述至 少一个通过检测用户的输入操作而产生的。 所述输入轨迹信息既可以包括由 多个轨迹点而形成的一系列的轨迹的信息, 也可以包括由单个轨迹点而形成 的轨迹的信息。 例如, 在所述电子设备包括触控单元并且用户通过所述触控 单元而进行输入操作的情况下, 所述输入轨迹信息可以是通过检测用户的滑 动手势而产生的信息, 也可以是通过检测用户的点击操作而产生的信息。
此外, 所述第一电子设备和所述第二电子设备中发送所述输入轨迹信息 的电子设备还可发送诸如所述电子设备的显示画面的尺寸等的信息。
此后, 所述信息处理方法基于所述输入轨迹信息, 确定处理对象。
更具体地, 例如, 在第一示例中, 例如第一电子设备的用户可选定所述 视频画面中的一个区域。 相应地, 所述第一电子设备通过检测用于选定所述 视频画面中的一区域的输入操作而形成输入轨迹信息。 此后, 所述第一电子 设备将所述输入轨迹信息与所述第一电子设备的电子设备参数信息发送至所 的部分视频画面确定为处理对象。
在第二示例中, 例如第一电子设备的用户可点击所述视频画面中的特定 位置。 相应地, 所述第一电子设备通过检测用于点击所述视频画面的点击操 作而形成输入轨迹信息。 此后, 所述第一电子设备将所述输入轨迹信息发送 至所述服务器。
接下来, 所述信息处理方法基于所述输入轨迹信息, 确定所述输入轨迹 信息对应于所述视频画面中的哪个位置(即, 上述特定位置)。 此后, 所述信 息处理方法对所述视频画面进行图像分割, 以获得包含所述特定位置的部分 视频画面, 并将所述部分视频画面确定为处理对象。 同样, 所述信息处理方 法可以基于本领域已知的各种图像分割算法进行上述操作, 在此不再详述。
在第三示例中, 所述信息处理方法可以通过将用户的主动输入与服务器 的自动分析相结合而确定处理对象。
具体地, 所述信息处理方法可以对所述视频画面进行图像识别, 以确定 多个候选对象。 此后, 所述信息处理方法可以将多个候选对象发送至所述第 一电子设备和所述第二电子设备中的至少一个, 以供用户选择。 所述第一电 子设备和所述第二电子设备中的所述至少一个检测用户对所述多个候选对象 中的至少一个候选对象的选择操作, 产生相应的输入轨迹信息并发送至所述 服务器。
由此, 所述服务器基于通过检测所述选择操作而得到的选择信息 (即, 如上所述的输入轨迹信息),将所选择的所述至少一个候选对象确定为所述处 理对象。
下面, 将描述通过自动地对通话信息进行分析和识别而确定处理对象的 情况。
具体地, 在第一示例中, 所述通话信息包含静态画面的信息。 在此情况 下, 所述信息处理方法对所述静态画面进行图像识别, 以将所述静态画面分 割为多个区域。 与上述第一实施方式同样, 本领域技术人员可以釆用各种算 法来进行图像分割, 在此不再详述。
此后, 所述信息处理方法基于预定标准, 从所述多个区域中确定目标区 域。 与上述第一实施方式同样, 本领域技术人员可以釆用各种标准和相应算 法来确定目标区域, 在此不再详述。
在确定所述目标区域之后, 所述信息处理方法基于所述目标区域, 确定 所述处理对象。 具体地, 例如, 所述信息处理方法可对所述目标区域的视频 画面进行分析, 以确定处理对象。 例如, 所述信息处理方法可通过识别所述 目标区域的视频画面以确定其对象种类, 从而确定处理对象。 又例如, 所述 像进行模糊匹配, 从而确定处理对象。 当然, 上述基于目标区域确定处理对 象的方法仅为示例。 本发明实施例的信息处理方法可以釆用本领域技术人员 已知的其他各种方法来确定处理对象, 在此不再详述。
在第二示例中, 所述通话信息包括动态画面的信息。 在此情况下, 所述 信息处理方法可对所述动态画面进行识别, 以识别出用户在所述通话过程中 做出的特定动作。 例如, 所述信息处理方法可通过对由多个时间上连续的帧 组成的动态画面进行与上面所述类似的识别, 从而识别出用户在此时间段内 做出的动作。
此后, 所述信息处理方法可以基于所述特定动作, 确定所述处理对象。 例如, 所述信息处理方法可以基于预先存储的动作与处理对象之间的关联关 系的表, 才艮据所述特定动作而确定处理对象。
在第三示例中, 所述通话信息包括音频的信息。 在此情况下, 所述信息 处理方法可对所述音频进行音频识别, 以确定处理对象。
更具体地, 例如, 所述信息处理方法可判断所述音频中是否存在与预定 关键词匹配的音频片段。 当判断所述音频中存在与预定关键词匹配的音频片 段时, 所述信息处理方法将与所述音频片段确定为处理对象。
又例如, 所述信息处理方法可对所述音频进行语义分析, 并基于语义分 析的结果来确定处理对象。
当然, 所述信息处理方法可利用本领域已知的各种算法来对所述音频进 行音频识别, 在此不再详述。
此外, 与上述同样, 本发明实施例的信息处理方法可以将用户的主动输 入与所述电子设备的自动识别相结合。 具体地, 在第四示例中, 所述信息处 理方法基于所述通话信息, 确定多个候选对象, 并将所述多个候选对象发送 至所述第一电子设备和所述第二电子设备中的至少一个。 接收到所述候选对 象的电子设备检测用户用于选择至少一个候选对象的选择操作, 并将所述选 择操作所产生的选择信息发送至所述服务器。 所述信息处理方法接收所述选 择信息, 并基于所述选择信息, 将所选择的所述至少一个候选对象确定为所 述处理对象。
在第五示例中, 所述通话信息包括文本信息。 在此情况下, 所述信息处 理方法可对所述文本进行文本识别, 以确定处理对象。
更具体地, 例如, 所述信息处理方法可判断所述文本中是否存在与预定 关键词匹配的文本片段。 当判断所述文本中存在与预定关键词匹配的文本片 段时, 所述信息处理方法将与所述文本片段确定为处理对象。
又例如, 所述信息处理方法可对所述文本进行语义分析, 并基于语义分 析的结果来确定处理对象。
当然, 所述信息处理方法可利用本领域已知的各种算法来对所述文本进 行文本识别, 在此不再详述。
通过如上所述的处理, 在步骤 S302, 所述信息处理方法基于所接收的通 话信息, 确定了处理对象。
接下来, 在步骤 S303 , 所述信息处理方法对所述处理对象进行分析, 以 获取与所述处理对象相关联的关联信息。
具体地,在一实施例中, 所述服务器中预先存储了多个对象的对象信息, 并且每个对象的对象信息与属性信息相关联地存储。 所述属性信息用于表示 所述对象的属性。
由此, 所述信息处理方法例如基于所述对象信息与属性信息之间的关联 关系, 对所述处理对象进行分析, 以确定所述处理对象的属性。 此后, 所述 信息处理方法基于所述处理对象的属性, 确定所存储的属性信息中对应的属 性信息。 例如, 所述属性信息可以分为不同类别。 所述信息处理方法可以将 所存储的属性信息中与所述处理对象的属性属于同一类别或相应类别的属性 信息确定为对应的属性信息。 接下来, 所述信息处理方法将与所述对应的属 性信息关联的对象信息确定为所述关联信息。
在另一实施例中, 所述属性信息包含多种属性的信息。 所述信息处理方 法在确定了所述处理对象的某一属性之后, 可直接将所述处理对象的其他属 性信息确定为所述关联信息。
需要指出的是, 上面描述的所述信息处理方法确定关联信息的方式仅为 示例。 本领域技术人员可釆用其他各种方式来获取所述关联信息。
此后, 在步骤 S304, 所述信息处理方法执行基于所述关联信息的操作。 具体地, 例如, 所述信息处理方法可以存储所述关联信息, 可以将所述关联 信息发送至所述第一电子设备和所述第二电子设备中的至少一个。 当然, 所 范围内。
以上, 描述了根据本发明第二实施方式的信息处理方法。
在根据本发明第二实施方式的信息处理方法中, 基于所述通话所产生的 通话信息确定处理对象, 获取与所述处理对象关联的关联信息, 并执行基于 所述关联信息的操作。
因此, 通过本发明第二实施方式的信息处理方法, 能够利用通话过程中 所产生的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应 用价值, 极大地丰富了用户的体验。
此外, 在本发明第二实施方式的信息处理方法中, 在服务器侧, 基于所 述通话信息, 既能响应于用户的输入操作而确定处理对象, 也能够自动地确 定处理对象, 还能够将上述两种方式相结合。
因此, 通过本发明第二实施方式的信息处理方法, 提供了多种方式来利 用所述通话信息, 从而进一步丰富了用户的体验。 此外, 在电子设备侧的处 理能力有限的情况下, 本发明第二实施方式的信息处理方法能够减轻电子设 备侧的处理负担, 因而尤为有利。 下面, 将参考图 4描述本发明第二实施方式的应用于服务器的信息处理 设备。
如图 4所示, 本发明实施例的信息处理设备 400包括通话信息获取单元 401、 确定单元 402、 关联信息获取单元 403和执行单元 404。
所述通话信息获取单元 401在第一电子设备与第二电子设备进行通话的 过程中, 从所述第一电子设备和 /或所述第二电子设备获取通话所产生的通话 信息。 所述确定单元 402基于所述通话信息, 确定处理对象。 所述关联信息 获取单元 403对所述处理对象进行分析, 以获取与所述处理对象相关联的关 联信息。 所述执行单元 404执行基于所述关联信息的操作。
具体地, 在一实施例中, 所述通话信息为视频画面的信息。 所述确定单 元 402包括接收单元和第一处理对象确定单元(未示出)。 所述接收单元接收 所述第一电子设备和所述第二电子设备中的至少一个发送的电子设备参数信 息与输入轨迹信息。 所述输入轨迹信息是所述第一电子设备和所述第二电子 设备中的所述至少一个通过检测用户的输入操作而产生的。 所述第一处理对 象确定单元基于所述电子设备参数信息与所述输入轨迹信息,确定处理对象。
更具体地, 在第一示例中, 所述输入轨迹信息是所述第一电子设备和所 述第二电子设备中的所述至少一个通过检测用于选定所述视频画面中的一区 域的输入操作而得到的。 所述第一处理对象确定单元配置为基于所述电子设 备参数信息, 将所述视频画面中与所述区域所对应的部分视频画面确定为处 理对象。
在第二示例中, 所述输入轨迹信息是所述第一电子设备和所述第二电子 设备中的所述至少一个通过检测用于点击所述视频画面的点击操作而得到 的。 所述第一处理对象确定单元包括图像分割单元和对象确定单元。 所述图 像分割单元基于所述电子设备参数信息, 并基于所述点击操作对应的所述视 频画面中的特定位置, 对所述视频画面进行图像分割, 以获得包含所述特定 位置的部分视频画面。 所述对象确定单元将所述部分视频画面确定为处理对 在第三示例中, 所述信息处理设备 400还包括识别单元和发送单元(未 示出)。 所述识别单元对所述视频画面进行图像识别, 以确定多个候选对象。 所述发送单元将多个候选对象发送至所述第一电子设备和所述第二电子设备 中的所述至少一个。 所述输入轨迹信息是所述第一电子设备和所述第二电子 设备中的所述至少一个通过检测用户对所述多个候选对象中的至少一个候选 对象的选择操作而获得的。 此外, 所述第一处理对象确定单元配置为基于所 述电子设备参数信息, 并基于所述选择操作, 将所选择的所述至少一个候选 对象确定为所述处理对象。
在另一实施例中, 所述通话信息为视频画面的信息。 所述确定单元 402 包括静态画面识别单元、 目标区域确定单元和第二处理对象确定单元。 所述 静态画面识别单元对所述视频画面进行图像识别, 以将所述静态画面分割为 多个区域。 所述目标区域确定单元基于预定标准, 从所述多个区域中确定目 标区域。 所述第二处理对象确定单元基于所述目标区域, 确定所述处理对象。
在另一实施例中, 所述通话信息为动态画面的信息。 所述确定单元 402 包括动态画面识别单元和第三处理对象确定单元。 所述动态画面识别单元对 所述动态画面进行识别, 以识别出所述动态画面中的物体在所述通话过程中 做出的特定动作。 所述第三处理对象确定单元基于所述特定动作, 确定所述 处理对象。
在又一实施例中, 所述通话信息为音频的信息。 所述确定单元 402包括 音频识别单元, 其对所述音频进行音频识别, 以确定处理对象。
此外, 在另一实施例中, 所述确定单元 402包括候选对象确定单元、 发 送单元、 接收单元和第四处理对象确定单元(未示出)。
具体地,所述候选对象确定单元基于所述通话信息,确定多个候选对象。 所述发送单元将所述多个候选对象发送至所述第一电子设备和所述第二电子 设备中的至少一个。 所述接收单元接收所述第一电子设备和所述第二电子设 备中的所述至少一个的用户用于选择至少一个候选对象的选择信息。 所述第 四处理对象确定单元基于所述选择信息, 将所选择的所述至少一个候选对象 确定为所述处理对象。
此外, 在一实施例中, 所述服务器中预先存储了多个对象的对象信息。 每个对象的对象信息与用于表示所述对象的属性的属性信息相关联地存储。 在此实施例中, 所述关联信息获取单元 403 包括属性确定单元、 属性信息确 定单元和对象信息确定单元(未示出)。
具体地, 所述属性确定单元对所述处理对象进行分析, 以确定所述处理 对象的属性。 所述属性信息确定单元基于所述处理对象的属性, 确定所存储 的属性信息中对应的属性信息。 所述对象信息确定单元将与所述对应的属性 信息关联的对象信息确定为所述关联信息。 本发明第二实施方式的信息处理设备的各单元的具体配置和操作已经在 参照图 3的本发明第二实施方式的信息处理方法的描述中详细说明, 在此不 再重复。
以上, 描述了根据本发明第二实施方式的信息处理设备。
通过本发明第二实施方式的信息处理设备, 能够利用通话过程中所产生 的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应用价值, 极大地丰富了用户的体验。
此外, 在本发明第二实施方式的信息处理设备中, 在服务器侧, 基于所 述通话信息, 既能响应于用户的输入操作而确定处理对象, 也能够自动地确 定处理对象, 还能够将上述两种方式相结合。
因此, 通过本发明第二实施方式的信息处理设备, 提供了多种方式来利 用所述通话信息, 从而进一步丰富了用户的体验。 此外, 在电子设备侧的处 理能力有限的情况下, 本发明第二实施方式的信息处理设备能够减轻电子设 备侧的处理负担, 因而尤为有利。
(第三实施方式)
在本发明第三实施方式中, 提供了一种应用于终端侧的信息处理方法和 信息处理设备, 其在获取如上所述的关联信息之后, 可以执行包括立即输出、 存储、 转发等的各种操作。
首先, 将描述本发明第三实施方式的信息处理方法。 同样, 在下面的描 述中, 假设所述信息处理方法应用于所述第一电子设备。
本发明第三实施方式的信息处理方法的流程与本发明第一实施方式的信 息处理方法的流程类似。 即, 所述信息处理方法同样包括: 在所述第一电子 设备与所述第二电子设备进行多媒体通话的过程中 , 基于所述通话所产生的 通话信息, 确定处理对象; 获取与所述处理对象关联的关联信息; 以及执行 基于所述关联信息的操作。
此外, 同样地, 在本发明第三实施例的信息处理方法中, 所述信息处理 方法可以将所述处理对象发送至远程服务器, 由所述远程服务器通过对所述 处理对象进行分析而获得所述关联信息, 并将所述关联信息发送至所述第一 电子设备。 另一方面, 所述信息处理方法也可以在本地对所述处理对象进行 分析, 以确定所述关联信息。 下面, 将主要描述所述信息处理方法执行基于所述关联信息的操作的细 节。
在第一实施例中, 所述信息处理方法在所述通话过程中输出所述关联信 息, 或在所述通话结束后立刻输出所述关联信息。
在此情况下, 例如, 在第一示例中, 所述信息处理方法可以生成用于提 示用户查看的提示图标, 并显示所述提示图标。 所述提示图标用于链接至所 述关联信息。 此后, 当检测到用户点击所述提示图标时, 所述信息处理方法 将访问所述关联信息。
在第二示例中, 所述通话为音频通话。 在此情况下, 所述信息处理方法 检测所述第一电子设备是否与一显示设备连接。 需要指出的是, 所述显示设 备可以是外部显示设备, 也可以是所述第一电子设备自身所包含、 但处于禁 用状态的显示单元。 所述信息处理方法例如可通过检测所述第一电子设备的 相应连接管脚而获得有关上述连接的信息。
当检测到所述第一电子设备与一显示设备连接时, 所述信息处理方法将 所述关联信息输出至所述显示设备。 由此, 通过所述显示设备执行基于所述 关联信息的显示。
在第三示例中, 所述通话为视频通话。 在此情况下, 所述信息处理方法 将基于关联信息的图像与所述视频通话的图像进行组合, 以生成组合图像, 并显示所述组合图像。 所述基于关联信息的图像可以是显示图片、 文字等各 种形式的内容的图像。 并不立即输出所述关联信息。 替代地, 所述信息处理方法将所述关联信息存 储在例如本地的存储器中。 此后, 仅当判断满足预定条件时, 所述信息处理 方法才输出所述关联信息。
具体地, 在第一示例中, 所述信息处理方法判断当前时间是否满足第一 预定条件。 例如, 所述信息处理方法判断当前时间是否为所述电子设备或用 户预设的时间。 又例如, 所述信息处理方法判断当前时间与通话结束时间之 间的时间间隔是否为所述电子设备或用户预设的时间间隔。 再例如, 所述信 息处理方法判断当前时间与通话结束时间之间的时间间隔是否大于所述电子 设备或用户预设的时间间隔。 此后, 当判断当前时间满足第一预定条件时, 所述信息处理方法执行基于所述关联信息的显示。 当然, 上面所述的第一预 定条件仅为示例。 本领域技术人员完全可以根据需要, 设计其他各种条件作 为所述第一预定条件。
在第二示例中,所述信息处理方法在所述第一电子设备进行网络访问时, 判断所述网络访问是否满足第二预定条件。 例如, 所述信息处理方法判断所 述信息处理方法在本地预先存储了关联信息与网络访问目的地之间的对照 应的目的地。 此后, 当判断所述网络访问满足第二预定条件时, 所述信息处 理方法执行基于所述关联信息的显示。 当然, 上面所述的第二预定条件仅为 示例。 本领域技术人员完全可以根据需要, 设计其他各种条件作为所述第二 预定条件。
在第三示例中, 所述信息处理方法还可以检测所述第一电子设备的环境 信息。 所述环境信息例如包含所述第一电子设备所处的位置信息、 所处环境 的天气信息、 温度信息等。 接下来, 所述信息处理方法判断所述环境信息是 否满足第三预定条件。 在位置信息的情况下, 例如, 所述信息处理方法判断 所述第一电子设备是否到达所述电子设备或用户预设的位置。 又例如, 所述 信息处理方法在本地预先存储了关联信息与位置信息之间的对照表。 所述信 息处理方法基于所述位置信息, 判断所述第一电子设备是否处于与所述关联 信息对应的位置。 其他种类的环境信息的判断与此类似, 在此不再详述。 此 后, 当所述环境信息满足第三预定条件时, 所述信息处理方法执行基于所述 关联信息的显示。 当然, 上面所述的第三预定条件仅为示例。 本领域技术人 员完全可以根据需要, 设计其他各种条件作为所述第三预定条件。
在第三实施例中, 同样, 所述信息处理方法在所述通话过程中以及通话 结束后并不立即输出所述关联信息。 与第二实施例不同的是, 所述信息处理 方法将所述关联信息发送至远程服务器和所述第二电子设备中的至少一个。 所述远程服务器和 /或所述第二电子设备例如可以存储所述关联信息或输出 所述关联信息。
此外, 在如上所述的各示例中, 所述显示处理既可以显示所述关联信息 本身, 也可以显示用于连接至所述关联信息的提示图标。
以上, 描述了本发明第三实施方式的信息处理方法。
在根据本发明第三实施方式的信息处理方法中, 基于所述通话所产生的 通话信息确定处理对象, 获取与所述处理对象关联的关联信息, 并执行基于 所述关联信息的操作。
因此, 通过本发明第三实施方式的信息处理方法, 能够利用通话过程中 所产生的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应 用价值, 极大地丰富了用户的体验。
此外, 在本发明第三实施方式的信息处理方法中, 在电子设备侧, 可以 储所述关联信息, 并在稍后的时间判断满足预定条件时才触发关联信息的输 出, 还可以将所述关联信息输出到服务器和 /或第二电子设备以进行处理。
因此, 通过本发明第三实施方式的信息处理方法, 提供了多种方式来输 出所述关联信息, 方便用户根据情况进行不同的定制, 从而进一步丰富了用 户的体马全。
下面, 将描述本发明第三实施方式的信息处理设备。 所述信息处理设备 的配置与本发明第一实施方式的信息处理设备的配置类似, 即, 同样包括确 定单元、 获取单元和执行单元。
所述确定单元在所述第一电子设备与所述第二电子设备进行多媒体通话 的过程中, 基于所述通话所产生的通话信息, 确定处理对象。 所述获取单元 获取与所述处理对象关联的关联信息。 所述执行单元执行基于所述关联信息 的操作。
与第一实施方式中同样, 在一实施例中, 所述获取单元可以包括: 发送 单元, 将所述处理对象发送至远程服务器; 以及接收单元, 从所述远程服务 器接收关联信息, 所述关联信息是由所述远程服务器通过对所述处理对象进 行分析而获得的、 与所述处理对象相关联的信息。
在另一实施例中, 所述获取单元可以包括: 分析单元, 对所述处理对象 进行分析, 以确定所述关联信息。
此外, 在本实施方式中, 所述执行单元配置为执行以下中的至少一个: 显示所述关联信息; 存储所述关联信息; 以及将所述关联信息发送至远程服 务器和所述第二电子设备中的至少一个。
具体地, 在一实施例中, 所述执行单元可以包括图标生成单元和图标显 示单元。 所述图标生成单元生成用于提示用户查看的提示图标, 所述提示图 标用于链接至所述关联信息。 所述图标显示单元显示所述提示图标。 此外, 在另一实施例中, 所述通话为音频通话。 所述执行单元可以包括 第一检测单元和输出单元。 所述第一检测单元检测所述第一电子设备是否与 一显示设备连接。 所述输出单元在检测到所述第一电子设备与一显示设备连 接时, 将所述关联信息输出至所述显示设备, 所述显示设备基于所述关联信 息进行显示。
在另一实施例中, 所述通话为视频通话。 所述执行单元可以包括组合单 元和组合图像显示单元。 所述组合单元将基于所述关联信息的图像与所述视 频通话的图像进行组合, 以生成组合图像。 所述组合图像显示单元显示所述 组合图像。
在所述执行单元配置为存储所述关联信息的情况下, 所述信息处理设备 还包括第一判断单元, 在存储所述关联信息之后, 判断当前时间是否满足第 一预定条件。 所述执行单元配置为当判断当前时间满足第一预定条件时, 执 行基于所述关联信息的显示。
在另一实施例中, 在所述执行单元配置为存储所述关联信息的情况下, 所述信息处理设备还包括: 第二判断单元, 在存储所述关联信息之后, 当所 述第一电子设备进行网络访问时,判断所述网络访问是否满足第二预定条件。 所述执行单元配置为当所述网络访问满足第二预定条件时, 执行基于所述关 联信息的显示。
在另一实施例中, 在所述执行单元配置为存储所述关联信息的情况下, 所述信息处理设备还包括: 环境信息检测单元, 在存储所述关联信息之后, 检测所述第一电子设备的环境信息; 以及第三判断单元, 判断所述环境信息 是否满足第三预定条件。 所述执行单元配置为当所述环境信息满足第三预定 条件时, 执行基于所述关联信息的显示。
此外, 在本发明第三实施方式中, 所述执行单元可以配置为显示所述关 联信息以及提示图标中的至少一个,所述提示图标用于链接至所述关联信息。
本发明第三实施方式的信息处理设备的各单元的具体配置和操作已经在 本发明第三实施方式的信息处理方法的描述中详细说明, 在此不再重复。
以上, 描述了本发明第三实施方式的信息处理设备。
通过本发明第三实施方式的信息处理设备, 能够利用通话过程中所产生 的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应用价值, 极大地丰富了用户的体验。 此外, 在本发明第三实施方式的信息处理设备中, 在电子设备侧, 可以 储所述关联信息, 并在稍后的时间判断满足预定条件时才触发关联信息的输 出, 还可以将所述关联信息输出到服务器和 /或第二电子设备以进行处理。
因此, 通过本发明第三实施方式的信息处理设备, 提供了多种方式来输 出所述关联信息, 方便用户根据情况进行不同的定制, 从而进一步丰富了用 户的体马全。
(第四实施方式)
在本发明第四实施方式中, 提供了一种应用于服务器的信息处理方法和 信息处理设备, 其在获取如上所述的关联信息之后, 可以执行包括立即输出、 存储、 转发等的各种操作。
首先, 将描述本发明第四实施方式的信息处理方法。
本发明第四实施方式的信息处理方法的流程与本发明第二实施方式的信 息处理方法的流程类似。 即, 所述信息处理方法同样包括: 在第一电子设备 与第二电子设备进行通话的过程中, 从所述第一电子设备和 /或所述第二电子 设备获取通话所产生的通话信息; 基于所述通话信息, 确定处理对象; 对所 述处理对象进行分析, 以获取与所述处理对象相关联的关联信息; 以及执行 基于所述关联信息的操作。
此外, 与所述第二实施方式同样, 所述服务器中也可以预先存储了多个 对象的对象信息, 并且每个对象的对象信息与用于表示所述对象的属性的属 性信息相关联地存储。 所述信息处理方法可以对所述处理对象进行分析, 以 确定所述处理对象的属性, 基于所述处理对象的属性确定所存储的属性信息 中对应的属性信息, 并将与所述对应的属性信息关联的对象信息确定为所述 关联信息。
下面, 将主要描述所述信息处理方法执行基于所述关联信息的操作的细 节。
具体地, 在本发明第四实施方式的信息处理方法中, 在如上所述获取了 关联信息之后, 可以存储所述关联信息, 例如用于在稍后输出。
在另一实施例中, 所述信息处理方法也可以基于预定策略, 将所述关联 信息发送至所述第一电子设备和所述第二电子设备中的至少一个。 更具体地, 在第一示例中, 所述信息处理方法接收来自于所述第一电子 设备和所述第二电子设备中的至少一个的请求。 所述请求用于请求所述服务 器发送所述关联信息。 在此示例中, 假设所述信息处理方法接收到来自第一 电子设备的请求。 由此, 所述信息处理方法响应于所述请求, 将所述关联信 息发送至所述第一电子设备和所述第二电子设备中进行请求的电子设备,即, 在此示例中的第一电子设备。
在第二示例中, 所述信息处理方法不必响应于来自第一电子设备或第二 电子设备的额外请求即可发送关联信息。 在此情况下, 所述信息处理方法默 认地将所述关联信息发送至所述第一电子设备和所述第二电子设备中发送通 话信息的电子设备。
在第三示例中, 所述通话信息包括音频的信息。 所述信息处理方法对所 述音频进行语义分析, 以确定所述关联信息适合于所述第一电子设备和所述 第二电子设备中的哪一个。 所述信息处理方法进行语义分析的技术为本领域 技术人员所知, 在此不再详述。 在通过语义分析获得确定结果之后, 所述信 息处理方法将所述关联信息发送至所述第一电子设备和所述第二电子设备中 被确定为适合的电子设备。
在第四示例中, 所述通话信息包括文本的信息。 同样, 所述信息处理方 法对所述文本进行语义分析, 以确定所述关联信息适合于所述第一电子设备 和所述第二电子设备中的哪一个。 所述信息处理方法进行语义分析的技术为 本领域技术人员所知, 在此不再详述。 在通过语义分析获得确定结果之后, 同样, 所述信息处理方法将所述关联信息发送至所述第一电子设备和所述第 二电子设备中被确定为适合的电子设备。
需要指出的是, 以上所描述的各种策略仅为示例。 本领域技术人员完全 可以根据需要设计其他各种策略,以将所述关联信息发送至适当的电子设备。
以上, 描述了本发明第四实施方式的信息处理方法。
在根据本发明第四实施方式的信息处理方法中, 基于所述通话所产生的 通话信息确定处理对象, 获取与所述处理对象关联的关联信息, 并执行基于 所述关联信息的操作。
因此, 通过本发明第四实施方式的信息处理方法, 能够利用通话过程中 所产生的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应 用价值, 极大地丰富了用户的体验。 此外, 在本发明第四实施方式的信息处理方法中, 在服务器侧, 可以存 储所述关联信息以延后输出, 也可以根据各种不同的策略将所述关联信息发 送至适当的电子设备, 以由接收到所述关联信息的电子设备进行进一步的处 理。
因此, 通过本发明第四实施方式的信息处理方法, 提供了多种方式来输 出所述关联信息, 并且提供了多种方式来将所述关联信息输出至不同的电子 设备, 方便服务提供者根据情况进行不同的定制, 并进一步丰富了用户的体 验。
下面, 描述本发明第四实施方式的信息处理设备。
所述信息处理设备的配置与本发明第二实施方式的信息处理设备的配置 类似, 即, 同样包括获取单元、 确定单元、 分析单元和执行单元。
所述获取单元, 在第一电子设备与第二电子设备进行通话的过程中, 从 所述第一电子设备和 /或所述第二电子设备获取通话所产生的通话信息。 所述 确定单元基于所述通话信息, 确定处理对象。 所述分析单元对所述处理对象 进行分析, 以获取与所述处理对象相关联的关联信息。 所述执行单元执行基 于所述关联信息的操作。
与第二实施方式中同样, 所述服务器中可以预先存储了多个对象的对象 信息, 并且每个对象的对象信息与用于表示所述对象的属性的属性信息相关 联地存储。 所述获取单元包括属性确定单元、 属性信息确定单元和对象信息 确定单元。
所述属性确定单元对所述处理对象进行分析, 以确定所述处理对象的属 性。 所述属性信息确定单元基于所述处理对象的属性, 确定所存储的属性信 息中对应的属性信息。 所述对象信息确定单元, 将与所述对应的属性信息关 联的对象信息确定为所述关联信息。
在第四实施方式的信息处理设备中, 所述执行单元配置为执行以下的至 少之一: 存储所述关联信息; 基于预定策略, 将所述关联信息发送至所述第 一电子设备和所述第二电子设备中的至少一个。
在基于预定策略、 将所述关联信息发送至所述第一电子设备或所述第二 电子设备的情况下, 在第一示例中, 所述执行单元包括: 接收单元, 接收来 自于所述第一电子设备和所述第二电子设备中的至少一个的请求; 以及发送 单元, 响应于所述请求, 将所述关联信息发送至所述第一电子设备和所述第 二电子设备中进行请求的电子设备。
在第二示例中, 所述执行单元配置为将所述关联信息发送至所述第一电 子设备和所述第二电子设备中发送通话信息的电子设备。
在第三示例中, 所述通话信息包括音频的信息。 所述执行单元包括: 语 义分析单元, 对所述音频进行语义分析, 以确定所述关联信息适合于所述第 一电子设备和所述第二电子设备中的哪一个; 以及发送单元, 将所述关联信 息发送至所述第一电子设备和所述第二电子设备中被确定为适合的电子设 备。
在第四示例中, 所述通话信息包括文本的信息。 所述执行单元包括: 语 义分析单元, 对所述文本进行语义分析, 以确定所述关联信息适合于所述第 一电子设备和所述第二电子设备中的哪一个; 以及发送单元, 将所述关联信 息发送至所述第一电子设备和所述第二电子设备中被确定为适合的电子设 备。
本发明第四实施方式的信息处理设备的各单元的具体配置和操作已经在 本发明第四实施方式的信息处理方法的描述中详细说明, 在此不再重复。
以上, 描述了本发明第四实施方式的信息处理设备。
通过本发明第四实施方式的信息处理设备, 能够利用通话过程中所产生 的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的应用价值, 极大地丰富了用户的体验。
此外, 在本发明第四实施方式的信息处理设备中, 在服务器侧, 可以存 储所述关联信息以延后输出, 也可以根据各种不同的策略将所述关联信息发 送至适当的电子设备, 以由接收到所述关联信息的电子设备进行进一步的处 理。
因此, 通过本发明第四实施方式的信息处理设备, 提供了多种方式来输 出所述关联信息, 并且提供了多种方式来将所述关联信息输出至不同的电子 设备, 方便服务提供者根据情况进行不同的定制, 并进一步丰富了用户的体 验。 以上, 描述了根据本发明第一至第四实施方式的信息处理方法和信息处 理设备。
下面, 将结合若干具体场景来描述本发明实施例的信息处理方法和信息 处理设备的应用。
首先, 将参考图 5A-5C描述本发明实施例的信息处理方法和信息处理设 备。 在图 5A-5C所示的场景中, 第一电子设备与远程的第二电子设备正在进 行视频通话。 图 5A-5C是图示应用了本发明实施例的信息处理方法的第一电 子设备的显示屏幕 500上的显示示意图。
所述显示屏幕 500划分为两个区域: 第一区域 501和第二区域 502。 第 一区域 501 中显示所述第一电子设备通过例如前置摄像头的图像釆集单元所 釆集的第一电子设备的用户 (以下, 适当时称为第一用户) 的图像。 第二区 域 502中显示所述第二电子设备通过例如摄像头的图像釆集单元所釆集的第 二电子设备的用户 (以下, 适当时称为第二用户) 的图像。
在下面的描述中,假设所述第一电子设备的显示屏幕 500为触摸显示屏。 然而, 本领域技术人员能够理解, 本发明实施例的信息处理方法和信息处理 设备也可以同样地应用于非触控输入的电子设备。
在图 5A的场景中, 第一用户在与第二用户的视频通信中, 对第二用户 的上衣产生了兴趣, 并通过手势圈出了所述显示屏幕 500上与所述上衣对应 的区域 503。 所述信息处理方法检测到用户的上述操作, 并将所述视频画面 中与所述区域 503所对应的部分视频画面确定为处理对象。
替代地, 第一用户也可通过手势点击所述显示屏幕 500上的所述上衣所 处的区域中的任一位置。 所述信息处理方法通过对视频画面进行图像分割, 以获得包含所述位置的部分视频画面, 同样如 503所示。
替代地, 所述信息处理方法也可自动对所述视频画面进行图像识别, 以 将所述视频画面划分为多个区域, 例如与上衣对应的区域 503、 与裤子对应 的区域 504、 与鞋对应的区域 505、 与人脸对应的区域 506、 以及与背景对应 的区域 507。 此后, 所述信息处理方法基于预定标准, 例如基于区域的显著 度, 将多个区域中的区域 503确定为处理对象。
替代地, 所述信息处理方法也可将上述的用户输入与自动确定的方式相 结合。 即, 所述信息处理方法可以首先自动对所述视频画面进行图像识别, 以确定多个候选对象, 例如上衣 503、 裤子 504和鞋 505 , 并将所述多个候选 对象呈现给第一用户。 所述呈现的方式不限。 例如, 所述信息处理方法可以 将区域 503、 504和 505对应的部分视频画面以缩略图的形式显示在所述显示 屏幕 500 中的适当位置。 又例如, 所述信息处理方法可以在所述区域 503、 504和 505 附近显示提示标记, 等等。 此后, 所述信息处理方法检测用户对 所述多个候选对象中的至少一个候选对象的选择操作,并基于所述选择操作, 将所选择的所述至少一个候选对象确定为所述处理对象。
从而, 所述信息处理方法获取与所述处理对象关联的关联信息并执行基 于所述关联信息的操作。 具体地, 在此场景中, 例如, 所述信息处理方法通 过图像分析确定所述上衣的品牌, 由此获得所述上衣的价格、 面料、 产地等 属性信息作为关联信息。 又例如, 所述信息处理方法通过图像分析确定所述 上衣的品牌, 并由此获得与所述上衣同一品牌的其他上衣等的信息作为关联 信息。 当然, 上述所述信息处理方法确定关联信息的方式仅为示例。
在获得了所述关联信息之后, 在一实施例中, 所述信息处理方法生成用 于提示用户查看的提示图标, 所述提示图标用于链接至所述关联信息, 并显 示所述提示图标, 如图 5B中的图标 508所示。
在另一实施例中, 所述信息处理方法生成基于所述关联信息的图像, 如 图 5C中的 509所示, 将其与所述视频通话的图像进行组合以生成组合图像, 并显示所述组合图像。
在又一实施例中, 所述信息处理方法在获取所述关联信息之后, 并不立 刻输出, 而是将其存储在本地存储器中, 或是发送至服务器和所述第二电子 设备中的至少一个。
在存储在本地存储器中的情况下, 在一实施例中, 所述信息处理方法可 以在判断当前时间满足第一预定条件时, 显示所述关联信息或用于提示访问 所述关联信息的图标。
在另一实施例中, 所述信息处理方法可以在判断所述网络访问是否满足 第二预定条件时, 例如, 在判断所述网络访问的目的地是购物网站时, 显示 所述关联信息或用于提示访问所述关联信息的图标。
在又一实施例中, 所述信息处理方法可以检测所述第一电子设备的环境 信息, 例如所述第一电子设备的位置信息。 当所述信息处理方法判断所述环 境信息满足第三预定条件时, 例如, 判断所述第一电子设备位于购物中心内 时, 显示所述关联信息或用于提示访问所述关联信息的图标。
需要指出的是, 图 5A-5C图示了第一用户通过第一电子设备的前置摄像 头与所述第二电子设备的第二用户进行视频通话、 并且处理对象为所述第二 用户对应的视频画面中的对象的情况。 替代地, 本发明实施例的信息处理方法和信息处理设备也可应用于第一 用户通过第一电子设备的后置摄像头与所述第二电子设备的第二用户进行视 频通话、 并且处理对象为所述第一用户对应的视频画面中的对象的情况。 图
6图示了此情况下的显示示意图。
如图 6所示, 所述显示屏幕 600划分为两个区域: 第一区域 601和第二 区域 602。 第一区域 601 中显示所述第一电子设备通过例如后置摄像头的图 像釆集单元所釆集的第一电子设备侧的图像。 第二区域 602中显示所述第二 电子设备通过例如摄像头的图像釆集单元所釆集的第二电子设备侧的图像。
在此场景下, ϋ殳第一用户希望向第二用户描述其所处的区域附近的建 筑, 但并不知道所述建筑的名称等的各种信息。 此时, 第一用户可通过本发 明实施例的信息处理方法, 获知所述建筑的例如名称、 建筑年代等的各种关 联信息, 其处理与上述类似, 在此不再详述。
需要指出的是, 以上, 以视频通信中的静态图像识别的情况为例进行了 描述。 本领域技术人员能够理解, 本发明实施例的信息处理方法和信息处理 设备可以同样地应用于视频通信中的动态图像识别, 或者音频通信、 文本通 信等。
此外, 需要指出的是, 以上以所述信息处理方法和所述信息处理设备应 用于第一电子设备的情况为例进行了描述。 本领域技术人员能够理解, 本发 明实施例的信息处理方法和信息处理设备可以同样地应用于所述第二电子设 备和所述服务器。
以上, 参考图 5和图 6描述了本发明实施例的信息处理方法和信息处理 设备的应用示例。
通过本发明实施例的信息处理方法和信息处理设备, 能够利用通话过程 中所产生的通话信息, 从而除了实现通信目的外, 还能够进一步提升通话的 应用价值, 极大地丰富了用户的体验。
此外, 在本发明实施例的信息处理方法和信息处理设备中, 在电子设备 侧能响应于用户的输入操作而确定处理对象, 也能够自动地确定处理对象, 还能够将上述两种方式相结合。 因此, 本发明实施例的信息处理方法和信息 处理设备提供了多种方式来利用所述通话信息, 从而进一步丰富了用户的体 验。
此外, 在本发明实施例的信息处理方法和信息处理设备中, 上述确定处 理对象的过程也可以在服务器侧执行, 从而, 在电子设备侧的处理能力有限 的情况下, 能够减轻电子设备侧的处理负担, 提高电子设备侧的处理效率。
此外, 在本发明实施例的信息处理方法和信息处理设备中, 在电子设备 也可以存储所述关联信息, 并在稍后的时间判断满足预定条件时才触发关联 信息的输出, 还可以将所述关联信息输出到服务器和 /或第二电子设备以进行 处理。 因此, 方便用户根据情况进行不同的定制, 从而进一步丰富了用户的 体验。
此外,在本发明实施例的信息处理方法和信息处理设备中,在服务器侧, 可以存储所述关联信息以延后输出, 也可以根据各种不同的策略将所述关联 信息发送至适当的电子设备, 以由接收到所述关联信息的电子设备进行进一 步的处理。 因此, 提供了多种方式来将所述关联信息输出至不同的电子设备, 方便服务提供者根据情况进行不同的定制。 以上, 参照图 1到图 6描述了根据本发明实施例的信息处理方法和信息 处理设备。
需要说明的是, 在本说明书中, 术语 "包括"、 "包含" 或者其任何其他 变体意在涵盖非排他性的包含, 从而使得包括一系列要素的过程、 方法、 物 品或者设备不仅包括那些要素, 而且还包括没有明确列出的其他要素, 或者 是还包括为这种过程、 方法、 物品或者设备所固有的要素。 在没有更多限制 的情况下, 由语句 "包括一个 ... ... " 限定的要素, 并不排除在包括所述要素 的过程、 方法、 物品或者设备中还存在另外的相同要素。
此外, 需要说明的是, 在本说明书中, 类似 "第一…单元"、 "第二…单 元" 的表述仅为了在描述时方便区分, 而并不意味着其必须实现为物理分离 的两个或多个单元。 事实上, 根据需要, 所述单元可以整体实现为一个单元, 也可以实现为多个单元。
最后, 还需要说明的是, 上述一系列处理不仅包括以这里所述的顺序按 时间序列执行的处理, 而且包括并行或分别地、 而不是按时间顺序执行的处 理。
通过以上的实施方式的描述, 本领域的技术人员可以清楚地了解到本发 明可借助软件加必需的硬件平台的方式来实现, 当然也可以全部通过硬件来 实施。 基于这样的理解, 本发明的技术方案对背景技术做出贡献的全部或者 部分可以以软件产品的形式体现出来, 该计算机软件产品可以存储在存储介 质中, 如 ROM/RAM、 磁碟、 光盘等, 包括若干指令用以使得一台计算机设 备(可以是个人计算机, 服务器, 或者网络设备等)执行本发明各个实施例 或者实施例的某些部分所述的方法。
在本发明实施例中, 单元 /模块可以用软件实现, 以便由各种类型的处理 器执行。 举例来说, 一个标识的可执行代码模块可以包括计算机指令的一个 或多个物理或者逻辑块, 举例来说, 其可以被构建为对象、 过程或函数。 尽 管如此, 所标识模块的可执行代码无需物理地位于一起, 而是可以包括存储 在不同位里上的不同的指令, 当这些指令逻辑上结合在一起时, 其构成单元 / 模块并且实现该单元 /模块的规定目的。
在单元 /模块可以利用软件实现时, 考虑到现有硬件工艺的水平, 所以可 以以软件实现的单元 /模块, 在不考虑成本的情况下, 本领域技术人员都可以 搭建对应的硬件电路来实现对应的功能, 所述硬件电路包括常规的超大规模 集成(VLSI ) 电路或者门阵列以及诸如逻辑芯片、 晶体管之类的现有半导体 或者是其它分立的元件。 模块还可以用可编程硬件设备, 诸如现场可编程门 阵列、 可编程阵列逻辑、 可编程逻辑设备等实现。
以上对本发明进行了详细介绍, 本文中应用了具体个例对本发明的原理 及实施方式进行了阐述, 以上实施例的说明只是用于帮助理解本发明的方法 及其核心思想; 同时, 对于本领域的一般技术人员, 依据本发明的思想, 在 具体实施方式及应用范围上均会有改变之处, 综上所述, 本说明书内容不应 理解为对本发明的限制。

Claims

权利要求书
1. 一种信息处理方法, 应用于一服务器, 所述信息处理方法包括: 在第一电子设备与第二电子设备进行通话的过程中, 从所述第一电子设 备和 /或所述第二电子设备获取通话所产生的通话信息;
基于所述通话信息, 确定处理对象;
对所述处理对象进行分析, 以获取与所述处理对象相关联的关联信息; 以及
执行基于所述关联信息的操作。
2. 如权利要求 1所述的信息处理方法, 其中, 执行基于所述关联信息的 操作包括以下的至少之一:
存储所述关联信息;
基于预定策略, 将所述关联信息发送至所述第一电子设备和所述第二电 子设备中的至少一个。
3. 如权利要求 2所述的信息处理方法, 其中, 所述基于预定策略、 将所 述关联信息发送至所述第一电子设备或所述第二电子设备包括以下至少之 接收来自于所述第一电子设备和所述第二电子设备中的至少一个的请 求; 以及响应于所述请求, 将所述关联信息发送至所述第一电子设备和所述 第二电子设备中进行请求的电子设备;
将所述关联信息发送至所述第一电子设备和所述第二电子设备中发送通 话信息的电子设备;
在所述通话信息包括音频的信息时, 对所述音频进行语义分析, 以确定 所述关联信息适合于所述第一电子设备和所述第二电子设备中的哪一个; 以 及将所述关联信息发送至所述第一电子设备和所述第二电子设备中被确定为 适合的电子设备。
4. 如权利要求 1所述的信息处理方法, 其中, 所述确定处理对象包括以 下至少之一:
在所述通话信息为视频画面的信息的情况下, 接收所述第一电子设备和 所述第二电子设备中的至少一个发送的输入轨迹信息, 所述输入轨迹信息是 所述第一电子设备和所述第二电子设备中的所述至少一个通过检测用户的输 入操作而产生的, 并基于所述输入轨迹信息, 确定处理对象;
在所述通话信息为视频画面的信息的情况下, 对所述视频画面进行图像 识别, 以将所述静态画面分割为多个区域; 基于预定标准, 从所述多个区域 中确定目标区域; 以及基于所述目标区域, 确定所述处理对象;
在所述通话信息为动态画面的信息的情况下,对所述动态画面进行识别, 于所述特定动作, 确定所述处理对象;
在所述通话信息为音频的信息的情况下, 对所述音频进行音频识别, 以 确定处理对象。
5. 一种信息处理方法, 应用于第一电子设备, 所述信息处理方法包括: 在所述第一电子设备与所述第二电子设备进行多媒体通话的过程中, 基 于所述通话所产生的通话信息, 确定处理对象;
获取与所述处理对象关联的关联信息; 以及
执行基于所述关联信息的操作。
6. 如权利要求 5所述的信息处理方法, 其中, 获取与所述处理对象关联 的关联信息包括以下至少之一:
将所述处理对象发送至远程服务器,并从所述远程服务器接收关联信息, 所述关联信息是由所述远程服务器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联的信息;
对所述处理对象进行分析, 以确定所述关联信息。
7. 如权利要求 5所述的信息处理方法, 其中, 执行基于所述关联信息的 操作包括存储所述关联信息, 所述信息处理方法还包括以下至少之一:
在存储所述关联信息之后, 判断当前时间是否满足第一预定条件, 并当 判断当前时间满足第一预定条件时, 执行基于所述关联信息的显示;
在存储所述关联信息之后, 当所述第一电子设备进行网络访问时, 判断 所述网络访问是否满足第二预定条件, 并且当所述网络访问满足第二预定条 件时, 执行基于所述关联信息的显示;
在存储所述关联信息之后, 检测所述第一电子设备的环境信息, 判断所 述环境信息是否满足第三预定条件, 并且当所述环境信息满足第三预定条件 时, 执行基于所述关联信息的显示。
8. 如权利要求 5所述的信息处理方法, 其中, 所述通话信息为视频画面 的信息, 并且所述确定处理对象包括:
检测用户的输入操作; 以及
基于所述输入操作, 从所述视频画面中确定处理对象。
9. 如权利要求 8所述的信息处理方法, 其中,
检测用户的输入操作包括: 检测用于选定所述视频画面中的一区域的输 入操作; 并且, 所述确定处理对象包括: 将所述视频画面中与所述区域所对 应的部分视频画面确定为处理对象; 或者
检测用户的输入操作包括: 检测用于点击所述视频画面的点击操作; 并 且, 所述确定处理对象包括: 基于所述点击操作对应的所述视频画面中的特 定位置, 对所述视频画面进行图像分割, 以获得包含所述特定位置的部分视 频画面, 并将所述部分视频画面确定为处理对象; 或者
在对所述视频画面进行图像识别以确定多个候选对象的情况下, 所述检 测用户的输入操作包括: 检测用户对所述多个候选对象中的至少一个候选对 象的选择操作; 并且, 所述确定处理对象包括: 基于所述选择操作, 将所选 择的所述至少一个候选对象确定为所述处理对象。
10. 如权利要求 5所述的信息处理方法, 其中, 所述确定处理对象还包 括:
基于所述通话信息, 确定多个候选对象;
检测用户对所述多个候选对象中的至少一个的选择操作; 以及
基于所述选择操作, 将所选择的所述至少一个候选对象确定为所述处理 对象。
11. 一种信息处理设备, 应用于一服务器, 所述信息处理设备包括: 获取单元, 在第一电子设备与第二电子设备进行通话的过程中, 从所述 第一电子设备和 /或所述第二电子设备获取通话所产生的通话信息;
确定单元, 基于所述通话信息, 确定处理对象;
分析单元, 对所述处理对象进行分析, 以获取与所述处理对象相关联的 关联信息; 以及
执行单元, 执行基于所述关联信息的操作。
12. 如权利要求 11所述的信息处理设备, 其中, 所述执行单元配置为执 行以下的至少之一: 存储所述关联信息;
基于预定策略, 将所述关联信息发送至所述第一电子设备和所述第二电 子设备中的至少一个。
13. 如权利要求 12所述的信息处理设备, 其中, 在所述执行单元配置为 基于预定策略、 将所述关联信息发送至所述第一电子设备或所述第二电子设 备的情况下, 所述执行单元配置为执行以下操作至少之一:
接收来自于所述第一电子设备和所述第二电子设备中的至少一个的请 求; 以及响应于所述请求, 将所述关联信息发送至所述第一电子设备和所述 第二电子设备中进行请求的电子设备;
将所述关联信息发送至所述第一电子设备和所述第二电子设备中发送通 话信息的电子设备;
在所述通话信息包括音频的信息时, 对所述音频进行语义分析, 以确定 所述关联信息适合于所述第一电子设备和所述第二电子设备中的哪一个, 以 及将所述关联信息发送至所述第一电子设备和所述第二电子设备中被确定为 适合的电子设备。
14. 如权利要求 11所述的信息处理设备, 其中, 所述确定单元配置为执 行以下操作至少之一:
在所述通话信息为视频画面的信息的情况下, 接收所述第一电子设备和 所述第二电子设备中的至少一个发送的输入轨迹信息, 所述输入轨迹信息是 所述第一电子设备和所述第二电子设备中的所述至少一个通过检测用户的输 入操作而产生的, 以及基于所述输入轨迹信息, 确定处理对象;
在所述通话信息为视频画面的信息的情况下, 对所述视频画面进行图像 识别以将所述静态画面分割为多个区域,,基于预定标准从所述多个区域中确 定目标区域, 并且基于所述目标区域确定所述处理对象;
在所述通话信息为动态画面的信息的情况下, 对所述动态画面进行识别 于所述特定动作, 确定所述处理对象;
在所述通话信息为音频的信息的情况下, 对所述音频进行音频识别, 以 确定处理对象。
15. 一种信息处理设备, 应用于第一电子设备, 所述信息处理设备包括: 确定单元, 在所述第一电子设备与所述第二电子设备进行多媒体通话的 过程中, 基于所述通话所产生的通话信息, 确定处理对象;
获取单元, 获取与所述处理对象关联的关联信息; 以及
执行单元, 执行基于所述关联信息的操作。
16. 如权利要求 15所述的信息处理设备, 其中, 所述获取单元配置为执 行以下操作至少之一:
将所述处理对象发送至远程服务器,并从所述远程服务器接收关联信息, 所述关联信息是由所述远程服务器通过对所述处理对象进行分析而获得的、 与所述处理对象相关联的信息;
对所述处理对象进行分析, 以确定所述关联信息。
17. 如权利要求 15所述的信息处理设备, 其中, 所述执行单元配置为存 储所述关联信息, 所述信息处理设备还包括以下至少之一:
第一判断单元, 在存储所述关联信息之后, 判断当前时间是否满足第一 预定条件; 并且, 所述执行单元配置为当判断当前时间满足第一预定条件时, 执行基于所述关联信息的显示;
第二判断单元, 在存储所述关联信息之后, 当所述第一电子设备进行网 络访问时, 判断所述网络访问是否满足第二预定条件; 并且, 所述执行单元 配置为当所述网络访问满足第二预定条件时,执行基于所述关联信息的显示; 环境信息检测单元, 在存储所述关联信息之后, 检测所述第一电子设备 的环境信息; 以及第三判断单元, 判断所述环境信息是否满足第三预定条件; 并且, 所述执行单元配置为当所述环境信息满足第三预定条件时, 执行基于 所述关联信息的显示。
18. 如权利要求 15所述的信息处理设备, 其中, 所述通话信息为视频画 面的信息, 并且所述确定单元包括:
检测单元, 检测用户的输入操作; 以及
第一处理对象确定单元, 基于所述输入操作, 从所述视频画面中确定处 理对象。
19. 如权利要求 18所述的信息处理设备, 其中,
所述检测单元配置为检测用于选定所述视频画面中的一区域的输入操 作; 并且, 所述第一处理对象确定单元配置为将所述视频画面中与所述区域 所对应的部分视频画面确定为处理对象; 或者
所述检测单元配置为检测用于点击所述视频画面的点击操作; 并且, 所 述第一处理对象确定单元包括: 图像分割单元, 基于所述点击操作对应的所 述视频画面中的特定位置, 对所述视频画面进行图像分割, 以获得包含所述 特定位置的部分视频画面; 以及对象确定单元, 将所述部分视频画面确定为 处理对象; 或者
在对所述视频画面进行图像识别以确定多个候选对象的情况下, 所述检 测单元包括: 选择检测单元, 检测用户对所述多个候选对象中的至少一个候 选对象的选择操作; 并且, 所述第一处理对象确定单元配置为基于所述选择 操作, 将所选择的所述至少一个候选对象确定为所述处理对象。
20. 如权利要求 15所述的信息处理设备, 其中, 所述确定单元还包括: 候选对象确定单元, 基于所述通话信息, 确定多个候选对象;
选择检测单元,检测用户对所述多个候选对象中的至少一个的选择操作; 以及
第四处理对象确定单元, 基于所述选择操作, 将所选择的所述至少一个 候选对象确定为所述处理对象。
PCT/CN2013/089778 2012-12-20 2013-12-18 信息处理方法和信息处理设备 WO2014094614A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/388,722 US10126821B2 (en) 2012-12-20 2013-12-18 Information processing method and information processing device
DE112013006130.9T DE112013006130T5 (de) 2012-12-20 2013-12-18 Informationsverarbeitungsverfahren und Informationsverarbeitungsvorrichtung

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN201210560705.XA CN103888423B (zh) 2012-12-20 2012-12-20 信息处理方法和信息处理设备
CN201210559888.3 2012-12-20
CN201210560726.1 2012-12-20
CN201210560705.X 2012-12-20
CN201210559888.3A CN103888494B (zh) 2012-12-20 2012-12-20 信息处理方法和信息处理设备
CN201210560726.1A CN103888425B (zh) 2012-12-20 2012-12-20 信息处理方法和信息处理设备
CN201210560832.XA CN103888426B (zh) 2012-12-20 信息处理方法和信息处理设备
CN201210560832.X 2012-12-20

Publications (1)

Publication Number Publication Date
WO2014094614A1 true WO2014094614A1 (zh) 2014-06-26

Family

ID=50977602

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/089778 WO2014094614A1 (zh) 2012-12-20 2013-12-18 信息处理方法和信息处理设备

Country Status (3)

Country Link
US (1) US10126821B2 (zh)
DE (1) DE112013006130T5 (zh)
WO (1) WO2014094614A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104754277B (zh) * 2013-12-27 2018-04-27 联想(北京)有限公司 信息处理设备及信息处理方法
CN103870160B (zh) * 2014-03-26 2018-03-23 联想(北京)有限公司 一种信息处理方法及电子设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101015208A (zh) * 2004-09-09 2007-08-08 松下电器产业株式会社 通信终端及其通信方法
CN101888519A (zh) * 2009-05-14 2010-11-17 华为技术有限公司 共享桌面内容的方法和智能设备
US20120302167A1 (en) * 2011-05-24 2012-11-29 Lg Electronics Inc. Mobile terminal

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002271507A (ja) 2001-03-08 2002-09-20 Matsushita Electric Ind Co Ltd テレビ電話端末を用いた広告提供方法及び該広告提供方法に用いるテレビ電話端末、並びにプログラムを格納した媒体
JP2003158729A (ja) 2001-11-22 2003-05-30 Mitsubishi Electric Corp テレビ電話装置
CN100479356C (zh) 2002-08-02 2009-04-15 中国科学院上海微系统与信息技术研究所 一种基于微机电系统技术制作的光分插复用器
JP2004153779A (ja) 2002-09-04 2004-05-27 Nec Corp 通信端末装置、電話機、発信者情報通知システム及びそれに用いる発信者情報通知方法並びそのプログラム
US20080215884A1 (en) * 2004-09-09 2008-09-04 Matsushita Electric Industrial Co., Ltd. Communication Terminal and Communication Method Thereof
US8199184B2 (en) * 2007-11-06 2012-06-12 Cisco Technology, Inc. Visually enhancing a conference
US20090157426A1 (en) * 2007-12-12 2009-06-18 Mckesson Financial Holdings Limited Methods, apparatuses & computer program products for facilitating efficient distribution of data within a system
CN101296450A (zh) 2008-05-27 2008-10-29 深圳华为通信技术有限公司 通信信息的管理方法及其终端
CN102479024A (zh) 2010-11-24 2012-05-30 国基电子(上海)有限公司 手持装置及其用户界面构建方法
CN102655544A (zh) 2011-03-01 2012-09-05 联想(北京)有限公司 一种发起通信的方法及通信终端
US9197848B2 (en) * 2012-06-25 2015-11-24 Intel Corporation Video conferencing transitions among a plurality of devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101015208A (zh) * 2004-09-09 2007-08-08 松下电器产业株式会社 通信终端及其通信方法
CN101888519A (zh) * 2009-05-14 2010-11-17 华为技术有限公司 共享桌面内容的方法和智能设备
US20120302167A1 (en) * 2011-05-24 2012-11-29 Lg Electronics Inc. Mobile terminal

Also Published As

Publication number Publication date
DE112013006130T5 (de) 2015-10-22
US20150286280A1 (en) 2015-10-08
US10126821B2 (en) 2018-11-13

Similar Documents

Publication Publication Date Title
CN106605224B (zh) 信息搜索方法、装置、电子设备及服务器
CN107341185B (zh) 信息显示的方法及装置
EP3221817B1 (en) Screenshot based indication of supplemental information
US10712936B2 (en) First electronic device and information processing method applicable to first or second electronic device comprising a first application
KR20180072833A (ko) 공유된 관심사를 갖는 메시지들의 갤러리
WO2020044099A1 (zh) 一种基于对象识别的业务处理方法和装置
US20150085146A1 (en) Method and system for storing contact information in an image using a mobile device
JP6143973B2 (ja) 電話着信に対する返信方法、装置、端末、プログラム及び記録媒体
WO2017219497A1 (zh) 消息生成方法及装置
JP7231638B2 (ja) 映像に基づく情報取得方法及び装置
WO2016082461A1 (zh) 推荐信息获取方法、终端及服务器
US20100275120A1 (en) Processing of fields in motion picture videos or still photos
JP2004164180A (ja) 情報処理装置、通信処理装置、および方法、並びにコンピュータ・プログラム
CN107665447B (zh) 信息处理方法和信息处理设备
CN103986845A (zh) 信息处理方法和信息处理设备
CN103888423B (zh) 信息处理方法和信息处理设备
WO2014094614A1 (zh) 信息处理方法和信息处理设备
CN111526380B (zh) 视频处理方法、装置、服务器、电子设备及存储介质
CN110580486A (zh) 一种数据处理方法、装置、电子设备和可读介质
CN117459662A (zh) 一种视频播放方法、识别方法、装置、设备及存储介质
CN106886541B (zh) 一种数据搜索方法、装置以及一种用于数据搜索的装置
CN106470215B (zh) 用户终端、服务器、未关注场景的消息推送系统及方法
CN111797746A (zh) 人脸识别方法、装置及计算机可读存储介质
CN111897474A (zh) 文件处理方法和电子设备
KR101961984B1 (ko) 메시지 내용을 분석하기 위한 방법 및 기술 장비

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13864566

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 14388722

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 112013006130

Country of ref document: DE

Ref document number: 1120130061309

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13864566

Country of ref document: EP

Kind code of ref document: A1