WO2008026024A1 - System and method for coordinating audiovisual content with contact list information - Google Patents

System and method for coordinating audiovisual content with contact list information Download PDF

Info

Publication number
WO2008026024A1
WO2008026024A1 PCT/IB2007/000471 IB2007000471W WO2008026024A1 WO 2008026024 A1 WO2008026024 A1 WO 2008026024A1 IB 2007000471 W IB2007000471 W IB 2007000471W WO 2008026024 A1 WO2008026024 A1 WO 2008026024A1
Authority
WO
WIPO (PCT)
Prior art keywords
contact list
audio message
photograph
audiovisual content
list entry
Prior art date
Application number
PCT/IB2007/000471
Other languages
French (fr)
Inventor
Bjorn Grohn
Magnus Hansson
Original Assignee
Sony Ericsson Mobile Communications Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Ericsson Mobile Communications Ab filed Critical Sony Ericsson Mobile Communications Ab
Priority to CN200780031878XA priority Critical patent/CN101513023B/en
Priority to EP07705655.4A priority patent/EP2057826B1/en
Publication of WO2008026024A1 publication Critical patent/WO2008026024A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/271—Devices whereby a plurality of signals may be stored simultaneously controlled by voice recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467—Methods of retrieving data
    • H04M1/27475—Methods of retrieving data using interactive graphical means or pictorial representations

Definitions

  • TITLE SYSTEM AND METHOD FOR COORDINATING AUDIOVISUAL CONTENT
  • the present invention relates generally to managing data in an electronic device such as a mobile telephone and, more particularly, to a system and method for coordinating audiovisual content with contact list information.
  • Mobile and/or wireless electronic devices are becoming increasingly popular. For example, mobile telephones, portable media players and portable gaming devices are now in wide-spread use.
  • the features associated with certain types of electronic devices have become increasingly diverse. To name a few examples, many electronic devices have cameras, text messaging capability, Internet browsing capability, electronic mail capability, video playback capability, audio playback capability, image display capability and handsfree headset interfaces.
  • Most mobile electronic devices that are capable of establishing a telephone call include a contact list function that stores the names of individuals and associated information, such as telephone numbers and/or addresses.
  • the collection of contacts and associated information is entered and stored in text format.
  • many users have difficultly associating what a person looks like with a written name. For instance, the user of an electronic device may recognize the appearance of a person, but not his or her name. An exemplary situation when this may be troublesome is during receipt of an incoming call and the user cannot remember the caller from the display of the caller's name and/or telephone number by a caller ID function. In other situations, the user may recognize a name, but cannot recall that person's appearance.
  • a method of coordinating audiovisual content with contact list information includes recording an audio message in relationship with the audiovisual content; matching the audio message with a contact list entry from a plurality of contact list entries; and associating the audiovisual content with the matched contact list entry.
  • the audiovisual content includes a photograph and the method further includes displaying the photograph with or instead of a display of the contact list entry.
  • the audiovisual content includes a photograph and the contact list is maintained by a mobile radio terminal capable of receiving calls, and the method further includes displaying the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
  • the audiovisual content is a photograph.
  • the contact list is maintained by a mobile radio terminal and the photograph is taken with a camera of the mobile radio terminal.
  • the contact list is maintained by a mobile radio terminal and the photograph is transferred to the mobile radio terminal.
  • the method further includes conducting speech recognition on the audio message to generate criteria from the audio message for use in the matching the audio message to the contact list entry.
  • the speech recognition converts the audio message to text.
  • text from a field of the contact list entry is used in the matching of the audio message to the contact list entry.
  • another recorded audio message that is associated with the contact list entry is used in the matching of the audio message to the contact list entry.
  • a program that coordinates audiovisual content with contact list information is embodied on a machine readable medium and includes executable logic to record an audio message in relationship with the audiovisual content; match the audio message with a contact list entry from a plurality of contact list entries; and associate the audiovisual content with the matched contact list entry.
  • the audiovisual content includes a photograph and the program further includes logic to display the photograph with or instead of a display of the contact list entry.
  • the audiovisual content includes a photograph and the contact list is maintained by a mobile radio terminal capable of receiving calls, and the program further includes logic to display the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
  • speech recognition is conducted on the audio message to generate criteria from the audio message for use in matching the audio message to the contact list entry.
  • the speech recognition converts the audio message to text.
  • a mobile radio terminal includes a radio circuit for establishing calls; and a control circuit that carries out logical operations to coordinate audiovisual content with contact list information including record an audio message in relationship with the audiovisual content; match the audio message with a contact list entry from a plurality of contact list entries; and associate the audiovisual content with the matched contact list entry.
  • the audiovisual content includes a photograph and the control circuit controls a display to display the photograph with or instead of a display of the contact list entry.
  • the audiovisual content includes a photograph and the control circuit controls a display to display the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
  • speech recognition is conducted on the audio message to generate criteria from the audio message for use in matching the audio message to the contact list entry.
  • the audio message is transmitted to a server that carries out the speech recognition.
  • the speech recognition converts the audio message to text.
  • FIG. 1 is a schematic view of a mobile telephone as an exemplary electronic equipment in accordance with an embodiment of the present invention
  • FIG. 2 is a schematic block diagram of the relevant portions of the mobile telephone of FIG. 1 in accordance with an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a communications system in which the mobile telephone of FIG. 1 may operate;
  • FIG. 4 is a flow chart representing an exemplary method of coordinating audiovisual content with contact list information using the mobile telephone of FIG. 1;
  • FIG. 5 is a flow chart representing another exemplary method of coordinating audiovisual content with contact list information using the mobile telephone of FIG. 1;
  • FIG. 6 is 'a flow chart representing still another exemplary method of coordinating audiovisual content with contact list information using the mobile telephone of FIG. 1.
  • the interchangeable terms “electronic equipment” and “electronic device” include portable radio communication equipment.
  • portable radio communication equipment which herein after is referred to as a “mobile radio terminal,” includes all equipment such as mobile telephones, pagers, communicators, electronic organizers, personal digital assistants (PDAs), smartphones, portable communication apparatus or the like.
  • PDAs personal digital assistants
  • the invention is described primarily in the context of a mobile telephone.
  • the invention is not intended to be limited to a mobile telephone and can be any type of appropriate electronic equipment, examples of which include a media player, a gaming device and a computer.
  • the electronic device 10 includes an audiovisual contact list function 12 that is configured to coordinate audiovisual content with contact list information. Additional details and operation of the audiovisual contact list function 12 will be described in greater detail below.
  • the audiovisual contact list function 12 may be embodied as executable code that is resident in and executed by the electronic device 10. In one embodiment, the audiovisual contact list function 12 may be a program stored on a computer or machine readable medium.
  • the audiovisual contact list function 12 may be a stand-alone software application or form a part of a software application that carries out additional tasks related to the electronic device 10.
  • the electronic device of the illustrated embodiment is a mobile telephone and will be referred to as the mobile telephone 10.
  • the mobile telephone 10 is shown as having a "brick" or “block” form factor housing, but it will be appreciated that other type housings, such as a clamshell housing or a slide-type housing, may be utilized.
  • the mobile telephone 10 may include a display 14.
  • the display 14 displays information to a user such as operating state, time, telephone numbers, contact information, various navigational menus, etc., which enable the user to utilize the various features of the mobile telephone 10.
  • the display 14 also maybe used to visually display content received by the mobile telephone 10 and/or retrieved from a memory 16 of the mobile telephone 10.
  • the display 14 may be used to present images, video and other graphics to the user, such as photographs, mobile television content and video associated with games.
  • a keypad 18 provides for a variety of user input operations.
  • the keypad 18 typically includes alphanumeric keys for allowing entry of alphanumeric information such as telephone numbers, phone lists, contact information, notes, etc.
  • the keypad 18 typically includes special function keys such as a "call send” key for initiating or answering a call, and a "call end” key for ending or “hanging up” a call.
  • Special function keys may also include menu navigation and select keys, for example, for navigating through a menu displayed on the display 16 to select different telephone functions, profiles, settings, etc, as is conventional.
  • Special function keys may include audiovisual content playback keys to start, stop and pause playback, skip or repeat tracks, and so forth.
  • keys associated with the mobile telephone may include a volume key, an audio mute key, an on/off power key, a web browser launch key, a camera key, etc. Keys or key-like functionality may also be embodied as a touch screen associated with the display 14.
  • the mobile telephone 10 includes call circuitry that enables the mobile telephone 10 to establish a call and/or exchange signals with a called/calling device, typically another mobile telephone or landline telephone.
  • the called/calling device need not be another telephone, but may be some other device such as an Internet web server, content providing server, etc.
  • Calls may take any suitable form.
  • the call could be a conventional call that is established over a cellular circuit-switched network or a voice over Internet Protocol (VoIP) call that is established over a packet-switched capability of a cellular network or over an alternative packet-switched network, such as WiFi, WiMax, etc.
  • VoIP voice over Internet Protocol
  • Another example includes a video enabled call that is established over a cellular or alternative network.
  • the mobile telephone 10 may be configured to transmit, receive and/or process data, such as text messages (e.g., colloquially referred to by some as "an SMS"), electronic mail messages, multimedia messages (e.g., colloquially referred to by some as "an MMS”), image files, video files, audio files, ring tones, streaming audio, streaming video, data feeds (including podcasts) and so forth.
  • processing such data may include storing the data in the memory 16, executing applications to allow user interaction with data, displaying video and/or image content associated with the data, outputting audio sounds associated with the data and so forth.
  • FIG. 2 represents a functional block diagram of the mobile telephone 10.
  • the mobile telephone 10 includes a primary control circuit 20 that is configured to carry out overall control of the functions and operations of the mobile telephone 10.
  • the control circuit 20 may include a processing device 22, such as a CPU, microcontroller or microprocessor.
  • the processing device 22 executes code stored in a memory (not shown) within the control circuit 20 and/or in a separate memory, such as memory 16, in order to carry out operation of the mobile telephone 10.
  • the memory 16 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory or other suitable device.
  • the processing device 22 may execute code that implements the audiovisual contact list function 12. It will be apparent to a person having ordinary skill in the art of computer programming, and specifically in application programming for mobile telephones or other electronic devices, how to program a mobile telephone 10 to operate and carry out logical functions associated with the audiovisual contact list function 12. Accordingly, details as to specific programming code have been left out for the sake of brevity. Also, while the audiovisual contact list function 12 is executed by the processing device 22 in accordance with a preferred embodiment of the invention, such functionality could also be carried out via dedicated hardware, firmware, software, or combinations thereof, without departing from the scope of the invention.
  • the mobile telephone 10 includes an antenna 24 coupled to a radio circuit 26.
  • the radio circuit 26 includes a radio frequency transmitter and receiver for transmitting and receiving signals via the antenna 24 as is conventional.
  • the radio circuit 26 may be configured to operate in a mobile communications system and may be used to send and receive data and/or audiovisual content.
  • Receiver types for interaction with a mobile radio network and/or broadcasting network include, but are not limited to, GSM, CDMA, WCDMA, GPRS, MBMS, WiFi, WiMax, DVB-H, ISDB-T, etc as well as advanced versions of these standards.
  • the mobile telephone 10 further includes a sound signal processing circuit 28 for processing audio signals transmitted by and received from the radio circuit 26. Coupled to the sound processing circuit 28 are a speaker 30 and a microphone 32 that enable a user to listen and speak via the mobile telephone 10 as is conventional.
  • the radio circuit 26 and sound processing circuit 28 are each coupled to the control circuit 20 so as to carry out overall operation. Audio data may be passed from the control circuit 20 to the sound signal processing circuit 28 for playback to the user.
  • the audio data may include, for example, audio data from an audio file stored by the memory 18 and retrieved by the control circuit 20, or received audio data such as in the form of streaming audio data from a mobile radio service.
  • the sound processing circuit 28 may include any appropriate buffers, decoders, amplifiers and so forth.
  • the display 14 may be coupled to the control circuit 20 by a video processing circuit 34 that converts video data to a video signal used to drive the display 14.
  • the video processing circuit 34 may include any appropriate buffers, decoders, video data processors and so forth.
  • the video data may be generated by the control circuit 20, retrieved from a video file that is stored in the memory 16, derived from an incoming video data stream received by the radio circuit 28 or obtained by any other suitable method.
  • the mobile telephone 10 further includes one or more I/O interface(s) 36.
  • the I/O interface(s) 36 may be in the form of typical mobile telephone I/O interfaces and may include one or more electrical connectors.
  • the I/O interface(s) 36 may be used to couple the mobile telephone 10 to a battery charger to charge a battery of a power supply unit (PSU) 38 within the mobile telephone 10.
  • PSU power supply unit
  • the I/O interface(s) 36 may serve to connect the mobile telephone 10 to a headset assembly
  • the I/O interface(s) 36 may serve to connect the mobile telephone 10 to a personal computer or other device via a data cable for the exchange of data.
  • the mobile telephone 10 may receive operating power via the I/O interface(s) 36 when connected to a vehicle power adapter or an electricity outlet power adapter.
  • the mobile telephone 10 may also include a timer 40 for carrying out timing functions. Such functions may include timing the durations of calls, generating the content of time and date stamps, etc.
  • the mobile telephone 10 may include a camera 42 for taking digital pictures and/or movies. Image and/or video files corresponding to the pictures and/or movies may be stored in the memory 16.
  • the mobile telephone 10 also may include a position data receiver 44, such as a global positioning system (GPS) receiver, Galileo satellite system receiver or the like.
  • GPS global positioning system
  • Galileo satellite system receiver or the like.
  • the mobile telephone 10 also may include a local wireless interface 46, such as an infrared transceiver and/or an RF adaptor (e.g., a Bluetooth adapter), for establishing communication with an accessory, another mobile radio terminal, a computer or another device.
  • a local wireless interface 46 may operatively couple the mobile telephone 10 to a headset assembly (e.g., a PHF device) in an embodiment where the headset assembly has a corresponding wireless interface.
  • the mobile telephone 10 may be configured to operate as part of a communications system 48.
  • the system 48- may include a communications network 50 having a server 52 (or servers) for managing calls placed by and destined to the mobile telephone 10, transmitting data to the mobile telephone 10 and carrying out any other support functions.
  • the server 52 communicates with the mobile telephone 10 via a transmission medium.
  • the transmission medium may be any appropriate device or assembly, including, for example, a communications tower (e.g., a cell tower), another mobile telephone, a wireless access point, a satellite, etc. Portions of the network may include wireless transmission pathways.
  • the network 50 may support the communications activity of multiple mobile telephones 10 and other types of end user devices.
  • the server 52 may be configured as a typical computer system used to carry out server functions and may include a processor configured to execute software containing logical instructions that embody the functions of the server 52.
  • FIG. 4 illustrated are logical operations to implement an exemplary method of coordinating audiovisual content with contact list information.
  • the exemplary method may be carried out by executing an embodiment of the audiovisual contact list function 12, for example.
  • the flow chart of FIG. 4 may be thought of as depicting steps of a method carried out by the mobile telephone 10.
  • FIG. 4 shows a specific order of executing functional logic blocks, the order of execution of the blocks may be changed relative to the order shown. Also, two or more blocks shown in succession may be executed concurrently or with partial concurrence. Certain blocks also may be omitted.
  • any number of commands, state variables, semaphores or messages may be added to the logical flow for purposes of enhanced utility, accounting, performance, measurement, troubleshooting, and the like. It is understood that all such variations are within the scope of the present invention.
  • the logical flow for the audiovisual contact list function 12 may begin in block 54 where the user carries out actions to take a photograph with the camera 42.
  • the photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
  • the user may record an audio message using the mobile telephone 10.
  • the audiovisual contact list function 12 may prompt the user to speak into the microphone 32 or the microphone of an operatively interfaced headset (not shown).
  • the photograph of block 54 is of a person, the user may have the subject of the photograph input the audio message.
  • the audio message may be captured and stored by the memory 16 in any suitable file format. In most cases, it is believed that the audio message will relate to the subject matter of the photograph that was taken in block 54. For instance, if the photograph is of a person, the audio message may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
  • a commercial establishment e.g., a store or building
  • the audio message is run through a speech recognition software engine.
  • the speech recognition engine may convert the audio message to text using a speech-to-text conversion process.
  • the speech recognition engine may attempt to recognize patterns in the audio message to identify a meaningful term (or terms) from the audio message by matching the audio signals to a function or value.
  • speech recognition software is undergoing continuous improvement, suitable speech recognition engines will be known to those of ordinary skill in the art.
  • the speech recognition engine may form a part of the audiovisual contact list function 12 or may be implemented in a separate program that is executed by the mobile telephone 10. Since speech recognition processing may consume a considerable amount of processing capacity, the speech recognition engine may be resident in and executed by the server 52. In this embodiment, the audio message may be transmitted to the server 52 for processing and the results of the speech recognition may be returned to the mobile telephone 10.
  • the audiovisual contact list function 12 may determine if there is a match between the output of the speech recognition from block 58 and existing contact information.
  • contact information may be stored in a contact list database.
  • Such databases typically store the names of people, along with their address (e.g., home address and/or work address), telephone numbers and electronic mail addresses. Other information may be stored, such as notes and important dates (e.g., birthdays and anniversaries).
  • the contact list database may be stored using the memory 16 and accessed using a contact list interface software application executed by the processing device 22.
  • the text may be compared against the entries in the user's contact list for a matching string of characters.
  • the search for a matching entry or entries may attempt to match text in one or more particular fields in the contact list database or all fields in the contact list database.
  • the engine used to identify matches may use variant spellings for the converted text and/or pronunciation-based search algorithms to match the text to contact list data.
  • the audio message was converted to a meaningful term (e.g., a value, a sound signal profile, etc.)
  • the term may be compared against commensurate types of terms derived from the data contained in the contact list database. For instance, text-based data that is entered into a contact list may be converted to a term by running a conversion algorithm.
  • the logical flow may proceed to block 62 where the photograph taken in block 54 is associated with the contact list entry that matches the converted audio message.
  • the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing.
  • the photograph may be displayed to assist the user identify the caller.
  • the audio message may be audibly played back to the user.
  • the logical flow may proceed to block 66 where the user may be prompted to enter contact information that corresponds to the photograph and/or the audio message. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph.
  • the logical flow may proceed to block 64 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
  • the exemplary method may be carried out by executing an embodiment of the audiovisual contact list function 12, for example.
  • FIG. 5 may be thought of as depicting steps of a method carried out by the mobile telephone 10.
  • FIG. 5 shows a specific order of executing functional logic blocks, the order of execution of the blocks may be changed relative to the order shown.
  • two or more blocks shown in succession may be executed concurrently or with partial concurrence.
  • Certain blocks also may be omitted.
  • any number of commands, state variables, semaphores or messages may be added to the logical flow for purposes of enhanced utility, accounting, performance, measurement, troubleshooting, and the like. It is understood that all such variations are within the scope of the present invention.
  • the user may carry out actions to take a photograph with the camera 42.
  • the photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape.
  • the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
  • the user may enter text relating to the photograph.
  • the audiovisual contact list function 12 may prompt the user to enter text by depressing buttons of the keypad 18.
  • the entered text will relate to the subject matter of the photograph that was taken in block 68.
  • the photograph is of a person
  • the text may be the name of the person.
  • the audio message may be the name or address of the corresponding location.
  • the audiovisual contact list function 12 may determine if there is a match between the text entered in block 70 and existing contact information that has been stored in a contact list database. For instance, the text may be compared against the entries in the user's contact list for a matching string of characters. The search for a matching entry or entries may attempt to match text in one or more particular fields in the contact list database or all fields in the contact list database. Also, the engine used to identify matches may use variant spellings for the text and/or pronunciation-based search algorithms to match the text to contact list data.
  • the logical flow may proceed to block 74 where the photograph taken in block 68 is associated with the contact list entry that matches the text entered in block 70.
  • the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller.
  • the logical flow may proceed to block 78 where the user may be prompted to enter contact information that corresponds to the photograph and/or the text entered in block 70. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 76 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
  • FIG. 6 illustrated are logical operations to implement still another exemplary method of coordinating audiovisual content with contact list information.
  • the exemplary method may be carried out by executing an embodiment of the audiovisual contact list function 12, for example.
  • the flow chart of FIG. 6 may be thought of as depicting steps of a method carried out by the mobile telephone 10.
  • FIG. 6 shows a specific order of executing functional logic blocks, the order of execution of the blocks may be changed relative to the order shown.
  • two or more blocks shown in succession may be executed concurrently or with partial concurrence. Certain blocks also may be omitted.
  • any number of commands, state variables, semaphores or messages may be added to the logical flow for purposes of enhanced utility, accounting, performance, measurement, troubleshooting, and the like.
  • the user may carry out actions to take a photograph with the camera 42.
  • the photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape.
  • the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
  • the user may record an audio message using the mobile telephone 10.
  • the audiovisual contact list function 12 may prompt the user to speak into the microphone 32 or the microphone of an operatively interfaced headset (not shown).
  • the user may have the subject of the photograph input the audio message.
  • the audio message may be captured and stored by the memory 16 in any suitable file format. In most cases, it is believed that the audio message will relate to the subject matter of the photograph that was taken in block 82. For instance, if the photograph is of a person, the audio message may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
  • a commercial establishment e.g., a store or building
  • the user may enter contact information a contact list database to establish a contact list entry in block 84.
  • entered may be the name a person, the business and/or residence address of the person, a telephone number or numbers for the person, an electronic mail address or addresses for the person and so forth.
  • the user may record a second audio message using the mobile telephone 10.
  • the second audio message will relate to the contact list entry that was entered in block 84.
  • the second audio message may be the name of the person for which contact information was entered. It will be appreciated that multiple contact list entries may be entered and an audio message for each contact list entry may be recorded.
  • a comparison may be made between the audio message recorded in conjunction with the photograph of block 82 and each of the audio messages recorded in conjunction with establishment of the contact list entries of block 84.
  • the comparison may be made by directly comparing the recordings or the sound characteristics of the recordings.
  • each of the recordings may be processed using a speech recognition software engine to convert the recordings to text or meaningful term, and the output of the speech recognition engine may serve as the basis of the comparison.
  • the logic may find that a match exists between the two recordings. If a match is identified in block 88, the logical flow may proceed to block 90 where the photograph taken in block 80 is associated with the contact list entry having the audio message that matched the audio message recorded in block 82.
  • the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller. In addition to or instead of displaying the photograph in these and similar circumstances, the corresponding audio message of either of blocks 82 or 86 may be audibly played back to the user.
  • the logical flow may proceed to block 94 where the user may be prompted to enter contact information that corresponds to the photograph and/or the audio message of block 82. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 92 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
  • An example application of the method includes taking a photograph of an individual and recording an audio message containing the name of the individual. Once an association between the photograph and a contract list entry has been made using the content of the audio message to match the photograph with the contact list entry, the photograph may be displayed in conjunction with the contract list entry. This may aid certain users who have difficultly "matching names with faces.”
  • the method may be used to associate other types of audiovisual content with a contact list entry.
  • Other types of audiovisual content that may be associated include, but are not limited to, video clips, ring tones, songs, and so on.
  • the term audiovisual content is used broadly to include photographs, image files, video files, audio files, text, and any other content that may be associated with a contact list entry consistent with the techniques described herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Telephonic Communication Services (AREA)

Abstract

A method of coordinating audiovisual content with contact list information includes recording an audio message in relationship with the audiovisual content. The audio message is matched with a contact list entry from a plurality of contact list entries and the audiovisual content is associated with the matched contact list entry.

Description

TITLE: SYSTEM AND METHOD FOR COORDINATING AUDIOVISUAL CONTENT
WITH CONTACT LIST INFORMATION
RELATED APPLICATION DATA
. The present application claims the benefit of U.S. Provisional Application Serial No. 60/823,698, filed August 28, 2006, the disclosure of which is herein incorporated by reference in its entirety.
TECHNICAL FIELD OF THE INVENTION
The present invention relates generally to managing data in an electronic device such as a mobile telephone and, more particularly, to a system and method for coordinating audiovisual content with contact list information.
DESCRIPTIONOFTHERELATEDART
Mobile and/or wireless electronic devices are becoming increasingly popular. For example, mobile telephones, portable media players and portable gaming devices are now in wide-spread use. In addition, the features associated with certain types of electronic devices have become increasingly diverse. To name a few examples, many electronic devices have cameras, text messaging capability, Internet browsing capability, electronic mail capability, video playback capability, audio playback capability, image display capability and handsfree headset interfaces.
Most mobile electronic devices that are capable of establishing a telephone call include a contact list function that stores the names of individuals and associated information, such as telephone numbers and/or addresses. The collection of contacts and associated information is entered and stored in text format. While it is convenient to search and sort text-based information, many users have difficultly associating what a person looks like with a written name. For instance, the user of an electronic device may recognize the appearance of a person, but not his or her name. An exemplary situation when this may be troublesome is during receipt of an incoming call and the user cannot remember the caller from the display of the caller's name and/or telephone number by a caller ID function. In other situations, the user may recognize a name, but cannot recall that person's appearance.
This difficulty in associating "names" and "faces" may become exacerbated when the user meets multiple people in a relatively short amount of time. In addition, as time goes by, people may have difficulty remembering persons or places that are preserved in photographs. SUMMARY
To improve a user's ability to effectively use stored contact information, there is a need in the art for an enhanced system and method for coordinating audiovisual content with contact list information, including mechanisms to match an audio message relating to a photograph with stored contact list information.
According to one aspect of the invention, a method of coordinating audiovisual content with contact list information includes recording an audio message in relationship with the audiovisual content; matching the audio message with a contact list entry from a plurality of contact list entries; and associating the audiovisual content with the matched contact list entry.
According to an embodiment of the method, the audiovisual content includes a photograph and the method further includes displaying the photograph with or instead of a display of the contact list entry.
According to an embodiment of the method, the audiovisual content includes a photograph and the contact list is maintained by a mobile radio terminal capable of receiving calls, and the method further includes displaying the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
According to an embodiment of the method, the audiovisual content is a photograph.
According to an embodiment of the method, the contact list is maintained by a mobile radio terminal and the photograph is taken with a camera of the mobile radio terminal.
According to an embodiment of the method, the contact list is maintained by a mobile radio terminal and the photograph is transferred to the mobile radio terminal.
According to an embodiment, the method further includes conducting speech recognition on the audio message to generate criteria from the audio message for use in the matching the audio message to the contact list entry.
According to an embodiment of the method, the speech recognition converts the audio message to text.
According to an embodiment of the method, text from a field of the contact list entry is used in the matching of the audio message to the contact list entry.
According to an embodiment of the method, another recorded audio message that is associated with the contact list entry is used in the matching of the audio message to the contact list entry. According to another aspect of the invention, a program that coordinates audiovisual content with contact list information is embodied on a machine readable medium and includes executable logic to record an audio message in relationship with the audiovisual content; match the audio message with a contact list entry from a plurality of contact list entries; and associate the audiovisual content with the matched contact list entry.
According to an embodiment of the program, the audiovisual content includes a photograph and the program further includes logic to display the photograph with or instead of a display of the contact list entry.
According to an embodiment of the program, the audiovisual content includes a photograph and the contact list is maintained by a mobile radio terminal capable of receiving calls, and the program further includes logic to display the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
According to an embodiment of the program, speech recognition is conducted on the audio message to generate criteria from the audio message for use in matching the audio message to the contact list entry.
According to an embodiment of the program, the speech recognition converts the audio message to text.
According to another aspect of the invention, a mobile radio terminal includes a radio circuit for establishing calls; and a control circuit that carries out logical operations to coordinate audiovisual content with contact list information including record an audio message in relationship with the audiovisual content; match the audio message with a contact list entry from a plurality of contact list entries; and associate the audiovisual content with the matched contact list entry.
According to an embodiment of the mobile radio terminal, the audiovisual content includes a photograph and the control circuit controls a display to display the photograph with or instead of a display of the contact list entry.
According to an embodiment of the mobile radio terminal, the audiovisual content includes a photograph and the control circuit controls a display to display the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
According to an embodiment of the mobile radio terminal, speech recognition is conducted on the audio message to generate criteria from the audio message for use in matching the audio message to the contact list entry.
According to an embodiment of the mobile radio terminal, the audio message is transmitted to a server that carries out the speech recognition. According to an embodiment of the mobile radio terminal, the speech recognition converts the audio message to text.
These and further features of the present invention will be apparent with reference to the following description and attached drawings. In the description and drawings, particular embodiments of the invention have been disclosed in detail as being indicative of some of the ways in which the principles of the invention may be employed, but it is understood that the invention is not limited correspondingly in scope. Rather, the invention includes all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.
Features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments.
It should be emphasized that the term "comprises/comprising" when used in this specification is taken to specify the presence of stated features, integers, steps or components but does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic view of a mobile telephone as an exemplary electronic equipment in accordance with an embodiment of the present invention;
FIG. 2 is a schematic block diagram of the relevant portions of the mobile telephone of FIG. 1 in accordance with an embodiment of the present invention;
FIG. 3 is a schematic diagram of a communications system in which the mobile telephone of FIG. 1 may operate;
FIG. 4 is a flow chart representing an exemplary method of coordinating audiovisual content with contact list information using the mobile telephone of FIG. 1;
FIG. 5 is a flow chart representing another exemplary method of coordinating audiovisual content with contact list information using the mobile telephone of FIG. 1; and
FIG. 6 is 'a flow chart representing still another exemplary method of coordinating audiovisual content with contact list information using the mobile telephone of FIG. 1. DETAILED DESCRIPTION OF EMBODIMENTS
The present invention will now be described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. It will be understood that the figures are not necessarily to scale,
The interchangeable terms "electronic equipment" and "electronic device" include portable radio communication equipment. The term "portable radio communication equipment," which herein after is referred to as a "mobile radio terminal," includes all equipment such as mobile telephones, pagers, communicators, electronic organizers, personal digital assistants (PDAs), smartphones, portable communication apparatus or the like.
In the present application, the invention is described primarily in the context of a mobile telephone.
However, it will be appreciated that the invention is not intended to be limited to a mobile telephone and can be any type of appropriate electronic equipment, examples of which include a media player, a gaming device and a computer.
Referring initially to FIGs. 1 and 2, an electronic device 10 is shown. The electronic device 10 includes an audiovisual contact list function 12 that is configured to coordinate audiovisual content with contact list information. Additional details and operation of the audiovisual contact list function 12 will be described in greater detail below. The audiovisual contact list function 12 may be embodied as executable code that is resident in and executed by the electronic device 10. In one embodiment, the audiovisual contact list function 12 may be a program stored on a computer or machine readable medium. The audiovisual contact list function 12 may be a stand-alone software application or form a part of a software application that carries out additional tasks related to the electronic device 10.
The electronic device of the illustrated embodiment is a mobile telephone and will be referred to as the mobile telephone 10. The mobile telephone 10 is shown as having a "brick" or "block" form factor housing, but it will be appreciated that other type housings, such as a clamshell housing or a slide-type housing, may be utilized.
The mobile telephone 10 may include a display 14. The display 14 displays information to a user such as operating state, time, telephone numbers, contact information, various navigational menus, etc., which enable the user to utilize the various features of the mobile telephone 10. The display 14 also maybe used to visually display content received by the mobile telephone 10 and/or retrieved from a memory 16 of the mobile telephone 10. The display 14 may be used to present images, video and other graphics to the user, such as photographs, mobile television content and video associated with games.
A keypad 18 provides for a variety of user input operations. For example, the keypad 18 typically includes alphanumeric keys for allowing entry of alphanumeric information such as telephone numbers, phone lists, contact information, notes, etc. In addition, the keypad 18 typically includes special function keys such as a "call send" key for initiating or answering a call, and a "call end" key for ending or "hanging up" a call. Special function keys may also include menu navigation and select keys, for example, for navigating through a menu displayed on the display 16 to select different telephone functions, profiles, settings, etc, as is conventional. Special function keys may include audiovisual content playback keys to start, stop and pause playback, skip or repeat tracks, and so forth. Other keys associated with the mobile telephone may include a volume key, an audio mute key, an on/off power key, a web browser launch key, a camera key, etc. Keys or key-like functionality may also be embodied as a touch screen associated with the display 14.
The mobile telephone 10 includes call circuitry that enables the mobile telephone 10 to establish a call and/or exchange signals with a called/calling device, typically another mobile telephone or landline telephone. However, the called/calling device need not be another telephone, but may be some other device such as an Internet web server, content providing server, etc. Calls may take any suitable form. For example, the call could be a conventional call that is established over a cellular circuit-switched network or a voice over Internet Protocol (VoIP) call that is established over a packet-switched capability of a cellular network or over an alternative packet-switched network, such as WiFi, WiMax, etc. Another example includes a video enabled call that is established over a cellular or alternative network.
The mobile telephone 10 may be configured to transmit, receive and/or process data, such as text messages (e.g., colloquially referred to by some as "an SMS"), electronic mail messages, multimedia messages (e.g., colloquially referred to by some as "an MMS"), image files, video files, audio files, ring tones, streaming audio, streaming video, data feeds (including podcasts) and so forth. Processing such data may include storing the data in the memory 16, executing applications to allow user interaction with data, displaying video and/or image content associated with the data, outputting audio sounds associated with the data and so forth.
FIG. 2 represents a functional block diagram of the mobile telephone 10. For the sake of brevity, generally conventional features of the mobile telephone 10 will not be described in great detail herein. The mobile telephone 10 includes a primary control circuit 20 that is configured to carry out overall control of the functions and operations of the mobile telephone 10. The control circuit 20 may include a processing device 22, such as a CPU, microcontroller or microprocessor. The processing device 22 executes code stored in a memory (not shown) within the control circuit 20 and/or in a separate memory, such as memory 16, in order to carry out operation of the mobile telephone 10. The memory 16 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory or other suitable device.
In addition, the processing device 22 may execute code that implements the audiovisual contact list function 12. It will be apparent to a person having ordinary skill in the art of computer programming, and specifically in application programming for mobile telephones or other electronic devices, how to program a mobile telephone 10 to operate and carry out logical functions associated with the audiovisual contact list function 12. Accordingly, details as to specific programming code have been left out for the sake of brevity. Also, while the audiovisual contact list function 12 is executed by the processing device 22 in accordance with a preferred embodiment of the invention, such functionality could also be carried out via dedicated hardware, firmware, software, or combinations thereof, without departing from the scope of the invention.
Continuing to refer to FIGs. 1 and 2, the mobile telephone 10 includes an antenna 24 coupled to a radio circuit 26. The radio circuit 26 includes a radio frequency transmitter and receiver for transmitting and receiving signals via the antenna 24 as is conventional. The radio circuit 26 may be configured to operate in a mobile communications system and may be used to send and receive data and/or audiovisual content. Receiver types for interaction with a mobile radio network and/or broadcasting network include, but are not limited to, GSM, CDMA, WCDMA, GPRS, MBMS, WiFi, WiMax, DVB-H, ISDB-T, etc as well as advanced versions of these standards.
The mobile telephone 10 further includes a sound signal processing circuit 28 for processing audio signals transmitted by and received from the radio circuit 26. Coupled to the sound processing circuit 28 are a speaker 30 and a microphone 32 that enable a user to listen and speak via the mobile telephone 10 as is conventional. The radio circuit 26 and sound processing circuit 28 are each coupled to the control circuit 20 so as to carry out overall operation. Audio data may be passed from the control circuit 20 to the sound signal processing circuit 28 for playback to the user. The audio data may include, for example, audio data from an audio file stored by the memory 18 and retrieved by the control circuit 20, or received audio data such as in the form of streaming audio data from a mobile radio service. The sound processing circuit 28 may include any appropriate buffers, decoders, amplifiers and so forth.
The display 14 may be coupled to the control circuit 20 by a video processing circuit 34 that converts video data to a video signal used to drive the display 14. The video processing circuit 34 may include any appropriate buffers, decoders, video data processors and so forth. The video data may be generated by the control circuit 20, retrieved from a video file that is stored in the memory 16, derived from an incoming video data stream received by the radio circuit 28 or obtained by any other suitable method.
The mobile telephone 10 further includes one or more I/O interface(s) 36. The I/O interface(s) 36 may be in the form of typical mobile telephone I/O interfaces and may include one or more electrical connectors. As is typical, the I/O interface(s) 36 may be used to couple the mobile telephone 10 to a battery charger to charge a battery of a power supply unit (PSU) 38 within the mobile telephone 10. In addition, or in the alternative, the I/O interface(s) 36 may serve to connect the mobile telephone 10 to a headset assembly
(e.g., a personal handsfree (PHF) device) that has a wired interface with the mobile telephone 10. Further, the I/O interface(s) 36 may serve to connect the mobile telephone 10 to a personal computer or other device via a data cable for the exchange of data. The mobile telephone 10 may receive operating power via the I/O interface(s) 36 when connected to a vehicle power adapter or an electricity outlet power adapter. The mobile telephone 10 may also include a timer 40 for carrying out timing functions. Such functions may include timing the durations of calls, generating the content of time and date stamps, etc. The mobile telephone 10 may include a camera 42 for taking digital pictures and/or movies. Image and/or video files corresponding to the pictures and/or movies may be stored in the memory 16. The mobile telephone 10 also may include a position data receiver 44, such as a global positioning system (GPS) receiver, Galileo satellite system receiver or the like.
The mobile telephone 10 also may include a local wireless interface 46, such as an infrared transceiver and/or an RF adaptor (e.g., a Bluetooth adapter), for establishing communication with an accessory, another mobile radio terminal, a computer or another device. For example, the local wireless interface 46 may operatively couple the mobile telephone 10 to a headset assembly (e.g., a PHF device) in an embodiment where the headset assembly has a corresponding wireless interface.
With additional reference to FIG. 3, the mobile telephone 10 may be configured to operate as part of a communications system 48. The system 48- may include a communications network 50 having a server 52 (or servers) for managing calls placed by and destined to the mobile telephone 10, transmitting data to the mobile telephone 10 and carrying out any other support functions. The server 52 communicates with the mobile telephone 10 via a transmission medium. The transmission medium may be any appropriate device or assembly, including, for example, a communications tower (e.g., a cell tower), another mobile telephone, a wireless access point, a satellite, etc. Portions of the network may include wireless transmission pathways. The network 50 may support the communications activity of multiple mobile telephones 10 and other types of end user devices. As will be appreciated, the server 52 may be configured as a typical computer system used to carry out server functions and may include a processor configured to execute software containing logical instructions that embody the functions of the server 52.
With additional reference to FIG. 4, illustrated are logical operations to implement an exemplary method of coordinating audiovisual content with contact list information. The exemplary method may be carried out by executing an embodiment of the audiovisual contact list function 12, for example. Thus, the flow chart of FIG. 4 may be thought of as depicting steps of a method carried out by the mobile telephone 10. Although FIG. 4 shows a specific order of executing functional logic blocks, the order of execution of the blocks may be changed relative to the order shown. Also, two or more blocks shown in succession may be executed concurrently or with partial concurrence. Certain blocks also may be omitted. In addition, any number of commands, state variables, semaphores or messages may be added to the logical flow for purposes of enhanced utility, accounting, performance, measurement, troubleshooting, and the like. It is understood that all such variations are within the scope of the present invention.
The logical flow for the audiovisual contact list function 12 may begin in block 54 where the user carries out actions to take a photograph with the camera 42. The photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
Proceeding to block 56, the user may record an audio message using the mobile telephone 10. For instance, the audiovisual contact list function 12 may prompt the user to speak into the microphone 32 or the microphone of an operatively interfaced headset (not shown). In one embodiment and when the photograph of block 54 is of a person, the user may have the subject of the photograph input the audio message.
The audio message may be captured and stored by the memory 16 in any suitable file format. In most cases, it is believed that the audio message will relate to the subject matter of the photograph that was taken in block 54. For instance, if the photograph is of a person, the audio message may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
Thereafter, in block 58, the audio message is run through a speech recognition software engine. For instance, the speech recognition engine may convert the audio message to text using a speech-to-text conversion process. Alternatively, the speech recognition engine may attempt to recognize patterns in the audio message to identify a meaningful term (or terms) from the audio message by matching the audio signals to a function or value. While speech recognition software is undergoing continuous improvement, suitable speech recognition engines will be known to those of ordinary skill in the art. The speech recognition engine may form a part of the audiovisual contact list function 12 or may be implemented in a separate program that is executed by the mobile telephone 10. Since speech recognition processing may consume a considerable amount of processing capacity, the speech recognition engine may be resident in and executed by the server 52. In this embodiment, the audio message may be transmitted to the server 52 for processing and the results of the speech recognition may be returned to the mobile telephone 10.
Proceeding to block 60, the audiovisual contact list function 12 may determine if there is a match between the output of the speech recognition from block 58 and existing contact information. As will be understood, contact information may be stored in a contact list database. Such databases typically store the names of people, along with their address (e.g., home address and/or work address), telephone numbers and electronic mail addresses. Other information may be stored, such as notes and important dates (e.g., birthdays and anniversaries). The contact list database may be stored using the memory 16 and accessed using a contact list interface software application executed by the processing device 22.
In the embodiment where the audio message was converted to text, the text may be compared against the entries in the user's contact list for a matching string of characters. The search for a matching entry or entries may attempt to match text in one or more particular fields in the contact list database or all fields in the contact list database. Also, the engine used to identify matches may use variant spellings for the converted text and/or pronunciation-based search algorithms to match the text to contact list data. In the embodiment where the audio message was converted to a meaningful term (e.g., a value, a sound signal profile, etc.), the term may be compared against commensurate types of terms derived from the data contained in the contact list database. For instance, text-based data that is entered into a contact list may be converted to a term by running a conversion algorithm.
If a match is identified in block 60, the logical flow may proceed to block 62 where the photograph taken in block 54 is associated with the contact list entry that matches the converted audio message. Thereafter, in block 64, the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller. In addition to or instead of displaying the photograph in these and/or similar circumstances, the audio message may be audibly played back to the user.
If a match is not identified in block 60, the logical flow may proceed to block 66 where the user may be prompted to enter contact information that corresponds to the photograph and/or the audio message. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph.
Thereafter, the logical flow may proceed to block 64 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
With additional reference to FIG. 5, illustrated are logical operations to implement another exemplary method of coordinating audiovisual content with contact list information. The exemplary method may be carried out by executing an embodiment of the audiovisual contact list function 12, for example.
Thus, the flow chart of FIG. 5 may be thought of as depicting steps of a method carried out by the mobile telephone 10. Although FIG. 5 shows a specific order of executing functional logic blocks, the order of execution of the blocks may be changed relative to the order shown. Also, two or more blocks shown in succession may be executed concurrently or with partial concurrence. Certain blocks also may be omitted. In addition, any number of commands, state variables, semaphores or messages may be added to the logical flow for purposes of enhanced utility, accounting, performance, measurement, troubleshooting, and the like. It is understood that all such variations are within the scope of the present invention.
Beginning in block 68 the user may carry out actions to take a photograph with the camera 42. The photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
Proceeding to block 70, the user may enter text relating to the photograph. For instance, the audiovisual contact list function 12 may prompt the user to enter text by depressing buttons of the keypad 18. In most cases, it is believed that the entered text will relate to the subject matter of the photograph that was taken in block 68. For instance, if the photograph is of a person, the text may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
Thereafter, in block 72, the audiovisual contact list function 12 may determine if there is a match between the text entered in block 70 and existing contact information that has been stored in a contact list database. For instance, the text may be compared against the entries in the user's contact list for a matching string of characters. The search for a matching entry or entries may attempt to match text in one or more particular fields in the contact list database or all fields in the contact list database. Also, the engine used to identify matches may use variant spellings for the text and/or pronunciation-based search algorithms to match the text to contact list data.
If a match is identified in block 72, the logical flow may proceed to block 74 where the photograph taken in block 68 is associated with the contact list entry that matches the text entered in block 70. Thereafter, in block 76, the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller.
If a match is not identified in block 72, the logical flow may proceed to block 78 where the user may be prompted to enter contact information that corresponds to the photograph and/or the text entered in block 70. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 76 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
With additional reference to FIG. 6, illustrated are logical operations to implement still another exemplary method of coordinating audiovisual content with contact list information. The exemplary method may be carried out by executing an embodiment of the audiovisual contact list function 12, for example. Thus, the flow chart of FIG. 6 may be thought of as depicting steps of a method carried out by the mobile telephone 10. Although FIG. 6 shows a specific order of executing functional logic blocks, the order of execution of the blocks may be changed relative to the order shown. Also, two or more blocks shown in succession may be executed concurrently or with partial concurrence. Certain blocks also may be omitted. In addition, any number of commands, state variables, semaphores or messages may be added to the logical flow for purposes of enhanced utility, accounting, performance, measurement, troubleshooting, and the like.
It is understood that all such variations are within the scope of the present invention.
In block 80, the user may carry out actions to take a photograph with the camera 42. The photograph may be stored by the memory 16 in any suitable file format, such as JPEG. In most cases, it is believed that the photograph will be of a person, but the photograph could include multiple people or the photograph could be of an object or landscape. In other embodiments, the photograph may be downloaded or transferred to the mobile telephone 10 instead of being generated by the camera 42. This embodiment may have particular application in situations where the mobile telephone 10 does not have a built-in camera.
Proceeding to block 82, the user may record an audio message using the mobile telephone 10. For instance, the audiovisual contact list function 12 may prompt the user to speak into the microphone 32 or the microphone of an operatively interfaced headset (not shown). In one embodiment and when the photograph of block 80 is of a person, the user may have the subject of the photograph input the audio message.
The audio message may be captured and stored by the memory 16 in any suitable file format. In most cases, it is believed that the audio message will relate to the subject matter of the photograph that was taken in block 82. For instance, if the photograph is of a person, the audio message may be the name of the person. As another example, if the photograph is of a commercial establishment (e.g., a store or building), the audio message may be the name or address of the corresponding location.
At some other time, such as before or after blocks 80 and 82 are carried out, the user may enter contact information a contact list database to establish a contact list entry in block 84. For example, entered may be the name a person, the business and/or residence address of the person, a telephone number or numbers for the person, an electronic mail address or addresses for the person and so forth.
Proceeding to block 86, the user may record a second audio message using the mobile telephone 10. In most cases, it is believed that the second audio message will relate to the contact list entry that was entered in block 84. For instance, the second audio message may be the name of the person for which contact information was entered. It will be appreciated that multiple contact list entries may be entered and an audio message for each contact list entry may be recorded.
In block 88, a comparison may be made between the audio message recorded in conjunction with the photograph of block 82 and each of the audio messages recorded in conjunction with establishment of the contact list entries of block 84. The comparison may be made by directly comparing the recordings or the sound characteristics of the recordings. In other embodiments, each of the recordings may be processed using a speech recognition software engine to convert the recordings to text or meaningful term, and the output of the speech recognition engine may serve as the basis of the comparison.
If the recording of block 82 contains sufficiently similar content to one of the recordings of block 86, the logic may find that a match exists between the two recordings. If a match is identified in block 88, the logical flow may proceed to block 90 where the photograph taken in block 80 is associated with the contact list entry having the audio message that matched the audio message recorded in block 82.
Thereafter, in block 92, the photograph may be displayed on the display 14 at times that may provide the user with a visual cue for the information from the associated contact list entry. This may assist the user recall the identity of a person corresponding to the associated contact list entry or a location corresponding to the associated contact list entry in a variety of circumstances. For example, if the user were to browse his or her contact list entries, the photograph may be displayed when the associated contact list entry is highlighted from a list of entries, or is selected for viewing or dialing. In another situation, if the mobile telephone 10 were to receive a call from a telephone number matching the contact list entry associated with the photograph, the photograph may be displayed to assist the user identify the caller. In addition to or instead of displaying the photograph in these and similar circumstances, the corresponding audio message of either of blocks 82 or 86 may be audibly played back to the user.
If a match is not identified in block 88, the logical flow may proceed to block 94 where the user may be prompted to enter contact information that corresponds to the photograph and/or the audio message of block 82. In this manner, a content list entry may be generated and associated with the photograph. Alternatively, the user may be prompted to manually identify an existing contact list entry for association with the photograph. Thereafter, the logical flow may proceed to block 92 (described above) so that the photograph may be displayed in connection with activity relating to the associated contact list entry.
The foregoing operations depict exemplary manners in which a method of coordinating audiovisual content with contact list information that may be implemented. An example application of the method includes taking a photograph of an individual and recording an audio message containing the name of the individual. Once an association between the photograph and a contract list entry has been made using the content of the audio message to match the photograph with the contact list entry, the photograph may be displayed in conjunction with the contract list entry. This may aid certain users who have difficultly "matching names with faces."
In a variation of the method described above, instead of associating a photograph with a contact list entry, the method may be used to associate other types of audiovisual content with a contact list entry. Other types of audiovisual content that may be associated include, but are not limited to, video clips, ring tones, songs, and so on. Accordingly, the term audiovisual content is used broadly to include photographs, image files, video files, audio files, text, and any other content that may be associated with a contact list entry consistent with the techniques described herein. Although the invention has been shown and described with respect to certain preferred embodiments, it is understood that equivalents and modifications will occur to others skilled in the art upon the reading and understanding of the specification. The present invention includes all such equivalents and modifications, and is limited only by the scope of the following claims.

Claims

CLAIMSWhat is claimed is:
1. A method of coordinating audiovisual content with contact list information, comprising: recording an audio message in relationship with the audiovisual content; matching the audio message with a contact list entry from a plurality of contact list entries; and associating the audiovisual content with the matched contact list entry.
2. The method of claim 1, wherein the audiovisual content includes a photograph and the method further comprises displaying the photograph with or instead of a display of the contact list entry.
3. The method of claim 1, wherein the audiovisual content includes a photograph and the contact list is maintained by a mobile radio terminal capable of receiving calls, and the method further comprises displaying the photograph when a call is received from a telephone number that forms part of the associated contact list entry.
4. The method of any of claims 2-3, wherein the contact list is maintained by a mobile radio terminal and the photograph is taken with a camera of the mobile radio terminal.
5. The method of any of claims 2-3, wherein the contact list is maintained by a mobile radio terminal and the photograph is transferred to the mobile radio terminal.
6. The method of any of claims 1-5, further comprising conducting speech recognition on the audio message to generate criteria from the audio message for use in the matching the audio message to the contact list entry.
7. The method of claim 6, wherein the speech recognition converts the audio message to text.
8. The method of any of claims 1-7, wherein text from a field of the contact list entry is used in the matching of the audio message to the contact list entry or another recorded audio message that is associated with the contact list entry is used in the matching of the audio message to the contact list entry.
9. A program (12) that coordinates audiovisual content with contact list information and is embodied on a machine readable medium, the program comprising executable logic to: record an audio message in relationship with the audiovisual content; match the audio message with a contact list entry from a plurality of contact list entries; and associate the audiovisual content with the matched contact list entry.
10. A mobile radio terminal (10), comprising: a radio circuit (26) for establishing calls; and a control circuit (20) that carries out logical operations to coordinate audiovisual content with contact list information including: record an audio message in relationship with the audiovisual content; match the audio message with a contact list entry from a plurality of contact list entries; and associate the audiovisual content with the matched contact list entry.
PCT/IB2007/000471 2006-08-28 2007-02-27 System and method for coordinating audiovisual content with contact list information WO2008026024A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN200780031878XA CN101513023B (en) 2006-08-28 2007-02-27 System and method for coordinating audiovisual content with contact list information
EP07705655.4A EP2057826B1 (en) 2006-08-28 2007-02-27 System and method for coordinating audiovisual content with contact list information

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US82369806P 2006-08-28 2006-08-28
US60/823,698 2006-08-28
US11/469,610 US20080063156A1 (en) 2006-08-28 2006-09-01 System and method for coordinating audiovisual content with contact list information
US11/469,610 2006-09-01

Publications (1)

Publication Number Publication Date
WO2008026024A1 true WO2008026024A1 (en) 2008-03-06

Family

ID=38042549

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2007/000471 WO2008026024A1 (en) 2006-08-28 2007-02-27 System and method for coordinating audiovisual content with contact list information

Country Status (4)

Country Link
US (1) US20080063156A1 (en)
EP (1) EP2057826B1 (en)
CN (1) CN101513023B (en)
WO (1) WO2008026024A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8548449B2 (en) 2010-05-20 2013-10-01 Microsoft Corporation Mobile contact notes
CN104580712A (en) * 2014-12-26 2015-04-29 北京奇虎科技有限公司 Message processing method and device

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006005979A1 (en) * 2004-06-14 2006-01-19 Nokia Corporation Automated application-selective processing of information obtained through wireless data communication links
US8977249B2 (en) * 2008-06-11 2015-03-10 Cisco Technology, Inc. Customized ring tones for mobile phones based on context information
KR101604692B1 (en) * 2009-06-30 2016-03-18 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN102118886A (en) * 2010-01-04 2011-07-06 中国移动通信集团公司 Recognition method of voice information and equipment
CN101931701A (en) * 2010-08-25 2010-12-29 宇龙计算机通信科技(深圳)有限公司 Method, system and mobile terminal for prompting contact information in communication process
US9184779B2 (en) * 2011-07-22 2015-11-10 Texas Instruments Incorporated Dynamic medium switch in co-located PLC and RF networks
US8755743B2 (en) * 2011-07-29 2014-06-17 Bose Corporation Earpiece messaging
CN102426015A (en) * 2011-09-06 2012-04-25 深圳市凯立德科技股份有限公司 Search method of navigation system interest points, and position service terminal
KR101331122B1 (en) * 2013-03-15 2013-11-19 주식회사 에이디자인 Method for connecting call in mbile device
CN104202458A (en) * 2014-09-02 2014-12-10 三星电子（中国）研发中心 Method and intelligent terminal for automatically storing contact information
CN106412201A (en) * 2016-11-01 2017-02-15 宇龙计算机通信科技(深圳)有限公司 Method for searching contact person and device thereof

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040207722A1 (en) * 2003-04-18 2004-10-21 Casio Computer Co., Ltd. Imaging apparatus with communication function, image data storing method and computer program
US20050010568A1 (en) * 2002-11-29 2005-01-13 Casio Computer Co., Ltd. Portable wireless communication terminal, picked-up image editing apparatus, and picked-up image editing method
GB2409365A (en) * 2003-12-19 2005-06-22 Nokia Corp Handling images depending on received voice tags
US6931263B1 (en) * 2001-03-14 2005-08-16 Matsushita Mobile Communications Development Corporation Of U.S.A. Voice activated text strings for electronic devices
US20050192808A1 (en) 2004-02-26 2005-09-01 Sharp Laboratories Of America, Inc. Use of speech recognition for identification and classification of images in a camera-equipped mobile handset
EP1677497A1 (en) * 2004-12-30 2006-07-05 LG Electronics Inc. Mobile terminal and method for associating photos with telephone numbers in a mobile terminal
GB2425441A (en) * 2005-04-18 2006-10-25 Big Ideas Product Dev Ltd Customised visual and audible alerts from a mobile phone

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050153740A1 (en) * 2004-01-13 2005-07-14 Binzel Charles P. Linked storage for enhanced phone book entries in mobile communications devices and methods
US7721301B2 (en) * 2005-03-31 2010-05-18 Microsoft Corporation Processing files from a mobile device using voice commands
CA2618623C (en) * 2005-08-09 2015-01-06 Mobilevoicecontrol, Inc. Control center for a voice controlled wireless communication device system
CA2619864A1 (en) * 2006-07-14 2008-01-17 Research In Motion Limited Contact image selection and association method and system for mobile device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6931263B1 (en) * 2001-03-14 2005-08-16 Matsushita Mobile Communications Development Corporation Of U.S.A. Voice activated text strings for electronic devices
US20050010568A1 (en) * 2002-11-29 2005-01-13 Casio Computer Co., Ltd. Portable wireless communication terminal, picked-up image editing apparatus, and picked-up image editing method
US20040207722A1 (en) * 2003-04-18 2004-10-21 Casio Computer Co., Ltd. Imaging apparatus with communication function, image data storing method and computer program
GB2409365A (en) * 2003-12-19 2005-06-22 Nokia Corp Handling images depending on received voice tags
US20050192808A1 (en) 2004-02-26 2005-09-01 Sharp Laboratories Of America, Inc. Use of speech recognition for identification and classification of images in a camera-equipped mobile handset
EP1677497A1 (en) * 2004-12-30 2006-07-05 LG Electronics Inc. Mobile terminal and method for associating photos with telephone numbers in a mobile terminal
GB2425441A (en) * 2005-04-18 2006-10-25 Big Ideas Product Dev Ltd Customised visual and audible alerts from a mobile phone

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8548449B2 (en) 2010-05-20 2013-10-01 Microsoft Corporation Mobile contact notes
CN104580712A (en) * 2014-12-26 2015-04-29 北京奇虎科技有限公司 Message processing method and device

Also Published As

Publication number Publication date
EP2057826A1 (en) 2009-05-13
CN101513023B (en) 2012-07-04
US20080063156A1 (en) 2008-03-13
EP2057826B1 (en) 2014-08-20
CN101513023A (en) 2009-08-19

Similar Documents

Publication Publication Date Title
EP2057826B1 (en) System and method for coordinating audiovisual content with contact list information
EP2126813B1 (en) Portable communication device and method for media-enhanced messaging
US20080102819A1 (en) System and method for verifying contact data
US8239480B2 (en) Methods of searching using captured portions of digital audio content and additional information separate therefrom and related systems and computer program products
US8676705B1 (en) Communication device
US7751773B2 (en) Portable communication device having a media time controller
US8170186B2 (en) Electronic device with motion controlled functions
US20100067708A1 (en) System and method for automatically updating presence information based on sound detection
US20080086539A1 (en) System and method for searching based on audio search criteria
US8059897B2 (en) Method for automatically performing an image processing function on an electronic device
US20080250066A1 (en) Apparatus and method for adding contact information into a contact list
US20080109846A1 (en) System and method for audiovisual content playback
EP2011322B1 (en) Method and system for personalizing a call set-up period
EP2619967B1 (en) System and method of enhancing messages
EP2378440A1 (en) System and method for location tracking using audio input
US9532190B2 (en) Embedded advertising in MMS stationery
US20080188204A1 (en) System and method for processing a voicemail message
US20090100494A1 (en) System and method for controlling playlist entry selection
CN106777204A (en) The processing method of image data, device and mobile terminal

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200780031878.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07705655

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2007705655

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU