WO2006028181A1 - 通信端末とその通信方法 - Google Patents
通信端末とその通信方法 Download PDFInfo
- Publication number
- WO2006028181A1 WO2006028181A1 PCT/JP2005/016534 JP2005016534W WO2006028181A1 WO 2006028181 A1 WO2006028181 A1 WO 2006028181A1 JP 2005016534 W JP2005016534 W JP 2005016534W WO 2006028181 A1 WO2006028181 A1 WO 2006028181A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- communication
- communication terminal
- communication partner
- search
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Definitions
- the present invention relates to, for example, a communication terminal that communicates using a video telephone and a communication method thereof
- Patent Document 1 When communicating using a videophone, a co-viewing screen telephone system has been proposed as a support device for making conversations more enjoyable (for example, Patent Document 1).
- the information that each terminal has is different from each other, so before starting the call, the information stored in the database held by each terminal is unified into the same state, and In the state, it is a support device that allows the conversation to progress smoothly by searching information in the database as needed and displaying the data obtained by the search on each terminal.
- Patent Document 1 Japanese Patent Application Laid-Open No. 3-49385
- the object of the present invention is to support activation of communication with a communication partner more easily, simplify the operation, and make it easy for elderly people and the like who are not used to the operation of information devices. It is an object of the present invention to provide a communication terminal and communication method that can communicate while displaying various video information and can promote warm communication. Means to solve the problem
- a communication terminal searches stored information stored in a memory based on key information acquisition means for acquiring key information from a communication party and the key information acquired from the communication party.
- a configuration comprising: search means for acquiring information related to key information; and information display means for displaying the information obtained as a result of the search by the search means.
- a communication terminal searches stored information stored in a memory based on key information acquisition means for acquiring key information from a communication party and the key information acquired from the communication party.
- a configuration comprising: search means for acquiring information related to key information; and information presentation means for transmitting the information obtained as a result of the search by the search means to the communication partner.
- the communication method of the present invention searches for stored information stored in a memory based on a key information acquisition step of acquiring communication partner power key information, and the key information acquired from the communication partner, and the key information And the information display step of displaying the information obtained as a result of the search in the search step.
- the communication method searches for stored information stored in a memory based on a key information acquisition step of acquiring communication partner power key information, and the key information acquired from the communication partner, and the key information , And an information presenting step of transmitting the information obtained as a result of the search by the search step to the communication partner.
- the present invention it is possible to support more active communication with the other party, simplify the operation, and make it easy for elderly people and the like who are not used to the operation of information equipment. You can talk while displaying various video information, and you can promote warm communication.
- FIG. 1 is a block diagram showing a configuration of a communication terminal according to Embodiment 1 of the present invention.
- FIG. 2 Construction diagram of the communication system according to the first embodiment of the present invention
- FIG. 3 A sequence diagram showing a method of acquiring communication partner information according to the first embodiment of the present invention
- FIG. 4 A flow diagram showing a method of storing received image information according to the first embodiment of the present invention
- FIG. 5 A flow chart showing a method of responding to a request for communication partner information according to Embodiment 1 of the present invention.
- FIG. 6 shows a method for searching stored information based on communication partner information according to Embodiment 1 of the present invention.
- FIG. 7 A diagram showing a display example of reproduction information according to Embodiment 1 of the present invention.
- FIG. 8 A block diagram showing another configuration of the communication terminal according to Embodiment 1 of the present invention
- FIG. 9 A diagram showing another display example of output information according to Embodiment 1 of the present invention.
- FIG. 10 A diagram showing another display example of output information according to Embodiment 1 of the present invention.
- FIG. 11 A flowchart for explaining extraction of stored information based on sound recognition according to Embodiment 3 of the present invention
- FIG. 12 A sequence diagram showing a communication method according to Embodiment 4 of the present invention
- FIG. 13 A block diagram showing a configuration of a communication terminal according to Embodiment 4 of the present invention
- FIG. 14 A flowchart showing a method of storing stored information based on image recognition according to the fifth embodiment of the present invention
- FIG. 15 A flow chart showing a search method of stored information based on speech recognition according to the fifth embodiment of the present invention
- the communication system according to the embodiment of the present invention is, as shown in FIG.
- the communication terminals (201 to 203) of the present invention are, for example, mobile phones.
- Communication terminal (201 to 203) are, for example, mobile phones.
- Communication terminal 100 of the present invention includes communication unit 101, information storage processing unit 102, information storage unit 103, communication partner information acquisition unit 104, and storage information search unit 105. , Information reproduction processing unit 106, and an output unit 107.
- Communication unit 101 performs call connection for incoming Z-call, and transmission / reception of data such as video information, sound information, text-based information, etc., when performing communication such as videophone.
- Text-based information is arbitrary data information, including data to be displayed and control information.
- the information storage processing unit 102 performs processing related to storage of information such as storage processing of reproduced images of videophones, storage processing of sent and received e-mails, storage processing of user information in an address book, and the like.
- the information storage unit 103 stores storage information, which is information to be stored and processed by the information storage processing unit 102. Specifically, the information storage unit 103 stores images reproduced on a videophone, as well as information acquired via mail or the web, received content received via a network, address of friend's acquaintance, telephone number Various information such as address information including etc. are stored in advance.
- the information storage unit 103 includes a memory built in each of the communication terminals 201 to 203, specifically, an electrically erasable non-volatile memory (EEPROM), a volatile memory capable of reading and writing (SRAM or DRAM Or magnetic memory (Hard Disk) can be used.
- the information storage unit 103 may use an external storage device attachable to and detachable from the communication terminals 201 to 203, such as a card type memory or a stick type memory.
- a storage device of a server of a network established by a wireless network or a wired network can be used as the information storage unit 103.
- the communication partner information acquisition unit 104 is key information acquisition means of the present invention, and acquires information on the communication partner during communication as well as the own terminal or the other terminal power as search key information.
- the key information to be obtained is information uniquely identifying the other party in the videophone call, personal information such as preference information, or environment information such as position information or time information.
- the stored information search unit 105 searches the information stored in the information storage unit 103 using the information related to the communication partner acquired by the communication partner information acquisition unit 104 as search key information (information for search). To extract information about the relationship with the other party in communication (target information).
- the information reproduction processing unit 106 causes the output unit 107 to reproduce the to-be-searched information having a deep relationship with the communication partner extracted by the stored information search unit 105.
- the output unit 107 is configured of a display or a speaker for displaying an image.
- the information reproduction processing unit 106 causes the output unit 107 to display the extracted image information on a display, and reproduces the extracted audio information using a speaker.
- the communication terminals 201 to 203 respectively have the communication unit 101, the information storage processing unit 102, the information storage unit 103, the communication partner information acquisition unit 104, the storage information search unit 105, and the information reproduction processing shown in FIG. A unit 106 and an output unit 107 are provided.
- the communication terminal 201 and the communication terminal 202 communicate, the communication terminal 201 acquires person information of the communication partner from the communication terminal 220, and the communication terminal 201 uses the acquired person information as a key information.
- storage information stored in the information storage unit 103 of the communication terminal 201 will be described as an example of searching and extracting.
- Communication terminal 201 issues a videophone connection request to communication terminal 202 (step S301).
- Communication terminal 202 responds to the connection request for the videophone call, and sends a permission response (step S302).
- 3G mobile phone standard 3G using data multiplexing of ITU-T Recommendation H. 223 which is a standard system for multiplexing multimedia information is used for videophone communication.
- the communication terminal establishes a data transmission channel capable of transmitting arbitrary data in addition to a video channel for transmitting video information and an audio channel for transmitting sound information by the 3G-324M protocol.
- each other's communication terminals it is possible for each other's communication terminals to display each other's video and have a conversation with each other.
- the communication terminal 201 stores the image information received from the communication terminal 202 during communication between the communication terminal 201 and the communication terminal 202 (step S 303), the communication terminal 201 sends the communication terminal 202 to the communication terminal 202 A request for acquiring personal information on the other party of communication is made (step S304).
- Communication terminal 202 extracts the target personal information in response to the personal information acquisition request from communication terminal 201, and transmits the target personal information to communication terminal 201 (step S305).
- the communication terminal 201 the image information of the communication partner and the personal information regarding the communication partner A process flow of associating and storing information (attribute information) will be described with reference to FIG.
- the communication terminal 201 and the communication terminal 202 communicate, and the communication terminal 201 receives image information and acquires information (person information) on the communication terminal 202 which is the other party of communication, and relates to the communication terminal 202 acquired. It shows a case where the received image information and the attribute information are associated and stored as the attribute information.
- Communication terminal 201 displays an image of the other party of communication during a videophone call (step S 401).
- step S 402 When communication terminal 201 detects an instruction to save the image information of the communication partner by the user's key input operation of communication terminal 201 or the like (step S 402), a communication terminal 202 as the communication partner receives a person An information acquisition request is made (step S304 in FIG. 3), and personal information of the communication partner is received from the communication terminal 202 (step S403).
- the information storage processing unit 102 of the communication terminal 201 associates the received image information of the other party of communication with the personal information including the telephone number which is the information uniquely identifying the other party of communication acquired in step S403.
- the information is stored as storage information in the information storage unit 103 of the communication terminal 201 (step S404).
- the person information is used as key information to search for and extract the stored information stored in the information storage unit 103 of the communication terminal 201. , You can search quickly.
- Communication terminal 202 displays an image of the other party during videophone communication with communication terminal 201 (step S 501).
- the communication terminal 202 receives, from the communication terminal 201, a request for acquiring personal information, which is information related to the other party of communication, via the data transmission channel (step S502).
- the requested personal information is personal information that uniquely identifies the user of the communication terminal 202.
- communication terminal 202 When communication terminal 202 receives a request for obtaining personal information, it follows the request, refers to storage information stored in information storage unit 103 of communication terminal 202, and uses communication terminal 202. After extracting the personal information of the person, that is, the video telephone number (step S503), the communication terminal 202 transmits the personal information to be obtained to the communication terminal 201 through the data transmission channel. Do (step S 504).
- Communication terminal 201 establishes videophone communication with communication terminal 202, and is in communication (step S601).
- Communication terminal 201 requests personal information, which is communication partner information, to communication terminal 202, which is the communication partner, via the data transmission channel (step S602).
- the personal information of (user B) is acquired (step S603).
- the communication terminal 201 acquires, as the person information of the communication partner, identification information for uniquely identifying the communication partner.
- the identification information uniquely identifying the communication partner is a telephone number.
- step 603 when personal information is acquired, the stored information search unit 105 obtains the telephone number which is the personal information of the communication partner, which is information uniquely identifying the communication partner obtained by the communication partner information acquisition unit 104. Storage information stored in the information storage unit 103 is automatically searched as search key information (step S 604).
- the information storage unit 103 stores image information of a person in advance, and further stores together with the image information, person information related to the image information as attribute information. Therefore, the stored information search unit 105 uses the telephone number uniquely identifying the user B who is the communication partner as search key information, and the stored information power in the information storage unit 103 also relates to the user B (information related to the key information Information) can be extracted.
- the information reproduction processing unit 106 causes the output unit 107 to automatically display the information related to the communication partner extracted (searched information) (step S 605).
- FIG. 7 shows an example in which the image information displayed on the communication terminal 201 and the data extracted by the search are displayed.
- the video 701 of the other party in communication via the video channel is displayed in the upper part of the screen, and the information related to the other party is displayed in the lower part (search Image information (to-be-searched information) 702 associated with the other party of communication, which is information extracted based on (information) is displayed.
- communication terminal 201 searches for and displays stored information in communication terminal 201 using, as key information, personal information acquired from communication terminal 202 which is the other party of communication. Therefore, by automatically displaying the information that the communication partner is interested in, it is possible to help activate the communication more easily, simplify the operation, and operate the information device. Even older people who are not familiar with it can easily make calls while displaying various video information and promote warm communication. That is, according to the first embodiment, the storage information in the information storage unit 103 is automatically searched based on the key information related to the communication partner, so information related to the communication partner can be obtained without complicated operations.
- the reception information including the image information received from the communication party and the communication party information such as the personal information are associated with each other and stored, so that the reception information is referred to with reference to the communication party information. Even if the amount of information to be searched is large, it is possible to easily extract the intended information.
- the information related to the communication partner to be acquired is the personal information uniquely identifying the communication partner, but other information such as preference information may be included in the personal information.
- the search may be performed without being limited to the information related to the communication partner. For example, it may be configured to search for information related to an artist using favorite artist information as a search condition.
- the personal information can be retrieved when searching for stored information. By using it, it is possible to narrow down the information to be searched.
- identification information for uniquely identifying a communication partner is not limited to a telephone number. It may be configured to use a user identifier assigned based on a pre-arranged rule. In addition, a user name or e-mail address information registered in address information may be used.
- the communication terminal 201 may be configured to request information related to the environment, instead of the communication partner information request step S304 in FIG.
- Information related to the environment refers to information related to the environmental condition in which the communication terminal 202 which is the other party in communication is placed. For example, information related to a place such as latitude Z longitude information or a time such as the current time It is related information.
- the communication terminal 202 when the communication terminal 201 requests position information as information related to a place, the communication terminal 202 acquires position information using a position measurement function of a GPS function (not shown). The communication terminal 202 transmits the acquired position information to the communication terminal 201 via the data transmission channel.
- the communication terminal 201 when storing the image information of the communication partner, can record the position information of the communication terminal 202 which is the communication partner terminal as attribute information.
- the communication terminal 201 can extract relevant information based on the position information at the time of the later retrieval.
- the position measurement function is not limited to the GPS function, but any other method may be used as long as good position information can be obtained. For example, location information may be acquired from a cellular network.
- information related to a place it may be information regarding a good place without having to be latitude Z longitude information. For example, zip code, address information, area information, landmark information, etc. may be used. Also, based on the obtained latitude Z longitude information, it may be converted to information related to another type of place. For example, it may be converted into area information and landmark information based on latitude Z longitude information. The conversion to information on another type of place may be performed on the side requesting the information on the place, or may be performed on the side requested. In addition, the requester may designate which type of location information is good, and may be configured to request location information.
- the location in the specified format The communication terminal for which the request information is requested converts it to the information related to the appropriate place and responds.
- the information on the environment to acquire the communication partner power is not limited to the information on the place, and may be information on other environments. That is, time information of the communication party may be acquired as the information related to the environment, and the acquired time information may be stored in association with the received image information. In this case, in the situation where there is a time difference between the communication partner and the own terminal, it is possible to save the information reflecting the time in the partner environment.
- the technical meaning of "relating received information including received image information to communication partner information such as personal information" is that there is a one-to-one relationship between a certain person information (attribute information) and its image information. If there is a certain person information (attribute information) and its image information have a one-to-n relationship, and if certain person information (attribute information) is extracted, the extracted person information (attribute information) This means that image information corresponding to one-to-one or image information corresponding to one-to-n with extracted person information (attribute information) is extracted.
- step S602 and step S603 the process of acquiring communication partner information (step S602 and step S603) will be described in more detail.
- the communication partner information acquisition process it is possible to acquire arbitrary information such as person information of the communication partner and environment information in the communication partner information acquisition side, but the acquisition request side (communication terminal 201) Describes how to specify the requested information.
- communication terminal 201 is a method of requesting acquisition of communication partner information determined in advance, and in this case, as an example, information uniquely identifying the communication partner is used as an example. Request the telephone number of the other party's terminal.
- the request information may be selected using a list menu or the like.
- Communication terminal 800 shown in FIG. 8 is provided with key information selection unit 808 in order to select request information.
- a target (a part of the image) with a pointing device such as a cursor with respect to the image of the communication partner displayed on the display . It is a method of requesting the information to be the object. That is, when a person image is designated by a cursor, person information is requested, and when a background is designated, environment information such as position information is requested.
- communication terminal 201 requests communication partner information and receives communication partner information as a response
- communication terminal 202 notifies communication partner information even without making a request. You may configure it to
- the caller ID notification obtained in the communication connection process may be used as the communication partner information.
- the communication terminal on the calling side may be configured to search the stored information stored in the information storage unit 103 of the communication terminal on the calling side, using the transmitted telephone number as key information.
- the communication terminal is configured to refer to and use additional personal information related to the communication partner according to the user information associated with the information uniquely identifying the communication partner stored in information storage section 103. Also good.
- the personal information (personal information) of the other party of communication includes information such as date of birth, sex, marriage calendar, job type, present address, taste, taste etc., and these are used as search key information (search condition) be able to.
- psychographic information such as hobbies and preferences
- demographic information such as age and family structure
- Embodiment 1 shows an example in which the other party of communication is uniquely identified using the telephone number as the personal information, the information uniquely identifying the other party of communication is good even if it is not the telephone number. You may use the user identifier given based on the rule decided beforehand. In addition, user names and e-mail address information registered in the address information may be used.
- communication terminal 201 is the communication terminal 2.
- Communication terminal 202 requested for position information obtains position information by position measurement function such as GPS function.
- step S 305 communication terminal 202 transmits position information to communication terminal 201.
- communication terminal 201 obtains position information of communication terminal 202 which is the communication partner.
- Communication terminal 201 searches the storage information of communication terminal 201 using the acquired position information of the communication partner as search key information, and based on this search, communication terminal 201 relates to the position information of the communication partner. Preferentially extract stored information and present it to the user.
- stored information may be searched using information that uniquely identifies a communication partner, and narrowing-down may be performed using position information that is environment information.
- location information may be obtained by a cellular network.
- the side requesting the position information may or may be converted, and the position information may be converted on the side requested.
- sequential switching display at a certain time interval or simultaneous display of a plurality of pieces of information may be performed. For example, display as shown in Figs.
- FIG. 9, 10 This is a code 901, and it is an image of a hand during communication, and codes 902, 100.
- the user can display a plurality of pieces of information by a method with a small display load such as thumbnails or a small display area. Even if it is selectable, it is good.
- the most relevant frame or scene may be displayed based on the associated attribute information.
- the telephone number is used as information uniquely identifying the user who uses the communication terminal.
- a name or a user identifier may be separately given. good. In this case, it is possible to cope with users having multiple telephone numbers.
- Embodiment 1 has a system configuration via a base station and a communication network, but in a form in which the communication terminals of each other directly communicate using a local communication interface. It is good.
- time information which is environmental information is used as key information for searching.
- time information is used as key information (search condition) for searching, for example, if the communication date and time is February 16th, information related to the past February 16th is preferentially searched.
- the information storage unit 103 of the communication terminal 201 stores address information and schedule information.
- Communication partner information acquisition section 104 of communication terminal 201 acquires information for uniquely identifying user B who is the communication partner.
- the user B is selected based on the address information to make a videophone connection. Therefore, information uniquely characterizing the communication partner is obtained from the address information. That is, the user B who is the other party of communication is uniquely identified using the telephone number obtained from the address information.
- the stored information to be searched is important information related to today's date, for example, the birth date of the communication partner.
- information such as having acted with a communication partner is stored on the date (February 16) as past information as schedule information, it is possible to present information to that effect.
- information related to the place where the user acted is stored in the schedule information, it is possible to present information to that effect by performing a search based on the location information of the communication partner.
- there is a plan with the user B as schedule of today it may be displayed in the schedule information to be stored.
- communication partner power time information is acquired, and the acquired time information is effective as a search key information for communication partners having a time difference. For example, if the current time concerning the communication terminal of the communication partner is 21:00 and indicates a time zone of night, priority is given to data on the night, that is, information on time on the communication partner is given priority. Search for.
- communication terminal 201 searches for and displays stored information in communication terminal 201 using, as key information, environment information acquired from communication terminal 202 which is the other party of communication. Therefore, by automatically displaying the information that the communication partner is interested in, it is possible to help activate the communication more easily, simplify the operation, and operate the information device. Even older people who are not familiar with it can easily make calls while displaying various video information and promote warm communication.
- time information, time information, day of the week information, month information, time information determined in advance, and time information are acceptable even if information related to time other than this is used. It may be information related to time such as information.
- the information to be searched may be mail information transmitted / received in the past. Yes.
- mail information or the like sent from a person in communication is retrieved.
- the third embodiment is a communication terminal in which information related to the other party of communication is obtained by recognizing information to be received by the other party of communication, and the recognition information is used as search key information.
- the information storage unit 103 of the communication terminal 201 stores image information and feature information of a person related to the image information.
- the feature information of the person includes feature information related to voice
- the communication terminal 202 sends the key information to the communication terminal 201 in response to the acquisition request of the key information of the communication terminal 201. It is done.
- Communication terminal 201 requests connection to communication terminal 202 by videophone and receives an acceptance response from communication terminal 202, according to H. 223 multiplexing using 3G-324M protocol , Make a videophone communication (step S 1101).
- the video is transmitted and received using the video channel, and the video of the other party is displayed by the output unit 107 (step S 1102). Also, talk over the audio channel.
- the communication partner information acquisition unit 104 of the communication terminal 201 extracts the speech information of the partner (step S 1103), and further, the communication partner information acquisition unit 1.
- step S 1104 analyzes the extracted other party's voice information, and uniquely identifies the other party of communication by referring to the voice database storing the features of the voice stored in the information storage unit 103 (step S 1104) ).
- the stored information search unit 105 of the communication terminal 201 searches stored information stored in the information storage unit 103 based on the identified communication partner information, and extracts information related to the user B who is the communication partner (see FIG. Step S1105).
- the information reproduction processing unit 106 of the communication terminal 201 displays, via the output unit 107, image information which is information related to the extracted user B (step S1106).
- communication terminal 201 is a communication terminal that is a communication partner. Since the stored information in the communication terminal 201 is searched and displayed by using the voice information acquired from the 202 as key information, the communication information can be displayed more automatically by displaying the information that the communication partner is interested in. While being able to support activation and simplifying the operation, even elderly people who are not familiar with the operation of information devices can easily communicate while displaying various video information, and warm communication is possible. It can be promoted.
- a user interface may be provided to control the timing of speech recognition.
- a software key or a Z hardware key is provided, and speech recognition is performed with a predetermined key press as a cue.
- timing of performing speech recognition may be performed at any time predetermined during communication, at any time.
- speech recognition it may be used to obtain a keyword for searching, apart from uniquely identifying the other party of communication. In this way, stored information can be searched based on the words spoken by the communication partner, and information related to conversation can be easily extracted.
- the communication terminal can improve speech recognition by storing a term database that assists speech recognition.
- voice recognition may be voice recognition of the user of the own terminal that is not only the communication partner.
- the sound information to be recognized is not limited to the voice information, but may be an environmental sound.
- an environmental sound it is possible to obtain information such as what place the communication partner is in, where it is. For example, indoors, outdoors, traveling by car, etc. are distinguished, and information corresponding thereto can be searched.
- you are at a station you will be able to extract timetable information with priority.
- the extracted timetable information can also be transmitted to the communication partner terminal and displayed. With this configuration, it becomes possible to easily extract and provide information necessary for the communication partner.
- the example of uniquely identifying the communication partner by voice information has been shown, but it may be identified including the emotion of the communication partner. By doing this, it is possible to extract stored information according to the emotion of the communication partner.
- the third embodiment an example has been described in which sound information is recognized and information related to a communication partner is acquired.
- information to be recognized video information to be received by the communication partner may be used.
- the image information of the communication partner user is analyzed using image recognition means to extract the characteristic information of the person, and the communication partner is uniquely identified by referring to the characteristic information of the person contained in the user information. It becomes possible to identify.
- the image may be recognized with priority given to the image information of the pointed portion.
- attribute information attached to a video target is also received together, it is possible to use the attribute information as search information.
- the attribute information is, for example, a person name or a building name attached to the image information as explanation information.
- attribute information associated with an object pointed by the pointing device can also be used as search information.
- the assistant specification may be prompted. For example, Designate to narrow down information related to priority or narrow down information related to time preferentially.
- Communication terminal 201 issues a videophone connection request to communication terminal 202 (step S 1).
- the communication terminal 202 sends a connection permission response (step S 1202).
- a session for making a videophone call is opened, and videophone communication is in progress (step S 1203).
- communication terminal 201 acquires information for uniquely identifying user B who is the other party of communication, and based on the information for uniquely identifying user B, user B The information related to the information is extracted from the information storage unit 103 of the communication terminal 201. Then, the communication terminal 201 transmits a request for confirmation of the reproduction capability information of the extracted image to the communication terminal 202 via the data transmission channel (step S 1204).
- Communication terminal 201 refers to the acquired reproduction capability information related to communication terminal 202, and converts the still image, which is to-be-searched information, into a format that can be reproduced by communication terminal 202 as necessary, It transmits to the communication terminal 202 via a data transmission channel (step S1206).
- FIG. 13 is a block diagram showing a configuration of communication terminal 1300 of the fourth embodiment.
- the communication terminal 1300 includes an image conversion unit 1308 for performing the image conversion process executed in step S1206.
- communication terminal 201 checks the image reproduction capability of communication terminal 202 of the communication partner. As a result, it is assumed that the communication terminal 202 has the reproduction capability up to the QCIF (Quarter CIF) format. In this case, since the communication terminal 202 can not reproduce in the CIF format stored in the communication terminal 201, the communication terminal 201 converts it into QCIF format data that can be reproduced by the communication terminal 202, and then the communication partner terminal 202 To (step S1206).
- CIF Common Interface Format
- communication terminal 201 searches stored information in communication terminal 201 using, as key information, the communication partner information acquired from communication terminal 202 which is the communication partner. Since the communication terminal 201 and the communication terminal 202 share information, it is possible to support activation of the communication more easily, simplify the operation, and become unfamiliar with the operation of the information device. Even elderly people can easily make calls while displaying various video information, and can promote warm communication.
- the reproduction capability information of the still image it may be information regarding the reproduction capability such as a good display color even if it is not the power resolution shown in the example using the resolution.
- reproduction capability information In the above description, an example of still image reproduction capability information is shown as the reproduction capability information, but it may be information about a moving image.
- the reproduction capability information may be reproduction capability information on a good sound or reproduction capability information on structured data such as XML (Extensible Markup Language) even if it is not the reproduction capability information on an image.
- XML Extensible Markup Language
- conversion may be performed according to the communication state between terminals. For example, when the transmission capacity for data transmission can not be increased, the data size is reduced and transmitted.
- video data may be compressed as a JPEG still image and transmitted.
- the reproduction capability information of the communication partner may be used as a search condition to perform the search.
- the communication terminal shown in FIG. 1 recognizes the image information or voice information received from the other party of communication to obtain information related to the other party of communication, and the image information for which the recognition information has been received. Or communication method for storing in association with voice information
- communication partner 202 receives image information.
- a feature related to a communication partner is acquired by recognizing speech information, and information related to the acquired communication partner is stored in association with received image information or speech information.
- step S 1401 communication terminal 201 displays an image of the other party of communication during a telephone call, as in the first embodiment.
- step S 1402 communication terminal 201 detects a recording instruction for recording image information or audio information received from the communication partner.
- the detection of a recording instruction is, for example, detection of a key operation instructing recording from a user by pressing a software key or a keyboard key.
- step S 1402 upon detecting a storage instruction of received image information or voice information, communication terminal 201 executes recognition processing of image information or voice information received from the other party of communication in step S 1403. Get information related to the other party.
- step S 1404 communication terminal 201 is based on the image information or voice information received from the communication partner and the feature information acquired by the recognition process in step S 1403.
- Communication partner information (attribute information) related to the communication partner is stored in the information storage unit 103 in association with each other.
- the image information and the feature information of the person related to the image information are stored together.
- the feature information of a person includes feature information related to voice.
- step S1403 an example will be described in which an image to be received is recognized to obtain information related to the person of the communication partner.
- Communication terminal 201 stores in identification information for identifying a plurality of users in information storage unit 103, and characteristic information of a person corresponding to the identification information, in association with each other. For example, the feature information and the voice feature of the face image of each user are stored in association with the telephone number of the address book which is the user information.
- the feature information of a person obtained by analyzing the video information received through the video channel and the features of each user included in the user information stored in the information storage unit 103.
- a recognition process that uniquely identifies the person at the other end of communication is performed by comparing the information.
- the feature related to the other party of communication is acquired, and the information related to the acquired other party of communication is acquired. Is stored in association with the received image information or voice information, so the received information can be searched with reference to the information related to the communication partner, and the intended information can be easily extracted even if the amount of information to be searched is large. can do.
- an example in which information relating to a person is extracted by image recognition as image recognition is not limited to this.
- Information relating to a landscape may be extracted.
- the image information received from the communication terminal of the other party of communication is subjected to image recognition
- information characterizing the landscape for example, information on a building
- the feature information is extracted. save.
- searching for stored information it becomes possible to search for stored information using the stored characteristic information. For example, information that is determined to be more deeply related by comparing feature information that obtains landscape information, which is video information from a communication partner, by image recognition with feature information related to the landscape stored in the information storage unit It is possible to present.
- Communication terminal 100 may be configured to recognize an image by giving priority to the image information of the pointed portion by designating the position of the other party's video screen to be displayed with the pointing device.
- attribute information associated with the video target according to the position of the partner video designated by the pointing device may be acquired from the communication partner, and may be stored together.
- attribute information associated with an object pointed by the pointing device can be used as a search condition for searching stored information.
- the communication terminal 201 stores the identification information for identifying a plurality of users in the information storage unit 103 in association with the characteristic information on the person image respectively corresponding to the identification information.
- the voice characteristic information of each user is stored in association with the telephone number of the address book which is user information.
- voice information of sound information received via the audio channel is separated, and voice characteristic information of a person obtained by analyzing the separated voice information;
- voice characteristic information of each user included in the user information stored in the information storage unit 103 recognition processing for uniquely identifying the person of the communication partner is performed.
- the communication terminal 201 requests the communication terminal 202 to connect using a videophone, and receives an acceptance response from the communication terminal 202.
- the video is transmitted and received using the video channel, and the output unit 107 displays the video of the other party (step S 1502). Also, talk over the audio channel.
- the communication partner information acquisition unit 104 of the communication terminal 201 extracts the speech information of the partner (step S1503), and further, the communication partner information acquisition unit 1
- step S 1504 analyzes the extracted other party's voice information, and uniquely identifies the other party of communication by referring to the voice database storing the features of the voice stored in the information storage unit 103 (step S 1504). ).
- the stored information search unit 105 of the communication terminal 201 searches the stored information stored in the information storage unit 103 based on the identified communication partner information, and extracts information related to the user B who is the communication partner (see FIG. Step S 1505).
- the extraction information reproduction unit 106 of the communication terminal 201 displays, via the output unit 107, image information which is information related to the extracted user B (step S1506).
- a user interface may be provided to control the timing of speech recognition.
- a software key or a Z hardware key is provided, and speech recognition is performed with a predetermined key press as a stop.
- the timing of performing speech recognition may be made at any time during communication, at any time decided in advance.
- the communication terminal can improve voice recognition by storing a term database that helps voice recognition.
- the speech recognition may be performed by speech recognition of the user of the own terminal without using only speech received from the communication partner.
- the sound information to be recognized is not limited to voice information, but may be environmental sound.
- environmental sound For example, by recognizing the environmental sound, what kind of place the communication partner is in, what situation Get information such as. For example, it is distinguished that the vehicle is indoors, outdoors, moving by car, etc., and the information is stored as feature information.
- the present invention particularly relates to communication terminals such as mobile phones, personal digital assistants (PDAs), notebook personal computers, personal computers on networks such as wireless LANs and wired LANs, and communication thereof. Suitable for use in the method.
- communication terminals such as mobile phones, personal digital assistants (PDAs), notebook personal computers, personal computers on networks such as wireless LANs and wired LANs, and communication thereof. Suitable for use in the method.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP05782307A EP1788809A1 (en) | 2004-09-09 | 2005-09-08 | Communication terminal and communication method thereof |
US11/574,848 US20080215884A1 (en) | 2004-09-09 | 2005-09-08 | Communication Terminal and Communication Method Thereof |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004262217A JP2006080850A (ja) | 2004-09-09 | 2004-09-09 | 通信端末とその通信方法 |
JP2004-262217 | 2004-09-09 | ||
JP2004-270409 | 2004-09-16 | ||
JP2004270409A JP2006086895A (ja) | 2004-09-16 | 2004-09-16 | 通信端末とその通信方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2006028181A1 true WO2006028181A1 (ja) | 2006-03-16 |
Family
ID=36036462
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2005/016534 WO2006028181A1 (ja) | 2004-09-09 | 2005-09-08 | 通信端末とその通信方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20080215884A1 (ja) |
EP (1) | EP1788809A1 (ja) |
WO (1) | WO2006028181A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105635426A (zh) * | 2014-11-28 | 2016-06-01 | 东莞宇龙通信科技有限公司 | 一种信息提示方法及终端 |
JP2019164598A (ja) * | 2018-03-20 | 2019-09-26 | パイオニア株式会社 | 情報検索装置 |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5245406B2 (ja) * | 2005-05-27 | 2013-07-24 | 日本電気株式会社 | 画像表示システム、端末装置、画像表示方法およびプログラム |
US8856331B2 (en) * | 2005-11-23 | 2014-10-07 | Qualcomm Incorporated | Apparatus and methods of distributing content and receiving selected content based on user personalization information |
KR101364044B1 (ko) * | 2007-04-13 | 2014-02-17 | 삼성전자주식회사 | 이동통신 단말기 및 그의 호에 따른 영상 표시 방법 |
US10126821B2 (en) * | 2012-12-20 | 2018-11-13 | Beijing Lenovo Software Ltd. | Information processing method and information processing device |
KR102099400B1 (ko) * | 2013-06-20 | 2020-04-09 | 삼성전자주식회사 | 휴대 단말기에서 이미지를 표시하는 장치 및 방법 |
CN105306657B (zh) * | 2014-06-20 | 2019-07-26 | 中兴通讯股份有限公司 | 身份识别方法、装置及通讯终端 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02246588A (ja) * | 1989-03-20 | 1990-10-02 | Dainippon Printing Co Ltd | 情報ファイルシステム及び個人情報ファイルカード |
JPH0497684A (ja) * | 1990-08-16 | 1992-03-30 | Oki Electric Ind Co Ltd | 画像伝送装置 |
JPH09149156A (ja) * | 1995-11-21 | 1997-06-06 | Matsushita Electric Ind Co Ltd | 電話装置 |
JPH09297532A (ja) * | 1996-05-08 | 1997-11-18 | Nippon Telegr & Teleph Corp <Ntt> | 端末装置 |
JP2000308033A (ja) * | 1999-04-19 | 2000-11-02 | Sharp Corp | テレビ電話補助装置およびテレビ電話システム |
JP2002271507A (ja) * | 2001-03-08 | 2002-09-20 | Matsushita Electric Ind Co Ltd | テレビ電話端末を用いた広告提供方法及び該広告提供方法に用いるテレビ電話端末、並びにプログラムを格納した媒体 |
JP2003158729A (ja) * | 2001-11-22 | 2003-05-30 | Mitsubishi Electric Corp | テレビ電話装置 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002027544A (ja) * | 2000-07-04 | 2002-01-25 | Fujitsu Ltd | データ蓄積システム |
US7409382B2 (en) * | 2000-12-08 | 2008-08-05 | Fujitsu Limited | Information processing system, terminal device, method and medium |
JP3987025B2 (ja) * | 2002-12-12 | 2007-10-03 | シャープ株式会社 | マルチメディアデータ処理装置およびマルチメディアデータ処理プログラム |
JPWO2005024645A1 (ja) * | 2003-08-29 | 2006-11-09 | 北川 淑子 | 情報処理サーバ及び情報処理方法 |
-
2005
- 2005-09-08 US US11/574,848 patent/US20080215884A1/en not_active Abandoned
- 2005-09-08 EP EP05782307A patent/EP1788809A1/en not_active Withdrawn
- 2005-09-08 WO PCT/JP2005/016534 patent/WO2006028181A1/ja not_active Application Discontinuation
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02246588A (ja) * | 1989-03-20 | 1990-10-02 | Dainippon Printing Co Ltd | 情報ファイルシステム及び個人情報ファイルカード |
JPH0497684A (ja) * | 1990-08-16 | 1992-03-30 | Oki Electric Ind Co Ltd | 画像伝送装置 |
JPH09149156A (ja) * | 1995-11-21 | 1997-06-06 | Matsushita Electric Ind Co Ltd | 電話装置 |
JPH09297532A (ja) * | 1996-05-08 | 1997-11-18 | Nippon Telegr & Teleph Corp <Ntt> | 端末装置 |
JP2000308033A (ja) * | 1999-04-19 | 2000-11-02 | Sharp Corp | テレビ電話補助装置およびテレビ電話システム |
JP2002271507A (ja) * | 2001-03-08 | 2002-09-20 | Matsushita Electric Ind Co Ltd | テレビ電話端末を用いた広告提供方法及び該広告提供方法に用いるテレビ電話端末、並びにプログラムを格納した媒体 |
JP2003158729A (ja) * | 2001-11-22 | 2003-05-30 | Mitsubishi Electric Corp | テレビ電話装置 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105635426A (zh) * | 2014-11-28 | 2016-06-01 | 东莞宇龙通信科技有限公司 | 一种信息提示方法及终端 |
JP2019164598A (ja) * | 2018-03-20 | 2019-09-26 | パイオニア株式会社 | 情報検索装置 |
JP2022179579A (ja) * | 2018-03-20 | 2022-12-02 | パイオニア株式会社 | 情報検索装置 |
Also Published As
Publication number | Publication date |
---|---|
US20080215884A1 (en) | 2008-09-04 |
EP1788809A1 (en) | 2007-05-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2003264434B2 (en) | Sign language interpretation system and sign language interpretation method | |
US8676705B1 (en) | Communication device | |
US8649776B2 (en) | Systems and methods to provide personal information assistance | |
WO2006028181A1 (ja) | 通信端末とその通信方法 | |
US20080147730A1 (en) | Method and system for providing location-specific image information | |
CN101015208A (zh) | 通信终端及其通信方法 | |
KR101953308B1 (ko) | 커뮤니케이션 정보 전송 시스템 및 방법 | |
US20150163561A1 (en) | Context Aware Geo-Targeted Advertisement in a Communication Session | |
AU2003264435B2 (en) | A videophone sign language interpretation assistance device and a sign language interpretation system using the same. | |
EP2892210B1 (en) | Providing video telephony using broadcast receiving apparatus and SMS message | |
JP2007129692A (ja) | 移動通信端末機の情報管理方法 | |
US8494123B2 (en) | On-hold visual menu from a user's communications device | |
JP5152045B2 (ja) | 電話装置、画像表示方法及び画像表示処理プログラム | |
WO2008097052A1 (en) | Methods for transmitting image of person, displaying image of caller and retrieving image of person, based on tag information | |
US7953798B2 (en) | Data sharing sequence display method and corresponding sharing device | |
JP5047467B2 (ja) | 映像記録装置、映像記録システム、及び、映像記録方法 | |
JP2007174281A (ja) | テレビ電話システム、通信端末、中継装置 | |
JP2006086895A (ja) | 通信端末とその通信方法 | |
JP5802116B2 (ja) | データ共有機能を有した通話システム | |
JP2011039647A (ja) | 情報提供装置および方法、端末装置および情報処理方法、並びにプログラム | |
JP2005056126A (ja) | コミュニケーションサービスシステム | |
US8892075B2 (en) | Selective generation of conversations from individually recorded communications | |
WO2019082606A1 (ja) | コンテンツ管理機器、コンテンツ管理システム、および、制御方法 | |
JP2007165951A (ja) | 無線端末制御システムおよび無線端末 | |
JP5878774B2 (ja) | 通話端末に関連する画像を表示装置に再生する画像再生サーバ、プログラム及び方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 200580029872.X Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11574848 Country of ref document: US Ref document number: 2005782307 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWP | Wipo information: published in national office |
Ref document number: 2005782307 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2005782307 Country of ref document: EP |