JP2004274550A - Mobile communication terminal equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable communication in which, when performing telephone conversations through a TV telephone using a user's own substitute picture instead of the user's true picture, the user's present conditions are transmitted to the other party almost accurately while preserving mutual privacies. <P>SOLUTION: Environments around user's mobile phone are detected by a GPS sensor 4, a timer 5, an optical sensor 6, a temperature sensor 7, and microphone equipment 8. The substitute pictures are formed which reflect costumes, accessories, motions, greetings, backgrounds, BGM or the like, and then are communicated mutually to perform the telephone conversations. Consequently, the substitute pictures precisely showing the users' conditions can be formed, so that the users' present conditions can be transmitted to the other party almost accurately while preserving users' privacies. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention is suitable for mobile communication provided in at least a portable telephone, a PHS telephone (Personal Handyphone System), a PDA (Personal Digital (Data) Assistant), or the like having at least a substitute image function and a communication function. It relates to a terminal device.
[0002]
[Prior art]
Today, a mobile phone provided with a video phone function is known. This videophone function compresses an image captured by a camera device provided in a mobile phone using an image compression technique such as Motion JPEG or MPEG4, and collects the compressed image information by a microphone device. By transmitting and receiving the voice information together with the transmitted voice information, it is possible to make a call while confirming the other person's face and the like.
[0003]
Here, in the near future, it will be essential to provide a mobile phone with a videophone function as a provider specification of a mobile communication terminal.
[0004]
However, telephone calls are often suddenly received regardless of the current situation of the receiving party. The video phone function directly reflects the current state of the receiving side, and therefore has a disadvantage for the user.
[0005]
Specifically, for example, in the case of women, there is a tendency that they do not want to go out in public when they are not wearing makeup, but even in this case, the videophone function reflects the real face of women, so the videophone function is Function may be inconvenient.
[0006]
Alternatively, even if the user cannot release their hands during housework or childcare, the videophone function reflects the busy current situation, and thus the videophone function may be an inconvenient function for the user.
[0007]
Therefore, in order to solve such inconveniences, Japanese Patent Laid-Open Publication No. 2000-175168 discloses a "substitute image" such as an arbitrarily variable character image or the like instead of a real image of a caller. There has been proposed a proxy image communication apparatus and a method for displaying on a screen and enabling a telephone call using a videophone function while protecting each other's privacy.
[0008]
In this substitute image communication apparatus and method, a substitute image that substitutes for the real image of the caller is stored in the image memory in association with various key codes, and the stored substitute image is stored under the control of the control unit. To the substitute image communication device. When a substitute image is received from the other party, the substitute image is stored in the image memory unit, and then the substitute image corresponding to the key code transmitted from the other party is read out from the image memory unit and displayed on the display unit.
[0009]
As a result, a call is made via the proxy image with each other, so that it is possible to make a call while protecting each other's privacy when using the videophone function.
[0010]
Further, in this substitute image communication device and method, a key code corresponding to an operation is transmitted and received, and a substitute image performing an operation corresponding to the key code is displayed. This makes it possible to express the operation of the substitute image.
[0011]
[Patent Document]
JP-A-2000-175168 (pages 4 to 6, FIG. 3)
[0012]
[Problems to be solved by the invention]
However, such a substitute image communication apparatus and method disclosed in Japanese Patent Application Laid-Open No. 2000-175168 discloses a substitute image of the desired expression or operation by selecting a key code corresponding to the desired expression or operation. Can be displayed, but since this display is only the display of the substitute image, it has been difficult to accurately convey the current state of the user to the other party.
[0013]
Specifically, for example, when the user is on the train, even if only the substitute image is displayed, it is not possible to inform the other party of the current situation that "the user is on the train" only by the expression and operation of the substitute image. Have difficulty.
[0014]
Similarly, for example, even when the user is climbing, if only the proxy image is displayed, it is difficult to convey the current state of “climbing” to the other party.
[0015]
Further, for example, when the user is at a sightseeing spot, it is difficult to tell the current situation that "the user is at a sightseeing spot" to the other party by displaying only the proxy image.
[0016]
Then, it is possible to establish more intimate communication by accurately communicating each other's current situation to the other party.
[0017]
However, on the other hand, even when the current situation of the user is to be communicated to the other party, it is necessary to satisfy the purpose of use of the substitute image, that is, protection of the privacy of the user.
[0018]
SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and it is possible to protect the privacy of each other and to almost accurately convey the current state of the user to the other party so as to achieve more friendly communication. An object of the present invention is to provide a body communication terminal device.
[0019]
[Means for Solving the Problems]
The present invention forms a proxy image by adding an environmental image corresponding to the surrounding environment detected by the environment detecting means, and by transmitting and receiving the proxy image, protects each other's privacy while substantially reducing the current state of the user. It is possible to convey to the other party accurately and to communicate more intimately.
[0020]
BEST MODE FOR CARRYING OUT THE INVENTION
The present invention can be applied to a mobile phone as an example. The mobile phone according to the embodiment of the present invention has a videophone function of transmitting and receiving audio information together with an image captured by a camera device to communicate with the image and voice. The videophone function includes a “real image mode” for transmitting and receiving a real image captured by the camera device, and a “proxy image” for transmitting and receiving a user's proxy image such as computer graphics instead of the real image captured by the camera device. Image mode ".
[0021]
In the mobile phone of this embodiment, in the “proxy image mode”, various images such as a background and clothes corresponding to the environment around the user (hereinafter collectively referred to as environment images) are used for the proxy image. ) Is added to perform transmission and reception.
[0022]
[Configuration of mobile phone]
FIG. 1 shows a block diagram of a main part of a mobile phone according to this embodiment. In FIG. 1, a mobile phone according to this embodiment includes an antenna 1 for transmitting and receiving image information and audio information, and performs predetermined information processing such as encoding / decoding processing and modulation / demodulation processing on each of the information. It has a transmitting / receiving unit 2 to be applied, and a camera device 3 for imaging a user or the like when the “real image mode” is executed.
[0023]
Note that, in this example, the description will be made assuming that a substitute image formed by computer graphics or the like is used instead of the actual image captured by the camera device 3 when the “substitute image mode” is executed. When the "surrogate image mode" is executed, computer graphics serving as a surrogate image of the user may be formed and used substantially in real time based on the real image captured by the camera device 3.
[0024]
The mobile phone has a GPS sensor 4 for detecting the position (latitude and mildness) and altitude of the mobile phone, a timer 5 for counting the current time, and an optical sensor for detecting the brightness around the mobile phone. 6, a temperature sensor 7 that detects the temperature around the mobile phone, a microphone device 8 that collects a user's voice and voice around the mobile phone, and each menu in the proxy image mode that is transmitted to the receiving side. And a display unit 9 for displaying the same.
[0025]
The mobile phone also includes a map information memory 10 storing map information, a proxy image, and polygon data and texture data serving as an image material when forming the environment image such as the background and clothes of the proxy image. An image material memory 11 in which the image material information is stored.
[0026]
The mobile phone also has an operation unit 12 for performing an operation related to the “proxy image mode” and image material information stored in the image material memory 11 based on each output of the GPS sensor 4 to the microphone device 8. And a user information memory that stores a user's information such as an age, a gender, a boarding station, and a drop-off station. 14 and a control unit 16 (CPU) for controlling the operation of the entire mobile phone.
[0027]
The image material information stored in the image material memory 11 is used when a substitute image or an environmental image is drawn. As the image material information, first, some image material information is stored and a predetermined image material information is stored. Alternatively, the image material may be additionally or updated downloaded from the server device and stored in the image material memory 11.
[0028]
Further, as the microphone device 8, a microphone device that collects a user's voice during a call is also used (a microphone device that collects the voice around the mobile phone may be separately provided).
[0029]
[Initial setting]
In such a mobile phone, as an initial setting, whether or not to use the substitute image when performing communication using the videophone function (on / off of the substitute image mode), and when the substitute image mode is used, the "use substitute agent" Selection of an image ", setting of an environmental image in a regular area, and setting of an environmental image in a specific area.
[0030]
[ON / OFF setting of substitute image mode]
First, when performing communication using the videophone function, the user sets whether to perform communication in the “real image mode” or in the “proxy image mode”. This setting is performed by operating the operation unit 12 to turn on / off the “surrogate image mode”. The CPU 16 stores the on / off setting information of the surrogate image mode in the user information memory 14. deep.
[0031]
[Selection of substitute image (avatar)]
When the substitute image mode is set to ON, the user selects a substitute image. When “selection of a substitute image” is designated by the user operating the operation unit 12, the CPU 16 first displays a selection screen for the user to select his / her gender (male / female). When a gender is selected, several types of surrogate images of that gender are displayed.
[0032]
The type of the substitute image is different from each other in the physique, the human face, the hairstyle, and the like, and the user selects a substitute image of a type similar to the user from the displayed substitute images. When a desired substitute image is selected by the user, the CPU 16 controls the user information memory 14 to store information for specifying the selected substitute image.
[0033]
The substitute image is not limited to a human image, but may be an animal, a fictitious creature, or the like.
[0034]
In addition, the user selects a desired proxy image from a plurality of proxy images prepared in advance. However, this is performed for each part such as eyebrows, hairstyle, mouth, nose, and body shape. The user may make a selection and the user may form the proxy image by himself.
[0035]
Further, the user may take an image of himself / herself with the camera device 3, and the CPU 16 may computerize the taken image substantially in real time to form a substitute image. In this case, since the image from which the substitute image is formed is the real image of the user, a substitute image more similar to the user can be formed.
[0036]
[Registration of regular area]
Next, the user sets each location of the steady area, which is the range of his / her daily activity, and environmental images corresponding to each location.
[0037]
When setting the location to be the regular area, the user operates the operation unit 12 to specify the display of the map. When this designation is made, the CPU 16 reads out the map information from the map information memory 10 and controls the display on the display unit 9. Based on the map displayed on the display unit 9, the user performs an operation of registering a place where the user is regularly acting, such as “home”, “workplace”, “ride station”, “get off station”, and the like.
[0038]
As a result, the CPU 16 stores and controls the latitude, longitude, and altitude of the location designated by the user in the user information memory 14 as the “steady area” of the user.
[0039]
Next, the user operates the operation unit 12 to set an environmental image in each place registered as the “steady area”.
[0040]
As shown in FIG. 2, the environment image of each place includes costumes, decorations, actions, greetings, backgrounds, background music (BGM), etc. for each area such as home, commuting, workplace, etc. It is to be set. In addition, these costumes, ornaments, actions, greetings, backgrounds, BGM, and the like are the brightness of the surroundings of the mobile phone detected by the optical sensor 6 at each time zone such as morning, daytime, night, or late night detected by the timer. The ambient temperature of the mobile phone detected by the temperature sensor (a humidity sensor may be provided and humidity may be used together), the noise around the mobile phone detected by the microphone device 8, and the like can be set. .
[0041]
As an example, if the user sets an environment image that is supposed to be at home in the morning, select “Sweet suit” as the “Costume” and select “None” for the ornament. , Select “motion brushing” as the “action”, select “good morning” as the “greeting”, select the background of “sunrise” as the background, and select “BGM” as the background. Radio gymnastics BGM ".
[0042]
In addition, when setting an environment image in which the user is supposed to be at "home" at "night", "pajamas" is selected as the "costume", "none" is selected for the ornament, and "operation" Select "Sleeping your eyes like a sleepy", select "Good night" as the "greeting", select the background of "Night sky with stars" as the background, and select "BGM" as the background. Select "BGM of a quiet song".
[0043]
In addition, when the user sets an environmental image in consideration of "commuting" in the "morning", the user selects "suit" as the "costume", selects "clock" as the ornament, and selects "operation". ”, Select“ Moving in a crowded train ”, select“ Greeting is commuting now ”as the“ greeting ”, and select“ Go ”as the background (not only the image) , A character may be selectable.), And “BGM of an active song” is selected as the “BGM”.
[0044]
In addition, when setting an environmental image in which the user is supposed to be in the "workplace" at "noon", "suit" is selected as the "costume", "clock" is selected as the decoration, and "operation" the select the "operation which is to work towards the desk", select the "Hello" as a "greeting", and select the background of the "office of the interior" as a background, as "BGM" is " Active Music BGM ".
[0045]
As described above, when the environment image is selected by the user for each place and for each time zone, the CPU 16 stores and controls information on the environment image in the user information memory 14.
[0046]
[Registration of specific area]
Next, the user sets each location of a specific area which is an area other than the steady area, which is the range of his or her daily activity, and environmental images corresponding to each location.
[0047]
When setting the location to be the specific area, the user operates the operation unit 12 to specify the display of the map, as described above. When this designation is made, the CPU 16 reads out the map information from the map information memory 10 and controls the display on the display unit 9. Based on the map displayed on the display unit 9, the user can regularly use “Hawaii (registration is allowed regardless of domestic and overseas)”, “Mt. Fuji”, “amusement park”, “hot spring”, “grandfather's house”, and the like. Register a place other than the place where you are acting.
[0048]
As a result, the CPU 16 stores and controls the latitude, longitude, and altitude of the location designated by the user in the user information memory 14 as the “steady area” of the user.
[0049]
Next, the user operates the operation unit 12 to set an environmental image in each place registered as the “specific area”.
[0050]
As shown in FIG. 3, the environment image of each place includes costumes, ornaments, movements, greetings, backgrounds, background music (BGM) for each place such as amusement park, Hawaii, Mt. Etc. are set. In the same manner as described above, costumes, ornaments, actions, greetings, backgrounds, background music (BGM), and the like can be set for each time zone such as morning, noon, night, or late night.
[0051]
As an example, if the user sets an environment image that supposes that he will be in "Hawaii" at "noon", select "Moomu" or "Swimsuit" as the "Costume" and set the decoration to "Surfboard" Or "Float", select "Wave action" as the "action", select "Aloha" as the "greeting", and set the background of the "sunny sun" as the background. Select “BGM”, and select “BGM of Hawaiian Music” as the “BGM”.
[0052]
Also, when the user sets an environmental image in consideration of being in the “amusement park” at “day”, the user selects “T-shirt” as the “outfit”, selects “clock” as the ornament, the operation "select the operation" shake "the hand," greeting and select the "Hello" as ", as the background to select the background of the" amusement park "," as the BGM, "" game music of BGM " Select
[0053]
In addition, when setting the environment image when the user is at “Mt. Fuji” at “Day”, select “Climbing Costume” as the “Costume”, select “Clock” as the decoration, and select “Operation”. the select the "operation which is up the hill", select the "Hello" as a "greeting", as the background to select the background of the "Mt. Fuji", as "BGM" of the "lively song BGM ".
[0054]
As described above, when the environment image is selected by the user for each area and for each time zone, the CPU 16 stores and controls information on the environment image in the user information memory 14.
[0055]
[Communication operation with environmental image added to proxy image]
Next, after the initial setting is completed in this way, the CPU 16 transmits the information registered in the user information memory and each output of the GPS sensor 4 to the microphone device 8 in the “proxy image mode” of the videophone function. Based on this, communication control using the proxy image is performed.
[0056]
FIG. 4 is a flowchart showing the flow of communication control using the proxy image. The flowchart in FIG. 4 starts when the CPU 16 detects a call from the transmission side or when the user performs an operation of making a call.
[0057]
In step S1, the CPU 16 captures the latitude, longitude, and altitude (location information) of the location where the user's mobile phone is located, measured by the GPS sensor 4.
[0058]
In step S2, the CPU 16 captures the current date and time (month, date, time = date information = time information) measured by the timer 5.
[0059]
In step S3, the CPU 16 compares the current location information of the mobile phone, which is acquired in step S1, with the information on the location stored in the user information memory 14, and determines the current location of the mobile phone. Determine the country or location. Then, in steps S4 and S5, it is determined whether the location where the mobile phone is currently located is a "steady area" (step S4) or a "specific area" (step S5).
[0060]
That is, as described above, in the user information memory 14, each place is registered separately in the "steady area" and the "specific area". Therefore, in steps S3 to S5, the CPU 16 determines whether the location where the mobile phone is currently located is a “steady area” or a “specific area”.
[0061]
If the CPU 16 determines that the location where the mobile phone is currently located is the “steady area”, the CPU 16 determines the user information memory based on the outputs from the GPS sensor 4 to the microphone device 8 in step S7. From 14, a corresponding environmental image is searched, and at the same time, the current state is determined based on the outputs from the GPS sensor 4 to the microphone device 8, and a proxy image is rendered based on the determination result (reflected in the proxy image). This is transmitted to the other party's mobile phone.
[0062]
That is, the environmental image registered in advance in the user information memory 14 may be directly reflected in the substitute image. In this case, the current outputs from the GPS sensor 4 to the microphone device 8 are also taken into consideration. In this case, the environment image is drawn and reflected in the proxy image. This makes it possible to further reflect the current state of the user on the substitute image.
[0063]
On the other hand, when the CPU 16 determines that the location where the mobile phone is currently located is the “specific area”, the CPU 16 determines in step S6 based on each output from the timer 5 to the microphone device 8. A corresponding environment image is searched from the user information memory 14 and the current state is determined based on each output from the GPS sensor 4 to the microphone device 8. To the other party's mobile phone.
[0064]
Steps S1 to S7 are repeatedly executed until the communication in the “proxy image mode” ends.
[0065]
[Effects of Embodiment]
As is apparent from the above description, the mobile phone of the present embodiment is provided with a plurality of sensors (for example, the GPS sensor 4 to the microphone device 8), and determines the current state of the user based on the output from each of the sensors. Then, an environment image corresponding to the determination result is drawn. Then, the environment image is reflected on the proxy image selected by the user in advance, and transmitted and received with the other party's mobile phone.
[0066]
Thus, since the communication is performed using the proxy image, communication can be performed while protecting each other's privacy.
[0067]
In addition, since the communication can be performed using the proxy image that approximately accurately represents the current state of the user, it is possible to perform communication that feels closer to each other while feeling close to each other.
[0068]
[Other fields of application]
In the above description of the embodiment, the present invention is applied to a mobile phone. However, the present invention also applies to a PHS phone (Personal Handyphone System) and a PDA device (PDA: Personal Digital (Data) Assistant). ) May be applied to the mobile communication terminal device.
[0069]
Further, in the description of the above-described embodiment, in the “surrogate image mode”, the environment image corresponding to the environment around the user is added to the surrogate image. Character information, voice information, and the like may be added.
[0070]
Also, in the description of the above-described embodiment, the transmitting-side mobile phone forms a substitute image to which the environmental image is added, and transmits the substitute image to the receiving-side mobile phone. Although the display is performed as it is, the transmitting-side mobile phone transmits only the parameter information corresponding to the environment image and the proxy image (not as image information, but as data for drawing the image). Alternatively, the environment image and the substitute image corresponding to the received parameter information may be rendered and displayed on the receiving-side mobile phone.
[0071]
In this case, since the transmitting-side mobile phone only needs to transmit the parameter information, the transmitting-side mobile phone does not need to form the environment image and the proxy image, and thus reduces the data processing load on the transmitting-side mobile phone. can do. Further, by transmitting and receiving parameter information having a small amount of information, high-speed communication can be realized.
[0072]
Alternatively, the transmitting-side mobile phone transmits the parameter information corresponding to the proxy image, and the server device of the communication network forms a proxy image corresponding to the parameter information and transmits the proxy image to the receiving-side mobile phone. May display the proxy image formed on the server device side.
[0073]
In this case, since the server device side only needs to provide the image material memory, the drawing processing means, the map information memory, and the like necessary for forming the substitute image, the configuration of the mobile phone can be greatly simplified.
[0074]
Lastly, the above embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and other than the embodiment, various modifications may be made according to the design and the like within a range not departing from the technical idea according to the present invention. It is of course added that it is possible to change.
[0075]
【The invention's effect】
According to the present invention, communication using a proxy image can be performed while protecting each other's privacy. In addition, it is possible to perform communication capable of almost accurately transmitting the current state of the user to the other party by using the proxy image and the environment image added to the proxy image.
[0076]
For this reason, it is possible to perform communication that feels close to each other while using the substitute image, and it is possible to achieve communication that is more familiar.
[Brief description of the drawings]
FIG. 1 is a block diagram of a main part of a mobile phone according to an embodiment to which the present invention is applied.
FIG. 2 is a diagram showing an example of information set as a regular area in the mobile phone according to the embodiment.
FIG. 3 is a diagram showing an example of information set as a specific area in the mobile phone according to the embodiment.
FIG. 4 is a flowchart showing a communication flow in a “substitute image mode” in the videophone function of the mobile phone according to the embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Antenna, 2 ... Transmission / reception part, 3 ... Camera device, 4 ... GPS sensor, 5 ... Timer, 6 ... Optical sensor, 7 ... Temperature sensor, 8 ... Microphone device, 9 ... Display part, 10 ... Map information memory, 11 ··· Art material memory, 12 · Operation unit, 13 · Drawing processing unit, 14 · User information memory, 15 · Speaker device, 16 · Control unit (CPU)

Claims (4)

A mobile communication terminal device having a function of transmitting and receiving at least a proxy image acting on behalf of a user and performing communication,
Environment detection means for detecting the surrounding environment;
Environmental image forming means for forming an environmental image corresponding to the surrounding environment detected by the environment detecting means,
A substitute image forming means for forming the substitute image by adding the environmental image formed by the environmental image forming means;
A mobile communication terminal device having a transmitting unit for transmitting the proxy image formed by the proxy image forming unit; The mobile communication terminal device according to claim 1,
For each surrounding environment detected by the environment detecting means, environment image specifying means for specifying an environment image corresponding to each environment,
An environment image storage unit that stores environment image information corresponding to the environment image specified by the environment image specification unit,
The environment image forming means reads the information indicating the current surrounding environment detected by the environment detecting means and the current surrounding environment detected by the environment detecting means from the environment image storing means. A mobile communication terminal device that forms the environmental image based on environmental image information. The mobile communication terminal device according to claim 1 or 2, wherein:
The mobile communication terminal device according to claim 1, wherein said environment detecting means detects at least one of a position, a date, an illuminance, a temperature, a humidity, and a volume. The mobile communication terminal device according to any one of claims 1 to 3, wherein
Character / speech forming means for forming at least one of characters and sounds corresponding to the surrounding environment detected by the environment detecting means,
The mobile communication terminal device according to claim 1, wherein the proxy image forming means adds at least one of a character and a voice formed by the character / voice forming means to form the proxy image.

Images