JP2006140595A - Information conversion apparatus and information conversion method, and communication apparatus and communication method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To relieve stress felt by a user in the case that the user performs communication with other party via a communication means. <P>SOLUTION: A communication section 13 receives voice information and supplies the information to a sense of distance expressing section 14. The sense of distance expressing section 14 controls feeling information included in the voice information of an opposite party supplied from the communication section 13 in response to sense of distance information supplied from an information input section 11 and thereafter converts the voice information of the opposite party whose feeling information is controlled so that the source of an output voice is localized at a position in response to the sense of feeling information supplied from the information input section 11 and supplies the converted voice information to a voice output section 15. The voice output section 15 outputs voice on the basis of the voice information supplied from the sense of distance expressing section 14. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information conversion apparatus and information conversion method for converting perceptual data and outputting, and a communication apparatus and communication method.

  In the interpersonal communication that is performed face-to-face, not only linguistic information is exchanged but also non-linguistic information is exchanged consciously or unconsciously. One such non-linguistic information is interpersonal distance. According to ETHall, interpersonal distance is divided into close distance, individual distance, social and social distance, and public distance, and each distance is close. It is said that it is divided into a phase and a far phase, and these distances are properly used according to the intimacy with the other party (for example, see Non-Patent Document 1).

  On the other hand, according to Ichiro Yamane of Hiyama Jogakuen, in addition to physical distances such as interpersonal distances, there are psychological distances such as intimacy, and this psychological distance is represented by active representation, active expression, It is said that it consists of four elements of passive representation and passive expression (for example, refer nonpatent literature 2).

  FIG. 16 shows a conceptual diagram of psychological distance proposed by Ichiro Yamane. An arrow 203 in FIG. 16 schematically indicates a psychological distance. The active representation is the psychological distance to the partner 202 in the mind of one's 201, the active expression is the psychological distance that the one person 201 actually conveys to the partner 202, and the passive expression is actually conveyed to the oneself 201 by the partner 202. The psychological distance and the passive representation are the psychological distance to the self 201 in the mind of the partner 202. It is considered that non-verbal communication such as interpersonal distance is performed by active expression and passive expression. The psychological distance can be adjusted, for example, by approaching or moving away, or by changing the interpersonal distance, as indicated by an arrow 203.

  On the other hand, there is an audio reproduction method as an attempt to realize interpersonal distance adjustment in communication via communication means (see, for example, Patent Document 1 and Non-Patent Document 3). In this audio reproduction method, in order to realize a sense of short distance, whispers and low voices are generated by frequency signal processing instead of increasing the volume.

Miles Patterson, "Basic Theory of Nonverbal Communication", Seishin Shobo, 1995, P.A. 190-191 Ichiro Yamane, “Modeling of Interpersonal Psychological Distance”, Ulsan Jogakuen University Research Review, No. 26, Social Sciences, 1995 Naofumi Inaki, et al., “Multimedia and Communication Space in a Seated Teleconference System”, IEICE Spring National Convention, 1991 JP-A-3-114000

  By the way, in telephones and TV (Television) telephones that have been widely used in recent years as communication means for communicating with others, improvement in sound quality and image quality, as well as line-of-sight coincidence, etc. are attracting attention, but psychological distance The feeling is not omitted at all. Therefore, the psychological distance cannot be adjusted in the communication through the conventional media.

  In FIG. 17, the conceptual diagram of the psychological distance in the communication via a communication means is shown. An arrow 204 in FIG. 17 schematically shows a psychological distance. In communication via the communication means, since the psychological distance cannot be adjusted, the user is always forced to communicate at a certain psychological distance as indicated by an arrow 204.

  Therefore, it is impossible to communicate with a close person or a favorite person at a close psychological distance, or a distant person or a dislike person from a distant psychological distance. In particular, it is said that the psychological distance between a person and a mobile phone is close, and communication with an unfamiliar person or a dislike person has a great stress.

  In addition, in order to reduce user stress when communicating with others via communication means, it is necessary to consider not only physical interpersonal distance but also the influence of psychological distance such as emotions embedded in speech There is.

  Accordingly, an object of the present invention is to provide an information conversion apparatus and information conversion method, and a communication apparatus and communication method that can reduce stress felt by the user when the user communicates with others via communication means. It is in.

In order to solve the above-mentioned problem, the first invention includes an input means for inputting psychological distance sense information,
An information conversion apparatus comprising: conversion means for converting perceptual data according to psychological distance sense information input by the input means.

  According to a second aspect of the present invention, there is provided an information conversion method characterized in that perceptual data is converted and output in accordance with psychological distance sense information input by an input means.

The third invention is a communication means for receiving or transmitting sensory data;
Input means for inputting psychological distance information,
A communication device comprising: conversion means for converting perceptual data according to psychological distance sense information input by the input means.

  According to a fourth aspect of the present invention, there is provided a communication method characterized in that sensory data is received by a communication means, and the sensory data is converted and output according to psychological distance sense information input by an input means.

  According to the present invention, the perceptual data is converted and output according to the input psychological distance sense information, so that the perceptual data can be converted so that the psychological distance desired by the user is obtained.

  As described above, according to the present invention, since perceptual data is converted and output according to the psychological distance sense information input by the input means, when communicating with others via the communication means, The user can adjust the psychological distance to others. Therefore, when a user communicates with others via a communication means, the stress which a user feels can be reduced.

Embodiments of the present invention will be described in the following order.
(1) First embodiment (1-1) Outline of first embodiment (1-2) Configuration of communication device according to first embodiment (1-3) Distance sensation expression unit according to first embodiment (1-4) Operation of the communication apparatus according to the first embodiment (1-5) Modification of the first embodiment

(2) Second embodiment (2-1) Configuration of playback apparatus according to the second embodiment (2-2) Modification of the second embodiment

(3) Third Embodiment (3-1) Outline of Third Embodiment (3-2) Configuration of Video Processing Device According to Third Embodiment (3-3) Distance Sense Expression According to Third Embodiment Part (3-4) Operation of Video Processing Device According to Third Embodiment (3-5) Modification of Third Embodiment

(4) Fourth embodiment (4-1) Configuration of communication apparatus according to the fourth embodiment (4-2) Modification of the fourth embodiment

(1) First Embodiment (1-1) Outline of First Embodiment FIG. 1 is a schematic diagram for explaining the outline of the first embodiment of the present invention. An arrow 6 and an arrow 7 in FIG. 1 schematically represent a psychological distance between the call partner 4 and the user 3.

  The communication device 1 is a mobile phone, for example, and is a distance filter for changing the psychological distance feeling into a part that transmits the active expression of the user 3 and a part that receives the passive expression of the other party of the call. 5 is provided.

  This distance sensation filter 5 changes the psychological distance sensation between the user 3 and the call partner 4 by converting audio information as perceptual information according to the distance sensation information input by the user 3. The communication device 2 is, for example, a mobile phone, and is a conventional communication device that is not provided with the above-described distance sensing filter 5.

  The communication device 1 converts the voice information of the call partner 4 received from the communication device 2 by the distance sense filter 5 according to the distance sense information input by the user 3 and outputs the converted information. When the other party 4 is close to the user 3, for example, as indicated by an arrow 6, the communication partner 2 receives the call so that the psychological distance between the other party 4 and the user 3 is closer. The voice information of the call partner 4 is converted by the distance filter 5 and output. On the other hand, when the call partner 4 is a partner that the user 3 does not know, for example, as shown by an arrow 7, the communication device 4 is configured so that the psychological distance between the call partner 4 and the user 3 is further increased. 2 is converted by the distance sense filter 5 and output.

  Further, the communication device 1 converts the voice information of the user 3 by the distance filter 5 according to the distance information input by the user 3 and transmits the converted information to the communication device 2 of the other party 4 on the call. When the other party 4 is close to the user 3, for example, as indicated by an arrow 6, the voice information of the user 3 is set so that the psychological distance between the other party 4 and the user 3 is closer. It is converted by the distance sensation filter 5 and output. On the other hand, when the call partner 4 is a partner that the user 3 does not know, for example, as indicated by an arrow 7, the user 3 is configured so that the psychological distance between the call partner 4 and the user 3 is further increased. Is converted by the distance sensation filter 5 and transmitted to the communication device 2.

  As described above, in the communication device 1 according to the first embodiment, the voice information of the user 3 and the voice information of the other party 4 are converted by the distance filter 5 according to the distance information input by the user. Thus, the user 3 can adjust the psychological distance from the call partner 4 to a desired distance.

(1-2) Configuration of Communication Device According to First Embodiment FIG. 2 is a block diagram showing a configuration example of the communication device 1 according to the first embodiment of the present invention. The communication device 1 includes an information input unit 11, a voice input unit 12, a communication unit 13, a distance feeling expression unit 14, and a voice output unit 15. The communication device 1 may further include a display unit for displaying various information such as menus.

  The information input unit 11 is used by a user to input sense of distance information, and is an input device that includes, for example, buttons, keys, or a jog dial. The sense of distance information input by the information input unit 11 is supplied to the sense of distance expression unit 14. In addition, when the communication apparatus 1 is further provided with a display unit, the user may be able to input distance sense information according to information displayed on the display unit.

  The sense of distance information is information for changing the sense of distance between the user and the other party via communication means. Here, the sense of distance is a sense of physical distance and / or a feeling of psychological distance. This sense of distance information can be expressed by a numerical value, for example. For example, in order to make the sense of distance between the user and the partner via the communication means closer, the numerical value “1” can be set, and the sense of distance between the user and the partner via the communication means or the like can be set. In the normal case, the numerical value “0” can be set, and in the case where the sense of distance between the user and the other party through the communication means is further increased, the numerical value “−1” can be set. The sense of distance information is not limited to numerical values, and characters, symbols, actual distances, and the like may be used.

  The voice input unit 12 is for inputting voice and is, for example, a voice input device such as a microphone device. The user's voice input to the voice input unit 12 is supplied to the communication unit 13 as voice information.

  The communication unit 13 transmits and receives audio information. For example, the communication unit 13 encodes and transmits the voice information supplied from the voice input unit 12. For example, the communication unit 13 decodes the received voice information of the other party and supplies the decoded voice information to the distance expression unit 14.

  The distance sensation expression unit 14 converts the voice information of the other party supplied from the communication unit 13 according to the distance sensation information supplied from the information input unit 11 and supplies the converted information to the voice output unit 15. That is, the distance sensation expressing unit 14 senses the distance between the user and the other party via the communication means, that is, the psychological distance sense and / or the physical distance sense, according to the distance sense information supplied from the information input unit 11. To change.

  The audio output unit 15 is an audio output device that outputs the other party's audio information supplied from the sense of distance expression unit 14 as audio, and the audio output device includes a plurality of speaker devices, for example, two speaker devices. The audio output unit 15 further includes connection means for connecting the headphone device, and supplies the other party's audio information converted by the distance expression unit 14 to the connection means. In this case, the distance sensation expression unit 14 is configured so that, for example, the other party's voice output from the headphone device is sound source localized at a position corresponding to the distance sensation information supplied from the information input unit 11. Convert information etc.

(1-3) Configuration of Distance Sense Representation Unit According to First Embodiment The distance sensation expression unit 14 is configured such that, for example, the user and the other party via a communication unit or the like according to the distance sensation information supplied from the information input unit 11 The physical distance feeling between the user and the other party via the communication means is changed according to the psychological distance feeling expression unit that changes the psychological distance feeling and the distance feeling information supplied from the information input unit 11. And a physical distance expression unit. Hereinafter, the psychological distance feeling expression unit and the physical distance feeling expression unit will be described.

(A) Psychological distance sensation expression unit The psychological distance sensation expression unit responds, for example, to emotion information included in the other party's voice information supplied from the communication unit 13 according to the distance sensation information supplied from the information input unit 11. Control. Emotion information is information such as voice inflection, voice pitch, voice loudness, or speaking speed. When emotion information is strong, it is considered that voice inflection increases, voice pitch increases, voice increases, and speaking speed increases. On the other hand, when emotion information is weak, it is considered that voice inflection becomes small, voice pitch becomes low, voice becomes small, and speaking speed becomes slow. Regardless of positive emotions such as joy or negative emotions such as anger, strong emotions cause a close sense of psychological distance and weak emotions cause a distant psychological distance.

  Therefore, if the emotion information included in the voice information is increased, the sense of distance between the user and the other party through the communication means is closer, for example, the sense of distance between the favorite partner and the close partner is closer. Can do. On the other hand, if the emotion information contained in the voice information is reduced, the distance between the user and the other party through the communication means is further increased. For example, the psychological relationship between a disliked person or an unacquainted person A sense of distance can be further increased.

  When distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the partner via the communication means closer is supplied from the information input unit 11, the distance sense expression unit 14, for example, The voice information supplied from the communication unit 13 is converted and supplied to the voice output unit 15 so that more emotion information is included in the voice information.

  When distance information (for example, a numerical value “0”) for normalizing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance expression unit 14 The voice information supplied from the communication unit 13 is converted and supplied to the voice output unit 15 so that emotion information included in the voice information supplied from the communication unit 13 does not change.

  When distance information (for example, numerical value “−1”) for further increasing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance expression unit 14 For example, the voice information supplied from the communication unit 13 is converted and supplied to the voice output unit 15 so that emotion information included in the voice information is reduced.

  The psychological distance feeling expression unit includes, for example, a voice conversion device that reduces the inflection of voice information, and distance information (for example, a numerical value “−1” for further increasing the distance between the user and the other party via a communication unit or the like. ”) Is supplied from the information input unit 11, the audio information supplied from the communication unit 13 is converted and supplied to the audio output unit 15 so that the inflection of the audio information is reduced.

  The voice conversion device is, for example, a vocoder based on formant analysis / synthesis. When a vocoder is used as the voice conversion device, distance information (for example, a numerical value “−1”) for further increasing the distance between the user and the other party via the communication means is supplied from the information input unit 11. In the vocoder, it is preferable that the pitch of the pulses for driving the synthesis filter is constant regardless of the pitch of the input voice.

(B) Physical distance feeling expression unit The physical distance feeling expression unit is configured such that the voice of the other party output from the audio output unit 15 or the headphone device is positioned according to the distance information supplied from the information input unit 11. The voice information of the partner whose emotion information is controlled is converted so that the sound source is localized.

  When distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the partner via the communication means closer is supplied from the information input unit 11, the distance sense expression unit 14, for example, The voice information of the partner whose emotion information is controlled is converted so that the position of the sound source such as the voice of the partner output from the voice output unit 15 or the headphone device is localized to the side of the user.

  When distance information (for example, a numerical value “0”) for normalizing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance expression unit 14 The voice information of the partner whose emotion information is controlled is converted so that the position of the sound source such as the voice of the other party output from the voice output unit 15 or the headphone device is localized in front of the user.

  When distance information (for example, numerical value “−1”) for further increasing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance expression unit 14 For example, the voice information of the partner whose emotion information is controlled is converted so that the position of the sound source such as the voice of the partner output from the voice output unit 15 or the headphone device is localized diagonally forward of the user.

  The physical distance sense expression unit changes the physical distance sense by sound source localization using three-dimensional sound by, for example, HRTF (Head-Related Transfer Function). HRTF is an acoustic transfer function from the sound source to the head ear canal entrance, and this changes the sound characteristics of the sound source at the head ear canal entrance, and humans perform sound source localization using this as a clue. Accordingly, if the sound at the head ear canal entrance is controlled in consideration of HRTF, sound source localization by three-dimensional sound can be realized.

  FIG. 3 shows an example of a sound source localization position by three-dimensional sound. The parameter of the physical distance feeling indicating the sound source position is represented by a set of a position vector PV and a direction vector DV.

  When distance information (for example, a numerical value “1”) for making the distance between the user and the partner via the communication means closer is supplied from the information input unit 11, the physical distance expression unit For example, it is supplied from the psychological distance sense expression unit so that the sound source is localized at the position represented by the physical distance sense parameter ((-0.5, 0.0, 0.0), (0.0, 1.0, 0.0)). Convert audio information. The position indicated by the parameter of physical distance corresponds to 0.5 m in the far phase of the close distance in the interpersonal distance of non-verbal communication, and corresponds to the sideways with high intimacy in the seat behavior.

  When distance information (for example, numerical value “0”) for normalizing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the physical distance sense expression unit For example, it is supplied from the psychological distance sense expression unit so that the sound source is localized at the position represented by the physical distance sense parameter ((0.0,1.0,0.0), (0.0, -1.0,0.0)). Convert audio information. This is equivalent to being in an informal communication distance at a distance of 1 meter in the far phase of personal distance in interpersonal distance.

  When distance sense information (for example, a numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means is supplied from the information input unit 11, the physical distance sense expression unit Supplied from the psychological distance expression unit so that the sound source is localized at the position represented by the physical distance sense parameters ((-1.2, 1.2, 0.0), (0.7, -0.7, 0.0)), for example. Audio information to be converted. This is 1.2m of the close phase of the social / talking distance in the interpersonal distance, but it is in the official communication distance of complicated contents, and it is in the diagonal direction with little psychological pressure that the line of sight does not fit directly It corresponds to that.

  FIG. 4 is a block diagram illustrating a configuration example of the physical distance feeling expression unit 112. The physical distance sense expression unit 112 includes a position vector acquisition unit 101 and a sound source localization unit 102. The position vector acquisition unit 101 acquires a position vector corresponding to the distance sense information supplied from the information input unit 11, and controls the sound source localization unit 102 based on the acquired position vector. The sound source localization unit 102 converts the audio information supplied from the psychological distance feeling expression unit based on the control of the position vector acquisition unit 101 and supplies the converted audio information to the audio output unit 15.

  FIG. 5 is a block diagram illustrating a configuration example of the distance feeling expression unit 14. The emotion signal included in the audio signal is controlled by the psychological distance expression unit 111 from the communication unit 13 and is divided into a left channel audio signal and a right channel audio signal. It is supplied to the gain 123. The gain 122 and the gain 123 adjust the gain of the audio information supplied from the psychological distance feeling expression unit 111 based on the control of the position vector acquisition unit 101, and supply it to the reverb circuit 121. Based on the control of the position vector acquisition unit 101, the reverb circuit 121 adds sound to the audio information supplied from the gain 122 and the gain 123 and supplies the audio information to the audio output unit 15. For example, the reverb circuit 121 is controlled as follows. That is, when distance information (for example, a numerical value “−1”) for further increasing the distance between the user and the other party via the communication means is supplied from the information input unit 11 to the position vector acquisition unit 101. The reverb circuit 121 adds more reverberation than the predetermined amount to the audio signals output from the gain 122 and the gain 123 based on the control of the position vector acquisition unit 101. On the other hand, when distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the partner via the communication means closer is supplied from the information input unit 11 to the position vector acquisition unit 101, Based on the control of the position vector acquisition unit 101, the reverb circuit 121 adds reverberation less than a predetermined amount to the audio signals output from the gain 122 and the gain 123.

  FIG. 6 is a block diagram illustrating another configuration example of the sense of distance expression unit 14. Here, as an example, a case where the other party's voice or the like is output from the headphone device will be described. The emotion signal included in the audio signal is controlled by the psychological distance sense expression unit 111, and the sound signal supplied from the communication unit 13 is divided into a left channel audio signal and a right channel audio signal. 102. The sound source localization unit 102, which is a digital processing circuit, includes a plurality of digital filters 113LL, 113LR, 113RL, and 113RR and two adders 114L and 114R, and the other party is actually in the vicinity of the user. This is a circuit that performs a process of converting so that a sound field similar to the sound field obtained when talking is obtained by the headphone device.

  In the sound source localization unit 102, the left channel audio signal is supplied to the first digital filter 113LL and the second digital filter 113LR, and the right channel audio signal is supplied to the third digital filter 113RL and the fourth digital filter 113RR. To be supplied.

  The position vector acquisition unit 101 controls the digital filters 113LL, 113LR, 113RL, and 113RR in accordance with the acquired position vector. Specifically, when distance information (for example, a numerical value “1”) for making the distance between the user and the other party closer via the communication means is supplied from the information input unit 11, the position vector is acquired. For example, the unit 101 obtains a position vector (−0.5, 0.0, 0.0) and sets the position vector (−−0.5, 0.0, 0.0), (0.0, 1.0, 0.0)) to the position represented by the physical distance sense. The digital filters 113LL, 113LR, 113RL, and 113RR are controlled so that the sound source is localized.

  When distance sense information (for example, a numerical value “0”) for making the sense of distance between the user and the other party via communication means normal is supplied from the information input unit 11, the position vector acquisition unit 101, for example, The position vector (0.0,1.0,0.0) is acquired and the sound source is localized at the position represented by the physical distance sense parameters ((0.0,1.0,0.0), (0.0, -1.0,0.0)). In addition, the digital filters 113LL, 113LR, 113RL, and 113RR are controlled.

  When distance information (for example, a numerical value “−1”) for further increasing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the position vector acquisition unit 101 For example, the position vector (-1.2, 1.2, 0.0) is acquired, and the sound source is localized at the position represented by the physical distance sense parameters ((-1.2, 1.2, 0.0), (0.7, -0.7, 0.0)). Thus, the digital filters 113LL, 113LR, 113RL, and 113RR are controlled.

  The output of the first digital filter 113LL configured with the digital filter having such a configuration and the output of the third digital filter 113RL are supplied to the adder 114L and added to obtain a conversion output for the left channel. . Further, the output of the second digital filter 113LR and the output of the fourth digital filter 113RR are supplied to the adder 114R and added to obtain a right channel conversion output.

  Then, the output of the left channel obtained by the addition by the adder 114L is supplied to the digital / analog converter 115L to be converted into an analog audio signal, and the converted analog audio signal is converted into an amplifier circuit for driving headphones. After being amplified by 116L, it is supplied to the left ear speaker unit 117L of the headphone device 117. Further, the output of the right channel obtained by the addition by the adder 114R is supplied to the digital / analog converter 115R and converted into an analog audio signal, and the converted analog audio signal is amplified by a headphone driving amplifier circuit. After being amplified by 116R, it is supplied to the right ear speaker unit 117R of the headphone device 117.

  A reverberation circuit may be further provided between the sound source localization unit 102 and the digital / analog converter 115L and the digital / analog converter 115R. For example, the reverberation circuit is controlled by the position vector acquisition unit 101 to adjust the amount of reverberation added according to the distance of the sound source from the user.

  For example, the reverb circuit is controlled as follows. That is, when the distance of the sound source from the user is further increased, that is, distance sense information (for example, a numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means or the like is input. When the signal is supplied from the unit 11 to the position vector acquisition unit 101, the reverb circuit adds a reverberation more than a predetermined amount to the audio signal output from the sound source localization unit 102, and the digital / analog converter 115L and the digital / analog The analog converter 115R is supplied.

  On the other hand, when the distance of the sound source from the user is made closer, that is, distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the other party closer via the communication means is an information input unit. 11 to the position vector acquisition unit 101, the reverb circuit adds a reverberation less than a predetermined amount to the sound signal output from the sound source localization unit 102, and the digital / analog converter 115L and the digital / analog This is supplied to the converter 115R.

(1-4) Operation of Communication Device According to First Embodiment FIG. 7 is a flowchart for explaining an example of operation of the communication device 1 according to the first embodiment of the present invention.

  First, in step S1, the communication unit 13 receives and acquires voice information. If the voice information is successfully received, the process proceeds to step S3. If the voice information is not successfully acquired, In step S2, the process returns to step S1.

  Next, in step S <b> 3, distance sense information is input by the information input unit 11, and distance sense information is acquired by the distance sense expression unit 14.

  Next, in step S4, the distance sensation expression unit 14 uses the distance sensation information (for example, a numerical value) for the distance sensation information acquired in step S3 to distant the sense of distance between the user and the partner via the communication means. "-1") or not.

  When it is determined that the sense of distance information acquired in step S3 is sense of distance information (for example, a numerical value “−1”) for increasing the sense of distance between the user and the other party via the communication means. In step S5, the distance sensation expression unit 14 performs, for example, a vocoder synthesis filter process on the voice information acquired in step S2. Thereby, the intonation contained in the audio | voice information acquired in step S2 is dropped. Then, the process proceeds to step S6. On the other hand, when it is determined that the sense of distance information acquired in step S3 is not the sense of distance information (for example, the numerical value “−1”) for increasing the sense of distance between the user and the partner via the communication means. The process proceeds to step S6.

  Next, in step S6, the distance feeling expression unit 14 acquires a position vector corresponding to the distance feeling information acquired in step S3. In step S7, the distance expression unit 14 converts the audio information so that the voice of the other party is sound source localized at the position corresponding to the position vector acquired in step S6, and sends it to the audio output unit 15. Supply.

  Specifically, when the sense of distance information acquired in step S3 is sense of distance information (for example, a numerical value “−1”) for increasing the sense of distance between the user and the other party via the communication means. For example, the distance sensation expression unit 14 performs, for example, three-dimensional sound processing on the audio information so that the sound source is localized diagonally forward of the user according to the position vector calculated in step S6. To the audio output unit 15.

  If the sense of distance information acquired in step S3 is sense of distance information (for example, a numerical value “0”) for making the sense of distance between the user and the other party via the communication means normal, the sense of distance For example, the expression unit 14 performs, for example, three-dimensional acoustic processing on the audio information so that the sound source is localized in front of the user according to the position vector acquired in step S6, and the audio output unit 15 To supply.

  When the sense of distance information acquired in step S3 is sense of distance information (for example, a numerical value “1”) for making the sense of distance between the user and the partner via the communication means close, the sense of distance expression For example, the unit 14 performs, for example, three-dimensional acoustic processing on the audio information so that the sound source is localized to the side of the user according to the position vector acquired in step S6, and the audio output unit 15 To supply.

  Thereafter, in step S8, if an operation for ending the call is performed, the process ends. If the call is continued without performing an operation for ending the call, the process returns to step S1.

In the first embodiment of the present invention, the following effects can be obtained.
Conventionally, since a short distance feeling is expressed only by frequency signal processing such as whispering voice, the expression of the short distance feeling is insufficient, and the sound source position is located at the position of the visual image due to a cross-modal effect such as a ventral speech effect. It will be pulled. On the other hand, in the first embodiment, since the sound source is actually localized at a short distance by the three-dimensional acoustic processing, a sense of short distance can be sufficiently expressed.

  Moreover, according to the distance information input by the user, information can be effectively presented, and emotion-rich and stress-free information presentation can be realized. In other words, filter processing that changes the feeling of psychological distance is added to communication devices, etc., so it communicates with a feeling of psychological distance close to a close person or a favorite person, and a psychology that is far from an unknown person or a disliked person Communication with a sense of distance can be realized. Therefore, communication with a close person or a favorite person becomes more enjoyable, and stress with a person who does not know or dislike is less likely to accumulate stress.

(1-5) Modified Example of First Embodiment Next, a modified example of the first embodiment will be described. In the first embodiment described above, the case where the user inputs distance sense information using the information input unit 11 has been described as an example. However, the other party's telephone number and distance sense information are associated in advance and registered in the address book. When making a call, distance information may be read from the address book together with the telephone number of the other party, and supplied to the distance expression unit 14.

  In this case, the communication apparatus 1 further includes a memory, and an address book in which the name or name of the other party, the telephone number of the other party's communication apparatus, and the distance information of the other party are associated is stored in this memory. To do. As this memory, for example, a rewritable ROM such as an EEPROM (Electrical Erasable Programmable ROM) can be used.

  When calling the other party, for example, a list of names or names registered in the address book is displayed on the display unit or the like. When a desired name or name is selected from this list, the telephone number and distance sense information associated with the selected name or name are read from the address book, and the telephone number is supplied to the communication unit 13. , Distance sense information is supplied to the distance sense representation unit 14. The communication unit 13 makes a call to the communication device of the other party having the telephone number read from the address book, and the distance feeling expression unit 14 receives from the communication unit 13 according to the distance information read from the address book. The supplied partner's voice information is converted and supplied to the voice output unit 15.

  In addition, the sound emitted from the sound source position may be changed in consideration of the face orientation (mouth direction) of the opponent virtually positioned at the sound source position with respect to the user. The change in voice according to the face direction of the other party can be expressed by, for example, equalizing the voice information (frequency characteristic operation).

  If the other party's face faces the direction of the user, the other party's voice becomes clear, and if the other party's face faces the direction opposite to the user's direction, the other party's voice becomes unclear. Moreover, according to the general principle of de Gar Kulka, the frequency band of 2 kHz to 6 kHz is related to the intelligibility. Therefore, the change of the voice of the other party according to the direction of the other party's face relative to the user is represented by attenuating the 2 kHz to 6 kHz band of the voice information by, for example, a bandpass filter according to the direction of the other party's face with respect to the user. Can do. For example, as the opponent's face deviates from the user's direction, the 2 kHz to 6 kHz band of the audio information is gradually attenuated by, for example, a band pass filter.

For example, when the sound source is localized at the position in front of the user, the amount S (0.0 to 1.0) to be attenuated using the band-pass filter is the direction vector DV and vector (0.0, 1.0, The following values can be made in proportion to the inner product with 0.0).
S = (DV ・ (0.0,1.0,0.0) +1.0) /2.0
("・" Is the inner product of vectors)

  In the first embodiment described above, the distance sense information is input by the information input unit 11 and supplied to the distance sense expression unit 14 as an example. However, the distance sense information is received by the communication unit 13. Then, it may be supplied to the distance feeling expression unit 14. In this case, each part with which the communication apparatus 1 was equipped operate | moves as follows, for example.

  The communication unit 13 receives the distance information and voice information of the other party, receives the received distance information and voice information of the other party, decodes them, and supplies them to the distance feeling expression unit 14. Then, the sense of distance expression unit 14 converts the voice information supplied from the communication unit 13 based on the sense of distance information supplied from the information input unit 11 and supplies the converted voice information to the voice output unit 15. Further, the communication unit 13 encodes and transmits the distance information supplied from the information input unit 11 and the voice information supplied from the voice input unit 12.

  It is also possible to perform a sense of distance operation using sense of distance information of both the user and the opponent. For example, when the communication device 1 is configured to further transmit user sense of distance information together with the user's voice information, the user sense of distance information transmitted by the communication device 1 and the distance of the partner received by the communication device 1 When both of the feeling information are distance feeling information (for example, a numerical value “1”) for making the distance between the user and the other party closer via the communication means, the communication device 1 such as a mobile phone is provided. Alternatively, the vibrator may be vibrated.

  In the first embodiment described above, the distance sensation expression unit 14 is described as an example of a configuration including both a psychological distance sensation expression unit and a physical distance sensation expression unit. However, the distance sensation expression unit 14 is psychological. It is good also as a structure provided only with either one of a distance feeling expression part and a physical distance feeling expression part. Moreover, it is good also as a structure which a user can select a desired thing from the psychological distance feeling expression part and the physical distance feeling expression part as needed. In this configuration, for example, the information input unit 11 can select which of the psychological distance feeling expression unit and the physical distance feeling expression unit is driven.

  Further, in the first embodiment described above, the case where the user's voice information is transmitted to the partner without being converted has been described as an example. However, the user's voice information is responded to the distance sense information supplied from the information input unit 11. May be converted and transmitted.

  FIG. 8 is a block diagram illustrating a configuration example of the communication device 1a that converts the user's voice information according to distance sense information and transmits the converted information. The communication device 1a includes an information input unit 11, a voice input unit 12, a communication unit 13a, a distance feeling expression unit 14a, and a voice output unit 15. Here, the same parts as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted.

  The distance feeling expression unit 14a converts the voice information supplied from the voice input unit 12 in accordance with the distance information supplied from the information input unit 11, and supplies the converted information to the communication unit 13a. For example, the distance sensation expression unit 14 a performs A / D conversion on the audio information supplied from the audio input unit 12, and emotion information included in the A / D converted audio information is supplied from the information input unit 11. It controls according to distance information and supplies it to the communication part 13a. The communication unit 13a encodes and transmits the voice information supplied from the distance feeling expression unit 14a. Since other than that is the same as that of the above-mentioned 1st Embodiment, description is abbreviate | omitted.

(2) Second Embodiment Next, a second embodiment of the present invention will be described. In the first embodiment described above, an example in which the present invention is applied to a communication device that transmits and receives audio information has been described. However, in the second embodiment, reproduction that reads and reproduces content stored in a database. The apparatus will be described.

(2-1) Configuration of Playback Device According to Second Embodiment FIG. 9 is a block diagram showing a configuration example of the playback device 20 according to the second embodiment of the present invention. A function similar to that of the playback apparatus 20 can be realized by a computer (electronic computer) such as a personal computer, for example. Here, the same parts as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted.

  The communication unit 21 is connected to the database 23 via a network 22 such as the Internet. The communication unit 21 exchanges information with the database 23 via the network 22. For example, the communication unit 21 requests the database to transmit content, receives the content transmitted from the database in response to this request, and supplies the content to the sense of distance expression unit 21.

  Content is stored in the database 23. Here, the content is audio information such as an audio message of an artist, for example. For example, the database 23 transmits content to the playback device 20 in response to a request from the playback device 20.

In the second embodiment, the following effects can be obtained.
If the content is, for example, a voice message of a favorite artist, listen to the voice message of the artist as if it were spoken in close proximity with a sense of distance by positioning the voice message side by side and the sound source. Can do.

(2-2) Modified Example of Second Embodiment Next, a modified example of the playback device 20 according to the second embodiment will be described. The playback apparatus 20 according to the second embodiment further includes storage means such as a nonvolatile memory for storing content, and the distance sense expression unit 14 performs processing on the content read from the storage means. It may be.

(3) Third Embodiment Next, a third embodiment of the present invention will be described. In the first embodiment described above, the case where the audio information is converted according to the distance sense information has been described, but in the third embodiment, the case where the video information is converted according to the distance sense information will be described.

(3-1) Overview of Third Embodiment First, an overview of the third embodiment of the present invention will be described. In psychology, it is known that there is a relationship between the size of the human pupil and the attractiveness felt to the other person. The pupil expands by 30% in diameter and 70% in area depending on interest and interest. When the other person's pupil expands, the person unconsciously determines that the other person is interested or interested in him. That is, when the opponent's pupil is enlarged, the attractiveness felt for the opponent increases. Thus, if the other party's charm increases, the sense of distance from the other party becomes closer.

  In the third embodiment, the sense of distance between a user and a person projected as a video is adjusted by changing the size of a pupil portion of the person projected as a video by image processing.

(3-2) Configuration of Video Processing Device According to Third Embodiment FIG. 10 is a block diagram showing a configuration example of the video processing device 30 according to the third embodiment of the present invention. The video processing device 30 includes an information input unit 11, a video input unit 31, a distance feeling expression unit 32, and a video output unit 33. Here, the same parts as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted.

  The video input unit 31 acquires video information and the like from the outside. The distance sensation expression unit 32 converts the video information supplied from the video input unit 31 according to the distance sensation information supplied from the information input unit 11 and supplies the converted video information to the video output unit 33. The video input unit 31 is an information reading unit that reads and acquires video information from, for example, a flash memory or an optical disk configured to be capable of storing video information. Instead of the video input unit 31, a communication unit that receives video information and supplies it to the distance expression unit 32 may be provided.

  The sense of distance expression unit 32 senses the sense of distance between the user and the other party via the communication means in accordance with the sense of distance information supplied from the information input unit 11, that is, the person and the user displayed on the video output unit 33. This is an information conversion device that changes the sense of distance. That is, the distance sensation expression unit 32 converts the video information supplied from the video input unit 31 according to the distance sensation information supplied from the information input unit 11 and supplies the converted video information to the video output unit 33.

  For example, the distance sensation expression unit 32 extracts an eye region, extracts a pupil region from the eye region, enlarges or reduces the pupil region, and superimposes the pupil region on the original image. As a method for extracting the eye region and the pupil region, a conventionally known method can be used. For example, the following method can be used. That is, the original image of the video information is binarized, and the eye region is extracted from the obtained binary image by fitting with an ellipse, for example. Then, the pupil region is extracted from the extracted eye region, for example, as a black portion by color.

  The video output unit 33 is a display device that displays video based on the video information supplied from the sense of distance expression unit 32. As this display device, for example, a CRT (Cathode-Ray Tube) display, a liquid crystal display, or a plasma display is used. Can be used. The sense of distance information is the same as that in the first embodiment described above, and a description thereof will be omitted.

(3-3) Distance Sense Representation Unit According to Third Embodiment FIG. 11A shows an example of a person image before enlarging the pupil, and FIG. 11B shows an example of a person image after enlarging the pupil. FIG. 12A shows an example of a human image before the pupil is reduced, and FIG. 12B shows an example of a human image after the pupil is reduced.

  The distance sensation expression unit 32 is supplied from the video input unit 31 so that the size of a pupil such as a person displayed on the video output unit 33 changes according to the distance sensation information supplied from the information input unit 11, for example. Video information to be converted.

  Specifically, the sense of distance expression unit 32 is supplied with sense of distance information (for example, a numerical value “1”) from the information input unit 11 for making the sense of distance between the user and the partner closer via the communication means. In this case, the video information supplied from the video input unit 31 is converted so that a pupil such as a person displayed on the video output unit 33 becomes larger (see FIGS. 11A and 11B). Thus, by enlarging the pupil region, the user can feel more attractive to the person displayed on the video output unit 33. Therefore, the sense of distance between the user and the person displayed on the video output unit 33 can be made closer.

  On the other hand, when distance information (for example, a numerical value “−1”) for further increasing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance expression For example, the unit 32 converts the video information supplied from the video input unit 31 so that a pupil such as a person displayed on the video output unit 33 becomes smaller (see FIGS. 12A and 12B). In this way, by reducing the pupil region, it is possible to prevent the user from feeling attractive to the person displayed on the video output unit 33. Therefore, the sense of distance between the user and the person displayed on the video output unit 33 can be further increased.

  More specifically, the distance sensation expression unit 32 converts the video information supplied from the video input unit 31 as follows. When distance information (for example, numerical value “1”) for making the distance between the user and the other party closer via the communication means is supplied from the information input unit 11, the distance feeling expression unit 32, for example, The video information supplied from the video input unit 31 is converted and output to the video output unit 33 so that the pupil displayed on the video output unit 33 is enlarged to 130% of the original pupil size. To do.

  When distance information (for example, a numerical value “0”) for normalizing the distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance feeling expression unit 32, for example, Then, the video information supplied from the video input unit 31 is converted and supplied to the video output unit 33 so that pupils such as a person displayed on the video output unit 33 remain the original image without being enlarged or reduced.

  When distance sense information (for example, numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means is supplied from the information input unit 11, the distance sense expression unit 32 For example, the video information supplied from the video input unit 31 is converted to the video output unit 33 so that the pupil displayed on the video output unit 33 is reduced to 70% of the size of the original pupil. Output.

(3-4) Operation of Video Processing Device According to Third Embodiment FIG. 13 is a flowchart for explaining an example of the operation of the video processing device 30 according to the third embodiment of the present invention.

  First, in step S11, the video input unit 31 acquires video information. If the video information acquisition is successful, the process proceeds to step S13. If the video information acquisition is not successful, the process proceeds to step S13. In S12, the process returns to step S11.

  Next, in step S <b> 13, the distance sensation expression unit 32 binarizes the original image of the video information acquired by the video input unit 31. In step S14, the distance sensation expression unit 32 extracts the eye region from the binarized image by fitting, for example, an ellipse. If the extraction is successful, the process proceeds to step S16, and the extraction is performed. If not successful, the process returns to step 11 in step S15.

  Next, in step S16, if the distance sensation expression unit 32 extracts the pupil region from the eye region extracted in step S14 as a black portion by color, for example, and succeeds in extracting the pupil region, the processing is performed. If the process proceeds to step S18 and the pupil region is not successfully extracted, the process returns to step S11 in step S17.

  Next, in step S <b> 18, distance sense information is input by the information input unit 11, and distance sense information is acquired by the distance sense information unit 32. Note that the video processing device 30 further includes a memory, in which the sense of distance information input by the information input unit 11 is stored in advance, and in step S18, the pre-stored sense of distance information is read from the memory. May be.

  Next, in step S19, the distance sensation expression unit 32 enlarges or reduces the pupil region extracted in step S16 according to the distance sensation information acquired in step S18. The distance sensation expression unit 32 enlarges or reduces the pupil region according to the distance sensation information as follows, for example.

  When the sense of distance information acquired in step S18 is sense of distance information (for example, a numerical value “1”) for making the sense of distance between the user and the partner closer, the sense of distance expression unit 32 proceeds to step S16. The extracted pupil region is enlarged.

  When the sense of distance information acquired in step S18 is sense of distance information (for example, a numerical value “0”) for making the sense of distance between the user and the other party normal, the sense of distance expression unit 32 proceeds to step S16. The pupil region extracted in this manner is left as the original image without being enlarged or reduced.

  When the sense of distance information acquired in step S18 is sense of distance information (for example, a numerical value “−1”) for further increasing the sense of distance between the user and the opponent, the sense of distance expression unit 32 performs step S16. The pupil region extracted in is reduced.

  Next, in step S20, the distance sensation expression unit 32 superimposes the pupil region reduced or enlarged in step 19 on the pupil region of the original image. Next, in step S21, when an operation for ending the video acquisition is performed, the process ends. When the video acquisition is continued without an operation for ending the video acquisition being performed. The process returns to step S11.

(3-5) Modified Example of Third Embodiment Next, a modified example of the third embodiment will be described. In the third embodiment described above, the case where the video information is input is shown as an example, but the video information may be output. In this case, for example, the video processing device 30 includes an input / output unit that inputs and outputs video information instead of the video input unit 31, and further includes a video input unit for inputting video. The input / output unit supplies video information input from the outside to the distance expression unit 32. The input / output unit outputs the video information supplied from the video input unit to the outside. Since other than this is the same as that of the above-mentioned 3rd Embodiment, description is abbreviate | omitted.

  Further, when the video information is output to the outside, the video information to be output to the outside may be converted and output according to the distance information input by the information input unit 11. In this case, for example, the video processing device 30 includes an input / output unit that inputs and outputs video information instead of the video input unit 31, and further includes a video input unit for inputting video. The distance sensation expression unit 32 converts the video information supplied from the video input unit according to the distance sensation information input by the information input unit 11 and supplies it to the input / output unit. The input / output unit outputs the video information supplied from the distance expression unit 32 to the outside. The input / output unit supplies video information input from the outside to the distance sense expression unit 32. Since other than this is the same as that of the above-mentioned 3rd Embodiment, description is abbreviate | omitted.

  For example, a camera device including a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) sensor can be used as the video input unit.

(4) Fourth Embodiment Next, a fourth embodiment of the present invention will be described. In the first embodiment described above, a case has been described in which only audio information is converted and transmitted according to distance sense information. However, in the fourth embodiment, both voice information and image information are converted to distance sense information. A case where the data is converted and transmitted according to the above will be described.

(4-1) Configuration of Communication Device According to Fourth Embodiment FIG. 14 is a block diagram showing a configuration example of the communication device 40 according to the fourth embodiment of the present invention. The communication device 40 includes an information input unit 11, an audio input unit 12, a video input unit 41, an audio output unit 15, a video output unit 33, a communication unit 42, and a distance feeling expression unit 43. The distance feeling expression unit 43 includes a first distance feeling expression unit 44 and a second distance feeling expression unit 45. Here, the same reference numerals are given to the same parts as those in the first and second embodiments described above, and the description thereof is omitted.

  The video input unit 41 is a photographing device that photographs a subject such as a user and outputs video information to the communication unit 42. For example, the camera device includes a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. It is.

  The communication unit 42 receives and combines the audio information and the image information, supplies the audio information to the first expression unit 44, and supplies the video information to the second expression unit 45. The communication unit 42 encodes and transmits the audio information supplied from the audio input unit 12 and the image information supplied from the video input unit 41.

  Since the first sense of distance expression unit 44 is the same as the sense of distance expression unit 14 according to the first embodiment, description thereof is omitted. The second sense of distance expression unit 45 is the same as the sense of distance expression unit 32 according to the third embodiment, and a description thereof will be omitted.

(4-2) Modification of Fourth Embodiment In the first embodiment described above, the audio information input by the audio input unit 12 and the video information input by the video input unit 41 are not converted. The case of transmission has been described as an example, but the audio information input by the audio input unit 12 and the video information input by the video input unit 41 are
You may make it convert and transmit according to the distance feeling information supplied from the information input part 11. FIG.

  FIG. 15 is a block diagram illustrating a configuration example of a communication device 40a that converts audio information and video information according to distance sense information and transmits the converted information. The distance feeling expression unit 43a includes a first distance feeling expression unit 44a and a second distance feeling expression unit 45a.

  The first sense of distance expression unit 44a converts the voice information supplied from the voice input unit 12 according to the distance information supplied from the information input unit 11, and supplies the converted information to the communication unit 42a. For example, the first sense of distance expression unit 44a performs A / D conversion on the audio information supplied from the audio input unit 12, and controls emotion information included in the A / D converted audio information to control the communication unit 42a. To supply.

  The second sense of distance expression unit 45a converts the video information supplied from the video input unit 41 according to the distance sense information supplied from the information input unit 11, and supplies the converted information to the communication unit 42a.

  The communication unit 42a encodes and transmits the audio information supplied from the first sense of distance expression unit 44a and the video information supplied from the second sense of distance expression unit 45a. Since other than this is the same as that of the above-mentioned 4th Embodiment, description is abbreviate | omitted.

  Although the first to fourth embodiments of the present invention have been specifically described above, the present invention is not limited to the above-described first to fourth embodiments, and is based on the technical idea of the present invention. Various variations based on this are possible.

  For example, the numerical values given in the first to fourth embodiments are merely examples, and different numerical values may be used as necessary.

  In the first to fourth embodiments described above, the case where video information and / or audio information is converted according to distance sense information has been described as an example. However, information regarding light or vibration is determined according to distance sense information. You may make it convert.

  For example, when converting information related to light according to distance sense information, the configuration of the communication device can be set as follows, for example. The communication device performs input of heartbeat information, detection means for detecting a heartbeat of a living body and outputting it as heartbeat information, transmission of heartbeat information output from the detection means, or reception of heartbeat information A communication unit, a distance sensation expressing unit that converts heart rate information received by the receiving unit according to distance sense information input by the input unit, and a light emission that emits light according to the heart rate information converted by the distance sense information Means. The detection means is, for example, a pressure sensor that can be attached to a living body such as a wrist to detect a heartbeat.

  The above-described communication apparatus operates as follows, for example. First, the communication unit receives the partner's heartbeat information and supplies it to the distance sense expression unit. The sense of distance expression unit converts the heart rate information supplied from the communication unit according to the sense of distance information supplied from the input unit, and supplies the converted information to the light emitting device. Specifically, the heart rate information supplied from the communication unit is converted and supplied to the light emitting device so that the heart rate changes in accordance with the sense of distance supplied from the input unit. A light emitting means including an LED (Light Emitting Diode) or the like blinks according to heartbeat information supplied from the distance expression unit. Specifically, the light emitting means blinks in synchronization with the heartbeat based on the heartbeat information.

  The sense of distance expression unit converts the heart rate information as follows, for example. When distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the partner via the communication means closer is supplied from the information input unit, the distance sense expression unit The heart rate information supplied from the communication unit is converted and supplied to the light emitting means so that the blinking becomes faster.

  On the other hand, when distance sense information (for example, numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means is supplied from the information input unit, The heart rate information supplied from the communication unit is converted and supplied to the light emitting means so that the blinking of the light from the light emitting means becomes slower.

  In the first, second, and fourth embodiments described above, the distance expression unit converts the audio information supplied from the communication unit so that the reverberation, frequency characteristics, or volume of the audio changes. Also good.

  When changing the reverberation of the sound output from the sound output unit, the distance expression unit operates as follows, for example. When distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the other party closer via a communication means or the like is supplied from the information input unit, the distance sense expression unit is a voice output unit. The audio information supplied from the communication unit is converted and supplied to the audio output unit so that the reverberation of the audio output from the communication unit becomes shorter. On the other hand, when distance sense information (for example, numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means is supplied from the information input unit, The audio information supplied from the communication unit is converted and supplied to the audio output unit so that the reverberation of the audio output from the audio output unit becomes longer.

  When changing the frequency characteristic output from the audio output unit, the distance expression unit operates, for example, as follows. When distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the other party closer via a communication means or the like is supplied from the information input unit, the distance sense expression unit is a voice output unit. The voice information supplied from the communication unit is converted and supplied to the voice output unit so that the voice output from the voice becomes a whisper. For example, a whispering voice is imitated by adding predetermined noise to the audio information, and supplied to the audio output unit. On the other hand, when distance sense information (for example, numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means is supplied from the information input unit, The high frequency component of the audio information is cut and supplied to the audio output unit.

  When changing the volume of the sound output from the sound output unit, the sense of distance expression unit operates as follows, for example. When distance sense information (for example, a numerical value “1”) for making the sense of distance between the user and the other party closer via a communication means or the like is supplied from the information input unit, the distance sense expression unit is a voice output unit. The sound information supplied from the communication unit is converted and supplied to the sound output unit so that the volume of the sound output from the device is increased. On the other hand, when distance sense information (for example, numerical value “−1”) for further increasing the sense of distance between the user and the other party via the communication means is supplied from the information input unit, The audio information supplied from the communication unit is converted and supplied to the audio output unit so that the volume of the audio output from the audio output unit is reduced.

It is the schematic for demonstrating the outline | summary of 1st Embodiment of this invention. It is a block diagram which shows the example of 1 structure of the communication apparatus by 1st Embodiment of this invention. It is an approximate line figure showing an example of a sound source localization position by three-dimensional sound. It is a block diagram which shows the example of 1 structure of the physical distance feeling expression part by 1st Embodiment of this invention. It is a block diagram which shows the example of 1 structure of a sound source localization part. It is a block diagram which shows the other structural example of a sound source localization part. It is a flowchart for demonstrating an example of operation | movement of the information converter by 1st Embodiment of this invention. It is a block diagram which shows one structural example of the communication apparatus by the modification of 1st Embodiment of this invention. It is a block diagram which shows the example of 1 structure of the reproducing | regenerating apparatus by the 2nd Embodiment of this invention. It is a block diagram which shows the example of 1 structure of the video processing apparatus by 3rd Embodiment of this invention. FIG. 11A is a schematic diagram illustrating an example of a human image before the pupil is enlarged, and FIG. 11B is a schematic diagram illustrating an example of a human image after the pupil is enlarged. 12A is a schematic diagram illustrating an example of a human image before the pupil is reduced, and FIG. 12B is a schematic diagram illustrating an example of a human image after the pupil is reduced. It is a flowchart for demonstrating an example of operation | movement of the video processing apparatus by 3rd Embodiment of this invention. It is a block diagram which shows the example of 1 structure of the communication apparatus by this 4th Embodiment. It is a block diagram which shows the example of 1 structure of the communication apparatus which converts and transmits audio | voice information and video information according to distance sense information. It is a conceptual diagram of the psychological distance proposed by Ichiro Yamane. It is a conceptual diagram of the psychological distance in communication via a communication means.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,40,40a Communication apparatus 1a Playback apparatus 11 Input part 12 Audio | voice input part 13 Communication part 14, 14a, 32, 43 Distance feeling expression part 15 Audio | voice output part 30 Video processing apparatus 31, 41 Video input part 33 Video | video output part 44 , 44a First distance sense expression unit 45, 45a Second distance sense expression unit 101 Vocoder 102 Coefficient generation unit 103 Sound source localization unit 104 Memory

Claims (30)

Input means for inputting psychological distance information,
An information conversion apparatus comprising: conversion means for converting perceptual data according to the psychological distance sense information input by the input means.   The information conversion apparatus according to claim 1, wherein the perceptual data is audio data.   3. The information conversion apparatus according to claim 2, wherein the conversion means performs the conversion so as to change the inflection of the audio data.   3. The information conversion apparatus according to claim 2, wherein the conversion means performs the conversion so as to change the volume of the audio data.   3. The information conversion apparatus according to claim 2, wherein the conversion means performs the conversion so as to change the reverberation of the audio data.   3. The information conversion apparatus according to claim 2, wherein the conversion means performs the conversion so as to change a frequency characteristic of the audio data.   3. The information conversion apparatus according to claim 2, wherein the conversion means performs the conversion so that a sound source of the audio data is localized at a position corresponding to the psychological distance sense information.   8. The information conversion apparatus according to claim 7, wherein the sound source is localized by three-dimensional sound processing. The conversion means is
When the psychological distance sense information is information indicating that the psychological distance is closer, the sound source position of the audio data is localized to the side of the user,
8. The information conversion according to claim 7, wherein when the psychological distance sense information is information indicating that the psychological distance is further increased, the sound source position of the audio data is localized diagonally forward of the user. apparatus.   3. The information conversion apparatus according to claim 2, wherein the conversion is performed so as to change the clarity of the audio data.   3. The information conversion apparatus according to claim 2, wherein the audio data is voice data obtained by a telephone call.   2. The information conversion apparatus according to claim 1, wherein the perceptual data is video data relating to a video including a person.   13. The information conversion apparatus according to claim 12, wherein the conversion means converts the video data so that the size of the pupil of the person changes.   The information conversion apparatus according to claim 1, wherein the perceptual data is input from the outside.   An information conversion method, wherein perceptual data is converted and output in accordance with psychological distance sense information input by an input means. A communication means for receiving or transmitting sensory data;
Input means for inputting psychological distance information,
A communication device, comprising: conversion means for converting perceptual data according to psychological distance sense information input by the input means.   The communication apparatus according to claim 16, wherein the perceptual data is audio data.   18. The communication apparatus according to claim 17, wherein the conversion means performs the conversion so as to change the inflection of the audio data.   18. The communication apparatus according to claim 17, wherein the conversion means performs the conversion so as to change a volume of the audio data.   18. The communication apparatus according to claim 17, wherein the conversion means performs the conversion to change the reverberation of the audio data.   18. The communication apparatus according to claim 17, wherein the conversion means performs the conversion so as to change a frequency characteristic of the audio data.   18. The communication apparatus according to claim 17, wherein the conversion means performs the conversion so that a sound source of the audio data is localized at a position corresponding to the psychological distance sense information.   The communication apparatus according to claim 22, wherein the sound source is localized by three-dimensional acoustic processing. The conversion means is
When the psychological distance sense information is information indicating that the psychological distance is closer, the sound source position of the audio data is localized to the side of the user,
23. The communication apparatus according to claim 22, wherein when the psychological distance sense information is information indicating that the psychological distance is further increased, the sound source position of the audio data is localized diagonally forward of the user. .   18. The communication apparatus according to claim 17, wherein the conversion is performed so as to change the clarity of the audio data.   18. The communication apparatus according to claim 17, wherein the audio data is voice data obtained by a telephone call.   17. The communication apparatus according to claim 16, wherein the perceptual data is video data relating to a video including a person.   28. The communication apparatus according to claim 27, wherein the conversion means converts the video data so that a size of the pupil of the person changes.   The communication apparatus according to claim 16, wherein the perceptual data is input from the outside.   A communication method characterized in that sensory data is received by a communication means, and the sensory data is converted and output in accordance with psychological distance sense information input by an input means.

Images