JP2011067479A - Image auralization apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image auralization apparatus more accurately recognizing a peripheral article aurally without touching an article. <P>SOLUTION: This image auralization apparatus 1 includes: imaging means 2; sound generating means 3 including sound generators 31, 32; an image processing means 41 for acquiring a processed image SP formed of a plurality of dots DT formed by a plurality of scanning lines extending in the X-axis direction and Y-axis direction from a pickup image of the imaging means 2; and generating sound deciding means 42 for deciding sound generated from the sound generating means 3 corresponding to the dots DT. The generating sound deciding means 42 indicates a position of the dot DT along the X-axis direction in the processed image SP by a difference in arrival time of sound between right and left ears, and indicates a position of the dot DT along the Y-axis direction in the processed image SP by a frequency increasing or decreasing from the plus side to the minus side in the Y-axis direction and assigned to each line of the dots DT along the Y-axis direction. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image auralization apparatus that aurally represents an image obtained by an imaging unit.

  Conventionally, visually handicapped persons have confirmed the surrounding situation by bringing a cane into contact with a surrounding object or by a guidance sound of a traffic light.

  However, when using a cane, a visually impaired person needs to touch a surrounding object with the cane, and the tip of the cane must be continuously moved over a wide range. Therefore, there is a possibility that the cane may fail to recognize the steps without contacting the steps or obstacles. Moreover, when using a guide sound etc., it is necessary to be provided with the equipment for emitting it.

  Therefore, even in an environment where no special equipment is provided, in order to be able to recognize an object located in the surroundings without visual recognition, the object is read by an imaging means such as a CCD camera and then the read image A technique has been proposed in which the outline of data is converted into sound, and the image data is recognized by the user with the sound (see, for example, Patent Document 1). In detail, the X axis of the contour information is expressed by the difference in sound intensity (volume difference) between the left and right ears, and the Y axis of the contour information is expressed by the frequency of the sound. .

JP 2003-84784 A

  However, when the sound frequency is relatively high (for example, exceeding 6000 Hz), the difference in intensity between the left and right sounds needs to be relatively large (for example, 20 db or more) in order to identify the position in the X-axis direction. There is. Therefore, when using the above-described conventional technology, it is difficult for the user to accurately grasp the position along the X-axis direction, and there is a possibility that the image data and the surrounding situation may be erroneously recognized.

  The present invention has been made in view of the above circumstances, and its purpose is to allow a user such as a visually impaired person to recognize surrounding objects and the like more accurately with hearing without touching the object. An object is to provide an image hearing device.

  In the following, each means suitable for solving the above-described object will be described in terms of items. In addition, the effect specific to the means to respond | corresponds as needed is added.

Means 1. Imaging means;
A sounding means attached to the left and right ears of the user and provided with a sound generator corresponding to each ear;
Image processing means for obtaining a processed image composed of a plurality of dots formed by a plurality of scanning lines extending along the X-axis direction and the Y-axis direction based on the captured image obtained by the imaging means;
An image auralization device comprising sound generation determination means for determining a sound emitted from the sound generation means corresponding to each dot constituting the processed image,
The generated sound determination means includes
By providing a difference in the arrival time of sound to the left and right ears, the position of the dot along the X-axis direction in the processed image is represented,
The position of the dot along the Y-axis direction in the processed image by a frequency that increases or decreases from the plus side to the minus side in the Y-axis direction and is assigned to each row of the dots along the Y-axis direction An image auralization device characterized by representing.

  According to the above means 1, a processed image composed of a plurality of dots is generated by the image processing means based on, for example, a captured image indicating the shape or position of a surrounding object. Then, with respect to the positions of a plurality of dots constituting the processed image, the position in the X-axis direction (left-right direction) is represented by using the difference in sound arrival time with respect to the left and right ears, and the Y-axis is represented by using the magnitude of the sound frequency. The position in the direction (vertical direction) is represented. Therefore, the processed image can be recognized more easily and more accurately with hearing, and the positions and shapes of surrounding objects can be recognized more accurately.

  In particular, according to the means 1, the position of the dot along the X-axis direction in the processed image is represented by using the difference in sound arrival time between the left and right ears. For this reason, it is possible to recognize the position and shape of surrounding objects very accurately as compared with the above-described conventional technique in which the position along the X-axis direction is expressed using the difference in sound intensity.

  Mean 2. The image auralization apparatus according to claim 1, wherein the intensity of sound is used to represent the density of the dots in the processed image.

  According to the means 2, the intensity of each sound (sound pressure) is adjusted to express the shade of each dot in the processed image. Therefore, in addition to the position of the object, a more accurate shape of the object such as the unevenness of the object can be recognized.

Means 3. When the sound generators corresponding to the left and right ears are attached to the user's ears, the sound generator is disposed above the user's ear canal and the second speaker is disposed below the user's ear canal. Each with a speaker,
Corresponding to the level of the frequency, the means 1 or 2 is characterized in that the intensity of the sound emitted from one of the two speakers is increased while the intensity of the sound emitted from the other of the two speakers is reduced. The image auralization apparatus described in 1.

  According to the means 3, each sound generator includes the first speaker that emits sound from the upper side of the ear canal and the second speaker that emits sound from the lower side of the ear canal, for example, on the upper side in the processed image. When representing a certain dot, the intensity of the sound emitted from the first speaker is increased, while the intensity of the sound emitted from the second speaker is reduced. Further, when representing the lower dot in the processed image, for example, the intensity of the sound emitted from the first speaker is reduced, while the intensity of the sound emitted from the second speaker is increased. That is, in this means 3, when expressing the dot located on the upper side, a difference in intensity is provided in the sound emitted from both speakers as if the sound is emitted from above, When expressing the dots located on the side, a difference in intensity is provided between the sounds emitted from both speakers as if the sound was emitted from below the user. Therefore, it is possible to more accurately recognize the position of the dot in the processed image along the Y-axis direction (up and down direction), and thus more accurately recognize the position of the object.

Means 4. While the sound produced by the pronunciation means is pure,
The image auralization apparatus according to any one of means 1 to 3, wherein the frequency assigned to each row of dots along the Y-axis direction is a different prime number.

  Note that “pure sound” means a sound that can be expressed as a sine wave.

  According to the means 4, the sound emitted by the sound generation means is a pure tone, and the frequency assigned to each row of dots along the Y-axis direction is a different prime number. Therefore, each sound does not resonate with other sounds, and the sound emitted from the sound generation means can be recognized more reliably. As a result, the positions of surrounding objects can be recognized more accurately.

  Means 5. The image auralization apparatus according to any one of means 1 to 4, wherein a sound is sequentially emitted for each frequency.

  According to the means 5, since the sound of each frequency is emitted individually, the sound can be recognized more easily. As a result, the positions of surrounding objects can be recognized more accurately and more easily.

  Means 6. The image auralization apparatus according to any one of means 1 to 4, wherein sounds corresponding to the respective dots determined by the generated sound determination means are emitted simultaneously from the sound generation means.

  Note that “simultaneously” does not mean that sounds corresponding to the dots are emitted from the sound generation means strictly at the same time. That is, when expressing the position of the dot in the processed image along the X-axis direction, a small time difference is provided in the sound emitted from the pair of sound generators, but such a small time difference is allowed. .

  According to the means 6, since the sound corresponding to each dot is emitted simultaneously from the sound producing means, the time required to recognize the processed image can be shortened. As a result, it becomes possible to recognize more processed images per unit time. For example, the object is moving and the speed of the object is more accurately and reliably known. be able to.

  Mean 7 The image auralization apparatus according to any one of means 1 to 6, wherein there are 20 or more scanning lines each along the X-axis direction and the Y-axis direction.

  According to the means 7, the processed image is configured with 20 or more dots along the X-axis direction and the Y-axis direction (that is, the dots divided into 20 rows × 20 columns or more). Therefore, the shape of the object can be grasped more accurately.

  Means 8. The image auralization apparatus according to any one of means 1 to 7, wherein a frequency of a sound emitted from the sound generation means is set to 60 Hz or more and 1000 Hz or less.

  It is generally known that the human audible range is about 20 Hz to 20000 Hz. However, even within this audible range, if the frequency is too low or too high, even if there is a difference in the arrival time of the sound to the left and right ears, If there is no difference in intensity (approximately 20 db), it may not be recognized that there is a difference in sound arrival time.

  In this regard, according to the above means 8, since the frequency of the sound emitted from the sound generation means is 60 Hz or more and 1000 Hz or less, there is a difference in the arrival time of the sound with respect to the left and right ears even if there is no difference in intensity between the sounds. It can be recognized more reliably. As a result, it is possible to more reliably recognize the dot positions along the X-axis direction over the entire Y-axis direction.

Means 9. The imaging means is configured to be directly or indirectly attachable to the user so as to face the same direction as the user's field of view,
The generated sound determination means sets a difference in arrival time of sounds to the left and right ears in accordance with a captured image capture angle in the left-right direction of the imaging means. The image auralization apparatus described.

  For example, when a sound was emitted from the right front 45 degrees, the sound reached the left ear after about 0.4 ms after the sound reached the right ear, and a sound was emitted from the front right 60 degrees. It is known that sometimes the sound reaches the left ear about 0.47 ms after the sound reaches the right ear. Also, the difference in sound arrival time between the left and right ears is approximately proportional to the angle of deviation of the sound source relative to the front of the person.

  Using this point, according to the means 9, the direction to the imaging means is the same as the viewing direction of the user, and the sound to the left and right ears expressing the position of the dot along the X-axis direction. Is set corresponding to the angle at which the captured image is captured by the imaging means. For example, if the capturing angle by the imaging means is 60 degrees left and right, and the number of dots along the X-axis direction in the processed image is 2M (or 2M + 1) (that is, M left and right), Every time S dots are shifted from the center in the X-axis direction of the image, an arrival time difference of 0.47 ms × (S / M) is provided for the left and right ears. Therefore, in the left-right direction, the relative position of the object with respect to the user coincides with the position of the object recognized by the user by sound. For this reason, the relative positional relationship between the self and the object can be grasped very accurately, and the surrounding situation can be recognized very accurately.

It is a block diagram which shows the structure of an image auralization apparatus. It is a schematic diagram which shows the structure of a sounding means. It is a figure which shows the processed image etc. which are produced | generated by the image processing means.

  Hereinafter, an embodiment will be described with reference to the drawings.

  As shown in FIG. 1, the image auralization apparatus 1 includes an imaging unit 2 such as a CCD image sensor, a sounding unit 3 that can be worn on both ears of a user, and a predetermined number of units for the imaging unit 2 and the sounding unit 3. And processing means 4 configured to be able to transmit and receive the above signal.

  The image pickup means 2 is configured to be attachable to, for example, a user's glasses or a hat so as to be directed in the substantially same direction as the user's field of view (of course, directly to the user). May be installed). Further, the imaging data obtained by the imaging means 2 is transmitted to the processing means 4. In addition, the image capture angle in the X-axis direction (left-right direction) of the imaging unit 2 is set to 90 degrees. In other words, the imaging means 2 is set so as to capture a range of 45 degrees left and right from the front of the user.

  The sounding means 3 converts the sound signal output from the processing means 4 into sound waves, and includes a pair of sounding devices 31 and 32 attached to both ears of the user as shown in FIG. ing. The sound generator 31 is attached to the left ear of the user, while the sound generator 32 is attached to the right ear of the user. In addition, the pair of sound generators 31 and 32 includes first speakers 31U and 32U and second speakers 31L and 32L, respectively. The first speakers 31U and 32U are disposed so as to be positioned above the user's external auditory canal when the sound generation means 3 is attached to the user. On the other hand, the second speakers 31L and 32L are disposed so as to be positioned below the user's external auditory canal when the sound generation means 3 is worn by the user.

  Returning to FIG. 1, the processing means 4 is constituted by a predetermined microcomputer or the like, and includes an image processing means 41 and a generated sound determination means 42.

  The image processing unit 41 generates a processed image composed of a plurality of dots formed by a plurality of scanning lines extending along the X-axis direction and the Y-axis direction based on the imaging data transmitted from the imaging unit 2. It is. More specifically, first, by using a conventionally known method such as thinning out pixels, the resolution of the imaging data is reduced, so that m dots are provided along the X-axis direction, and n dots are provided along the Y-axis direction. An intermediate image having a number of dots (that is, m columns × n rows) is generated. Next, by performing density processing on the intermediate image, as shown in FIG. 3, a processed image SP having a plurality of dots DT in X (for example, 3) gradation monochrome is generated. In the present embodiment, the processed image SP is partitioned by 41 scanning lines along the X-axis direction and 39 scanning lines along the Y-axis direction, and 41 processed along the X-axis direction and along the Y-axis direction. It is assumed that it has 39 dots along. Therefore, as described above, since the image capture angle in the X-axis direction (left-right direction) of the imaging unit 2 is 90 degrees, each dot DT along the X-axis direction corresponds to a field of view of 2.25 degrees. is doing.

  The generated sound determination means 42 determines the sound emitted from the sound generation means 3 corresponding to the position of each dot DT in the processed image SP. In the present embodiment, the generated sound determination means 42 uses the difference in the arrival time of the sound with respect to the left and right ears, and the X axis (left and right) of the colored dots (referred to as dots other than the white dots WD) BD in the processed image SP. The position along the direction is represented, and on the other hand, the position of the colored dot BD in the processed image SP along the Y-axis (vertical) direction is represented using the frequency level.

  Here, the position along the X-axis direction of the colored dots BD in the processed image SP is expressed as follows. In other words, a dot row located in the center of the processed image SP along the X-axis direction is defined as a reference row BL (a row sandwiched between dotted lines in the center in FIG. 3), and the plus side in the X-axis direction from the reference row BL. For the colored dot BD located on the right side of the user (that is, on the right side of the user), the user's voice is more than the sound generator 31 attached to the user's left ear by an amount corresponding to the distance from the reference row BL to the colored dot BD. A sound is emitted quickly from the sound generator 32 attached to the right ear. On the other hand, with respect to the colored dots BD located on the minus side in the X-axis direction (that is, the user's left side) with respect to the reference row BL, the sound generator 32 provides an amount corresponding to the distance from the reference row BL to the colored dot BD. Also, the sound generator 31 can emit a sound early.

  Further, in the present embodiment, the difference in sound arrival time to the left and right ears representing the position of the dot DT along the X-axis direction is set corresponding to the captured angle of the captured image by the imaging unit 2.

  More specifically, when a sound is emitted from the front right 45 degrees, the sound reaches the left ear about 0.4 ms after the sound reaches the right ear, and the sound is emitted from the front left 45 degrees. It is known that the sound reaches the right ear about 0.4 ms after the sound reaches the left ear. Therefore, in the present embodiment, as described above, the image capturing angle of the imaging unit 2 is set to 45 degrees to the left and right, and for example, the colored dot BD (that is, the user located on the rightmost side of the processed image SP) 2) is set so that the sound is emitted from the sound generator 31 with a delay of about 0.4 ms after the sound is emitted from the sound generator 32. Further, since the processed image SP has 20 dots on each of the left and right sides, 0.02 ms (= 0.0 ms) after the sound generator 32 emits sound every time one row moves from the reference row BL to the right. The sound is emitted from the sound generator 31 with a delay of 4 ms / 20). On the other hand, the sound from the sound generator 32 is delayed by 0.02 ms after the sound of the sound generator 31 is advanced by one line from the reference row BL to the left. Can be emitted. For example, when the tenth colored dot BD is displayed to the right of the reference row BL, the sound from the sound generator 31 is delayed by 0.2 ms (= 0.02 ms × 10) after the sound generator 32 emits sound. It is supposed to be emitted.

  In addition, the position along the Y-axis direction of the colored dots BD in the processed image SP is expressed as follows. That is, the frequency of the sound emitted for each row of dots DT along the Y-axis direction is assigned in advance, and in this embodiment, from the plus side (ie, the upper side) in the Y-axis direction to the minus side (ie, the Y-axis direction). A gradually decreasing frequency is assigned to the lower side. In expressing the position of the colored dot BD along the Y-axis direction, a sound having a frequency corresponding to the row where the colored dot BD is present is emitted from the sound generation means 3. Note that the frequencies assigned to the rows of the dots DT are different prime numbers as shown in FIG. Moreover, the frequency used is set to 60 Hz to 1000 Hz (about 4 octaves) that is particularly easy to hear in the human audible range (20 Hz to 20000 Hz). In addition, the sound emitted from the sound generation means 3 is a pure tone.

  Furthermore, in this embodiment, the density of the colored dots BD is expressed by the intensity difference (sound pressure difference) of the emitted sound. That is, among the colored dots BD, a relatively dark colored dot BD1 is expressed by a relatively loud sound (for example, 50 db), while a relatively thin colored dot BD2 is expressed by a relatively small sound (for example, 30 db). (Note that the sound volume is an example, and is not limited to this.)

  The processing unit 4 converts each sound determined by the generated sound determination unit 42 corresponding to each colored dot BD into a signal and transmits the signal to the sound generation unit 3. The sound determined by the sounding means 3 corresponding to each colored dot BD is emitted simultaneously. In the present embodiment, the sound corresponding to the white dot WD is not emitted.

  Next, how the processed image SP shown in FIG. 3 is expressed will be described by taking a line with a frequency of 191 Hz as an example.

  First, among the colored dots BD present in the row having a frequency of 191 Hz, the intensity comparison is performed from the sound generator 31 for a plurality of colored dots A that are located on the left side of the reference column BL (the front of the user) and have relatively dark colors. Sound with relatively high intensity from the sound generator 32 after 0.26 ms, 0.24 ms, 0.22 ms, 0.20 ms, 0.18 ms, 0.16 ms, and 0.14 ms It is expressed by being emitted.

  Further, for the relatively light colored dots B located on the left side of the reference row BL, after a sound having a relatively lower intensity than the sound generator 31 is emitted, 0.12 ms, 0.10 ms, and 0. This is expressed by a sound having a relatively low intensity from the sound generator 32 being delayed by 08 ms. Further, the relatively dark colored dot C located on the reference row BL side has a strength higher than that of the sound generator 32 by 0.04 ms and 0.02 ms after the sound having a relatively high intensity is emitted from the sound generator 31. It is expressed by a relatively loud sound.

  In addition, with respect to the colored dots D that are located on the reference row BL (that is, in front of the user) and have a relatively dark color, the sound generator 31 and the sound generator 32 simultaneously emit relatively strong sounds. Expressed.

  In addition, the colored dot E, which is located on the right side of the reference row BL and has a relatively dark color, is delayed by 0.02 ms and 0.04 ms after the sound having a relatively high intensity is emitted from the sound generator 32. It is expressed by emitting a relatively loud sound.

  For the colored dot F, which is located on the right side of the reference row BL and has a relatively light color, the sound generator 31 is delayed by 0.06 ms and 0.08 ms after the sound having a relatively low intensity is emitted from the sound generator 32. It is expressed by the sound of a relatively small intensity. As described above, the sound corresponding to the white dot WD is not emitted.

  As described above in detail, according to the present embodiment, with respect to the positions of the plurality of colored dots BD constituting the processed image SP, the position in the X-axis direction (left-right direction) is determined by using the arrival time difference of the sound with respect to the left and right ears. And the position in the Y-axis direction (vertical direction) is represented by using the magnitude of the frequency. Therefore, the processed image SP can be recognized more easily and more accurately with hearing, and the position and shape of surrounding objects can be recognized more accurately.

  In particular, in the present embodiment, the position of the colored dot BD along the X-axis direction in the processed image SP is represented by using a difference in sound arrival time between the left and right ears. For this reason, it is possible to recognize the position and shape of surrounding objects very accurately as compared with the above-described conventional technique in which the position along the X-axis direction is expressed using the difference in sound intensity.

  Further, by adjusting the sound intensity (sound pressure), the shade of the colored dots BD in the processed image SP is expressed. Therefore, in addition to the position of the object, a more accurate shape of the object such as the unevenness of the object can be recognized.

  In addition, the sound emitted by the sound generation means 3 is a pure tone, and the frequency assigned to each row of dots DT along the Y-axis direction is a different prime number. Therefore, each sound does not resonate with other sounds, and the sound emitted from the sound generation means 3 can be recognized more reliably. As a result, the positions of surrounding objects can be recognized more accurately.

  In addition, since the sound corresponding to each colored dot BD is simultaneously emitted from the sound generation means 3, the time required to recognize the processed image SP can be shortened. As a result, more processed images SP can be recognized per unit time, so that, for example, the fact that the object is moving, the speed of the object, and the like can be more accurately and reliably known. it can.

  Further, since the processed image SP is configured with 21 or more dots DT along the X-axis direction and the Y-axis direction, the shape of the object can be grasped more accurately.

  In addition, since the frequency of the sound emitted from the sound generation means 3 is 60 Hz or more and 1000 Hz or less, it is more reliably recognized that there is a difference in the arrival time of the sound with respect to the left and right ears without providing a difference in intensity between the sounds. can do. As a result, the dot DT position along the X-axis direction can be more reliably recognized over the entire area in the Y-axis direction.

  Furthermore, the direction in which the image pickup means 3 faces is the same as the user's field of view, and furthermore, the difference in the arrival time of the sound to the left and right ears representing the position of the colored dot BD along the X-axis direction is the captured image. It is set according to the included angle. Therefore, in the left-right direction, the relative position of the object with respect to the user coincides with the position of the object recognized by the user by sound. For this reason, the relative positional relationship between the self and the object can be grasped very accurately, and the surrounding situation can be recognized very accurately.

  In addition, it is not limited to the description content of the said embodiment, For example, you may implement as follows. Of course, other application examples and modification examples not illustrated below are also possible.

  (A) In the above embodiment, the generated sound determination means 42 expresses the shade of the processed image SP using the magnitude of the sound. On the other hand, by providing a difference in intensity between the sounds emitted from the first speakers 31U and 32U and the second speakers 31L and 32L, it is used to represent the position (vertical position) of the colored dots BD along the Y-axis direction. It is good as well. That is, in expressing the colored dots BD located above the processed image SP, the second speaker emits a relatively high frequency and relatively strong sound from the first speakers 31U and 32U. 31L and 32L emit relatively low-intensity sounds at the same high frequency, and in expressing the colored dots BD located below in the processed image SP, the first speakers 31U and 32U have a relatively low frequency. In addition, while emitting a relatively small sound, the second speakers 31L and 32L may emit a relatively large sound at the same low frequency. In this case, the user feels that the colored dot BD located on the upper side is emitted from the upper side due to bone conduction, skin tactile sensation, and the like, while being located on the lower side. About the colored dot BD, it will feel as if the sound is emitted from below itself. Therefore, together with the difference in frequency, the user can more accurately recognize the vertical position of the colored dot BD (object) in the processed image SP. In addition, it is good also as expressing the position of the colored dot BD along the Y-axis direction, and the shade of the colored dot BD using the difference in sound intensity.

  (B) In the above-described embodiment, the processed image SP is a grayscale image with three gradations, but the grayscale of the processed image SP is not limited to this. Therefore, for example, a black and white image (2 gradations) may be generated as the processed image.

  (C) In the above embodiment, the sound generators 31 and 32 include the first speakers 31U and 32U and the second speakers 31L and 32L, respectively, but the sound generators 31 and 32 each have one or three or more speakers. It is good also as comprising.

  (D) In the above embodiment, sounds corresponding to the colored dots BD are simultaneously emitted from the sound generation means 3, but sounds may be emitted sequentially for each frequency. In this case, since the user can recognize the sound more easily, the user can more reliably and more easily recognize the position of the surrounding object.

  (E) In the above embodiment, the frequency representing the position of the colored dot BD in the Y-axis direction is set so as to decrease from above to below, but the frequency is set so as to gradually increase from above to below. It is good to do. Moreover, in the said embodiment, although the frequency of a sound shall be 60 Hz-1000 Hz, the range of the frequency of the sound to emit is not limited to this. However, as described above, a high frequency exceeding 6000 Hz may make it difficult to recognize the arrival time difference between the left and right ears. Therefore, the upper limit of the frequency is preferably 6000 Hz or less, and the upper limit of the frequency is more preferably 3000 Hz or less.

  (F) The number of dots of the processed image SP in the above embodiment is an example, and the number is not limited. Further, the image processing means 41 may be configured so that the number of dots (number of rows and columns) of the generated processed image can be changed as appropriate. For example, when it is desired to grasp the surrounding situation in more detail, the number of dots in the processed image may be increased. Further, if the number of dots in the processed image is further reduced, the burden on the user when recognizing the image can be reduced.

  (G) In the above-described embodiment, the capturing angle in the left-right direction by the imaging unit 2 is 45 degrees to the left and right, but the capturing angle of the imaging unit 2 is not limited to this.

  DESCRIPTION OF SYMBOLS 1 ... Image auralization apparatus, 2 ... Imaging means, 3 ... Sound generation means, 4 ... Processing means, 31 and 32 ... Sound generator, 31U, 32U ... 1st speaker, 31L, 32L ... 2nd speaker, 41 ... Image processing means 42 ... Generated sound determining means, DT ... Dot.

Claims (9)

Imaging means;
A sounding means attached to the left and right ears of the user and provided with a sound generator corresponding to each ear;
Image processing means for obtaining a processed image composed of a plurality of dots formed by a plurality of scanning lines extending along the X-axis direction and the Y-axis direction based on the captured image obtained by the imaging means;
An image auralization device comprising sound generation determination means for determining a sound emitted from the sound generation means corresponding to each dot constituting the processed image,
The generated sound determination means includes
By providing a difference in the arrival time of sound to the left and right ears, the position of the dot along the X-axis direction in the processed image is represented,
The position of the dot along the Y-axis direction in the processed image by a frequency that increases or decreases from the plus side to the minus side in the Y-axis direction and is assigned to each row of the dots along the Y-axis direction An image auralization device characterized by representing.   The image auralization apparatus according to claim 1, wherein the density of the dots in the processed image is expressed using a magnitude of sound intensity. When the sound generators corresponding to the left and right ears are attached to the user's ears, the sound generator is disposed above the user's ear canal and the second speaker is disposed below the user's ear canal. Each with a speaker,
The intensity of the sound emitted from one of the two speakers is increased while the intensity of the sound emitted from the other of the two speakers is reduced corresponding to the level of the frequency. 2. The image auralization apparatus according to 2. While the sound produced by the pronunciation means is pure,
4. The image auralization apparatus according to claim 1, wherein frequencies assigned to the respective rows of dots along the Y-axis direction are respectively different prime numbers. 5.   The image auralization apparatus according to any one of claims 1 to 4, wherein a sound is emitted sequentially for each frequency.   5. The image auralization apparatus according to claim 1, wherein sounds corresponding to the respective dots determined by the generated sound determination unit are simultaneously emitted from the sound generation unit.   The image auralization apparatus according to claim 1, wherein there are 20 or more scanning lines each along the X-axis direction and the Y-axis direction.   The image auralization apparatus according to any one of claims 1 to 7, wherein a frequency of a sound emitted from the sound generation unit is set to 60 Hz or more and 1000 Hz or less. The imaging means is configured to be directly or indirectly attachable to the user so as to face the same direction as the user's field of view,
9. The generated sound determining means sets a difference in arrival time of sounds to the left and right ears in accordance with a captured image capture angle in the left-right direction of the imaging means. The image auralization apparatus according to claim 1.