JP2020035405A - Voice output device - Google Patents

Abstract

To provide a voice recognition output device that has high operability and portability and is inexpensive.SOLUTION: A voice output device comprises: a carrying member that has a base part and a first arm part and a second arm part extending in the same direction from the base part; voice data generation means that generates voice data on the basis of a picked-up image; output means that outputs a voice on the basis of the voice data; and operation receiving means that is mounted on at least one of the first arm part and the second arm part of the carrying member and receives an operation related to a mode of output of the voice performed by the output means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an audio output device that outputs audio.

  2. Description of the Related Art Conventionally, there is an audio output device that assists a visually impaired person's life by outputting characters included in an image as audio. As such an audio output device, Patent Document 1 discloses an audio output device having a camera attached to glasses and a computer connected to the camera by a wire (see Patent Document 1).

WO 2014/140800

  In Patent Literature 1, a computer converts an image or a character projected by a camera into audio data, and outputs audio from a speaker based on the converted audio data. When using the audio output device, the user wears glasses to which a camera is attached and fixes a box-shaped computer to a body part such as a waist.

  Such a device in which the voice recognition device is attached to the waist has a problem that operability is poor. In addition, when a camera is attached to the head and the camera and the computer are connected by wire, the problem that the cord is cumbersome is cited as an example.

  Further, when a box-shaped computer is attached to the waist, the weight of the computer is applied to one side of the body. Therefore, a heavy computer makes it difficult for a user to move. Therefore, the problem that the weight of a computer needs to be reduced to improve portability is cited as an example. In addition, there is a problem that the weight of the computer is extremely high and the apparatus becomes expensive.

  The present invention has been made in view of the above-mentioned conventional problems, and has as its object to provide an inexpensive voice recognition output device having high operability and portability.

  In order to solve such a problem, an audio output device according to the present invention includes: a base member; a carrying member having a first arm and a second arm extending in the same direction from the base; Audio data generating means, output means for outputting audio based on the audio data, and the output means mounted on at least one of the first arm and the second arm of the carrying member. Operation receiving means for receiving an operation relating to a mode of outputting a voice.

  According to the audio output device of the present invention, for example, a part of the body of the user can be sandwiched between the first arm and the second arm of the carrying member. That is, the user can wear the carrying member. For example, the user can wear the audio output device such that the carrying member is hung on the neck. For this reason, it is possible to move the audio output device without carrying a box-shaped computer. Therefore, the portability of the audio output device can be improved.

  In addition, since the carrying member can be equipped with, for example, an audio output device in a manner of hanging around the user's neck, the weight is distributed to the first arm and the second arm while maintaining a certain size. It is possible to do. That is, since it is not necessary to reduce the size of the carrying member, an inexpensive voice recognition output device can be provided.

  Further, the operation accepting means is mounted on at least one of the first arm and the second arm, so that the operation accepting means can be operated at hand of the user. Therefore, it is possible to improve the operability of the audio output device.

  The first arm and the second arm may be formed so as to approach each other as the distance from the base increases.

  The first arm and the second arm are formed so as to approach each other as the distance from the base increases, so that the carrying member can be fitted to the body of the user. Therefore, it is possible to prevent the carrying member from separating from the user. In addition, by increasing the fit of the carrying member to the user, the load on the carrying member applied to the user can be dispersed, and user fatigue can be reduced.

  The carrying member is formed in a U-shape when viewed from a direction perpendicular to a plane defined by a straight line extending in a direction in which the first arm extends and a straight line extending in a direction in which the second arm extends. It is good to be.

  By forming the carrying member in this manner, the carrying member can be mounted around the neck of the user. Therefore, the portability of the audio output device can be improved.

  The operation receiving unit is mounted on the first arm unit and the second arm unit, and a mounting surface of the first arm unit on which the operation receiving unit is mounted is a mounting surface of the second arm unit. It is preferable that the mounting surface intersects with the mounting surface on which the operation receiving unit is mounted in an extension thereof.

  By forming the carrying member in this manner, the user's hand can easily touch the operation receiving unit. Therefore, it is possible to improve the operability of the audio output device.

  The output unit may be mounted on at least one of the first arm unit and the second arm unit, and the output unit may be disposed closer to the base than the operation receiving unit.

  By arranging the output means in this way, it is possible to provide the output means at a position near the user's ear. Therefore, it is possible to improve the audibility of the sound output from the sound output device.

  Holding means that can be mounted on the user's head, imaging means for capturing the image held by the holding means, and holding by the holding means so as to be positioned on the right or left side of the user's head And an imaging instruction input means for receiving an input of an imaging instruction to the imaging means, wherein the operation receiving means includes the imaging instruction input means of the first arm portion and the second arm portion. It is good to be provided in the arm part which is proximal from the viewpoint.

  With the provision of the operation receiving means, the user can operate the operation receiving means with the other hand while operating the imaging instruction input means with one hand. Therefore, it is possible to improve the operability of the audio output device.

  The carrying member may include an imaging instruction input unit that instructs the imaging device to perform imaging.

  The provision of the imaging instruction input means as described above allows the user to operate the imaging instruction input means with the carrying member. Therefore, it is possible to improve the operability of the audio output device.

  The carrying member may include an imaging instruction input unit that instructs the imaging device to perform imaging.

  It is preferable that the operation receiving means has an exposed part exposed on the mounting surface, and the exposed part has different unevenness formed on a surface in accordance with an operation received by the operation receiving means.

  As described above, since the unevenness different from each other is formed on the surface of the exposed portion according to the operation accepted by the operation accepting means, the user can recognize the function accepted by the operation accepting means simply by touching the unevenness of the operation accepting means. Becomes possible. Therefore, it is possible to improve the operability of the audio output device.

  It is preferable to include a control unit provided in the carrying member and functioning as the audio data generating unit.

  Further, the carrying member of the present invention is a housing having a base and a first arm and a second arm extending in the same direction from the base, and an acquisition unit for acquiring an image of the periphery of the housing, It is characterized by comprising transmitting means for transmitting the image to the outside, receiving means for receiving audio data generated based on the image, and output means for outputting audio based on the audio data.

FIG. 3 is an explanatory diagram illustrating a mode in which a user uses the audio output device according to the first embodiment. It is a perspective view of the carrying member of FIG. It is a perspective view of the carrying member of FIG. It is a perspective view of the carrying member of FIG. It is a perspective view of the carrying member of FIG. FIG. 2B is an enlarged view of an operation button arranged on the carrying member of FIG. 2A. FIG. 2B is an enlarged view of an operation button arranged on the carrying member of FIG. 2A. FIG. 2B is an enlarged view of an operation button arranged on the carrying member of FIG. 2A. FIG. 2B is an enlarged view of an operation button arranged on the carrying member of FIG. 2A. FIG. 3 is an explanatory diagram illustrating a mode in which a user uses the audio output device according to the first embodiment. FIG. 4 is an explanatory diagram illustrating an operation mode of the audio output device according to the first embodiment. FIG. 4 is an explanatory diagram illustrating an operation mode of the audio output device according to the first embodiment. FIG. 2 is a block diagram illustrating functional blocks of a control unit of the imaging device in FIG. 1. It is a block diagram which shows the functional block of the control unit of the carrying member of FIG. FIG. 4 is a flowchart illustrating a sound output process of the sound output device according to the first embodiment. FIG. 2 is a flowchart illustrating an imaging process performed by the imaging device of FIG. 1. FIG. 2 is a flowchart illustrating audio data generation processing by the portable member in FIG. 1. FIG. 14 is a block diagram illustrating functional blocks of a server connected to the audio output device according to the second embodiment. FIG. 14 is a flowchart illustrating audio data generation processing by the server in FIG. 13.

  Hereinafter, embodiments of the present invention will be described in more detail with reference to the drawings. However, these may be appropriately modified and combined. In the following description and the accompanying drawings, substantially the same or equivalent parts are denoted by the same reference numerals.

  FIG. 1 illustrates an aspect in which a user U uses the audio output device 10 according to the first embodiment. As shown in FIG. 1, the audio output device 10 outputs audio based on an image captured by a camera 20, which is an imaging device.

  The camera 20 is mounted on glasses EG as holding means that can be worn on the user's head. Specifically, the glasses EG include a frame FR that supports a right lens RL that covers the right eye of the user U and a left lens LL that covers the left eye of the user U. The camera 20 is mounted on a frame FR on the left lens LL side of the glasses EG. In other words, the camera 20 is held by the glasses EG so as to be located on the left side of the head of the user U.

  Note that the camera 20 may be mounted via an attachment that is easily detachable from the glasses EG, or may be fastened to the frame FR by a fastening member such as a bolt or a screw. Further, the camera 20 may be held by the glasses EG so as to be located on the right side of the head of the user U.

  The camera 20 captures an image around the user U. In other words, the camera 20 captures an image around the glasses EG. The camera 20 includes a shutter button SB that receives an input of an instruction to perform imaging with respect to the camera 20. In other words, the shutter button SB functions as an imaging instruction input unit that receives an input of an imaging instruction to the camera 20. The shutter button SB is provided so as to protrude away from the body of the camera 20 in the vertical direction. In the present embodiment, the shutter button SB is provided so as to protrude from the body of the camera 20 so as to be away from the body in the vertical direction or toward the ground. This is because in the present embodiment, it is assumed that the user U operates the buttons B1 and B2, which are the operation units, with the dominant arm, and operates the shutter button SB with the arm opposite to the dominant arm. For example, when the user U has a dominant arm, the shutter button SB and the buttons B1 and B2, which are operation units, are arranged on the left side of the user U. When the user operates the shutter button SB arranged on the arm side opposite to the dominant arm, it is natural that the thumb is on the lower side and the forefinger is on the upper side with respect to the thumb as shown in FIG. Therefore, when the user U operates the shutter button SB, the upper side of the shutter button SB is supported by an arbitrary one of the index finger and the little finger, and the shutter button SB is pressed by the thumb (in this case, pressed upward). . By doing so, a natural hand arrangement is achieved, so that even if the shutter button SB is pressed with the arm opposite to the dominant arm, vibration is less likely to be applied to the glasses EG and the camera 20 accompanying the glasses EG, and an image with less camera shake Can be imaged. By doing so, the error rate of character recognition from an image can be reduced. At the same time, since the user U can operate the buttons B1 and B2, which are the operation units, with the dominant arm, the user U can perform a finer operation than the operation with the arm that is not the dominant arm.

  When the shutter button BS is pressed, the camera 20 converts the light incident from the lens LE into an electric signal by an image sensor (not shown). The converted electric signal is recorded as an image on a recording medium (not shown) such as a flash memory built in the camera 20.

  The audio output device 10 includes a carrying member 30. The carrying member 30 is formed of, for example, a resin material. The carrying member 30 is provided with an interface (not shown) capable of communicating with the camera 20. The carrying member 30 is connected to the camera 20 by a cable such as a USB (Universal Sirial Bas). That is, it can be said that the camera 20 captures an image around the carrying member 30.

  The portable member 30 is equipped with a speaker SP as an output unit that outputs sound based on sound data. The speaker SP outputs audio based on audio data converted based on an image captured by the camera 20. The carrying member 30 has a control unit CU1 that controls output of sound based on the sound data.

  FIG. 2A is a perspective view of the carrying member 30 according to the first embodiment as viewed from the front. FIG. 2B is a perspective view of the carrying member 30 according to the first embodiment as viewed from above. As shown in FIGS. 2A and 2B, the carrying member 30 has a base 31 and a first arm 33 and a second arm 34 extending from the base 31 in the same direction. That is, the housing is constituted by the base 31, the first arm 33, and the second arm 34.

  The base 31 has an arc shape when viewed from a direction perpendicular to a plane S defined by a straight line L1 extending in the direction in which the first arm 33 extends and a straight line L2 extending in the direction in which the second arm 34 extends. It is a curved plate-shaped member.

  The first arm 33 and the second arm 34 are formed separately from the base 31. The first arm portion 33 has a connection portion 33a connected to one end of the base portion 31. The first arm portion 33 has a connection portion 33a connected to one end of the base portion 31. The connecting portion 33a is fixed to the base 31 by a fastening member such as a bolt.

  The first arm portion 33 has an extension portion 33b formed integrally with the connecting portion 33a and formed substantially in an L-shape with the base portion 31. The extension 33b is formed in a frustum shape.

  The extension 33b is specifically formed in a truncated pyramid shape as a whole. The distal end of the extension 33b in the direction of extension is rounded and curved. Further, the portion that touches the body of the user U is formed with a corner falling. The top surface of the extension 33b and the bottom surface facing the top surface are formed in a substantially rectangular shape. The top surface has a smaller area than the bottom surface. The side surface formed between the top surface and the bottom surface has a trapezoidal shape.

  The second arm portion 34 has a connecting portion 34a connected to one end of the base 31. The second arm portion 34 has a connecting portion 34a connected to the other end of the base 31. The connecting portion 34a is fixed to the base 31 by a fastening member such as a bolt.

  The second arm portion 34 has an extension portion 34b formed integrally with the connecting portion 34a and formed substantially in an L-shape with respect to the base portion 31. The extension 34b is formed in a frustum shape.

  The extension part 34b is specifically formed in the shape of a truncated pyramid as a whole. The distal end of the extension 34b in the extension direction is rounded and curved. Further, the portion that touches the body of the user U is formed with a corner falling. The top surface of the extension 34b and the bottom surface facing the top surface are formed in a substantially rectangular shape. The top surface has a smaller area than the bottom surface. The side surface formed between the top surface and the bottom surface has a trapezoidal shape.

  The top surface of the extension 33b of the first arm 33 is disposed so as to face the top of the extension 34b of the second arm 34. The extension 33b of the first arm 33 and the extension 34b of the second arm 34 are formed so as to approach each other as the distance from the base 31 increases.

  That is, the carrying member 30 is viewed from a direction perpendicular to the plane S defined by the straight line L1 extending in the direction in which the first arm 33 extends and the line L2 extending in the direction in which the second arm 34 extends. It is formed in a U-shape. Accordingly, when the user puts the audio output device 10 on his / her neck, the carrying member 30 is curved so as to extend from around the user's neck to around his / her shoulder.

  Thus, by forming the carrying member 30, the contact area of the carrying member 30 that contacts the body of the user U increases. That is, the carrying member 30 can be fitted to the body of the user U. Therefore, it is possible to prevent the carrying member 30 from separating from the user. Further, by increasing the fit of the carrying member 30 to the user U, the load of the carrying member 30 applied to the user U can be dispersed, and fatigue of the user U can be reduced.

  Four buttons B1, B2, B3, and B4 are mounted on the first arm 33 and the second arm 34 as operation accepting means for accepting an operation related to the mode of audio output of the speaker SP. In other words, the audio output device 10 has an operation receiving unit that is mounted on at least one of the first arm 33 and the second arm 34 of the carrying member 30 and that receives an operation related to an audio output mode of the speaker SP. .

  The buttons B1 to B4 are mounted on, for example, mounting surfaces S1 and S2 formed along the extension direction of the first arm 33 or the second arm. It is desirable that the length of each button in a direction parallel to the mounting surface and perpendicular to the extending direction, that is, the lateral width, is formed to be 15 mm or less. When the width is 15 mm or less, the user U can easily press with the belly of his / her finger, and the operational feeling can be improved. Further, the width is desirably 1.2 mm or more. When the width is 1.2 mm or more, the user U can recognize by touching the buttons B1 to B4.

  The buttons B1 and B2 are mounted on the first arm 33. The buttons B1 and B2 are arranged in a row in the extension direction of the first arm 33. Specifically, the button B1 is disposed closer to the base 31 than the button B2. For example, the button B1 may be arranged at a position where the thumb touches when the user U holds the first arm 33 with the right hand.

  The button B1 is formed so as to be rectangularly recessed from the mounting surface S1 of the extension 33b of the first arm 33. The button B1 is, for example, an operation button for rewinding the output sound. The button B2 is formed to protrude in a rectangular shape from the mounting surface S1 of the extension 33b of the first arm 33. The button B2 is a button for adjusting the volume of the speaker SP, for example. The button B2 has two regions Ra and Rb. One area Ra of the button B2 functions as an operation button for increasing the volume of the speaker SP. The other region Rb of the button B2 functions as an operation button for reducing the volume of the speaker SP.

  One area Ra on the surface of the button B2 is arranged on the base 31 side, and the other area Rb on the surface of the button B2 is arranged on the tip side of the arm 33.

  Since the frequency of operating the operation button for increasing the volume first when the sound cannot be heard due to the influence of the surrounding environmental sound or the like is higher than the frequency of operating the operation button for decreasing the volume first, the operation button is disposed on the base 31 side. By making one area Ra on the surface of the button B2 function as an operation button for increasing the volume, operability can be improved.

  Further, when the area Ra on the surface of the button B2 is pressed, the area Rb on the surface of the button B2 rises, and when the area Rb on the surface of the button B2 is pushed, the area Ra on the surface of the button B2 rises. Is also good.

  The buttons B3 and B4 are mounted on the second arm 34. The buttons B3 and B4 are arranged in a row in the extending direction of the second arm 34. Specifically, the button B3 is disposed closer to the base 31 than the button B4. For example, when the user U holds the second arm 34 with the left hand, the button B1 may be arranged at a position where the thumb touches.

  The button B3 is formed to protrude in a rectangular shape from the mounting surface S2 of the extension 34b of the second arm 34. The button B3 is, for example, a button for adjusting the speed of the sound reproduced from the speaker SP. The button B3 has two regions Rc and Rd. One region Rc of the button B3 functions as an operation button for increasing the speed of sound reproduced from the speaker SP. The other area Rd of the button B3 functions as an operation button for reducing the speed of the sound reproduced from the speaker SP.

  One region Rc on the surface of the button B2 is located on the base 31 side, and the other region Rd on the surface of the button B2 is located on the tip side of the arm portion.

  The operation button for adjusting the reproduction speed is first used to increase the reproduction speed of less necessary information, and often lowers the reproduction speed when listening to important information. In view of the above, since the operation button for increasing the reproduction speed is often operated earlier than the operation button for decreasing the reproduction speed, the surface of the button B3 arranged on the base 31 side is By making one of the regions Rc function as an operation button for increasing the reproduction speed, the operability can be improved.

  Further, when the region Rc on the surface of the button B3 is pressed, the region Rd on the surface of the button B3 rises, and when the region Rd on the surface of the button B3 is pressed, the region Rc on the surface of the button B3 rises. Is also good.

  The button B4 is formed to be rectangularly recessed from the mounting surface S2 of the extension 34b of the second arm 34. The button B4 is, for example, an operation button for changing a mode of generating audio data from an image captured by the camera 20, that is, for changing a control mode of the audio output device 10 for generating audio data. As an example of the control mode, for example, when there is much information to be conveyed to the user U around the user U, the frequency at which the user U presses the shutter button SB increases. In such a case, the audio output device 10 controls the audio data to be generated based on information included in the image captured by the camera 20 without the user U pressing the shutter button SB (hereinafter, referred to as a city walking mode). ) May be performed. The button B4 is an operation button for switching between the town walking mode and the normal control mode.

  As described above, the buttons B1 and B2 are formed so as to be exposed from the mounting surface S1 of the first arm 33. The buttons B3 and B4 are formed so as to be exposed from the mounting surface S2 of the second arm 34. That is, the buttons B1 to B4 function as exposed portions that are exposed on the mounting surfaces of the first arm 33 and the second arm 34.

  A method of distributing the functions of the buttons B1 to B4 in this embodiment will be described. In the present embodiment, the user U is right-handed and operates the shutter button SB with the left hand opposite to the dominant arm. At this time, the buttons B1 and B2 are arranged on the left first arm 33, which is the arm opposite to the user U's dominant arm, and the buttons B3 and B4 are arranged on the right second arm, which is the user U's dominant arm. It is arranged on the arm 34. Therefore, the user U operates the buttons B1 and B2 with the right arm, which is the dominant arm, and operates the buttons B3 and B4 with the left hand opposite to the dominant arm.

  At this time, the buttons B1 and B2 may be provided with functions that are likely to be used at the same time as the user U operates the shutter button SB or immediately before or immediately after operating the shutter button SB. Specifically, it is preferable to arrange a fast-return button and a volume adjustment button on the buttons B1 and B2. These fast-return buttons and volume adjustment buttons need to be pressed immediately when the user U cannot hear the sound output from the sound output device 10 well. Therefore, when the user U operates the shutter button SB, the person who can prepare for pressing while pressing the button B1 or the button B2 with the arm (right hand) opposite to the arm (right hand) for operating the shutter button SB, The nature increases. On the other hand, the functions mainly used in the preparatory stage of photographing or during photographing may be operated by the same arm (left hand) as the arm by which the user U operates the shutter button SB. Therefore, the adjustment of the reproduction speed and the setting of the menu are preferably arranged on the buttons B3 and B4 on the same arm side as the arm on which the user U operates the shutter button SB.

  The button on the same side as the arm on which the user U operates the shutter button SB may be provided with a function in which the operation unit (button) closer to the base 31 is frequently operated. As a premise, the user U may be a visually impaired person. When the user U operates the buttons B1 to B4, the user U does not look at the positions where the buttons B1 to B4 are arranged. Operate. Therefore, when the user U naturally grasps the first arm 33 or the second arm 34, it is preferable that the button of the most frequently used function is arranged near the place where the thumb is arranged. . At this time, for example, when the user U operates the button B1 or B2 with the right hand, as shown in FIG. 7A, the button B1 (the button closer to the base 31 than the button B2) is arranged on the tip side of the thumb, The button B2 (the button farther than the button B1 with respect to the base 31) is arranged on the base side of the thumb. Due to the structure of human hands, when the user U naturally grasps the first arm 33 or the second arm 34, the thumb often extends naturally. Therefore, when operating the button B2 on the root side from the operation on the button B1 on the tip side of the thumb, the user U can respond only by bending the thumb. On the other hand, when the user U further operates the button 1 on the tip side of the thumb from a state in which the user U holds the first arm 33 or the second arm 34, the user U cannot cope even with the thumb extended. It is necessary to operate the button 1 by moving the entire arm toward the base 31. That is, when the user U once grips the first arm 33 or the second arm 34, the user U moves from the gripped state to the direction in which the first arm 33 or the second arm 34 extends (with respect to the base 31). It is easier to operate the button B2 (distant from the button B1) than to operate the button B1 disposed in the direction of the base 31. Therefore, the most frequently used functions are arranged on the buttons (buttons B1, B3) proximal to the base 31, and the less frequently used functions are arranged on the buttons (buttons B2, B4) in the direction of extension of the arm. Good to be.

  The speaker SP is mounted on the mounting surface S1 of the first arm 33 and the mounting surface S2 of the second arm 34. The speaker SP mounted on the first arm 33 is located closer to the base 31 than the buttons B1 and B2. Further, the speaker SP mounted on the second arm portion 34 is disposed closer to the base 31 than the buttons B3 and B4.

  FIG. 3 is a perspective view of the carrying member 30 according to the first embodiment as viewed from the front. As shown in FIG. 3, the surface 3 including the mounting surface S1 of the extension 33b of the first arm 33 on which the buttons B1 and B2 are mounted is the button B3 of the extension 34b of the second arm 34. It intersects with a surface S4 including a mounting surface S2 on which B4 is mounted. In other words, the mounting surface S1 is formed so as to form a predetermined angle from the mounting surface S2. That is, the mounting surface S1 is not parallel to the mounting surface S2.

  FIG. 4 is a perspective view of the carrying member 30 according to the first embodiment as viewed from the front. In FIG. 4, the mounting surface S1 of the extension 33b of the first arm 33 on which the buttons B1 and B2 are formed forms an angle α from the plane S. The mounting surface S2 of the extension 34b of the second arm 34 on which the buttons B3, B4 are formed forms an angle -α from the plane S. That is, the mounting surface S1 and the mounting surface S2 have shapes that are symmetric with respect to the plane S.

  In other words, the mounting surface S1 of the extension 33b of the first arm 33 on which the buttons B1 and B2 are formed and the mounting surface S2 of the extension 34b of the second arm 34 on which the buttons B3 and B4 are formed. Is formed at an angle to a plane S defined by a straight line L1 extending in the direction in which the first arm 33 extends and a straight line L2 extending in the direction in which the second arm 34 extends.

  FIG. 5A shows the plane of the button B1. As shown in FIG. 5A, the button B1 is an operation button for quickly returning the output sound. On the surface of the button B1, a symbol as an operation button for quickly returning the sound is formed in a convex shape. The symbol as the operation button for rewinding quickly includes, for example, a symbol in which the end point of an arc is represented by an arrow.

  FIG. 5B shows the plane of the button B2. As shown in FIG. 5B, button B2 is a button for adjusting the volume of the speaker. The button B2 is preferably formed to have a larger area on the mounting surface S1 than the button B1. By forming the button B2 in this manner, the user U can identify which button is the button B1 or the button B2 with a feeling of touching the button B2 without visual observation.

  Two areas are provided on the surface of the button B2. In one area Ra on the surface of the button B2, a symbol as an operation button for increasing the volume is formed in a convex shape. The symbol as the operation button for increasing the volume may be, for example, one represented by three concentric arcs having different radii. Each arc is arranged according to the length of the radius of the arc. For example, an arc having an intermediate radius is disposed between an arc having the shortest radius and an arc having the longest radius among the three arcs.

  In the other region Rb on the surface of the button B2, a symbol as an operation button for reducing the volume is formed in a convex shape. The symbol as the operation button for decreasing the volume may be, for example, one represented by a single arc.

  FIG. 5C shows the plane of the button B3. As shown in FIG. 5C, the button B3 is a button for adjusting the reproduction speed for reproducing the sound of the speaker. The button B3 is preferably formed to have a larger area on the mounting surface S2 than the button B4. By forming the button B3 in this way, the user U can identify which button is the button B4 or the button B3 with the touch of the button B3 without visual observation.

  Two areas are provided on the surface of the button B3. In one region Rc on the surface of the button B3, a symbol for increasing the sound reproduction speed is formed in a convex shape. Symbols used as operation buttons for increasing the reproduction speed include, for example, those represented by three circles having the same radius. Each circle is arranged in a row on the surface of the button B3.

  In the other region Rc on the surface of the button B3, a symbol as an operation button for reducing the reproduction speed is formed in a convex shape. The symbol used as the operation button for reducing the reproduction speed is, for example, one represented by one circle.

  FIG. 5D shows the plane of the button B4. As illustrated in FIG. 5D, the button B4 is an operation button for operating a control mode for generating a sound of the sound output device 10. On the surface of the button B4, a symbol as an operation button for operating the control mode is formed in a convex shape. The symbol as the operation button for operating the control mode includes, for example, a symbol with a motif of a lower body when a human walks.

  As described above, the buttons B1 to B4 have different irregularities on the surface in accordance with the operation to be received. Note that the functions accepted by the buttons B1 to B4 are merely examples, and may be implemented by appropriately changing them. For example, any of the buttons B1 to B4 may have a function of a shutter button of the camera 20.

  FIG. 6 shows an aspect when the user operates the audio output device. As shown in FIG. 6, the first arm 33 of the carrying member 30 is disposed on the left lens LL side of the frame FR of the glasses EG. The second arm 34 of the carrying member 30 is arranged on the right lens RL side of the frame FR of the glasses EG.

  The buttons B1 and B2 are provided on the first arm portion 33 that is proximal to the shutter button SB. That is, the buttons B1 and B2 are provided on one of the first arm 33 and the second arm 34 that is proximal to the shutter button SB.

FIG. 7A shows an operation mode of the buttons B1 and B2 by the right hand when the right-handed person operates the shutter button SB with the left hand. As shown in FIG. 7A, when operating the shutter button SB with the left hand, the user U can operate the button B1 or the button B2 with the right hand. This is because the normally dominant arm can perform more delicate operations than the non-dominant arm. When the operation of pressing the shutter button SB and the operation of the button B1 (fast rewind) or the operation of the button B2 (adjustment of the volume) are compared, the operation of the buttons B1 and B2 requires a more complicated operation. Therefore, by arranging the buttons B1 and B2 on the first arm 33 which is easy for the right-handed person to operate according to the dominant arm, the shutter button SB can be operated and the buttons B1 and B2 can be operated. Becomes That is, by arranging the buttons B1 and B2 for functions having a high priority desired by the user U, it is possible to improve the operability of the audio output device 10.

  Incidentally, the shutter button SB and the buttons B1 to B4 may be arranged according to the dominant arm of the user U. For example, when the left hand is a dominant arm, the shutter button SB of the camera 20 is mounted on the right side of the user's head, and when the shutter button SB is operated with the right hand, the button B3 or the button B4 may be operated with the left hand. Good. Further, an interface (not shown) of the carrying member 30 that can communicate with the camera 20 may be provided according to the position where the camera 20 is mounted on the glasses EG. For example, when the shutter button SB of the camera 20 is mounted on the left side of the head of the user U, an interface may be provided on the first arm 33. On the other hand, when the shutter button SB of the camera 20 is mounted on the right side of the head of the user U, an interface may be provided on the first arm 34.

  FIG. 7B shows an operation mode of the buttons B1 and B2 by the left hand. As shown in FIG. 7B, the user U can operate the button B1 or the button B2 on the left.

  That is, as described in FIG. 4, the mounting surface S1 of the extension 33b of the first arm 33 on which the buttons B1 and B2 are formed forms an angle α with the plane S. For example, when the control mode of the audio output device 10 is set to the city walking mode, the user U may operate the button B1 or the button B2 with the left hand. At this time, the operability of the button B1 and the button B2 can be enhanced by the mounting surface S1 having the angle α with respect to the plane S. Further, since the mounting surface S1 is formed with the corners dropped, the stress applied to the user U when operating the buttons B1 and B2 can be reduced.

FIG. 8 shows functional blocks of the control unit CU2 of the camera 20. As shown in FIG. 8, the input unit 21 is an interface unit connected to the shutter button SB and the imaging unit IU. The camera 20 can acquire an imaging instruction from the shutter button SB via the input unit 21. The camera 20 can acquire image data generated by the imaging unit IU via the input unit 21.

  The imaging unit IU includes an imaging device that generates image data by converting light that has entered from the lens LE into an electric signal. The image sensor is, for example, a CMOS image sensor. The imaging unit IU includes, for example, an imaging mechanism such as a shutter.

  The storage device 22 is configured by, for example, a flash memory or the like. The storage device 22 stores various programs such as a basic input output system (BIOS) and software. Further, the storage device 22 can store image data IM captured by the camera 20.

  The communication unit 23 is an interface unit that communicates with the portable member 30. The camera 20 can transmit image data stored in the storage device 22 to the portable member 30 via the communication unit 23.

  The output unit 24 is an interface unit connected to the imaging unit IU. The camera 20 can output an imaging instruction input from the shutter button SB to the imaging unit IU.

  The control unit 25 is realized by a computer having a CPU (Central Processing Unit) as an arithmetic processing device, a ROM (Read Only Memory) as a main storage device, and a RAM (Random Access Memory). The CPU reads out a program corresponding to the processing content from the ROM or the storage device 22, expands the program into the RAM, and realizes various functions in cooperation with the expanded program.

  The operation control unit 25a is one of the functional blocks of the control unit 25. The operation control unit 25a can control the imaging operation of the camera 20.

  The input unit 21, the storage device 22, the communication unit 23, the output unit 24, and the control unit 25 are connected to each other via a system bus B1.

  FIG. 9 shows functional blocks of the control unit CU1 of the carrying member 30. As shown in FIG. 9, the input unit 35 is an interface unit connected to the buttons B1 to B4.

  The storage device 36 is configured by, for example, a flash memory or the like. The storage device 36 stores various programs such as a basic input output system (BIOS) and software. Further, the storage device 36 can store image data transmitted from the camera 20.

  The storage device 36 includes a video / audio conversion database (hereinafter, the database is referred to as DB). The image-sound conversion DB stores information included in an image and sound data associated with the information. For example, the image-audio conversion DB has a data structure in which characters and audio data are linked. The image / audio conversion DB has a data structure in which words and audio data are linked. The image-sound conversion DB has a data structure in which an object and sound data are linked. Note that the image-audio conversion DB may be constructed by deep learning based on the image captured by the camera 20.

  The communication unit 37 is an interface unit that communicates with the camera 20. The carrying member 30 can communicate with the camera 20 via the communication unit 37.

  The output unit 38 is an interface unit connected to the speaker SP. The carrying member 30 can output sound from the speaker SP via the output unit 38.

  The control unit 39 is realized by a computer having a CPU (Central Processing Unit) as an arithmetic processing device, a ROM (Read Only Memory) as a main storage device, and a RAM (Random Access Memory). The CPU reads out a program corresponding to the processing content from the ROM or the storage device 36 and develops the program on the RAM, and realizes various functions in cooperation with the developed program.

  The input unit 35, the storage device 36, the communication unit 37, the output unit 38, and the control unit 39 are connected to each other via a system bus B2.

  The audio data generation unit 39a is one of the functional blocks of the control unit 39. When receiving the image data transmitted from the camera 20, the audio data generation unit 39a can generate audio data based on characters included in the received image data IM. Therefore, the control unit 39 functions as an audio data generation unit that generates audio data based on characters included in an image of the area around the user U.

  The audio data generation unit 39a recognizes characters in an image by, for example, OCR (Optical Character Recognition). The audio data generation unit 39a generates audio data by referring to the image and audio conversion DB for the recognized character.

The sound output processing of the sound output device 10 described above will be described. The case where the speech output device 10 converts a sentence composed of characters printed on paper into speech data and outputs the speech data will be described.

  FIG. 10 shows a sound output process of the sound output device 10. As shown in FIG. 10, the audio output device 10 captures an image of a paper to be converted into audio by the camera 20 (step S11). The audio output device 10 generates audio data based on the image data IM captured in step S11 (step S12). The sound output device 10 outputs a sound from the speaker SP based on the sound data generated in step S12 (step S13).

  FIG. 11 shows a subroutine of the imaging process in step S11 of FIG. As shown in FIG. 11, the control unit 25 of the camera 20 determines whether the shutter button has been pressed (step S21). When the shutter button SB of the camera 20 is pressed by the user U (Step S21: Y), an image of an object to be imaged is captured by the imaging unit UI of the camera 20 (Step S22). The image data IM captured in step S12 may be recorded in the storage device 22. The camera 20 transmits the image data IM captured in step S12 to the control unit U1 of the carrying member 30 (step S23).

  FIG. 12 shows a subroutine of the audio data generation processing in step S12 of FIG. As shown in FIG. 12, the control unit 39 of the carrying member 30 determines whether the image data IM has been received (step 31). When determining that the image data IM has been received (step S31: Y), the control unit 39 of the carrying member 30 generates audio data based on the text of the text included in the received image data IM (step S32). . Therefore, the control unit 39 of the carrying member 30 functions as the audio data generation unit 39a. When the text included in the image data IM extends over a long text, the audio data generation unit 39a may generate audio data by summarizing the content of the text.

  The object to be converted into the sound included in the image data IM may be not only a sentence but also a combination of a character and a table, such as a timetable. In the case of such an object to be converted into voice, for example, voice data including a bus destination and a time of departure from a bus stop may be generated. For example, the audio data may be generated such that the audio is output as follows: "The bus going to A (destination) departs from the B bus stop at 8 o'clock is C, D, E minutes." .

  Further, the object to be converted to voice may include information associated with a proper noun. For example, in the case of image data including the name of a shopping street, for example, the audio data is "This shopping street has shops such as A, B, and C, and the lunch at A has a menu of D and E. The average amount of the A point lunch is F yen. "

  Furthermore, the object from which the audio data generation unit 39a generates audio data is an image captured by the camera 20. However, the target for which the audio data generation unit 39a generates the audio data is not limited to a still image, and may be, for example, a video captured by the camera 20.

  As described above, according to the audio output device 10 of the present invention, the user U can wear the audio output device 10 in a manner of hanging the carrying member 30 around the neck. For this reason, it is possible to move the audio output device 10 without carrying a box-shaped computer. Therefore, the portability of the audio output device 10 can be improved.

  In addition, since the carrying member 30 of the audio output device 10 can be mounted on the neck of the user U, the weight can be distributed to the first arm 33 and the second arm 34. Become.

  In this embodiment, audio is output from the speaker SP. However, the output of the sound is not limited to the speaker SP, and may be performed by, for example, an earphone or headphones. When sound is output from an earphone or headphones, for example, an earphone jack may be provided on the base 31 of the carrying member 30.

  In this embodiment, the speakers SP are mounted on both the first arm 33 and the second arm 34. However, the speaker SP only needs to be mounted on at least one of the first arm 33 and the second arm 34, and the speaker SP is not necessarily provided on both the first arm 33 and the second arm 34. It does not need to be installed.

(Generate audio data on the server)
The audio output device 10 according to the second embodiment will be described. The audio output device 10 according to the second embodiment is different from the audio output device 10 according to the first embodiment in that the audio output device 10 is communicably connected to a server. Specifically, the server generates audio data based on characters included in the image data IM. Note that the same components as those of the audio output device 10 according to the first embodiment are denoted by the same reference numerals, and description thereof is omitted.

  FIG. 13 illustrates a configuration of a server 40 to which the audio output device 10 according to the second embodiment is connected. As shown in FIG. 13, the storage device 41 of the server 40 is configured by, for example, a flash memory. The storage device 41 stores various programs such as a basic input output system (BIOS) and software. Further, the storage device 41 can store image data transmitted from the carrying member 30.

  The storage device 41 includes an image / audio conversion DB. The image-sound conversion DB stores information included in an image and sound data associated with the information. For example, the image-audio conversion DB has a data structure in which characters and audio data are linked. The image / audio conversion DB has a data structure in which words and audio data are linked. The image-sound conversion DB has a data structure in which an object and sound data are linked. Note that the image-audio conversion DB may be constructed by deep learning based on the image captured by the camera 20.

  The communication unit 42 is an interface unit that communicates with the portable member 30. The server 40 can communicate with the portable member 30 via the communication unit 42.

  The control unit 43 is realized by a computer having a CPU (Central Processing Unit) as an arithmetic processing device, a ROM (Read Only Memory) as a main storage device, and a RAM (Random Access Memory). The CPU reads out a program corresponding to the processing content from the storage device 41, loads the program on the RAM, and realizes various functions in cooperation with the loaded program.

  The storage device 41, the communication unit 42, and the control unit 43 are connected to each other via a system bus B3.

  When receiving the image data transmitted from the carrying member 30, the control unit 43 can generate audio data based on the characters included in the received image data IM. Therefore, the control unit 43 functions as an audio data generation unit that generates audio data based on characters included in an image of the area around the user U.

  The audio data generation unit 43a is one of the functional blocks of the control unit 43. When receiving the image data transmitted from the portable member 30, the audio data generation unit 43a can generate the audio data based on the characters included in the received image data IM. Therefore, the control unit 43 functions as an audio data generation unit that generates audio data based on characters included in an image of the area around the user U.

  The audio data generation unit 43a recognizes characters in an image by, for example, OCR (Optical Character Recognition). The voice data generation unit 43a generates voice data with reference to the image / voice conversion DB for the recognized character.

  A description will be given of an output mode of the audio output device 10 described above. The processing is the same as that of the first embodiment except for the audio data generation processing in step S12 in FIG.

  When carrying the image data IM, the carrying member 30 transmits the image data IM to the server 40.

  FIG. 14 shows a subroutine of audio data generation processing by the server 40. As shown in FIG. 14, the control unit 43 of the server 40 determines whether the image data IM has been received (Step 41). When the control unit 43 of the server 40 determines that the image data IM has been received (step S41: Y), the control unit 43 generates audio data based on the text of the text included in the received image data IM (step S42). Therefore, the control unit 43 of the server 40 functions as the audio data generation unit 43a. The control unit 43 of the server 40 transmits the audio data generated in step S42 to the control unit U1 of the portable member 30 (step S43).

  As described above, according to the audio output device 10 of the present invention, the user U can wear the audio output device 10 in a manner of hanging the carrying member 30 around the neck. For this reason, it is possible to move the audio output device 10 without carrying a box-shaped computer. Therefore, the portability of the audio output device 10 can be improved.

Reference Signs List 10 audio output device 20 camera 30 carrying member 31 base 33 first arm 34 second arm 39 control unit 40 server B1 to B4 button EG glasses FR frame SB shutter button SP speaker

Claims (10)

A carrying member having a base and a first arm and a second arm extending in the same direction from the base;
Audio data generating means for generating audio data based on a captured image,
Output means for outputting a sound based on the sound data,
Operation receiving means mounted on at least one of the first arm part and the second arm part of the carrying member and receiving an operation relating to an output mode of the sound by the output means;
An audio output device comprising:   The audio output device according to claim 1, wherein the first arm and the second arm are formed so as to approach each other as the distance from the base increases.   The carrying member is formed in a U-shape when viewed from a direction perpendicular to a plane defined by a straight line extending in a direction in which the first arm extends and a straight line extending in a direction in which the second arm extends. The audio output device according to claim 1, wherein: The operation receiving means is mounted on the first arm and the second arm,
The surface of the first arm portion including the mounting surface on which the operation receiving unit is mounted intersects with the surface of the second arm portion including the mounting surface on which the operation receiving unit is mounted. The audio output device according to claim 1, wherein: The output unit is mounted on at least one of the first arm and the second arm,
The audio output device according to claim 1, wherein the output unit is disposed closer to the base than the operation receiving unit. Holding means attachable to the user's head;
Imaging means for imaging the image held by the holding means;
An imaging instruction input unit that is held by the holding unit so as to be located on the right side or the left side of the user's head, and that receives an input of an imaging instruction to the imaging unit,
6. The method according to claim 1, wherein the operation receiving unit is provided on an arm of the first arm and the second arm that is proximal to the imaging instruction input unit. 7. An audio output device according to any one of the above.   The audio output device according to any one of claims 1 to 6, wherein the carrying member includes an imaging instruction input unit that instructs the imaging device to perform imaging. The operation receiving means has an exposed portion exposed on the mounting surface,
The audio output device according to any one of claims 1 to 7, wherein the exposure unit has different irregularities formed on a surface according to an operation received by the operation receiving unit.   The audio output device according to any one of claims 1 to 8, further comprising a control unit provided in the portable member and functioning as the audio data generation unit. A housing having a base and a first arm and a second arm extending in the same direction from the base;
Acquisition means for acquiring an image of the periphery of the housing,
Transmitting means for transmitting the image to the outside,
Receiving means for receiving audio data generated based on the image,
Output means for outputting a sound based on the sound data,
A carrying member comprising: