JP7023022B1 - Neck-mounted device and remote work support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a small worker terminal that can be used for a remote work support system. SOLUTION: The neck-mounted device 100 is attached to a user's wrist, and has a first arm portion 10 and a second arm portion 20 which can be arranged at positions sandwiching the neck portion, and at least the first arm portion 10. Alternatively, the imaging unit 41, 51 provided on the second arm portion 20 and capable of photographing the front side of the user, and the imaging unit 41, 51 provided on at least the first arm portion or the second arm portion, irradiate light within the imaging range. It is provided with possible floodlights 42 and 52. [Selection diagram] Fig. 1

Description

The present invention relates to a neck-mounted device and a remote work support system using the neck-mounted device.

Conventionally, a remote work support system including a worker terminal having a camera, a laser pointer, and the like and a supporter terminal connected to the terminal via the Internet has been known (Patent Document 1). In this system, when the worker terminal sends an image taken by the camera to the supporter terminal, the image is displayed on the supporter terminal. Further, when a supporter such as an operator designates a part of the image to the supporter terminal with a mouse pointer or the like while looking at the image, the designated information is transmitted to the worker terminal via the Internet. Then, the worker terminal controls the irradiation direction and angle of the laser pointer based on this designated information. As a result, even when the supporter is located at a remote location from the work site, support information can be transmitted to the worker at this site via a laser pointer or the like provided in the worker terminal.

Further, in the remote work support system as described above, it has been proposed to miniaturize the worker terminal to make it a device (wearable device) that can be worn by the worker (Patent Document 2).

Japanese Unexamined Patent Publication No. 2000-12502 Japanese Unexamined Patent Publication No. 2004-219847

By the way, the small mobile terminal disclosed in Patent Document 2 is used by being attached to the shoulder of the user, but it is about half the size of the head of the user, and there is still room for miniaturization. In particular, in this small mobile terminal, the laser light source and the camera are integrally fixed. Therefore, in this terminal, in order to be configured to irradiate the laser beam from the laser light source within the angle of view range of the camera, the irradiation direction of the laser beam is controlled by using a relatively large turntable. This is an obstacle to the miniaturization of terminals. In addition, as the size of the rotary table increases, it becomes necessary to mount a large battery for supplying power to the rotary table, which is also one of the factors that hinder the miniaturization of terminals.

Therefore, the main object of the present invention is to make the terminal for workers that can be used in the remote work support system smaller.

A first aspect of the present invention relates to a neck-mounted device worn around the user's neck. The neck-mounted device has a first arm portion and a second arm portion that can be arranged at positions sandwiching the neck. An image pickup unit (camera or the like) capable of photographing the front side of the user is provided on either one or both of the first arm portion and the second arm portion. Further, one or both of the first arm portion and the second arm portion are provided with a light projecting unit (laser light source, projector, etc.) capable of irradiating light within the photographing range of the imaging unit. The neck-mounted device according to the present invention can also give an instruction (pointing) at a specific location by using the light emitted from the light projecting unit, and the light can be used to give a figure, a letter, a number, a symbol, or an image. It is also possible to project message information including on an object. In this way, by providing the image pickup unit and the light projecting unit on the arm portion of the neck-mounted device, the terminal for workers that can be used for the remote work support system can be further miniaturized. As a result, the portability of the worker terminal can be improved.

In the neck-mounted device according to the present invention, the imaging unit is provided on at least one of the first arm portion and the second arm portion, and the light projecting portion is provided on at least one of the first arm portion and the second arm portion. Is preferable. In this way, by providing the imaging unit and the light projecting unit on separate arms, the terminal can be further miniaturized. Specifically, for example, when an imaging unit is provided on the first arm and a light projecting unit is provided on the second arm, there is a certain distance between the imaging unit and the light projecting unit, and the optical axes of both are set. You can make a certain angle difference. Therefore, when irradiating light from the light projecting unit with respect to the shooting range of the image pickup unit, the drive amount of the drive unit (actuator or the like) that controls the light irradiation direction of the light projecting unit can be reduced. If the amount of drive is small, the configuration of the drive unit itself can be miniaturized. Further, if the drive unit can be miniaturized, the battery for supplying electric power to the drive unit can also be miniaturized. As a result, the entire device can be made compact. It is also possible to provide the imaging unit on either the first arm portion or the second arm portion and provide the light projecting portion on both the first arm portion and the second arm portion. It is also possible to provide the imaging unit on both the first arm and the second arm and provide the light projecting unit on either the first arm or the second arm.

In the neck-mounted device according to the present invention, it is preferable that the image pickup unit and the light projecting unit are provided on both the first arm portion and the second arm portion, respectively. In this way, by providing the imaging unit on both arms, the front side of the user can be widely photographed by the two imaging units. In particular, the shooting range in the horizontal direction (horizontal angle of view) is widened. Similarly, by providing the imaging unit on both arms, the light from the projection unit can be irradiated over a wide range. In addition, by installing the floodlights in two or more places, for example, while instructing a specific place with the light from one floodlight, character information, graphic information, etc. can be output by the other floodlights. Therefore, the amount of information given to the user can be significantly improved. Further, if one light projecting unit attempts to simultaneously display a pointing point (pointing) at a specific location and character information, etc., it is necessary to irradiate light over a wide range from this light projecting unit, for example. There is a concern that the illuminance at the indicated point will decrease. In this regard, by separately displaying the designated point and the text information at a specific location by two or more floodlights, the illuminance of the designated point can be kept strong and the text information can be displayed effectively. Become.

In the neck-mounted device according to the present invention, it is preferable that the light projecting portion of the first arm portion is configured to be able to irradiate light within the photographing range of the imaging portion of the second arm portion. Further, it is preferable that the light projecting portion of the second arm portion is configured to be able to irradiate light within the photographing range of the imaging portion of the first arm portion. In this way, the light is irradiated from the light projecting portion of the first arm to the shooting range of the second imaging unit, and the light is irradiated from the light projecting portion of the second arm to the shooting range of the first imaging unit. By arranging each light projecting unit and each imaging unit as described above, the configuration of the drive unit that controls the irradiation direction of the light projecting unit can be miniaturized as described above.

In the neck-mounted device according to the present invention, in a plan view, the imaging direction of the imaging unit of the first arm portion and the second arm portion is tilted outward, and the light projecting portion of the first arm portion and the second arm portion. It is preferable that the light projection direction of the light is inclined inward. In addition, "outward" means that the imaging direction of the imaging unit of the first arm is opposite to the direction in which the second arm is present, and similarly, the imaging direction of the imaging unit of the second arm. Means that is facing in the direction opposite to the direction in which the first arm is present. Further, "inward" means that the light projecting direction of the light projecting portion of the first arm is the direction in which the second arm portion exists, and similarly, the light projecting direction of the light projecting portion of the second arm portion is It means that the first arm is facing the direction in which it exists. In this way, by setting the shooting direction of the imaging unit of each arm to be outward, when the images captured by the two imaging units are integrated, the horizontal angle of view of the integrated image can be widened. can. Further, by setting the light emitting direction of the light projecting portion of each arm to be inward, it becomes easy for the light projecting portion of one arm to irradiate light within the photographing range of the imaging unit of the other arm. Further, by making the shooting direction by the imaging unit and the projection direction by the projection unit opposite to each other, the light from the projection unit arranged on the same arm portion is less likely to be incident on the imaging unit. As a result, a phenomenon such as so-called overexposure is less likely to occur in the image acquired by the image pickup unit.

The neck-mounted device according to the present invention may further include a control unit for controlling the light projecting unit and one or more sound collecting units provided on the first arm portion or the second arm portion. In this case, the control unit can control the floodlight unit so that the light indicates the direction in which the sound is emitted, based on the information regarding the sound acquired by the sound collection unit. This allows the user to visually understand the direction in which the sound is generated.

The second aspect of the present invention relates to a remote work support system using the neck-mounted device according to the first aspect described above. The remote work support system according to the present invention is configured by connecting a neck-mounted device worn around the user's neck and a supporter device operated by a supporter to each other via an information communication line. Has been done. The neck-mounted device is provided on the first arm portion and the second arm portion that can be arranged at positions sandwiching the user's neck, and at least the first arm portion or the second arm portion, and can photograph the front side of the user. It includes an image pickup unit, a light projecting unit provided on at least the first arm portion or the second arm portion and capable of irradiating light within the photographing range of the image pickup unit, and a control unit for controlling the light projection unit. The supporter device includes a display unit capable of displaying the captured image acquired by the image pickup unit of the neck-mounted device, and an operation unit capable of inputting the designation of coordinates on the display screen of the display unit. When the coordinates in the captured image displayed on the display screen are specified by the operation unit, the supporter device transmits the coordinate information in the captured image to the worker terminal. The control unit of the neck-mounted device controls the irradiation direction of the light emitted from the light projecting unit based on this coordinate information. As a result, support information can be transmitted from a remote location from the supporter terminal to the neck-mounted device (worker terminal).

According to the present invention, the terminal for workers that can be used for the remote work support system can be further miniaturized.

FIG. 1 is a perspective view showing an example of a neck-mounted device. FIG. 2 is a plan view showing a mounted state of the neck-mounted device, and schematically shows a shooting range of each imaging unit and a projectable range of each floodlight unit. FIG. 3 is a block diagram showing a functional configuration of a neck-mounted device. FIG. 4 shows an example of a remote work support system. FIG. 5 is a flow chart showing an example of processing of a worker terminal and a supporter terminal included in the remote work support system.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. The present invention is not limited to the forms described below, and includes those appropriately modified from the following forms to the extent apparent to those skilled in the art.

FIG. 1 shows an embodiment of a neck-mounted device 100 according to the present invention. Further, FIG. 2 schematically shows a state in which the wearer wears the neck-mounted device 100. Further, FIG. 3 is a block diagram showing the components of the neck-mounted device 100. As shown in FIG. 1, the housing constituting the neck-mounted device 100 includes a left arm portion 10, a right arm portion 20, and a main body portion 30. The left arm portion 10 and the right arm portion 20 extend forward from the left end and the right end of the main body portion 30, respectively, and the neck-mounted device 100 has a structure in which the device as a whole forms a substantially U shape when viewed in a plan view. ing. When wearing the neck-mounted device 100, as shown in FIG. 2, the main body 30 is brought into contact with the back of the wearer's neck, and the left arm 10 and the right arm 20 are moved from the side of the wearer's neck to the chest side. All you have to do is hang it down and hook the entire device around your neck. As shown in FIG. 3, various electronic components are stored in the housing of the neck-mounted device 100.

In the present embodiment, the left arm portion 10 and the right arm portion 20 are provided with image pickup units (cameras) 41 and 51, respectively. Specifically, a first image pickup unit 41 is provided at the tip of the left arm portion 10, and a second image pickup unit 51 is provided at the tip end portion of the right arm portion 20, and these image pickup units 41 and 51 allow the wearer to use these image pickup units 41 and 51. It is possible to shoot still images and moving images on the front side. The images acquired by the imaging units 41 and 51 are transmitted to the control unit 60 in the main body unit 30, and after performing predetermined processing, they are stored as image data. The shooting ranges of the first imaging unit 41 and the second imaging unit 51 partially overlap. Therefore, after acquiring the captured image of the first imaging unit 41 and the captured image of the second imaging unit 51, the control unit 60 performs a process of integrating these two captured images and processing them into one image. be able to.

Further, the left arm portion 10 and the right arm portion 20 are further provided with light projection portions 42 and 52, respectively. Specifically, the first light projecting portion 42 is provided at the tip end portion of the left arm portion 10, and the second light projecting portion 52 is provided at the tip end portion of the right arm portion 20. The light projecting units 42 and 52 are configured to be able to irradiate light within the shooting range of the image pickup units 41 and 51. Examples of the light projecting units 42 and 52 are known laser light sources and projectors. For example, the light projecting units 42 and 52 can indicate a specific location on the front side of the wearer by the laser light emitted from the laser light source. Further, by scanning the laser beam emitted from the laser light source (for example, resage scanning), characters and figures can be expressed by the laser beam. Further, as the light projecting units 42 and 52, a known microprojector may be adopted to project the image light toward the front side of the wearer. Further, each of the light projecting units 42 and 52 is configured so that the light irradiation direction can be changed independently by the drive units (actuators) 43 and 53 (see FIG. 3) provided inside the housing. ing.

FIG. 2 shows the arrangement relationship between the image pickup units 41 and 51 and the light projectors 42 and 52 on the arms 10 and 20, the shooting range of the image pickup units 41 and 51, and the projection of the light projectors 42 and 52. It shows the relationship of the lightable range. In FIG. 2, for convenience, the shooting range of each image pickup unit 41, 51 is shown by a fan-shaped broken line, but in reality, the shooting range of each image pickup unit 41, 51 is also at the tip of the fan-shaped arc. It is natural that it is spreading. Further, in FIG. 2, the light projectable range of each of the light projecting units 42 and 52 is shown by a alternate long and short dash line. The light projectable range means that light is emitted from the light projecting units 42, 52 by changing the irradiation direction of the light (laser light, etc.) of the light projecting units 42, 52 by the drive units 43, 53 described above. It means the maximum range that can be done. Further, in FIG. 2, the optical axis (main axis) of the first imaging unit 41 is indicated by the reference numeral L1, and the central axis of the first projection unit 42 is indicated by the reference numeral L2. The optical axis L1 of the first image pickup unit 41 is an axis of symmetry passing through the center of the lens constituting the image pickup unit, and extends along the center of the photographing range. Further, the central axis L2 of the first light projecting unit 42 is a line extending along the center of the light projectable range of the light projecting unit, and mainly corresponds to the light emitted from the initial position of the light projecting unit. is doing. Although not shown, the second imaging unit 51 and the second floodlight unit 52 also have an optical axis and a central axis. Further, in FIG. 2, a planar object arranged at a position 1 m away from the tip of the neck-mounted device 100 on the front side of the wearer is indicated by reference numeral O.

As shown in FIGS. 1 and 2, first, the tips of the left arm 10 and the right arm 20 include extroverts 11 and 21 and introverts 12 and 22, respectively. The outward surfaces 11 and 21 are surfaces facing the outside of the neck-mounted device 100. For example, in a plan view, when normals (lines perpendicular to the plane) are drawn from the outward faces 11 and 21 of the left and right arm portions 10 and 20, the normals do not intersect. On the other hand, the inward facing surfaces 12 and 22 are the inward facing surfaces of the neck-mounted device 100. For example, in a plan view, when normals (lines perpendicular to the plane) are drawn from the inward surfaces 12, 22 of the left and right arms 10, 20, the normals intersect on the front side of the wearer. Become.

The image pickup units 41 and 51 are arranged on the outward surfaces 11 and 21 of the tip portions of the arm portions 10 and 20. Therefore, as shown in FIG. 2, the optical axis L1 of each of the imaging units 41 and 51 is tilted outward of the neck-mounted device 100. As a result, the shooting directions of the imaging units 41 and 51 are inclined outward. However, as shown in FIG. 2, since the horizontal angle of view of each of the image pickup units 41 and 51 is designed to be an ultra-wide angle, the shooting range of the two image pickup units 41 and 51 is at least partially. Duplicate. Specifically, the photographing ranges of the imaging units 41 and 51 overlap in the front portion of the wearer. For example, the horizontal angle of view of each of the imaging units 41 and 51 may be 90 to 180 degrees, and is particularly preferably 100 degrees or more, 110 degrees or more, or 120 degrees or more. The inclination of the optical axis L1 of each of the imaging units 41 and 51 is not particularly limited, but for example, the inclination θ1 of the optical axis L1 with respect to the line of sight of the wearer extending straight toward the front is about 5 to 45 degrees or 10 to 30 degrees. It is preferable to do so.

On the other hand, the light projecting portions 42 and 52 are arranged on the inward surfaces 12 and 22 of the tip portions of the arm portions 10 and 20. Therefore, as shown in FIG. 2, the central axis L2 of each of the light projecting portions 42 and 52 is inclined outward from the neck-mounted device 100. As a result, the light projecting directions of the light projecting units 42 and 52 are inclined outward. Further, the light projection direction of each of the light projection units 42 and 52 can be adjusted by the drive units 43 and 53 to adjust the left-right angle (yaw angle) and the vertical angle (pitch angle), and the adjustment range of these angles (that is, the projection angle). The larger the optical range), the larger the structure of the drive units 43 and 53. Therefore, from the viewpoint of miniaturization of the drive units 43 and 53, it is preferable that the adjustment range of the angle of the light projecting units 43 and 52 in the light projecting direction is 10 to 90 degrees for both the left-right angle and the vertical angle. It is particularly preferably 15 to 80 degrees, or 20 to 60 degrees. Further, the adjustment range of this angle can be 45 degrees or less. Further, as shown in FIG. 2, since the light projecting directions of the light projecting units 42 and 52 are inclined inward, the light projecting directions (central axis) of the light projecting units 42 and 52 are the wearer. It will cross in front of. The inclination of the central axis L2 of each of the light projecting portions 42 and 52 is not particularly limited, but for example, the inclination θ2 of the central axis L2 with respect to the line of sight of the wearer extending straight toward the front is 5 to 45 degrees or 10 to 30 degrees. It is preferable to do so. However, as shown in FIG. 2, assuming that the object O is located at a distance of 1 m on the front side of the wearer, the light projectable range of the light projecting portions 42 and 52 is on the surface of the object O. It is preferable that they overlap at least partially. In this way, the postable range of each of the floodlights 42 and 52 and each of the floodlights are such that the floodable ranges of the floodlights 42 and 52 overlap on the surface of the object O 1 m away from the wearer. The inclination θ2 of the central axis L2 of 42 and 52 may be adjusted. As a result, at least in this object O, the two light projecting portions 42 and 52 can irradiate light without a gap.

As described above, the shooting range of each of the imaging units 41 and 51 is inclined outward, while the postable range of each of the light projecting units 42 and 52 is inclined inward. Therefore, as shown in FIG. 2, the first light projecting unit 42 provided on the left arm portion 10 can irradiate the photographing range of the second imaging unit 51 provided on the right arm portion 20 with light. The first light projecting unit 42 may be capable of irradiating light to the photographing range of the first imaging unit 41 also provided on the left arm unit 10, but the first light emitting unit 42 is provided on the right arm unit 20. 2 The main function is to irradiate the imaging range of the imaging unit 51 with light. Similarly, the second light projecting unit 52 provided on the right arm portion 20 can irradiate the photographing range of the first imaging unit 41 provided on the left arm portion 10. The second light projecting unit 52 may also be capable of irradiating the imaging range of the second imaging unit 51 provided on the right arm unit 20, but the first imaging unit provided on the left arm unit 10 may also be capable of irradiating light. The main function is to irradiate the shooting range of 41 with light. As described above, in the present embodiment, the light projecting unit provided on one arm portion is configured to mainly irradiate the photographing range of the imaging unit provided on the other arm portion. ..

As in the present embodiment, the outward surfaces 11 and 21 and the inward surfaces 12 and 22 are formed on the tips of the left arm portion 10 and the right arm portion 20, respectively, and the imaging portions 41 and 51 are provided on the outward surfaces 11 and 21 to inward. By providing the light projecting units 42 and 52 on the surfaces 12 and 22, the light emitted from the light projecting units 42 and 52 is less likely to be directly incident on the image pickup units 41 and 51. As a result, a phenomenon called overexposure is less likely to occur in the captured images of the image pickup units 41 and 51. However, although not shown, in another embodiment, the outward surfaces 11 and 21 and the inward surfaces 12 and 22 are not formed on the tips of the arm portions 10 and 20, and the imaging units 41 and 51 and the light projecting unit 42 are not formed. , 52 can be provided on the same plane. Even in this case, the image pickup units 41, 51 and the light projection units 42, 52 are arranged so that the optical axis L1 of the image pickup units 41, 51 is tilted outward and the central axis L1 of the light projector units 42, 52 is tilted inward. It is preferable to install.

As shown in FIG. 1 and the like, lighting units 44 and 54 (flashlights) may be further installed at the tips of the arms 10 and 20 in addition to the light projecting units 42 and 52. As described above, the light projecting units 42 and 52 have a main function of presenting information to the wearer, such as instructing a specific place and displaying characters / figures by light, but the lighting is used. The units 44 and 54 are simply installed for the purpose of brightly illuminating the photographing range of the imaging units 41 and 51. In the present embodiment, the first lighting unit 44 of the left arm portion 10 is configured to mainly illuminate the shooting range of the second imaging unit 51 of the right arm portion 20, and the second illumination unit 54 of the right arm portion 20 is configured. It is preferable that the left arm portion 10 is configured to mainly illuminate the photographing range of the first imaging unit 41. Therefore, it is preferable to install the lighting units 44 and 54 on the inward surfaces 12 and 22 of the tips of the arm portions 10 and 20 in the same manner as the above-mentioned floodlight units 42 and 52. Further, by installing in this way, it is possible to prevent the illumination light emitted from the illumination units 44 and 54 from directly incident on the image pickup units 41 and 51.

As shown in FIG. 1 and the like, the left arm portion 10 and the right arm portion 20 are provided with one or a plurality of sound collecting portions (microphones) 45 and 55, respectively. The sound collecting units 45 and 55 are arranged mainly for the purpose of acquiring the voices of the wearer and the interlocutor. In the example shown in FIG. 1, the left arm portion 10 is provided with the first sound collecting portion 45 at three locations, and the right arm portion 20 is also provided with the second sound collecting portion 55 at three locations. As an arbitrary element, one or a plurality of sound collecting portions may be additionally provided on the left arm portion 10 and the right arm portion 20. Further, although not shown, the main body portion 30 located between the left arm portion 10 and the right arm portion 20 may also be provided with a sound collecting portion as an optional additional element. The sound signals acquired by these sound collecting units 45 and 55 are transmitted to the control unit 60 (see FIG. 3) provided in the main body unit 30 to perform a predetermined analysis process.

The control unit 60 may analyze the sound signals acquired from the sound collecting units 45 and 55 to specify the position of the sound source and the direction in which the source exists with respect to the neck-mounted device 100. good. In this case, the control unit 60 can control the light projecting units 42 and 52 so as to indicate the direction in which the sound is emitted by light. For example, the control unit 60 may emit light for projecting the shape of an arrow onto an object from the light projecting units 42 and 52, and visually transmit the sound source to the wearer according to the direction of the arrow. good. Further, the control unit 60 actually emits light from the light projecting units 42 and 52 with respect to the sound source, and illuminates the source with the light, thereby visually indicating the sound source to the wearer. It is also possible to communicate.

The left arm portion 10 and the right arm portion 20 described above can be arranged at positions sandwiching the neck. The left arm portion 10 and the right arm portion 20 are connected by a main body portion 30 provided at a position where the wearer's neck back abuts. The main body 30 contains electronic components (control system circuits) such as a processor and a battery. As shown in FIG. 1, the housing constituting the main body portion 30 has a substantially flat shape, and can store a flat (plate-shaped) circuit board and a battery. Further, the main body portion 30 has a drooping portion 31 extending downward from the left arm portion 10 and the right arm portion 20. By providing the hanging portion 31 in the main body portion 30, a space for incorporating the control system circuit is secured. Further, the control system circuits are centrally mounted on the main body 30. This control system circuit includes a battery and a circuit board on which various electronic components such as a processor that is driven by receiving electric power from the battery are mounted. Therefore, when the total weight of the neck-mounted device 100 is 100%, the weight of the main body 30 occupies 40 to 80% or 50% to 70%. By arranging such a heavy main body portion 30 on the back of the wearer's neck, the stability at the time of wearing is improved. Further, by arranging the heavy main body portion 30 at a position close to the wearer's trunk, the load given to the wearer by the weight of the entire device can be reduced.

Further, a proximity sensor 63 is provided inside the main body portion 30 (on the wearer side). The proximity sensor 63 is for detecting the approach of an object, and when the neck-mounted device 100 is attached to the neck of the wearer, the proximity sensor 63 detects the approach of the neck. Therefore, when the proximity sensor 63 is in a state of detecting the proximity of an object, each image pickup unit 41, 51, each floodlight unit 42, 52, each illumination unit 44, 54, and each sound collection unit 45, When devices such as 55 are turned on (driving state) and the proximity sensor 63 is in a state where the proximity of an object is not detected, these devices may be turned off (sleep state) or put into a state in which they cannot be started. As a result, the power consumption of the battery can be efficiently suppressed. Further, when the proximity sensor 63 is in a state where the proximity of an object is not detected, the imaging units 41, 51 and the sound collecting units 45, 55 cannot be activated, so that the image pickup unit 41, 51 and the sound collection units 45, 55 cannot be activated, so that the image pickup unit 41, 51 or the sound collection unit 45, 55 cannot be activated, so that the image pickup unit 41, 51 or the sound collection unit 45, 55 cannot be activated, so that the image pickup unit 41, 51 or the sound collection unit 45, 55 cannot be activated. It can also be expected to have the effect of preventing data from being recorded in the data. A known proximity sensor 63 can be used, but when an optical type is used, the detection light is transmitted to the main body 30 in order to transmit the detection light of the proximity sensor 63. It is advisable to provide a window.

Further, a sound emitting portion 64 (speaker) is provided on the outside of the main body portion 30 (opposite side of the wearer). It is preferable that the sound emitting unit 64 is arranged so as to output sound toward the outside of the main body unit 30. In the present embodiment, the left arm portion 10 and the right arm portion 20 are provided with sound collecting portions 45 and 55, respectively, but by providing the sound emitting portion 64 at a position corresponding to the back of the wearer's neck, sound is emitted. The physical distance between the unit 64 and the sound collecting units 45 and 55 can be maximized. That is, when some sound is output from the sound emitting unit 64 while the sound collecting units 45 and 55 are collecting the sounds of the wearer and the interlocutor, the recorded sound of the wearer and the like is emitted. The sound from the unit 64 (self-output sound) may be mixed. If the self-output sound is mixed with the recorded voice, it interferes with voice recognition, so it is necessary to remove this self-output sound by echo cancellation processing or the like. However, in reality, it is difficult to completely remove the self-output sound even if the echo cancellation process is performed due to the influence of the vibration of the housing. Therefore, in order to minimize the volume of the self-output sound mixed in the voice of the wearer or the like, a sound emitting unit 64 is provided at a position corresponding to the back of the wearer's neck as described above, and the sound collecting unit 45, It is preferable to keep a physical distance from 55.

Further, as a structural feature of the neck-mounted device 100, the left arm portion 10 and the right arm portion 20 have flexible portions 13 and 23 in the vicinity of the connecting portion with the main body portion 30, as shown in FIG. The flexible portions 13 and 23 are made of a flexible material such as rubber or silicone. Therefore, when the neck-mounted device 100 is attached, the left arm portion 10 and the right arm portion 20 are likely to fit on the wearer's neck and shoulders. The flexible portions 13 and 23 are also provided with wiring for connecting the electronic devices mounted on the arm portions 10 and 20 and the control unit 60 provided on the main body portion 30.

FIG. 3 is a block diagram showing a functional configuration of the neck-mounted device 100. As shown in FIG. 3, in the neck-mounted device 100, the first and second imaging units 41, 51, the first and second floodlight units 42, 52, the first and second drive units 43, 53, and the first 1 and 2 lighting units 44, 54, 1st and 2nd sound collecting units 45, 55, operation unit 46, control unit 60, storage unit 61, communication unit 62, proximity sensor 63, sound emitting unit 64, and battery 70. Has. In the present embodiment, the left arm portion 10 is provided with a first imaging unit 41, a first light emitting unit 42, a first driving unit 43, a first lighting unit 44, a first sound collecting unit 45, and an operating unit 46. ing. Further, a second imaging unit 51, a second light emitting unit 52, a second driving unit 53, a second lighting unit 54, and a second sound collecting unit 55 are arranged on the right arm unit 20. Further, a control unit 60, a storage unit 61, a communication unit 62, a proximity sensor 63, a sound emitting unit 64, and a battery 70 are arranged in the main body unit 30. In addition to the functional configuration shown in FIG. 3, the neck-mounted device 100 is mounted on a general portable information terminal such as a gyro sensor, an acceleration sensor, a geomagnetic sensor, or sensors such as a GPS sensor. Module equipment can be installed as appropriate.

The image pickup units 41 and 51 acquire image data of a still image or a moving image. A general digital camera may be adopted as the image pickup units 41 and 51. The image pickup units 41 and 51 are, for example, a photoelectric conversion element such as a photographing lens, a mechanical shutter, a shutter driver, a CCD image sensor unit, a digital signal processor (DSP) that reads an electric charge amount from the photoelectric conversion element and generates image data, and an IC. Consists of memory. Further, the imaging units 41 and 51 include an autofocus sensor (AF sensor) that measures the distance from the photographing lens to the subject, and a mechanism for adjusting the focal length of the photographing lens according to the distance detected by the AF sensor. It is preferable to provide. The type of AF sensor is not particularly limited, but a known passive type sensor such as a phase difference sensor or a contrast sensor may be used. Further, as the AF sensor, an active type sensor that directs infrared rays or ultrasonic waves to the subject and receives the reflected light or the reflected wave can also be used. The image data acquired by the image pickup units 41 and 51 is supplied to the control unit 60 and stored in the storage unit 61, and predetermined image analysis processing and image processing processing are performed. Alternatively, the image data is transmitted to another device via the Internet via the communication unit 62. In the present embodiment, as described above, the front side of the wearer is photographed by the two image pickup units 41 and 51. Since the two captured images acquired by the imaging units 41 and 51 partially overlap, it is preferable that the control unit 60 performs a processing process for integrating these images.

The light projecting units 42 and 52 present information to the wearer by irradiating with light. A known laser light source or projector can be used as the light projecting units 42 and 52, but here, an image display unit provided with the laser light source will be described as an example. The image display unit includes, for example, a laser light source that emits laser light, an optical fiber having one end connected to the laser light source, and an optical scanning unit arranged on the other end side of the optical fiber. As for the configuration of the image display unit, for example, those disclosed in Japanese Patent Application Laid-Open No. 2019-133102 can be referred to.

The laser light source emits laser light of each color of R (red), G (green), and B (blue), and includes three monochromatic laser diode chips that emit laser light of these three colors. The light emitted from the laser light source is controlled by the control unit 60 based on the image data. That is, the control unit 60 converts the image data corresponding to a plurality of pixels representing the image to be displayed into an image signal by a predetermined method, and based on this image signal, the emission timing of each color laser diode chip and each color laser of RGB. Controls the modulation of light.

One end of an optical fiber is connected to the emission end of the laser light source, and each color laser light modulated according to the image signal is transmitted through the optical fiber. The other end of the optical fiber is opened as a free end, and each color laser beam propagating in the optical fiber is emitted from the tip end portion. As this optical fiber, one optical fiber having a single core in which laser light of three colors is waveguide is used, or three optical fibers having a single core in which laser light of each color is waveguide are bundled. A bundle fiber may be used, or a multi-core fiber having three cores to which laser light of each color is waveguide may be used.

The optical scanning unit is composed of, for example, a holding member that cantilevers and supports the optical fiber, and a cylindrical piezoelectric element connected to the holding member and provided on the tip end side of the optical fiber. By arranging the optical fiber in the center of the cylindrical piezoelectric element and vibrating the cylindrical piezoelectric element, the optical fiber is flexed and vibrated. Specifically, the cylindrical piezoelectric element has electrodes divided into four, and based on the drive signal output from the control unit 60, a voltage having a phase difference of π / 2 is applied to each of these adjacent electrodes to form a cylindrical shape. Circularly vibrate the end face of the piezoelectric element on the open end side. Then, the amplitude is controlled by the control unit 60 at a predetermined cycle, so that the optical scanning unit scans the laser beam emitted from the tip of the optical fiber in a spiral shape, for example, in two dimensions. In this case, the display screen is circular or elliptical. The form in which the laser beam is scanned in the two-dimensional direction is not limited to this. For example, the resage scanning may be performed by adjusting the application timing of the voltage applied to each electrode of the cylindrical piezoelectric element. In this case, the display screen corresponds to a substantially rectangular shape. In this way, by manipulating the laser beam emitted from the optical fiber, figures, letters, numbers, symbols, or images can be freely drawn to some extent.

The drive units 43 and 53 include a mechanism for changing the irradiation direction of the light from the light projecting units 42 and 52. For example, the drive units 43 and 53 have a mechanism for rotating the direction of the emission end of the light projecting units 42 and 52 to the left and right, and a mechanism for rotating the direction of the emission end of the light projecting units 42 and 52 up and down. Including the mechanism. As these rotation mechanisms, a known rotary table or the like may be adopted. Further, as the drive units 43 and 53, those including a mirror that reflects the light from the light projecting units 42 and 53 and an adjustment mechanism for adjusting the direction of the mirror can also be adopted. Based on the control signal from the control unit 60, the drive units 43 and 53 drive these rotation mechanisms or adjustment mechanisms to control the irradiation direction of the light from the light projecting units 42 and 52.

The illumination units 44 and 54 are lights for illuminating the shooting range of the image pickup units 41 and 51. As the illumination units 44 and 54, for example, a known light emitting element such as an LED, a laser light source, or a diffused laser light source can be adopted. For example, since it is desirable that the illumination units 44 and 54 can emit white light, a type that obtains white light by combining a blue LED and a yellow phosphor that is a complementary color thereof, or a type that obtains white light, or three colors of red, blue, and green. A full-color type that obtains white light by combining LEDs can be used. The lighting units 44 and 54 may be turned off when the brightness sensor (not shown) detects sufficient brightness of ambient light, and may be turned on when the brightness sensor does not detect sufficient brightness. good.

As the sound collecting units 45 and 55, known microphones such as a dynamic microphone, a condenser microphone, and a MEMS (Micro-Electrical-Mechanical Systems) microphone may be adopted. The sound collecting units 45 and 55 convert the sound into an electric signal, amplify the electric signal by the amplifier circuit, convert it into digital information by the A / D conversion circuit, and output it to the control unit 60. In the present embodiment, the sound collecting units 45 and 55 can acquire not only the voice of the wearer but also the voice of one or more interlocutors existing around the wearer. Therefore, it is preferable to use an omnidirectional (omnidirectional) microphone as each of the sound collecting units 45 and 55 so that the sound generated around the wearer can be widely collected.

The operation unit 46 receives an operation input by the wearer. As the operation unit 46, a known switch circuit, touch panel, or the like can be adopted. The operation unit 46 is, for example, an operation for instructing the start or stop of voice input, an operation for instructing the start or stop of shooting, an operation for instructing ON or OFF of the power of the device, an operation for instructing raising / lowering the volume of the speaker, and the like. It accepts other operations necessary to realize the functions of the neck-mounted device 100. The information input via the operation unit 46 is transmitted to the control unit 60.

The control unit 60 performs arithmetic processing for controlling other elements included in the neck-mounted device 100. As the control unit 60, a processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) can be used. The control unit 60 basically reads a program stored in the storage unit 61 and executes a predetermined arithmetic process according to this program. Further, the control unit 60 can appropriately write and read the calculation result according to the program in the storage unit 61.

The storage unit 61 is an element for storing information used for arithmetic processing and the like in the control unit 60 and the arithmetic result thereof. Specifically, the storage unit 61 stores a program for causing the neck-mounted device 100 to exert a function peculiar to the present invention. When this program is started by an instruction from the user, the control unit 60 executes a process according to the program. The storage function of the storage unit 61 can be realized by a non-volatile memory such as an HDD and an SDD. Further, the storage unit 61 may have a function as a memory for writing or reading the progress of the arithmetic processing by the control unit 60. The memory function of the storage unit 61 can be realized by a volatile memory such as RAM or DRAM. Further, the storage unit 61 may store ID information unique to the user who possesses it. Further, the storage unit 61 may store an IP address which is identification information on the network of the neck-mounted device 100.

The communication unit 62 is an element for wireless communication with another device on the cloud (specifically, a supporter terminal described later) or another neck-mounted device. The communication unit 62 communicates with a supporter terminal or another neck-mounted device via the Internet, for example, known mobile communication such as 3G (W-CDMA), 4G (LTE / LTE-Advanced), and 5G. A communication module for wireless communication using a standard or a wireless LAN method such as Wi-Fi (registered trademark) may be adopted. Further, the communication unit 62 can also adopt a communication module for near field communication such as Bluetooth (registered trademark) or NFC in order to directly communicate with another neck-mounted device.

The proximity sensor 63 is mainly used to detect the proximity of the neck-mounted device 100 (particularly the main body 30) to the wearer. As the proximity sensor 63, known ones such as an optical type, an ultrasonic type, a magnetic type, a capacitance type, and a warmth type can be adopted as described above. The proximity sensor 63 is arranged inside the main body 30, and detects that the wearer's neck has approached within a predetermined range. When the proximity sensor 63 detects that the wearer's neck is approaching, the imaging unit 41, 51, the light projecting unit 42, 52, the lighting unit 44, 54, and / or the sound collecting unit 45, 55 are activated. Can be done.

The sound emitting unit 64 is an acoustic device that converts an electric signal into physical vibration (that is, sound). An example of the sound emitting unit 64 is a general speaker that transmits sound to the wearer by air vibration. In this case, as described above, the sound emitting portion 64 is provided on the outside of the main body portion 30 (the side opposite to the wearer), and the direction away from the back of the neck of the wearer (horizontally rearward) or the direction along the back of the neck (vertical). It is preferable to configure the sound so as to emit sound toward (upward in the direction). Further, the sound emitting unit 64 may be a bone conduction speaker that transmits sound to the wearer by vibrating the wearer's bones. In this case, the sound emitting portion 64 may be provided inside the main body portion 30 (on the wearer side) so that the bone conduction speaker comes into contact with the bone (cervical spine) on the back of the wearer's neck.

The battery 70 is a battery that supplies electric power to various electronic components included in the neck-mounted device 100. As the battery 70, a rechargeable storage battery is used. As the battery 70, a known battery such as a lithium ion battery, a lithium polymer battery, an alkaline storage battery, a nickel cadmium battery, a nickel hydrogen battery, or a lead storage battery may be adopted.

Subsequently, an example of the use of the neck-mounted device 100 according to the present invention will be described with reference to FIGS. 4 and 5. As shown in these figures, the neck-mounted device 100 can be used as a worker terminal constituting a remote work support system. The remote work support system includes a worker terminal 100 (neck-mounted device) and a supporter terminal 200 connected to each other via the Internet. The worker terminal 100 is worn by a worker who works in the field. As the worker terminal 100, the neck-mounted device according to the present invention having the above-described configuration is used. On the other hand, the supporter terminal 200 is a terminal operated by a supporter (operator or the like) who provides support information to workers in the field. As a result, the supporter can send work instructions and the like to the workers at the site from a remote location. As the supporter terminal 200, a general PC can be used. Specifically, the supporter terminal 200 includes a control device 210 including a processor, a communication module, and the like, a display device 220 such as a display, and an input device 230 such as a mouse and a keyboard.

FIG. 5 shows an example of the processing flow of the worker terminal 100 and the supporter terminal 200. As shown in FIG. 5, first, the image pickup units 41 and 51 of the worker terminal 100 acquire a photographed image on the front side of the worker (wearer) (step S1). Since the worker terminal 100 is equipped with image pickup units 41 and 51 on the left and right arm portions 10 and 20, respectively, images captured by these two image pickup units 41 and 51 over a wide range in the horizontal direction. Can be obtained. Next, the worker terminal 100 processes the captured images acquired by the two image pickup units 41 and 51 (step S2). In the processing here, a process of integrating two captured images into one image is mainly performed. In addition, as the processing, the distortion caused by the lens may be corrected for each photographed image, or the contrast, brightness, sharpness, and color tone may be corrected. After that, the worker terminal 100 transmits the processed image to the supporter terminal 200 via the Internet (step S3). In the example shown in FIG. 5, the image processing process is performed on the worker terminal 100 side, but this image processing process may be performed on the supporter terminal 200 side. In this case, the worker terminal 100 transmits the captured images acquired by the imaging units 41 and 51 to the supporter terminal 200 without being processed. The supporter terminal 200 performs the above-mentioned processing process on the captured image received from the worker terminal 100.

Subsequently, the supporter terminal 200 displays the processed image received from the worker terminal 100 on the display (step S4). When the worker terminal 100 acquires a moving image by the image pickup units 41 and 51, the moving image is also displayed on the display of the worker terminal 100. Next, the supporter terminal 200 determines whether or not the support information for the worker has been input via the input device 230 such as a mouse or keyboard (step S5). An example of support information is the designation of coordinates for a display image on a display. For example, as shown in FIG. 4, it is possible to specify predetermined coordinates for the display image with the mouse pointer. Another example of support information is the input of messages (letters, numbers, symbols, figures, etc.) to workers. For example, as shown in FIG. 4, information such as characters can be input using a keyboard or the like. When such various types of support information are input, the supporter terminal 200 transmits this support information to the worker terminal 100 (step S6). On the other hand, if this support information is not input, steps S1 to S4 are repeated.

Subsequently, the worker terminal 100 outputs the support information received from the supporter terminal 200 by controlling the floodlight units 42, 52 and the drive units 43, 53 (step S7). Specifically, the control unit 60 of the worker terminal 100 generates control signals for the floodlight units 42, 52 and the drive units 43, 53 based on the support information received from the supporter terminal 200. The control signals for the floodlights 42 and 52 include information for reproducing a message to the operator. Further, the control signal for the drive units 43 and 53 includes information for controlling the light irradiation direction of the light projecting units 42 and 52. The control unit 60 of the worker terminal 100 provides these control signals to the projection units 42, 52 and the drive units 43, 53, and as shown in FIG. 4, for example, light is applied to a specific location within the shooting range. It irradiates (laser light) or projects a specific message on an object within the shooting range. Further, as shown in FIG. 4, light having different information can be emitted from the light projecting portions 42 and 52 of the left and right arm portions 10 and 20. For example, in the example shown in FIG. 4, a laser beam for instructing a specific location within the photographing range is emitted from the first light projecting portion 42 of the left arm portion 10. Further, the second light projecting unit 52 of the right arm unit 20 reproduces specific character information by scanning the laser beam. In this way, by providing two or more light projecting units 42, 52, it is possible to output two or more information at the same time. As a result, the support information input by the supporter to the supporter terminal 200 can be transmitted to the worker by irradiating the light projecting units 42 and 52 of the worker terminal 100 with light.

Further, the worker terminal 100 and the supporter terminal 200 may each have a call function. The worker terminal 100 acquires the voice of the worker from the sound collecting units 45 and 55 and transmits it to the supporter terminal 200, and outputs the voice of the supporter from the sound emitting unit 64. The supporter terminal 200 acquires the voice of the supporter by using, for example, a headset (not shown) and transmits it to the worker terminal 100, and outputs the voice of the worker from this headset. As a result, it is possible to simultaneously provide visual support using the light emitted from the light projecting units 42 and 52 and auditory support by conversation between the supporter and the worker.

As described above, in the present specification, in order to express the content of the present invention, the embodiments of the present invention have been described with reference to the drawings. However, the present invention is not limited to the above embodiment, and includes modifications and improvements which are obvious to those skilled in the art based on the matters described in the present specification.

10 ... Left arm 11 ... Outer surface 12 ... Inward surface 13 ... Flexible part 20 ... Right arm 21 ... Outer surface 22 ... Inward surface 23 ... Flexible part 30 ... Main body 31 ... Drooping part 41 ... First imaging part 42 ... First Floodlight 43 ... 1st drive unit 44 ... 1st lighting unit 45 ... 1st sound collection unit 46 ... Operation unit 51 ... 2nd image pickup unit 52 ... 2nd floodlight unit 53 ... 2nd drive unit 54 ... 2nd lighting Unit 55 ... 2nd sound collecting unit 60 ... Control unit 61 ... Storage unit 62 ... Communication unit 63 ... Proximity sensor 64 ... Sound emitting unit 70 ... Battery 100 ... Neck-mounted device (worker terminal)
200 ... Supporter terminal 210 ... Control device 220 ... Display device 230 ... Input device

Claims (4)

In a remote support system that remotely supports the work of workers in the field, it is a neck-mounted device that can be interconnected with the supporter device and is worn around the user's neck.
The first arm and the second arm that can be placed across the neck,
An image pickup unit provided on the first arm portion and the second arm portion and capable of photographing the front side of the user.
A light projecting unit provided on the first arm portion and the second arm portion and capable of irradiating light within the photographing range of the imaging unit is provided.
The light projecting portion of the first arm portion can irradiate light within the photographing range of the imaging portion of the second arm portion.
The light projecting portion of the second arm portion is a neck-mounted device capable of irradiating light within the photographing range of the imaging portion of the first arm portion. In a plan view, the imaging direction of the first arm portion and the imaging portion of the second arm portion is tilted outward.
The neck-mounted device according to claim 1, wherein the light emitting direction of the first arm portion and the light emitting portion of the second arm portion is inclined inward in a plan view. A control unit that controls the floodlight unit and
Further provided with one or more sound collecting portions provided on the first arm portion or the second arm portion.
The first or second aspect of the present invention, wherein the control unit controls the light projecting unit so as to indicate the direction in which the sound is emitted by light based on the information regarding the sound acquired by the sound collecting unit. Neck-mounted device . It is a remote work support system in which a neck-mounted device worn around the user's neck and a supporter device operated by a supporter are connected to each other via an information communication line.
The neck-mounted device is
The first arm and the second arm that can be placed across the neck,
An image pickup unit provided on the first arm portion and the second arm portion and capable of photographing the front side of the user.
A light projecting unit provided on the first arm portion and the second arm portion and capable of irradiating light within the photographing range of the imaging unit.
A control unit that controls the floodlight unit is provided.
The light projecting portion of the first arm portion can irradiate light within the photographing range of the imaging portion of the second arm portion.
The light projecting portion of the second arm portion can irradiate light within the photographing range of the imaging portion of the first arm portion.
The supporter device is
A display unit capable of displaying a captured image acquired by the image pickup unit of the neck-mounted device, and a display unit capable of displaying the captured image.
It is provided with an operation unit capable of inputting a coordinate specification on the display screen of the display unit.
When the coordinates in the captured image displayed on the display screen are specified by the operation unit, the supporter device transmits the coordinate information in the captured image to the neck-mounted device .
The control unit of the neck-mounted device is a remote work support system that controls the irradiation direction of light emitted from the light projecting unit based on the coordinate information.

Images