JP2011109276A - Camera finder, photographing apparatus, and remote operation support system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera finder for displaying a video of a subject so that a photography range of the camera is precisely confirmed by a simpler technique without calculating a photography direction of the camera or the like and a photographing apparatus provided with the same, and a remote operation support system. <P>SOLUTION: The camera finder is mounted on, for example, the photography apparatus 1 and includes: a display unit 40 for displaying a video of the subject superimposed on external light; and a discriminating image processing part 63a for performing to the video of the subject discriminating image processing for discriminating the video of the subject from an image by the external light in displaying to the display unit 40 the video of the subject superimposed on the external light. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a camera finder that displays an image of a subject photographed by a camera so as to be superimposed on external light. The present invention also relates to a photographing apparatus that includes the camera finder and photographs a video of the subject using a camera that can be mounted on the head, and a remote work support system using the photographing apparatus.

  Conventionally, an image (image) that is detachably mounted on the observer's head or face and obtained from image display means such as a compact CRT or liquid crystal display element is displayed in the observer's field of view by an eyepiece optical system. In addition, a so-called HMD (Head Mount Display) is known in which the video is configured to be observable by an observer. As one of such HMDs, there is an optical see-through type HMD that superimposes and displays the video image on external light, and is disclosed in Patent Document 1, for example.

  The wearable camera system provided with the viewfinder means disclosed in Patent Document 1 includes a spectacle frame, and the spectacle frame includes a wide-angle camera hidden in the nose bridge, The narrow-angle camera hidden at the top of the spectacle frame, a television screen driven by the wide-angle camera and the video signal obtained by the narrow-angle camera, in or on the back of one or both spectacle lenses And an optical system capable of obtaining an enlarged image by the television screen.

  In such an optical see-through type HMD, the image of the subject in the front field of view taken by the camera mounted on the head is superimposed on the subject image by the external light. It is difficult to discriminate between a captured image and an external image that are observed in an overlapping manner, and it is difficult for the wearer to confirm the range of the video, that is, the shooting range of the camera. For example, there is a head-mounted camera disclosed in Patent Document 2 in response to a request that a wearer wants to accurately check a shooting range.

  The head-mounted camera disclosed in Patent Document 2 is configured to include a head-mounted unit that is substantially glasses-type, and the head-mounted unit is a subject image that is provided integrally with the temple unit. And a see-through image display unit provided on a transparent optical member corresponding to a lens for correcting the diopter of the glasses. The see-through image display unit emits image light by illuminating a translucent LCD that displays an image captured by the first imaging unit from the back surface with light emitted from an LED and collected by a condenser lens. The image light is generated and guided to a volume phase reflection type holographic optical element provided on the transparent optical member, and displayed as a virtual image in front of the photographer's visual field by the reflection type holographic optical element. is there. With this configuration, the transparent optical member transmits external light toward the photographer's eye, and the reflective holographic optical element provided on the transparent optical member transmits the image light to the front of the photographer in the visual field direction. As a result, the image of the subject imaged by the first imaging unit and the subject caused by external light are superimposed. In the head mounted camera disclosed in Patent Document 2, a shooting image frame indicating a shooting range is displayed on the see-through image display unit, thereby representing the range of the subject imaged by the first imaging unit.

Special Table 2002-508636 JP 2005-223749 A

  By the way, in the head-mounted camera disclosed in Patent Document 2, in order to display the photographic image frame on the see-through image display unit, the relative relationship between the photographing direction and photographing range of the camera and the image of the see-through external light is set. It is necessary to obtain it accurately, and a process such as information processing for that purpose is complicated, and it is difficult to completely match the image by the external light and the photographing image frame.

  The present invention has been made in view of the above circumstances, and its purpose is to be able to confirm the shooting range of the camera accurately by a simpler method without calculating the shooting direction of the camera. Thus, it is to provide a camera finder capable of displaying an image of the subject. The present invention also provides an imaging device that includes the camera finder and that captures an image of the subject using a camera that can be mounted on the head, and a remote operation support system that uses the imaging device.

  As a result of various studies, the present inventor has found that the above object is achieved by the present invention described below. That is, a camera finder according to an aspect of the present invention is a camera finder that displays a subject image superimposed on external light, a display unit that displays the subject image superimposed on external light, and the display A discriminating image processing unit for performing discriminating image processing for discriminating between the video of the subject and the image of the external light on the video of the subject when the video of the subject is displayed superimposed on external light It is characterized by providing.

  In the camera finder having such a configuration, when the subject video is superimposed on the external light and displayed on the display unit, the discriminating image processing unit performs discriminating image processing on the subject video. In this way, the camera finder having the above configuration performs discriminative image processing on the subject video itself, so that it is possible to accurately check the shooting range of the camera with a simpler method without calculating the shooting direction of the camera or the like. So that the image of the subject can be displayed.

  In another aspect, in the above-described camera finder, preferably, the discriminating image processing includes monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, and number of gradation levels. It is at least one of a reduction process and a noise superimposition process.

  According to this configuration, at least one of monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing is used as discriminating image processing. Therefore, the observer (user) can easily distinguish and observe the image of the subject from the image of the external light.

  In another aspect, in the above-described camera finder, preferably, the discriminating image processing includes monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, and number of gradation levels. A plurality of sub-discriminant image processes including at least one of a reduction process and a noise superimposition process, wherein the discriminant image processing unit selects any one of the plurality of sub-discriminant image processes; Applying the selected sub-discriminating image processing to the video of the subject.

  According to this configuration, since a plurality of sub-discriminating image processes are prepared in advance, an appropriate sub-discriminating image process can be selected according to different use environments of external light such as indoors, daytime, and nighttime. The image of the subject can be displayed so that the shooting range of the camera can be confirmed more accurately.

  In another aspect, the above-described camera finder preferably further includes a display control unit that controls whether or not the video of the subject is displayed on the display unit so as to be superimposed on external light. .

  According to this configuration, since the display control unit is further provided, when the subject image is superimposed on the external light and displayed on the display unit, discriminating image processing is performed on the subject image as necessary. Can be applied. In particular, when a video that is not a subject video is displayed on the display unit, since this video is different from an image by external light, discriminating image processing is not inherently necessary. It is possible to effectively cope with such cases.

  In another aspect, in the above-described camera finder, the visible light transmittance of external light in the display unit is preferably 70% or more.

  When the visible light transmittance of the external light is 70% or more, it becomes difficult to distinguish between the subject image and the image by the external light. However, according to the above configuration, the subject image is subjected to discriminative image processing. Therefore, it is possible to discriminate between a subject image and an image by external light. Thus, when the visible light transmittance of external light is 70% or more, the present invention is more effective.

  According to another aspect, in the above-described camera finder, preferably, the display unit includes a video light generation unit that generates video light of the subject, and an image of the subject generated by the video light generation unit. A light guide unit that guides the light by totally reflecting the light a plurality of times; and a reflection unit that reflects the video light of the subject guided by the light guide unit to the outside of the light guide unit.

  According to this configuration, since the image light of the subject is totally reflected and guided a plurality of times, the display unit can be downsized (compact).

  In another aspect, in the above-described camera finder, preferably, the reflection unit is a reflection type hologram optical element.

  According to this configuration, since the reflective hologram optical element is used for the reflecting portion, the visible light transmittance of the external light becomes relatively high, and the observer can observe the image by the external light better. When working by observing the outside world through the display unit, the workability is improved.

  In another aspect, in the above-described camera finder, it is preferable that the reflective hologram optical element includes a reflective surface having a positive optical power that magnifies and reflects the image light of the subject.

  According to this configuration, the reflection hologram optical element has a reflection surface having a positive optical power, and the reflection hologram optical element also serves as an eyepiece optical system. Therefore, the display unit can be reduced in size.

  And the imaging device (camera) according to another aspect of the present invention was photographed by the mounting unit to be mounted on the head, the shooting unit for shooting the subject provided in the mounting unit, and the shooting unit. A camera finder for displaying an image of a subject, and the camera finder is any one of the above-described camera finder.

  In the photographing apparatus having such a configuration, since the photographing unit is provided in the mounting part, when photographing a subject, the hands become free and both hands can be used. Therefore, the wearer (user) can perform another work while photographing the subject.

  In another aspect, in the above-described imaging device, it is preferable that the area captured by the imaging unit is an area within the visual field of the wearer.

  In such a configuration, since the region within the field of view of the wearer is photographed by the photographing unit and it is difficult to distinguish when an image is superimposed on an image by external light, the present invention is more effective.

  In another aspect, in the above-described imaging device, preferably, the display unit is provided in the mounting unit.

  According to this configuration, since the display unit is also provided in the mounting unit, the wearer can recognize the subject imaged by the imaging unit.

  Further, in another aspect, in the above-described imaging device, preferably, the imaging apparatus further includes a communication unit that transmits and receives a communication signal, and a communication control unit that controls transmission and reception of the communication unit, The image of the subject photographed by the photographing unit is transmitted to the communication unit.

  According to this configuration, since the video of the subject photographed by the photographing unit can be transmitted to the outside by the communication unit, a third party can observe the video of the subject from the viewpoint of the wearer.

  A remote operation support system according to another aspect of the present invention is a remote operation support system including an imaging device and a remote operation support device that is communicably connected to the imaging device via a communication network. The imaging device is any one of the above-described imaging devices, and the remote operation support device displays a video of a subject received by the imaging unit and received through the communication network. And an instruction receiving unit that receives an instruction from the instructor and transmits the instruction to the photographing apparatus via the communication network.

  Since the remote operation support system having such a configuration includes any of the above-described imaging apparatuses, it is possible to accurately check the imaging range of the camera with a simpler method without calculating the imaging direction of the camera. The video of the subject can be displayed so that the photographer can accurately recognize the range of the photographed video to be transmitted to the user (instructor) of the remote operation support device.

  The camera finder, the photographing apparatus, and the remote operation support system according to the present invention are configured so that the photographing range of the subject can be accurately confirmed by a simpler method without calculating the photographing direction of the camera. Video can be displayed.

It is a figure which shows the structure of the remote operation assistance system concerning embodiment. It is an external appearance perspective view which shows the structure of the imaging device in the remote operation assistance system concerning embodiment. It is a sectional side view of the display unit in the imaging device of the remote operation support system according to the embodiment. It is a figure for demonstrating the expansion projection by the reflection type hologram optical element in the imaging device of the remote operation assistance system concerning embodiment. It is a block diagram which shows the electrical structure of the imaging device in the remote operation assistance system concerning embodiment. It is a flowchart which shows operation | movement of the imaging device in the remote operation assistance system of embodiment. It is a figure for demonstrating an example of the discriminating image process implemented by the imaging device in the remote operation assistance system of embodiment.

  Hereinafter, an embodiment according to the present invention will be described with reference to the drawings. In addition, the structure which attached | subjected the same code | symbol in each figure shows that it is the same structure, The description is abbreviate | omitted suitably.

  FIG. 1 is a diagram illustrating a configuration of a remote operation support system according to the embodiment. FIG. 2 is an external perspective view illustrating a configuration of the imaging device in the remote operation support system according to the embodiment. FIG. 3 is a side sectional view of the display unit in the photographing apparatus of the remote operation support system according to the embodiment. FIG. 4 is a diagram for explaining an enlarged projection by the reflection hologram optical element in the photographing apparatus of the remote operation support system according to the embodiment. FIG. 4A is a diagram for explaining a manufacturing method of a reflective hologram optical element, and FIG. 4B is a diagram of a reflective hologram optical element manufactured by the manufacturing method shown in FIG. It is a figure for demonstrating an image | video. FIG. 5 is a block diagram illustrating an electrical configuration of the imaging apparatus in the remote operation support system according to the embodiment.

  The remote operation support system according to the embodiment images a subject in a predetermined direction of the worker so that an instructor in a different place away from the worker can observe the image of the photographed subject. The instruction of the instructor referring to the image of the subject is provided to the worker. For example, as shown in FIGS. 1 to 5, such a remote work support system S is used by a worker W, for example, a work object in a predetermined direction of the worker W, for example, the line of sight of the worker W, etc. The instructor A receives the image of the subject photographed by the photographing device 1 via the network (communication network) NT, and the photographing device 1 that shoots the subject and transmits the image of the photographed subject. The received instruction is displayed so that the received image of the subject is displayed, the instruction of the instructor A referring to the image of the object is received, and the instruction of the received instruction A is output from the photographing apparatus 1. And a remote support device 5 that transmits an instruction of the person A to the photographing device 1 via the network NT.

  The remote support device 5 is provided at a location distant from the photographing device 1 and is connected to the photographing device 1 through the network NT so as to be able to exchange data with the photographing device 1. 1, a main server computer device (hereinafter abbreviated as “main server PC”) 6, a support record server computer device (hereinafter abbreviated as “support record server PC”) 7, and a content server. And a computer device (hereinafter abbreviated as “content server PC”) 8.

  The network NT is, for example, a communication network such as a telephone network, a digital communication network, and a wireless communication network, and data is transmitted using a predetermined communication protocol. In the present embodiment, the network NT is a public network NTa such as a public telephone network (fixed telephone network), a digital communication network such as ISDN, and a mobile telephone network (cellular phone network), and an Ethernet (registered trademark), for example. And a local area network (LAN; private network) NTb. The public network NTa configures the Internet by using an Internet protocol such as FTP (File Transfer Protocol) or TCP / IP (Transmission Control Protocol / Internet Protocol) as a communication protocol, and the private network NTb is, for example, the Internet A protocol is used to construct an intranet. The photographing apparatus 1 is communicably connected to the public network NTa, and the main server PC 6, the support recording server PC 7, and the content server PC 7 of the remote support apparatus 5 are private so that they can exchange data with each other. The network NTb is communicably connected, and the public network NTa and the private network NTb are communicably connected.

  The main server PC 6 displays the video of the subject received from the photographing apparatus 1 via the network NT, accepts the instruction of the instructor A referring to the video of the subject, and sends the received instruction of the instructor A to the network NT. Is a server computer that transmits to the imaging device 1 via, for example, a computer 161 that controls the entire main server PC 6 and an input device such as a keyboard 162a or a mouse 162b for receiving and inputting an instruction from the instructor A 162 and an output device 163 such as a display 163a for displaying an image, for example.

  In the present specification, when referring generically, it is indicated by a reference symbol without a suffix, and when referring to an individual configuration, it is indicated by a reference symbol with a suffix.

  The computer 161 includes a communication interface circuit (network card) similar to a network interface unit 68 (to be described later) in the photographing apparatus 1 for communicably connecting to the network NT (private network NTb). Control of displaying the image of the subject received via the network NT on the display 163a and transmitting the instruction of the instructor A received (input) from the keyboard 162a and the mouse 162b to the photographing apparatus 1 via the network NT. Do. The instruction from the instructor A is received by the photographing apparatus 1 via the network NT and displayed on a display unit 40 described later in the photographing apparatus 1.

  The support recording server PC 7 stores and records support data exchanged between the photographing apparatus 1 and the remote support apparatus 5 and provides support data corresponding to the request to the client apparatus according to the request of the client apparatus. It is. The support storage server PC7 independently displays the video of the subject by the photographic video apparatus 1 with date / time information such as date and time under the control of the computer 161 or by monitoring (monitoring) the communication signal transmitted through the private network NTb. The support data is recorded in association with each other, and the instruction of the worker A by the remote support device 5 is recorded as support data in association with date / time information such as date and time. As described above, the support record server PC 7 stores and records support data as a history of the remote work support system S.

  The remote operation support system S of the present embodiment is configured so that not only video but also sound such as voice can be exchanged between the image capturing device 1 and the remote support device 5. As will be described later, the device 1 includes earphones 51L and 51R as a sound input / output unit 50 and a microphone 52. The main server PC6 further includes a microphone 162c as an input device 162, and a speaker as an output device 163. 163b is further provided. Then, the computer 161 outputs a sound such as a sound received from the photographing apparatus 1 via the network NT (a sound collected by the microphone 52) from the speaker 163b and receives (inputs) the instruction from the microphone 162c. Control is performed to transmit the instruction A (voice instruction) to the photographing apparatus 1 via the network NT. The voice instruction of the instructor A is received by the photographing apparatus 1 via the network NT and output from the earphones 51L and 51R in the photographing apparatus 1. Further, the support recording server PC7 records the sound from the photographing apparatus 1 as support data in association with date / time information according to the control of the computer 161 or independently, and also gives the voice instruction of the worker A by the remote support apparatus 5 It is recorded as support data in association with date and time information.

  In the remote work support system S according to the present embodiment, the instruction from the instructor A includes not only data such as text data and voice instructions directly input to the remote support device 5 by the worker W, but also work objects, for example. Support content such as video and audio that assists the work when the worker W performs work, such as a reference video representing work, a work manual showing work procedures, and an instruction manual showing how to handle the product. Information). The content server PC 8 is a server computer that stores the support content and provides support content corresponding to the request to the client device according to the request of the client device. The computer 161 of the main server PC 6 receives an instruction (content selection instruction) for selecting support content of the instructor A from the keyboard 162a and the mouse 162b, and sends support content corresponding to the content selection instruction via the network NT. The content server PC8 is controlled so as to be transmitted to. Under the control of the computer 161, the content server PC8 transmits support content corresponding to the content selection instruction to the image capturing device 1 via the network NT, and provides the support content to the image capturing device 1.

  An imaging device 1 that is preferably used in combination with such a remote support device 5 is worn on the head of the worker W, photographs a subject that is substantially along the line of sight of the worker W (wearer), and A head-mounted imaging device (camera) that transmits a photographed subject image to the remote support device 5 via the network NT. For example, as shown in FIGS. 2 to 5, the mounting unit 10 and the imaging unit 20, a display unit 40, a sound input / output unit 50, and a control unit 60.

  The mounting unit 10 is a device for mounting on the head of the worker W, and in the present embodiment, has a structure imitating glasses for correcting vision. That is, the mounting unit 10 of the present embodiment includes a pair of left and right temples 11L and 11R, a bridge 12, a pair of left and right nose pads 13L and 13R, and a pair of left and right transparent members 14L and 14R. .

  The temples 11L and 11R are elongate rod-shaped members made of, for example, an elastic material, and have an ear-hook portion that is hung on the ear of the wearer (here, worker W) at one end. The end portion has a holding portion that is fixed to and held by the transparent members 14L and 14R via the rotating portions 11La and 11Ra, and is hooked on the ear or the temporal region of the worker W. This is for adjusting the holding position on the head and the mounting position. For fixing the temples 11L, 11R and the transparent members 14L, 14R, for example, fixing means such as bonding with an adhesive or screwing with screws is used. In addition, the photographing apparatus 1 rotates the temples 11L and 11R in the directions of arrows P and Q having different rotation directions by the rotation of the rotation units 11La and 11Ra, so that the temples 11L and 11R become the transparent members 14L and 14R. By keeping it along, it can be folded compactly when not in use.

  The bridge 12 is a short bar-like member for connecting the pair of left and right transparent members 14L and 14R to each other, and is fixed to the transparent members 14L and 14R at both ends by means similar to the means for fixing the temples 11L and 11R. . The pair of left and right transparent members 14 </ b> L and 14 </ b> R are held by the bridge 12 in a relative positional relationship with a predetermined interval.

  The nose pads 13 </ b> L and 13 </ b> R are members for holding the mounting unit 10 on the face of the wearer (here, the worker W), and are connected to the bridge 12 through each leg.

  The transparent members 14L and 14R are made of a material that is transparent to visible light, such as a resin such as polycarbonate or polymethyl methacrylate, or glass, and have rounded corners such as the outer shape of a spectacle lens for correcting vision. It is a rectangular plate-shaped member. Of course, the transparent members 14L and 14R do not have to have an adjustment power for correcting vision from the viewpoint of the original function of the photographing apparatus 1, but may have an adjustment power for correcting vision. In this embodiment, a substantially U-shaped cutout portion 14Rs for fitting the eyepiece optical system 41 of the display unit 40 to the transparent member 14R corresponding to the right eye is formed on one of the transparent members 14L and 14R. Yes.

  These temples 11L and 11R, the bridge 12 and the nose pads 13L and 13R constitute a so-called spectacle frame. The spectacle frame is hooked on the wearer, and the transparent members 14L and 14R are in a predetermined state (see FIG. It is mounted at a predetermined distance and a predetermined position.

  In the present embodiment, the mounting unit 10 is configured to fix and hold the transparent members 14L and 14R by the temples 11L and 11R and the bridge 12, but includes a pair of left and right rims, and through these rims. The transparent members 14L and 14R may be configured to be fixed and held. Each rim is, for example, an annular or semi-annular member having an inner groove, and the transparent members 14L and 14R are fixed and held by fitting the outer peripheral portions of the transparent members 14L and 14R into the ring or semi-ring. It is.

  The photographing unit 20 is a device that photographs a subject such as a work object or an external scene around the wearer (worker W in this case), and is attached to the wearer (worker W) so that the wearer is substantially horizontal in front. When viewed in the direction, the optical axis is fixedly held with respect to the mounting unit 10 so that the optical axis substantially coincides with the line of sight of the wearer. As a result, the photographing unit 20 can photograph within the wearer's front visual field. In the present embodiment, the photographing unit 20 is externally attached to one end of the display unit main body 45, and the display unit main body 45 is fixedly attached to the transparent member 14R of the mounting unit 10 via the eyepiece optical system 41. Thus, the mounting unit 10 is fixedly held. Thus, in this embodiment, the imaging unit 20 functions as a camera within the field of view of the wearer (here, worker W) and is held by the mounting unit 10, so that the imaging device 1 is configured in a compact manner. Also, the operator W becomes hands-free and can perform work using both hands. Therefore, the worker W can perform another work while photographing the subject in the front visual field. Note that the mechanism that holds the photographing unit 20 fixedly to the mounting unit 10 so as to substantially coincide with the optical axis may be a structure that allows the photographing unit 20 to be detachable. With this configuration, the photographing unit 20 can be appropriately changed.

  For example, as illustrated in FIG. 5, the photographing unit 20 includes a photographing optical system 21, an imaging element 22, an analog front end 23, and a video control unit 24.

  The photographing optical system 21 is an optical system for forming an optical image (light image) of a subject on the light receiving surface of the image sensor 22. The photographing optical system 21 may be a single focus optical system or a variable magnification optical system having a zoom function for zooming. Further, the photographing optical system 21 may be configured to have an autofocus (AF) function.

  The image sensor 22 performs photoelectric conversion into image signals of R (red), G (green), and B (blue) components in accordance with the amount of light in the optical image of the subject formed on the light receiving surface by the photographing optical system 21. And output to the analog front end 23. For example, a CCD type color image sensor, a CMOS type color image sensor, or the like is used for the imaging element 22. In the present embodiment, a CMOS color image sensor is used, and the CMOS color image sensor is, for example, each color transmission filter corresponding to each light of R (red) light, G (green) light, and B (blue) light. Is a color area photographing sensor arranged in a checkered pattern in pixel units (pixel units), and subject light images formed by the photographing optical system 21 are R (red) light, G (green) light, B ( Blue) This is photoelectrically converted into an image signal of each component of light (a signal composed of a signal sequence of pixel signals received in units of pixels).

  The analog front end 23 controls the driving of the image sensor 22 based on a predetermined reference clock, performs a known analog signal process on the image signal obtained by the image sensor 22, converts the image signal into a digital video signal, and controls the video. It is a circuit that outputs to the unit 24.

  The video control unit 24 performs well-known image processing such as black level correction processing, pixel interpolation processing, white balance adjustment processing, gamma (γ) correction processing, shading correction processing, and the like on the video signal input from the analog front end 23. It is the circuit which applies. The video control unit 24 writes the video signal input from the analog front end 23 in the image memory 61 in the control unit 60 in synchronization with the image signal readout clock in the CMOS type color image sensor. That is, the video signal is once written from the analog front end 23 to the image memory 61, and when predetermined image processing is performed, the video signal is read from the image memory 61 to the video control unit 24 and subjected to each image processing. . Then, the video signals subjected to these image processes are written again in the image memory 61 and stored (stored).

  The display unit 40 is a device that displays a predetermined image (video), and displays the instruction of the instructor A transmitted from the remote support device 5 via the network NT. As described above, the instruction by the instructor A includes not only data such as text data directly input by the instructor A directly to the remote support device 5, but also support of the work when the worker W performs the work. Supporting content by the content server PC 8 such as video and audio is also included. In the present embodiment, the display unit 40 also functions as an electronic viewfinder of the photographing unit 20 and can display an image photographed by the photographing unit 20. When an image of a subject photographed by the photographing unit 20 is displayed on a separate display device, the operator W can use the display device to view a region (subject) photographed by the photographing unit 20. However, in the photographing apparatus 1 of the present embodiment, the display unit 40 functions as a camera finder of the photographing unit 20, so that a worker W who is a photographer of the photographing unit 20 can use the photographing unit 20. It is not necessary to change the direction of the head to view the area (subject) being photographed, and it is not necessary to deflect the line of sight. Can be recognized.

  The display unit 40 may be configured as a separate body without being attached to the mounting unit 10. However, as described above, the worker W self-confidence accurately recognizes the area (subject) captured by the imaging unit 20. In the present embodiment, the instruction of the instructor A is displayed in the field of view of the worker W so that the worker W can perform the work while referring to the instruction of the instructor A. The mounting unit 10 is attached to one transparent member 14R. 2 to 5, for example, such a display unit 40 includes an eyepiece optical system 41, an image generation unit 42, an illumination optical system 43, a light source unit 44, the image generation unit 42, and an illumination. The optical system 43 and the light source unit 44 are accommodated, and a display unit main body 45 that is a casing attached to the eyepiece optical system 41 is provided. As described above, the imaging unit 20 is externally attached to one end of the display unit main body 45, and the eyepiece optical system 41 extends from the bottom surface to the outside. Further, a cable 46 extends from the other end of the display unit main body 45, and the cable 46 so that the photographing unit 20, the display unit 40, the sound input / output unit 50, and the control unit 60 can exchange data with each other. Are electrically connected.

  The light source unit 44 is a device that emits light of a predetermined wavelength, and is, for example, a point light source composed of a white light emitting diode (hereinafter abbreviated as “white LED”) including a predetermined wavelength color.

  The illumination optical system 43 is a device that receives the light emitted from the light source unit 44 and generates illumination light that illuminates the image generation unit 42 from the incident light emitted. For example, in this embodiment, the diffusivity depends on the direction. Is different, and includes a unidirectional diffuser plate 43a that diffuses the incident emitted light in one direction, and a condenser lens 43b that condenses the light diffused by the unidirectional diffuser plate 43a. More specifically, for example, in the present embodiment, the unidirectional diffusion plate 43a diffuses the emitted light incident from the light source unit 44 at about 40 degrees in a direction perpendicular to the paper surface of FIG. 3 and the paper surface of FIG. It diffuses at about 0.2 degree in the direction parallel to the.

  The image generation unit 42 is an apparatus that generates the image by illuminating the illumination light of the illumination optical system 43 and modulating the intensity of the illumination light for each RGB in accordance with the image signal of the VRAM 64 in each pixel. A transmissive LCD device (transmissive liquid crystal display device) is provided.

  The eyepiece optical system 41 is a device for guiding the image generated by the image generation unit 42 to the eyes of the wearer (worker W), and includes, for example, an optical prism 41a and a reflection unit 41b. .

  The optical prism 41a is a member made of a material transparent to visible light such as glass or transparent resin, for example, and is a parallel flat plate formed such that a pair of main surfaces facing each other are substantially parallel. The upper end portion (upper surface portion) of the optical prism 41a is the incident surface of the image light generated by the image generation unit 42 on the upper surface, and the thick portion 411 so that most of the image light can be collected inside. Is formed. The thick portion 411 is formed in a wedge shape with the front side (opposite to the eyepiece surface) protruding so as to become thicker upward. The lower end portion (bottom surface portion) of the optical prism 41a is formed with an inclined portion 412 that is cut obliquely, and the inclined portion 412 is provided with a reflecting portion 41b. The optical prism 41a causes the image light incident from the upper end portion thereof to be reflected a plurality of times therein, and guides the image light to the reflection portion 41b. More specifically, the optical prism 41a repeats total reflection of the image light incident from the upper end portion thereof alternately on the pair of main surfaces, and guides the image light to the reflection portion 41b.

  The reflection part 41b is an optical element that reflects the image light guided by the optical prism 41a to the rear side (eyepiece side) outside the optical prism 41a in cooperation with the inclined part 412 of the optical prism 41a. For example, a half mirror, a multilayer film, a hologram optical element, and the like. In the present embodiment, the reflecting portion 41b is a hologram optical element (HOE) that generates a hologram. For example, since both wavelength selectivity and angle selectivity are relatively high, information is obtained by phase difference depending on the thickness of the photosensitive material. Is a volume phase reflection hologram optical element. In the present embodiment, the reflection type hologram optical element is constituted by a so-called free-form surface that is optically axisymmetric and magnifies and reflects image light of a subject, and has a positive optical power. As described above, in the present embodiment, the reflective hologram optical element has a reflecting surface having a positive optical power and magnifies and reflects the image light of the subject, and also serves as an eyepiece optical system. can do. Since the reflecting surface of the reflecting portion 41b is non-axial, the reflection hologram optical element can be configured to correct a predetermined aberration, and the operator W (wearer, observer) It is possible to observe the corrected subject image. As described above, the reflecting surface of the reflecting portion 41b is appropriately designed so that a predetermined aberration can be corrected.

  The reflection hologram optical element is configured to diffract and reflect image light having a predetermined wavelength, and the light source unit 44 emits light having a predetermined wavelength corresponding to the diffraction wavelength of the reflection hologram optical element. Configured to do. More specifically, in the present embodiment, the reflection type hologram optical element is manufactured so as to diffract image lights having wavelengths of 465 nm ± 10 nm, 520 nm ± 10 nm, and 635 nm ± 10 nm corresponding to RGB (red, green, and blue), In response to this, the light source unit 44 includes an RGB integrated white LED having center wavelengths of 465 nm, 520 nm, and 635 nm. Examples of the photosensitive material for the reflection type hologram optical element include a photopolymer, a silver salt material, gelatin dichromate, and the like. In particular, a photopolymer is preferable because it can be manufactured by a dry process.

  The cutout portion 14Rs of the transparent member 14R has a shape corresponding to the shape of the optical prism 41a so that the optical prism 41a can be fitted without any gap, and the cutout portion 14Rs of the transparent member 14R has an eyepiece optical system. When 41 is fitted, the transparent member 14R and the eyepiece optical system 41 are integrated into a single plate, and the reflecting portion 41b provided on the inclined portion 412 is sandwiched between the optical prism 41a and the transparent member 14R. Buried. Thus, the transparent member 14R and the optical prism 41a constitute a cemented optical prism in which the reflecting portion 41b is embedded in two transparent materials. For this reason, when the reflection part 41b does not touch external air and the reflection part 41b is a hologram optical element, it becomes possible to maintain the performance of a hologram stably.

  The image light guided by the optical prism 41a is reflected by the reflecting portion 41b. More specifically, in this embodiment, the image light is diffracted by the reflective hologram optical element and guided to the optical pupil E as a virtual image. The wearer (worker W) can view the image by causing the image light of the optical pupil E to enter the pupil. As described above, in the display unit 40, the video based on the video signal of the VRAM 64 is displayed on the transmissive LCD device of the video generation unit 42, and the video obtained by the transmissive LCD device of the video generation unit 42 is displayed by the eyepiece optical system 41. A virtual image can be observed as if it was projected directly onto the eyeball of the wearer (worker W) and as if the image was magnified and projected in the air.

  Here, the wavefront reproducibility of the hologram optical element will be described with a simple example. As shown in FIG. 4A, parallel light is reflected by a concave mirror and condensed on the pupil E. A holographic material is placed in front of the concave mirror. Considering the original parallel light and the convergent light as reference light and object light in the hologram, respectively, a hologram optical element (HOE) corresponding to a concave surface can be produced. At the time of reproduction, the light from the image generation means (Display panel) such as a transmissive LCD device is converted into the light condensed on the pupil E by the hologram, so as shown in FIG. When viewed from the position of the condensing point, the image generation means appears to be enlarged (Virtual image).

  Further, since the transparent member 14R cancels (cancels) refraction at the inclined portion 412 of the optical prism 41a, the wearer (worker W) can see the external light without being substantially distorted. Further, as described above, the volume phase type reflection type hologram optical element diffracts only light having a specific wavelength at a specific incident angle, and therefore hardly affects external light. The wearer (worker W) can see the outside world almost as usual through the reflection type hologram optical element and the optical prism 41a of the portion 41b. As described above, the volume phase type reflection hologram optical element functions as a combiner optical element that synthesizes reflected light in a specific wavelength region and transmitted light in other wavelength regions. With such a configuration, the visible light transmittance of the external light in the display unit 40 can be relatively high, for example, about 70% or more, preferably about 85%, and the external light transmittance is high. The wearer (worker W) can see through the outside well through see-through, and the workability of the wearer (worker W) can be improved. In the present embodiment, the eyepiece optical system 41 is disposed on the transparent member 14R corresponding to the right eye so that an image displayed on the display unit 40 can be observed with the right eye, and at the same time, the outside world can be viewed with the right eye. Can be observed (of course, the left eye can observe the outside world).

  Here, when the visible light transmittance of the external light is 70% or more, it becomes difficult to distinguish between the subject image and the image by the external light. However, in the present embodiment, as will be described later, Since the discriminating image processing is performed, it is possible to discriminate between the image of the subject and the image by external light. Thus, when the visible light transmittance of external light is 70% or more, the remote operation support system S and the imaging device 1 of the present embodiment are more effective.

  In the present embodiment, the eyepiece optical system 41 is configured to reflect the image light inside the optical prism 41a and guide it to the optical pupil E by the volume phase type reflection hologram optical element of the reflection portion 41b. Therefore, the thickness of the transparent member 14R can be approximately the same as a normal eyeglass lens (for example, about 3 mm), and is small (compact) and lightweight. Since the reflection is total reflection in the present embodiment, the wearer (operator W) views the outside world without substantially reducing the transmittance of outside light through the pair of main surfaces of the transparent member 14R. be able to.

  The sound input / output unit 50 is a circuit for inputting and outputting sound, and includes a pair of left and right earphones 51L and 51R that output sound, and a microphone 52 that collects sound. The microphone 52 is attached to the tip of a substantially L-shaped arm 53 extending from the temple 11L of the mounting unit 10 to collect the voice of the worker W when the mounting unit 10 is mounted by the worker W. . The voice of the operator W is collected by the microphone 52 of the sound input unit 50, and the voice data of the voice is transmitted from the photographing apparatus 1 to the remote support apparatus 5 via the network NT. The main server PC 6 of the remote support apparatus 5 The sound of the sound data is output from the speaker 163b. On the other hand, the voice of the instructor A is collected by the microphone 162c in the main server PC6 of the remote support device 5, and the voice data of this voice is transmitted from the remote support device 5 to the photographing device 1 via the network NT. The sound of this sound data is output from one earphone 51L, 51R. Alternatively, audio support content is transmitted from the content server PC8 to the image capturing apparatus 1 via the network NT, and the audio support content is output from the earphones 51L and 51R of the image capture apparatus 1. Note that the earphones 51L and 51R of the photographing apparatus 1 may be only one. Thus, the remote work support system S of the present embodiment can give a voice instruction to the worker W, and for example, sound such as voice can be exchanged between the photographing apparatus 1 and the remote support apparatus 5. The worker W and the instructor A can communicate by voice.

  The control unit 60 is a circuit that governs overall control of the photographing apparatus 1. The control unit 60 may be attached to the mounting unit 10 like the photographing unit 20 and the display unit 40. However, in order to reduce the weight of the portion attached to the head of the operator W in the photographing device 1, In the embodiment, it is provided separately from the mounting unit 10 without being attached to the mounting unit 10, and is electrically connected to the photographing unit 20, the display unit 40, and the sound input / output unit 50 by the cable 46 as described above. It is connected. For example, as shown in FIGS. 1, 2, and 5, the control unit 60 includes an image memory 61, a control unit 162, a VRAM 64, a sound input processing unit 65, a sound output processing unit 66, and a power switch 67a. And a selection switch 67b and a network IF unit 68. These image memory 61, control unit 162, VRAM 64, sound input processing unit 65, sound output processing unit 66, power switch 67a, selection switch 67b and network The IF unit 68 is accommodated in a substantially rectangular parallelepiped housing 69. The power switch 67a and the selection switch 67b are disposed in the housing 69 so that their operation portions face the outside of the housing 69, and the network IF section 68 has its connector portion facing the outside of the housing 69. In this manner, the housing 69 is disposed.

  The image memory 61 includes, for example, a volatile storage element such as a RAM (Random Access Memory) and its peripheral circuits, and is used as a work area of the video control unit 24 in the photographing unit 20 as described above.

  The VRAM 64 is a so-called video RAM that includes a RAM and its peripheral circuits, and has at least a video signal storage capacity corresponding to the number of pixels of the video generation unit 42 in the display unit 40. This is a buffer memory for buffering a video signal that constitutes a video to be reproduced and displayed by the generation unit.

  The sound input processing unit 65 is a circuit that performs predetermined signal processing such as amplification and noise cut on the sound signal input from the microphone 52 in the sound input / output unit 50 and outputs the signal to the control unit 62.

  The sound output processing unit 66 is a circuit that performs predetermined signal processing such as amplification and noise cut on the sound signal input from the control unit 62 and outputs the signal to the earphones 51L and 51R in the sound input / output unit 50. is there.

  The power switch 67 a is a switch circuit that activates the photographing apparatus 1 in order to operate the photographing apparatus 1. When the power switch 67 is turned on (switched on), for example, power is supplied from a power source such as a battery to each unit that requires power in the photographing apparatus 1.

  The selection switch 67b receives a switching instruction for instructing switching of the sub-discriminated image processing from the user in order to select one of a plurality of sub-discriminated image processing described later, and sends it to the control unit 62 of the photographing apparatus 1. It is a switch circuit for inputting. The selection switch 67b is configured to include, for example, a push button switch, and the imaging apparatus 1 sequentially switches a plurality of sub-discrimination image processes cyclically every time a switch operation is received regarding selection of sub-discrimination image processing. The sub-discrimination image processing may be selected from among the plurality of sub-discrimination image processings. In addition, for example, the selection switch 67b is configured to include a plurality of switches, and each of the plurality of switches is assigned one different sub-discrimination image process, and photographing regarding selection of the sub-discrimination image processing is performed. The apparatus 1 may be configured to select a sub-discriminating image process corresponding to a switch that is switched on and turned on. Further, for example, the selection switch 67b is configured to include a rotary switch having a plurality of switch contacts, and one different sub-discriminating image process is assigned to each of the plurality of switch contacts in the rotary switch. Regarding the selection of the sub-discrimination image processing, the photographing apparatus 1 may be configured to select the sub-discrimination image processing corresponding to the switch contact that is switched on and turned on.

  The network IF unit 68 is a communication interface circuit for performing communication between the imaging device 1 and the remote support device 5 via the network NT, and uses the data input from the control unit 62 as a communication protocol of the network NT. It accommodates in the corresponding communication signal, transmits the accommodated communication signal to the network NT, receives the communication signal addressed to the photographing apparatus 1 from the network NT, extracts the data accommodated in the received communication signal, and controls it. The data is converted into a format that can be processed by the unit 62, and the converted data is output to the control unit 62.

  The control unit 62 is a circuit that controls each unit of the imaging device 1 according to the function. For example, the control unit 62 may be various predetermined programs such as a control program for controlling the units of the imaging device 1 according to the function. ROM (Read Only Memory) that is a nonvolatile storage element that stores various kinds of predetermined data such as data necessary for execution of the predetermined program, and predetermined arithmetic processing by reading and executing the predetermined program And a CPU (Central Processing Unit) that performs control processing, a RAM that serves as a working memory of the CPU that stores data generated during the execution of the predetermined program, and a microcomputer that includes these peripheral circuits Is done. The control unit 62 may include a rewritable nonvolatile memory element such as an EEPROM (Electrically Erasable Programmable Read Only Memory). The control unit 62 functionally includes a discriminating image processing unit 63a and a display control unit 63b.

  The discriminating image processing unit 63a distinguishes between the image of the subject and the image of the external light when displaying the video of the subject photographed by the photographing unit 20 on the display unit 40 so as to be superimposed on the external light. The discriminating image processing is applied to the video of the subject. The discriminating image processing is preferably processing in which the video after the discriminating image processing is clearly different from the video of the color subject photographed by the photographing unit 20. As described above, in the photographing apparatus 1 of the present embodiment, the discriminating image processing is performed on the subject image itself, and the subject image photographed by the photographing unit 20 is displayed on the display unit 40 so as to be superimposed on the external light. In addition, the image of the subject photographed by the photographing unit 20 can be distinguished from the image by the external light. In particular, when the imaging unit 20 captures an area within the field of view of the worker W, it is more effective because it is difficult to distinguish when an image overlaps an image of external light.

  As the discriminating image processing, at least one of monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing is employed. The discriminating image processing unit 63a independently performs one of monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing on the subject. In addition, the discriminating image processing unit 63a may perform monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing. A plurality of images may be selected, and the selected plurality of image processes may be performed on the video of the subject. For example, monotone processing and edge enhancement processing are each performed on the video of the subject. Further, for example, each of the edge enhancement processing and the edge extraction processing is performed on the video of the subject. For this reason, the operator W (wearer, observer) can easily distinguish and observe the image of the subject from the image of the external light.

  The monotone process is a process for converting a subject image into a monochrome image. Monotone processing is, for example, processing for converting the color of each pixel to a single color while maintaining the gradation of each pixel, processing for changing the intensity balance of the three RGB colors in the video signal of the subject, and processing of the RGB three-color signal. It is executed by a known conventional means such as processing using only one or two colors. Monotone processing includes color tone change processing, monochrome processing (monochrome processing) for converting a subject video to black and white, and conversion of the subject video to two different gradation levels with a predetermined threshold as a boundary. Also includes binarization processing. By using only the brightness (luminance) in the video signal of the subject, the monochrome process can be easily performed. Since the color tone of the display image of the image displayed on the display unit 40 is different due to such monotone processing, the worker W (wearer, observer) can view the image of the subject photographed by the photographing unit 20 by external light. It can be easily distinguished from the image and observed.

  The edge enhancement process is a process for enhancing an edge that is a boundary between a bright part and a dark part in an image. For example, a filter that emphasizes an edge by calculation using a differential or difference of a gradation value near a target pixel is used. It implements by well-known conventional means, such as. The edge of the image displayed on the display unit 40 is emphasized by such edge enhancement processing, so that the worker W (wearer, observer) can view the image of the subject photographed by the photographing unit 20 by external light. It can be easily distinguished from the image and observed.

  The edge extraction process is a process for extracting only the edge, and can be executed by the same process as the edge enhancement process. The edge of the video displayed on the display unit 40 is extracted by such an edge extraction process, which is different from the image by the external light. Therefore, the operator W (wearer, observer) takes a picture with the photographing unit 20. It is possible to easily distinguish the observed subject image from the image of the external light and observe it.

  The contrast enhancement process is a process for enhancing the contrast, and an image with poor contrast is converted into a sharp image by the contrast enhancement process. This contrast enhancement processing is performed by a known conventional means such as, for example, conversion so that the gradation level of each pixel is darker when it is darker and brighter when it is brighter by a predetermined arithmetic expression set in advance. Executed. By such contrast processing, a sharp image is obtained, so that the worker W (wearer, observer) can easily view the image of the subject photographed by the photographing unit 20 from an image of ambient light having a relatively low contrast. It is possible to observe separately.

  The negative / positive inversion processing is processing for converting a negative image into a positive image or a positive image into a negative image. For example, when converting a negative image (positive image) into a positive image (negative image), The color is performed by known conventional means such as converting the color from negative (positive) to positive (negative). In the case of monochrome, black and white are reversed by negative / positive reversal processing. By such negative / positive inversion processing, the image displayed on the display unit 40 is negative / positive-inverted and completely different from the image by the external light. Therefore, the operator W (wearer, observer) takes an image with the imaging unit 20. It is possible to easily distinguish the observed subject image from the image of the external light and observe it.

  Mosaic processing is processing that blurs a video like a mosaic, and is executed by a known conventional means such as integrating pixel values of a plurality of adjacent pixels into one pixel value by a predetermined arithmetic expression. The When mosaic processing is performed, the level that the observer actually feels as a mosaic depends on the screen size (observation angle of view) at the time of observation. That is, even if an observer observes a mosaic image having the same number of pixels, it is observed as a rough image if the observation screen (observation angle of view) is large, and conversely, if the observation screen (observation angle of view) is small, a fine image (mosaic and Is not felt image). For this reason, the degree of mosaicing (the size of the mosaic) needs to consider the observation screen size (observation angle of view) of the display unit 40 observed as a camera finder, but the observation angle of view in a general HMD is Therefore, in this embodiment, the mosaic processing is performed so that an image having about 2500 (about 50 pixels on a side) to about 14400 (about 120 pixels on a side) is obtained. Of course, the aspect ratio is changed according to the aspect ratio of the display image. About 6400 pixels (about 80 pixels on a side if square) is preferable because it is the easiest to distinguish from an external image. By such mosaic processing, the image displayed on the display unit 40 is made into a mosaic and the resolution is lowered, so that the image is different from the image by external light. Therefore, the worker W (wearer, observer) It is possible to easily distinguish and observe the image of the subject photographed by 20 from the image of the external light. When the number of pixels for mosaicing is less than the above range, the display image becomes too coarse and recognition of the subject becomes difficult. When the number of pixels for mosaicing is larger than the above range, the merit of mosaicing is small.

  The gradation level number reduction process is a process for reducing the number of gradation levels of an image, and is executed, for example, by a known conventional means such as integrating a plurality of adjacent gradation levels into one gradation level. By such a gradation level number reduction process, the number of gradation levels of the image displayed on the display unit 40 is reduced and becomes different from the image by the external light. Therefore, the operator W (wearer, observer) can The image of the subject photographed by the photographing unit 20 can be easily distinguished from the image of the external light and observed.

  The noise superimposition process (noise addition process) is a process of superimposing random noise data at a certain ratio on a regular photographed image (original video photographed by the photographing unit 20), and is executed by a known conventional means. Is done. In the present embodiment, the noise superimposition process is executed by a process of replacing pixel values with randomly generated pixel values at a rate of 15 to 50% of all pixels with respect to an actual regular captured image. If it is less than 15% of all pixels, there is too little noise, and the difference from the external image becomes small, making it difficult to distinguish. If it exceeds 50% of all pixels, it will be buried in the noise of the contour and area of the photographed subject, making discrimination difficult, and this is not preferable. About 30% of all pixels is most preferable. By such noise superimposition processing, noise is superimposed on the image displayed on the display unit 40 and becomes different from the image by the external light. Therefore, the operator W (wearer, observer) takes a picture with the photographing unit 20. It is possible to easily distinguish the observed subject image from the image of the external light and observe it.

  These monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing can be realized by known conventional means as described above. However, in the remote support work system S and the photographing apparatus 1 of the present embodiment, each of these image processings is not limited to its original use, but the subject image photographed by the photographing unit 20 is superimposed on the external light. In order to distinguish between the image of the subject and the image of the external light, it is used in a completely new and unexpected idea.

  Furthermore, in this embodiment, the discriminating image processing unit 63a selects any one of a plurality of sub-discriminating image processes, and applies the selected sub-discriminating image process to the video of the subject.

  The sub-discriminated image processing includes at least one of the above-described monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing. For example, monotone processing and edge enhancement processing are set as one of the sub-discrimination image processing. Further, for example, edge enhancement processing and edge extraction processing are set as one of the sub-discrimination image processing. Thus, since a plurality of sub-discrimination image processing is prepared in advance, appropriate sub-discrimination image processing can be selected according to different use environments of outside light such as indoors, daytime, and nighttime, The image of the subject can be displayed so that the shooting range of the camera can be confirmed more accurately.

  More specifically, in the present embodiment, the discriminating image processing unit 63 a is functionally configured to include a discriminating processing unit 631 and a discriminating process selection unit 632. The discriminating process selecting unit 632 selects any one of the plurality of sub-discriminating image processes according to the switch operation of the selection switch 67b, and the selected sub-discriminating image process is selected as the sub-discriminating image process. The discriminating processing unit 631 is notified as discriminating image processing to be performed on the video of the subject. The discriminating processing unit 631 performs the sub-discriminating image processing notified from the discriminating processing selecting unit 632 when displaying the video of the subject imaged by the imaging unit 20 on the display unit 40 so as to be superimposed on the external light. It is applied to the image of the subject.

  The display control unit 63b controls whether or not the image of the subject is displayed on the display unit 40 while being superimposed on the external light. In the present embodiment, for example, when there is another video different from the video of the subject captured by the imaging unit 20 (for example, the network IF unit 68 from the remote support device 5 via the network NT). When there is a received image), the display unit 40 stops displaying the image of the subject imaged by the image capturing unit 20 on the external light and superimposing the other image on the external light. 40 is displayed. Since the display control unit 63b is provided in this way, when the video of the subject imaged by the imaging unit 20 is displayed on the display unit 40 so as to be superimposed on the external light, the discriminating image is included in the video of the subject as necessary. Processing can be performed. In particular, when the other video that is not the video of the subject is displayed on the display unit 40, this different video is inherently different from the image by the external light, and thus discriminating image processing is not necessary. Such a configuration can effectively cope with such a case, for example.

  Next, the operation of this embodiment will be described. FIG. 6 is a flowchart showing the operation of the photographing apparatus in the remote operation support system of this embodiment. FIG. 7 is a diagram for explaining an example of discriminating image processing performed by the imaging device in the remote operation support system according to the embodiment.

  The imaging device 1 in the remote operation support system S of the present embodiment operates as shown in FIG. 6 for discriminating image processing. That is, in FIG. 6, in step S <b> 11, the control unit 62 determines whether to shoot a subject with the shooting unit 20. As a result of this determination, when the subject is not photographed by the photographing unit 20 (N), step S20 is executed. On the other hand, when the subject is photographed by the photographing unit 20 as a result of this judgment (Y), step S12 is executed. Is executed.

  In step S <b> 12, the subject is shot by the shooting unit 20, and the video of the subject stored in the image memory 61 is taken into the control unit 62 by the control unit 62.

  Subsequently, in step S <b> 13, it is determined whether or not to transmit the video of the subject photographed by the photographing unit 20 to the remote support device 5. As a result of this determination, when the video of the subject photographed by the photographing unit 20 is transmitted (Y), step S14 is executed. On the other hand, as a result of this determination, the subject image photographed by the photographing unit 20 is transmitted. If not (N), step S14 is skipped and step S15 is executed.

  In step S <b> 14, the image of the subject photographed by the photographing unit 20 is transmitted by the control unit 62 to the remote support apparatus 5 via the network NT using the network IF unit 68. That is, an image of the subject as it is captured by the imaging unit 20 that has not been subjected to discriminating image processing is transmitted to the remote support device 5. In this transmission, the video of the subject may be image-compressed by the control unit 62 in order to reduce the communication load and the communication time.

  Subsequently, in step S <b> 15, the control unit 62 determines whether or not to display an image of the subject imaged by the imaging unit 20 on the display unit 40. As a result of this determination, when the video of the subject photographed by the photographing unit 20 is displayed on the display unit 40 (Y), step S16 is executed. On the other hand, as a result of this judgment, the subject photographed by the photographing unit 20 Is not displayed on the display unit 40 (N), step S20 is executed.

  In step S <b> 16, the video of the subject photographed by the photographing unit 20 by the discriminating processing unit 631 in the discriminating image processing unit 63 a of the control unit 62 is sub-discriminated image processing notified from the discriminating process selection unit 632. Image processing is performed. Note that, as described above, the discriminating process selection unit 632 notifies the discriminating process selection unit 632 of the sub-discriminating image process corresponding to the switch operation of the selection switch 67b.

  Subsequently, in step S <b> 17, the control unit 62 displays on the display unit 40 the video of the subject that has been subjected to the discrimination image processing by the discrimination processing unit 631 of the discrimination image processing unit 63 a. For this reason, the operator W (wearer) can easily distinguish between the image of the subject photographed by the photographing unit 20 and the image of the external light by executing this discriminating image processing, and accurately. Twenty shooting ranges can be confirmed. In addition, for this reason, it is not necessary to calculate the shooting direction of the camera as in Patent Document 2, and the effects can be achieved with a simpler method.

  When the video of the subject photographed by the photographing unit 20 is a video in which it is difficult to distinguish between the subject video and the image by external light, for example, as shown in FIG. 7C, for example, monotone processing and edge enhancement processing When the discriminating image processing is performed by the sub-discriminating image processing including the combination of the above, the image is monotoned and the edge is emphasized as shown in FIG. Is easy to distinguish. Or, for example, when discriminating image processing is performed by sub-discriminating image processing including a combination of edge extraction processing and edge enhancement processing, an edge is extracted and enhanced as shown in FIG. It is easy to distinguish between a subject image and an image by external light.

  Subsequently, in step S18, the visibility of whether or not the image of the subject photographed by the photographing unit 20 and the image by the external light can be distinguished by the operator W (wearer) is determined. When the condition is good (Y), the selection switch 67b is not operated by the operator W, and the control unit 62 ends this process. On the other hand, when the visibility is not good (N), The selection switch 67b is operated by the operator W, and step S19 is executed.

  In step S19, by the switch operation of the selection switch 67b, the sub-discriminating image processing is switched by the discriminating process selection unit 632, and the sub-discrimination image processing corresponding to the switch operation of the selection switch 67b is performed. The discrimination processing unit 631 is notified from 632, and the process returns to step S16. As described above, in the present embodiment, an appropriate sub-discrimination image process can be selected according to different use environments of external light.

  On the other hand, in step S20, the display control unit 63b of the control unit 62 determines whether or not to display another image different from the image of the subject imaged by the imaging unit 20. As a result of this determination, when the other video is not displayed, the video control unit 63b of the display unit 40 is turned off by the display control unit 63b, and this process is ended. On the other hand, as a result of this determination, when the other video is displayed, the display control unit 63b displays the other video on the display unit 40 without being subjected to discriminating image processing, and this processing is terminated. The As described above, in this embodiment, the image displayed on the display unit 40 can be subjected to discriminating image processing as necessary, and the image of the subject photographed by the photographing unit 20 is superimposed on the external light to be displayed on the display unit. Only when the image is displayed on 40, the image of the subject can be subjected to discriminating image processing.

  Note that the control unit 60 may include a plurality of switches that accept switch operations from the worker W (wearer) in order to make the above-described determinations of step S11, step S13, step S15, and step S20. The success or failure of each determination is determined according to the switch operation of these switches.

  Since it operates in this way, the remote work support system S and the photographing apparatus 1 (including the camera finder) according to the present embodiment discriminates when the subject image is displayed on the display unit 40 while being superimposed on the external light. The image processing unit 63a applies discriminating image processing to the video of the subject. For this reason, the remote operation support system S and the photographing apparatus 1 (including the camera finder) according to the present embodiment performs discriminating image processing on the subject image itself, and thus calculates the photographing direction and the like of the photographing unit 20. The image of the subject can be displayed so that the photographing range of the photographing unit 20 can be accurately confirmed by a simpler method.

  In the present embodiment, the photographing apparatus 1 includes a photographing unit 20 that functions as a photographing camera within the field of view of the worker W (wearer). The photographing apparatus 1 and the remote support apparatus 5 include a network IF unit, and a network It is possible to communicate with each other via NT. As described above, since the photographing apparatus 1 can transmit the image of the subject photographed by the photographing unit 20 to the outside, the external instructor A that exists remotely from the worker W can be viewed from the viewpoint of the worker W. The video of the subject can be observed.

  In the present embodiment, the discriminating image processing allows the worker W (wearer) to easily refer to the display of the display unit 40 that functions as a camera finder, thereby easily capturing the photographing range photographed by the photographing unit 20. Since it can be confirmed, for example, an image intended by the operator W, such as a video obtained by photographing the work object to be instructed at an appropriate angle, or an instruction when receiving an instruction to shoot from the instructor A, for example. The video intended by the operator A can be appropriately transmitted to the external instructor A that is remote from the worker W.

  In the present embodiment, as shown by a broken line in FIG. 5, the photographing apparatus 1 is photographed by the photographing unit 20 and the subject image before being subjected to the discriminating image processing by the discriminating image processing unit 63 a of the control unit 62. The recording unit 70 may be further provided. The recording unit 70 includes, for example, a memory card such as a hard disk or a flash memory. In this embodiment, since the image of the subject before the discriminating image processing is stored in the image memory 61, such a configuration can be easily realized. With this configuration, the subject image before the discriminating image processing is recorded in the recording unit 70, so that a more accurate subject image can be recorded.

  In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

S Remote Work Support System 1 Imaging Device 5 Remote Support Device 6 Main Server Computer Device 7 Support Recording Server Computer Device 8 Content Server Computer Device 10 Mounting Unit 20 Imaging Unit 40 Display Unit 41 Eyepiece Optical System 41a Optical Prism 41b Reflector 50 Sound Input Output unit 60 Control unit 63a Discrimination image processing unit 63b Display control unit 631 Discrimination processing unit 632 Discrimination processing selection unit 70 Recording unit

Claims (13)

In the camera finder that displays the subject image superimposed on the external light,
A display unit that displays an image of the subject superimposed on external light;
A discriminating image in which discriminating image processing for discriminating between the video of the subject and the image of the external light is applied to the video of the subject when the video of the subject is displayed on the display unit so as to be superimposed on the external light. A camera finder comprising a processing unit. The discriminating image processing is at least one of monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing. The camera finder according to claim 1. The discriminating image processing includes a plurality of sub-processes including at least one of monotone processing, edge enhancement processing, edge extraction processing, contrast enhancement processing, negative / positive inversion processing, mosaic processing, gradation level number reduction processing, and noise superimposition processing. With discriminating image processing,
2. The discriminating image processing unit selects any one of the plurality of sub-discriminating image processes, and applies the selected sub-discriminating image process to the video of the subject. Camera finder. The camera according to any one of claims 1 to 3, further comprising a display control unit that controls whether or not the video of the subject is displayed on the display unit so as to be superimposed on external light. finder. The camera viewfinder according to any one of claims 1 to 4, wherein a visible light transmittance of external light in the display unit is 70% or more. The display unit
An image light generator for generating image light of the subject;
A light guide unit for guiding the image light of the subject generated by the image light generation unit by total reflection a plurality of times;
The camera according to claim 1, further comprising: a reflection unit that reflects the image light of the subject guided by the light guide unit to the outside of the light guide unit. finder. The camera finder according to claim 6, wherein the reflection unit is a reflection hologram optical element. The camera finder according to claim 7, wherein the reflective hologram optical element includes a reflective surface having a positive optical power that magnifies and reflects the image light of the subject. A wearing part to be worn on the head;
A photographing unit for photographing a subject provided in the mounting unit;
A camera finder for displaying an image of a subject photographed by the photographing unit,
The camera finder according to any one of claims 1 to 8, wherein the camera finder is a camera finder. The image capturing apparatus according to claim 9, wherein the region captured by the image capturing unit is a region within the field of view of the wearer. The photographing apparatus according to claim 9, wherein the display unit is provided in the mounting unit. A communication unit that transmits and receives communication signals; and a communication control unit that controls transmission and reception of the communication unit;
The photographing apparatus according to any one of claims 9 to 11, wherein the communication control unit causes the communication unit to transmit a video of the subject photographed by the photographing unit. A remote work support system comprising a photographing device and a remote work support device communicably connected to the photographing device via a communication network,
The imaging device is the imaging device according to any one of claims 9 to 12,
The remote work support device receives a command from an instructor by receiving a second display unit that displays an image of a subject that is received through the communication network and photographed by the photographing unit, and transmits the command through the communication network. A remote operation support system, comprising: an instruction receiving unit that transmits the image to the photographing apparatus.