JP2010183274A - Camera system, camera, and face mount image display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera system which can control a face mount display so that an image can be seen on a big screen while paying attention to the safety and the degree of freedom of a user, and to provide a camera for use in such a camera system, and a face mount display. <P>SOLUTION: A state detection unit 109 detects whether a user mounting an FMD 200 has a camera 100 or not. When the user has a camera 100, the control unit 101 of the camera 100 transmits an image obarined through an image capturing unit 104 to the FMD 200 through a communication unit 108. When an image from the camera 100 is received, the control unit 201 of the FMD 200 displays the image thus received on the display unit in an optical system 206, and brings a shutter in the optical system 206 into light blocking state. However, when an image from the camera 100 is not received, the control unit 201 brings a shutter in the optical system 206 into open state. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a camera system having a wearable image display device and a camera that can be worn by a user, and to a camera and a wearable image display device used in such a camera system.

  In recent years, the trend toward miniaturization and high functionality of devices has been accelerated, and it has become a situation where such high performance devices can be carried outdoors. Under these trends, wearable image display devices that allow viewing of images with a large-screen sensation outdoors have been proposed under names such as FMD (face-mounted display) and HMD (head-mounted display). Further, for example, Patent Document 1 proposes to use such a wearable image display device as a camera finder device.

JP 2001-209037 A

  Here, considering a case where a wearable image display device such as an FMD is used as a finder device, the user can usually only see an image sent from the camera while the image display device is being worn. In recent years, an image display device that is attached to only one eye has been proposed, but even in this case, only the image sent from the camera can be seen with respect to the eye on which the image display device is attached. . Such a situation not only feels inconvenient for the user, but is not preferable from the viewpoint of safety. Considering the safety aspect and the user's degree of freedom, it is better to give priority to the natural field of view with the naked eye in unnecessary situations even when the image display device is being worn.

  The present invention has been made in view of the above circumstances, and a camera system capable of checking an image on a large screen and controlling a wearable image display device in consideration of safety and user's freedom, and such An object of the present invention is to provide a camera and a wearable image display device used in a simple camera system.

  In order to achieve the above object, a camera system according to a first aspect of the present invention includes a camera and a wearable image display device configured to be freely wearable on a user's eyes and operating in cooperation with the camera. In the camera system, the camera is permitted to transmit an image, an image capturing unit that captures an image of a subject, an image transmission unit that determines whether the image acquired by the image capturing unit can be transmitted, and the image transmission. A camera-side communication unit that transmits the image acquired by the imaging unit to the wearable image display device, and the wearable image display device receives the image transmitted from the camera-side communication unit. When an image is received by the receiving display device side communication unit and the display device side communication unit, the received image is guided to the user's eyes, and the display device side communication unit receives the image. If not, an image based on light from the outside of the mounted image display apparatus, characterized by comprising an optical system for guiding the eyes of the user.

  In order to achieve the above object, the camera according to the second aspect of the present invention images a subject in a camera that operates in cooperation with a wearable image display device configured to be freely wearable on the user's eyes. And an image acquired by the imaging unit when transmission of the image is permitted, an imaging unit that acquires an image, a transmission availability determination unit that determines whether or not to transmit the image acquired by the imaging unit And a camera-side communication unit that transmits the image to the wearable image display device.

  In order to achieve the above object, a wearable display device according to a third aspect of the present invention is a wearable image display device configured to be freely wearable on a user's eyes and operating in cooperation with a camera. When an image is received by the display device side communication unit that receives an image from the camera and the display device side communication unit, the received image is guided to the eyes of the user, and the display device side communication unit An optical system for guiding an image based on light from the outside of the wearable image display device to the eyes of the user when no image is received.

  According to the present invention, a camera system capable of confirming an image on a large screen and controlling a wearable image display device in consideration of safety and user freedom, and a camera used in such a camera system and the wearer A type image display apparatus can be provided.

It is a block diagram which shows the structure of the camera system which concerns on one Embodiment of this invention. It is a figure which shows an example of a structure of an optical system. It is an external view of FMD. It is a figure which shows the mode at the time of using the camera system in one Embodiment of this invention. FIG. 5A is a diagram illustrating a field of view when the user holds the camera, and FIG. 5B is a diagram illustrating a state of the field of view to be shown to the user via the FMD when the camera is held. is there. FIG. 6A is a diagram showing the field of view when the user does not hold the camera, and FIG. 6B shows the state of the field of view to be shown to the user via the FMD when the camera is not held. FIG. It is a figure which shows an example of a structure of a state detection part. It is a figure which shows the modification of a structure of a state detection part. It is a flowchart which shows the main operation | movement of a camera. It is a flowchart which shows the process of reproduction | regeneration mode. It is a flowchart which shows the main operation | movement of FMD. It is a flowchart which shows the modification of the process of reproduction | regeneration mode. It is a figure which shows the modification of a structure of an optical system.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a camera system according to an embodiment of the present invention. As shown in FIG. 1, the camera system in the present embodiment includes a camera 100 and a face mount display (hereinafter referred to as FMD) 200. The camera 100 and the FMD 200 are communicably connected to each other, and an image acquired by the camera 100 can be viewed on the FMD 200 by transmitting the image acquired by the camera 100 to the FMD 200.

  The camera 100 includes a control unit 101, an operation unit 102, a photographing lens 103, an imaging unit 104, a display unit 105, a clock unit 106, a recording unit 107, a communication unit 108, and a state detection unit 109. Have.

  The control unit 101 is configured by an LSI or the like configured for a camera, and controls each block inside the camera 100 of FIG. 1 in response to an operation of the operation unit 102 by the user. The control unit 101 also performs image processing such as white balance correction and compression / decompression processing on the image acquired by the imaging unit 104.

  The operation unit 102 is an operation unit for the user to operate the camera 100. The operation unit 102 includes, for example, a power button for switching on / off the power of the camera 100, a release button for instructing execution of shooting by the user, a playback button for instructing playback of an image by the user, and a user Includes a selection button for performing various selection operations related to the camera 100.

  The photographing lens 103 is a lens for causing a light beam from a subject (not shown) to enter the imaging unit 104. The imaging unit 104 acquires an image by converting an image of a subject based on the light flux from the photographing lens 103 into an electrical signal, and further outputs the image to the control unit 101 as digital data.

  The display unit 105 having a function as an integrated display unit is provided integrally on the back surface of the camera 100, for example, and various images such as an image acquired via the imaging unit 104 and an image recorded in the recording unit 107. Is displayed. The display unit 105 is composed of, for example, a liquid crystal display. The display unit 105 allows the user to check the composition of the subject and the photo opportunity.

  The clock unit 106 measures the date and time when the image was taken. The recording unit 107 records an image acquired through the imaging unit 104 and compressed by the control unit 101. The recording unit 107 records an image as an image file to which shooting conditions such as a shooting date and time counted by the clock unit 106 are added.

  The communication unit 108 is a communication circuit for performing communication with the FMD 200, and transmits an image to the FMD 200 under the control of the control unit 101. A communication method between the camera 100 and the FMD 200 is not particularly limited. For example, wired communication in which communication is performed by connecting the camera 100 and the FMD 200 via a USB cable or the like may be used, or wireless communication such as a wireless LAN may be used.

  A state detection unit 109 having a function of a transmission permission / inhibition determination unit together with the control unit 101 detects whether or not transmission of an image from the camera 100 to the FMD 200 can be permitted. Although details will be described later, the state detection unit 109 detects whether the user is wearing the FMD 200 and whether the user is holding the camera 100 for shooting. The control unit 101 determines that transmission of an image can be permitted when the state detection unit 109 detects that the user is holding the camera 100.

  The FMD 200 in the present embodiment has a function as a wearable image display device, and is freely wearable on the user's eyes. The FMD 200 includes a control unit 201, a communication unit 202, a recording unit 203, a display drive unit 204, a shutter drive unit 205, an optical system 206, and an operation unit 207.

  The control unit 201 controls each block of the FMD 200 such as operation control of the communication unit 202, expansion processing of an image recorded in the recording unit 203, and operation control of the display driving unit 204 and the shutter driving unit 205.

  The communication unit 202 is a communication circuit for performing communication with the camera 100, and receives an image from the camera 100 under the control of the control unit 101. The recording unit 203 records the image received by the communication unit 202.

  The display driving unit 204 drives the display unit included in the optical system 206 under the control of the control unit 201. A shutter drive unit 205 drives a shutter included in the optical system 206 under the control of the control unit 201. The optical system 206 is an optical system including a display unit for displaying an image received by the communication unit 202 or an image recorded in the recording unit 203. The optical system 206 will be described later.

  The operation unit 207 is a variety of operation units for switching on / off the power of the FMD 200 and switching the operation mode of the FMD 200.

  FIG. 2 is a diagram illustrating an example of the configuration of the optical system 206. As illustrated in FIG. 2, the optical system 206 includes a display unit 301, an optical unit 302, and a shutter 303.

  The display unit 301 is a display unit for displaying an image received by the communication unit 202 or an image recorded in the recording unit 203. FIG. 2 shows an example in which the display unit 301 is a liquid crystal display (LCD). The display unit 301 in this case includes an LCD panel 301a and a backlight 301b. The LCD panel 301 a is configured by two-dimensionally arranging pixels including liquid crystal, and changes the light transmittance of each pixel according to the control of the display driving unit 204. The backlight 301b uses, for example, a white light emitting diode (LED) as a light source, and performs light irradiation from the back surface of the LCD panel 301a in accordance with the control of the display driving unit 204. In the example of FIG. 2, an LCD is used for the display unit 301, but the display unit 301 is not limited to the LCD. For example, an organic EL display device (OELD) may be used for the display unit 301.

  The optical unit 302 includes a free-form surface prism 302a including a curved surface that forms an angle of 45 degrees with respect to the incident direction of light from the outside of the FMD 200 (the direction of the arrow in the drawing). A free curved surface portion formed on the free curved surface prism 302a is coated with a half mirror 302b, and a correcting prism 302c for correcting the power of the free curved surface prism 302a is joined to the half mirror 302b.

  The shutter 303 is disposed on an incident optical path of light from the outside of the FMD 200. The shutter 303 is opened as shown in FIG. 2A when no image is displayed on the display unit 301 (when the backlight 301b is in a non-lighting state). In this case, light from the outside of the FMD 200 enters the user's eyes 400 via the optical unit 302. Therefore, the user can obtain a natural field of view without being blocked by wearing the FMD 200.

  On the other hand, when an image is displayed on the display unit 301 (when the backlight 301b is turned on), the shutter 303 is in a light-shielding state as shown in FIG. In this case, the light from the outside of the FMD 200 is blocked by the shutter 303, and the light based on the image displayed on the display unit 301 passes through the optical path as indicated by the arrow in FIG. 400 is incident. As a result, the user can see the image displayed on the display unit 301.

  FIG. 3 is an external view of the FMD 200. The appearance of the FMD 200 in the present embodiment has a substantially glasses-like shape with only one eye as shown in FIG. 3A, and the user puts the string part 200a formed on the FMD 200 on the ear in the same manner as the glasses, and nose The FMD 200 is mounted by applying the contact part 200b to the nose. As described above, when the image transmitted from the camera 100 is displayed on the FMD 200, the shutter 303 is closed as shown in FIG. Although FIG. 3A shows the FMD 200 that can be attached to only one eye, the FMD 200 may be attached to both eyes. In this case, it is necessary to provide a pair of the optical systems 206 shown in FIG.

  3A and 3B show a case where the communication form of the FMD 200 is wireless communication. In this case, the FMD 200 is provided with the antenna 202a of the communication unit 202. On the other hand, when the communication form of the FMD 200 is wired communication, the cable 202b is connected to the FMD 200 as shown in FIG.

  FIG. 4 is a diagram illustrating a situation when the camera system according to the present embodiment is used. When the FMD 200 is used as a finder in the camera system according to the present embodiment, as shown in FIGS. 4A and 4B, the user wears the FMD 200 on the eyes. In this state, as shown in FIG. 4A, when the user does not hold the camera 100, transmission of an image from the camera 100 is prohibited. Further, in this case, the shutter 303 of the FMD 200 is in an open state, so that the user can see the outside world through. On the other hand, as shown in FIG. 4B, when the user holds the camera 100, transmission of an image from the camera 100 is permitted. Furthermore, since the shutter 303 is in a light-shielded state, the user can check images transmitted from the camera 100 at intervals such as a large screen. Even if the display screen of the display unit 301 of the FMD 200 is small, the display is performed near the user's eyes, so that the user can feel that an image of several tens of inches can be seen 2 m away.

  In general, as shown in FIG. 5A, in the state where the camera 100 is held, the direction that the user is looking for matches the shooting range, and the user has the intention and consciousness to take a picture. Therefore, in this case, as shown in FIG. 5B, it is desirable that the display unit 301 of the FMD 200 display so as to match the photographing result of the camera 100. On the other hand, as shown in FIG. 6A, in the state where the camera 100 is not held, the direction that the user is trying to see does not match the shooting range. In such a case, if the field of view (broken line portion) of the camera 100 is displayed, it only confuses the user. In this case, it is desirable to open the shutter 303 so that the outside can be seen through as shown in FIG. 6B.

  FIG. 7 is a diagram illustrating an example of a configuration of the state detection unit 109 for detecting whether or not the user holds the camera 100. In the example illustrated in FIG. 7, the state detection unit 109 includes a back lens 109a and a back imaging unit 109b.

  The rear lens 109a is provided on the rear surface of the camera 100. When the user holds the camera 100, that is, when the FMD 200 and the rear lens 109a face each other, the rear lens 109a includes the FMD 200 (via the rear lens 109a. The light beam from the user is incident on the rear imaging unit 109b. The rear imaging unit 109b acquires an image by converting an image of the FMD 200 based on the light flux from the rear lens 109a into an electrical signal, and outputs the image to the control unit 101 as digital data. The control unit 101 compares the image obtained from the rear imaging unit 109b with the shape pattern of the FMD 200 registered in advance, and when the appearance shape of the FMD 200 is detected in the image, the user wearing the FMD 200 It is determined that the camera 100 is held, and communication from the camera 100 to the FMD 200 is permitted.

  Here, in the present embodiment, an example is shown in which the camera 100 is provided with the state detection unit 109 so that the user can determine whether or not the user holds the camera 100. However, this determination is performed on the FMD 200 side. You may do it.

  Further, it is not necessary to detect whether or not the camera 100 is held directly. For example, it is possible to determine whether or not the user holds the camera 100 by performing near field communication between the camera 100 and the FMD 200. Anyway. FIG. 8 is a diagram showing such a modification. For example, when the communication form between the camera 100 and the FMD 200 is non-contact wireless communication, communication may be established only when the FMD 200 is brought close to the camera 100 as shown in FIG. In addition, in the case where communication is established even when the distance is not close, such as a wireless LAN, for example, when the user's finger touches the release button 102a, the user intends to take a picture. A communication request may be made from the camera 100 to the FMD 200. In this case, the user does not necessarily have to bring the camera 100 close to the FMD 200.

  Further, the determination may be made based on whether or not signals can be exchanged between the camera 100 and the FMD 200. In this case, for example, as shown in FIG. 8B, the light emitting diode 110 and the photodiode 111 are provided in the camera 100, and the light emitting diode 208 and the photodiode 209 are provided in the FMD 200. In the configuration of FIG. 8B, light from each light emitting diode is received by the corresponding photodiode only when the light emitting diode and the photodiode face each other. Therefore, it is possible to determine whether the user holds the camera 100 by monitoring the output signal of the photodiode in the control unit 101 and the control unit 201, respectively.

Next, the detailed operation of the camera system of this embodiment will be described.
First, the operation of the camera 100 will be described. FIG. 9 is a flowchart showing the main operation of the camera 100. Here, the camera 100 in the present embodiment has a shooting mode and a playback mode as operation modes. The shooting mode is an operation mode for the user to shoot an image for recording, and the playback mode is a mode for playing back the recorded image. Switching between these operation modes can be performed by operating a selection button of the operation unit 102, for example.

  In FIG. 9, the control unit 101 of the camera 100 first determines whether or not the power of the camera 100 is turned on (step S101). If it is determined in step S101 that the power is off, the control unit 101 ends the process of FIG. Note that the communication unit 108 operates even when the power is turned off, and the control unit 101 turns on the power of the camera 100 when a power-on instruction is issued from the FMD 200 via the communication unit 108.

  On the other hand, when the power is turned on in the determination in step S101, the control unit 101 determines whether or not the operation mode of the camera 100 is the shooting mode (step S102). If it is determined in step S102 that the operation mode of the camera 100 is the shooting mode, the control unit 101 performs exposure correction (step S103). In this exposure correction, the control unit 101 measures the brightness of the subject based on the image obtained via the imaging unit 104 and the output of a dedicated photometric sensor. Then, based on the measured brightness of the subject, the control unit 101 corrects the brightness of the image so that the brightness of the image obtained via the imaging unit 104 is an appropriate brightness.

  Next, the control unit 101 determines whether the user wearing the FMD 200 holds the camera 100 based on the output of the state detection unit 109. Then, based on this determination result, it is determined whether or not communication with the FMD 200 can be permitted (step S104). If the communication cannot be permitted in the determination in step S104, that is, if the user does not wear the FMD 200 or does not hold the camera 100, the control unit 101 displays a through image on the display unit 105 (step S105). In the live view display on the camera 100 side, the control unit 101 causes the imaging unit 104 to continuously operate, and causes the display unit 105 to display images sequentially obtained via the imaging unit 104 by this continuous operation in real time. On the other hand, in the determination of step S104, when the communication can be permitted, that is, when the user wearing the FMD 200 holds the camera 100, the control unit 101 causes the display unit 301 of the FMD 200 to display a through image display. The image acquired in (1) is transmitted to the FMD 200 via the communication unit 108 (step S106). Furthermore, the control unit 101 turns off the live view display on the display unit 105 when the live view display is performed on the display unit 105 (step S107). With such a through image display on the display unit 105 of the camera 100 or the display unit 301 of the FMD 200, the user can determine the composition and the photo opportunity. The reason why the display of the camera 100 is turned off during the through image display in the FMD 200 is that the user holds the FMD 200 and holds the camera 100, and it is considered that the user does not pay attention to the display unit 105 of the camera 100. . As a result, the power consumption of the camera 100 can be reduced.

  After the through image display, the control unit 101 determines whether or not the release button of the operation unit 102 has been pressed by the photographer (step S108). If it is determined in step S108 that the release button has not been pressed, the process returns to step S101. In this case, the control unit 101 determines again whether the camera 100 is powered on. On the other hand, when the release button is pressed in the determination in step S108, the control unit 101 performs exposure control (capture of a recording image) (step S109). After capturing the image, the control unit 101 performs image processing such as compression processing on the captured image, and then adds a shooting condition such as a shooting date and time counted by the clock unit 106 to the processed image. Is generated. Then, the control unit 101 causes the recording unit 107 to record the generated image file (step S110). Thereafter, the process returns to step S101.

  In step S102, when the operation mode of the camera 100 is not the shooting mode, the control unit 101 determines whether or not the operation mode of the camera 100 is the playback mode (step S111). If it is determined in step S111 that the operation mode of the camera 100 is not the playback mode, the process returns to step S101. On the other hand, if it is determined in step S111 that the operation mode of the camera 100 is the playback mode, the control unit 101 performs a playback mode process (step S112). After the playback mode process, the process returns to step S101.

  FIG. 10 is a flowchart showing processing in the reproduction mode. In FIG. 10, the control unit 101 sets the last recorded image file among the image files recorded in the recording unit 107 as a reproduction candidate image (step S201). Next, the control unit 101 determines whether or not to end the process of the playback mode, that is, whether or not the user has performed an end operation of the playback mode (step S202). The reproduction mode end operation is, for example, an operation for switching the operation mode of the camera 100. If it is determined in step S202 that the reproduction mode has been terminated, the control unit 101 terminates the process in FIG.

  On the other hand, if it is determined in step S202 that the end operation of the playback mode has not been performed, the control unit 101 determines whether the user wearing the FMD 200 holds the camera 100 based on the output of the state detection unit 109. To do. Then, based on the determination result, it is determined whether or not communication with the FMD 200 can be permitted (step S203).

  If it is determined in step S203 that communication with the FMD 200 cannot be permitted, the control unit 101 reads an image file corresponding to the candidate image from the recording unit 107, performs an expansion process on the image in the image file, and then displays the image file. 105 is displayed (step S204). On the other hand, if it is determined in step S204 that communication with the FMD 200 can be permitted, the control unit 101 reads an image file corresponding to the candidate image from the recording unit 107 in order to reproduce an image on the FMD 200. Then, the control unit 101 transmits the read image file to the FMD 200 via the communication unit 108 (step S205). At this time, the display unit 105 may be hidden. This is because it is considered that the user wears the FMD 200 and holds the camera 100 and does not pay attention to the display unit 105 of the camera 100.

  After the reproduction of the image, the control unit 101 determines whether or not to switch the reproduction image, that is, whether or not the reproduction image switching operation has been performed by the operation of the operation unit 102 of the user (step S206). If it is determined in step S206 that the playback image is not switched, the process returns to step S201. In this case, the control unit 101 determines again whether or not to end the playback mode process. On the other hand, when the playback image is switched in the determination in step S206, the control unit 101 sets the next image file of the next shooting date among the image files recorded in the recording unit 107 as the next candidate image. (Step S207). Thereafter, the process returns to step S201.

  FIG. 11 is a flowchart showing the main operation of the FMD 200. Here, the FMD 200 in this embodiment has a finder mode, a playback mode, and a through mode as operation modes. The viewfinder mode is an operation mode for using the FMD 200 for the viewfinder of the camera 100. The reproduction mode is an operation mode for reproducing an image recorded in the recording unit 203 of the FMD 200. Further, the through mode is an operation mode in which the shutter 303 is in an open state when no image is displayed on the display unit 301. Switching between the finder mode and the playback mode can be performed by the operation unit 207 of the FMD 200.

  In FIG. 11, the control unit 201 first determines whether or not the power of the FMD 200 is on (step S301). If it is determined in step S301 that the power is off, the control unit 201 ends the process in FIG. In this case, the image display by the FMD 200 is not performed. On the other hand, when the power is turned on in the determination in step S301, the control unit 201 controls the shutter driving unit 205 to open the shutter 303 (step S302). In such a through mode, the user can obtain a plain view.

  Next, the control unit 201 determines whether an image is received from the camera 100 via the communication unit 202 (step S303). If it is determined in step S303 that an image is received from the camera 100, the control unit 201 controls the shutter driving unit 205 to put the shutter 303 in a light-shielding state (step S304). Thereafter, the control unit 201 controls the display driving unit 204 to display an image received via the communication unit 202 on the display unit 301 (step S305).

  Next, the control unit 201 determines whether or not the operation mode of the FMD 200 is a finder mode (step S306). If it is determined in step S306 that the operation mode of the FMD 200 is the finder mode, the process returns to step S303. Then, the control unit 201 waits for reception of the next image from the camera 100. Since images are sequentially transmitted from the camera 100 in the finder mode, by displaying these images on the display unit 301, it is possible to display a through image similar to the camera 100 in the FMD 200.

  If the operation mode of the FMD 200 is not the finder mode, that is, the playback mode is determined in step S306, the control unit 201 records the image file received via the communication unit 202 in the recording unit 203 (step 307). ). Thereafter, the process returns to step S301.

  If it is determined in step S303 that no image is received from the camera 100, the control unit 201 sends a power-on instruction to the camera 100 via the communication unit 202 (step S308). The camera 100 is also turned on when receiving this instruction. Next, the control unit 201 determines whether or not the operation mode of the FMD 200 is a playback mode (step S309). If it is determined in step S309 that the operation mode of the FMD 200 is not the playback mode, the process returns to step S301. On the other hand, if it is determined in step S309 that the operation mode of the FMD 200 is the reproduction mode, the control unit 201 controls the shutter driving unit 205 to put the shutter 303 in a light shielding state (step S310). Thereafter, the control unit 201 expands the image in the image file recorded last among the image files recorded in the recording unit 203 and displays the image on the display unit 301 (step S311). After the reproduction of the image, the control unit 201 determines whether or not the reproduction image is switched, that is, whether or not the reproduction image switching operation is performed by the operation of the operation unit 207 of the user (step S312). If it is determined in step S312 that the playback image is not switched, the process proceeds to step S314. On the other hand, when the playback image is switched in the determination in step S312, the control unit 201 sets the next image file with the next recording date among the image files recorded in the recording unit 203 as the next candidate image. Is displayed on the display unit 301 (step S313).

  After step S312 or step S313, the control unit 201 determines whether or not to end the processing of the playback mode, that is, whether or not the user has performed an end operation of the playback mode (step S314). If it is determined in step S314 that the reproduction mode has been ended, the process returns to step S301. On the other hand, if it is determined in step S314 that the playback mode end operation has not been performed, the process returns to step S312. In this case, the control unit 201 continues to reproduce the candidate image.

  As described above, according to the present embodiment, when the user wearing the FMD 200 holds the camera 100, an image similar to that displayed on the display unit 105 of the camera 100 is displayed on the display unit 301 of the FMD 200. Reproduced above. As a result, the user can check the images before and after shooting with the feeling of a large screen by the FMD 200. Further, when the camera 100 is not held, the user can obtain a natural field of view.

  Here, the candidate image may be displayed on the FMD 200 by the processing shown in FIG. In other words, real-time image display is required at the time of shooting, but real-time performance is not required at the time of reproduction. Therefore, the compressed image recorded in the recording unit 107 is transmitted instead of the candidate image itself being reproduced. As a result, the image transmission time can be shortened to save energy.

  It should be noted that the flowchart of FIG. 12 is replaced with the flowchart of FIG. In FIG. 12, the control unit 101 sets the image file recorded last among the images recorded in the recording unit 107 as a reproduction candidate image (step S401). Next, the control unit 101 expands the image in the image file set as the candidate image, and displays the image on the display unit 105 (step S402). Thereafter, the control unit 101 determines whether or not communication with the FMD 200 can be permitted (step S403).

  If it is determined in step S403 that communication with the FMD 200 can be permitted, the control unit 101 transmits an image file corresponding to the image set as the candidate image via the communication unit 108 in order to reproduce the image on the FMD 200. To the FMD 200 (step S404). That is, after a candidate image is determined and displayed on the display unit 105, for example, when a user wearing the FMD 200 approaches the eyes (FMD 200) to look closely at the image, the image being displayed on the display unit 105 is displayed. An image file corresponding to is sent.

  If it is determined in step S403 that communication with the FMD 200 cannot be permitted, the control unit 101 determines whether to end the playback mode process, that is, whether the user has performed an end operation of the playback mode (step S403). S405). If it is determined in step S405 that the reproduction mode is terminated, the control unit 101 terminates the process in FIG. On the other hand, if it is determined in step S405 that the reproduction mode end operation has not been performed, the control unit 101 switches the reproduction image, that is, the reproduction image switching operation is performed by the operation of the operation unit 102 of the user. It is determined whether or not (step S406). If it is determined in step S406 that the playback image is not switched, the process returns to step S405. In this case, the control unit 101 determines again whether or not to end the playback mode process. On the other hand, when the playback image is switched in the determination in step S406, the control unit 101 sets the next image file with the next shooting date and time among the image files recorded in the recording unit 107 as the next candidate image. (Step S407). Thereafter, the process returns to step S401, and the control unit 101 reproduces the image file newly set as the candidate image.

  In the modified example as shown in FIG. 12, an image file can be transmitted to the FMD 200 even when an image is displayed on the display unit 105 of the camera 100.

  Further, the optical system 206 shown in FIG. 2 is an example of an optical system that provides a clear field of view when the shutter 303 is open when the user does not hold the camera 100. However, the configuration of the optical system 206 is not limited to that shown in FIG. For example, an auxiliary camera 210 as shown in FIG. The auxiliary camera 210 includes a photographing lens 210a, an imaging unit 210b, and an imaging processing unit 210c. The photographing lens 210a has a function similar to that of the photographing lens 103, and is a lens for causing a light beam from a subject outside the FMD 200 to enter the imaging unit 210b. The imaging unit 210b having a function as an auxiliary imaging unit has the same function as the imaging unit 104, acquires an image by converting an image of a subject based on a light beam from the photographing lens 210a into an electrical signal, and further The image is output as digital data to the imaging processing unit 210c. The imaging processing unit 210 c performs image processing on the image obtained through the imaging unit 210 b and outputs the processed image to the display driving unit 204.

  In the configuration as shown in FIG. 13, the same function as that of the optical system shown in FIG. 2 is realized only by appropriately switching the image to be displayed on the display unit 301. That is, it is only necessary to control the display unit 301 to display an image obtained via the auxiliary camera 210 except when an image is received from the camera 100 or when an image recorded in the recording unit 203 is reproduced. .

  Here, in the configuration shown in FIG. 13, it is not necessary to coat the free-form curved prism 302a with the half mirror 302b, and it is sufficient to simply coat the reflection mirror 302d. Further, the correction prism 302c is also unnecessary. Further, the shutter 303 is not necessary, and light may be shielded by the mask 304 instead of the shutter 303. That is, by using the configuration of FIG. 13, the configuration of the optical system 206 can be simplified compared to the configuration of FIG.

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  Further, the above-described embodiments include various stages of the invention, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some configuration requirements are deleted from all the configuration requirements shown in the embodiment, the above-described problem can be solved, and this configuration requirement is deleted when the above-described effects can be obtained. The configuration can also be extracted as an invention.

  DESCRIPTION OF SYMBOLS 100 ... Camera, 101 ... Control part, 102 ... Operation part, 103 ... Shooting lens, 104 ... Imaging part, 105 ... Display part, 106 ... Clock part, 107 ... Recording part, 108 ... Communication part, 109 ... State detection part, DESCRIPTION OF SYMBOLS 200 ... Face mount display (FMD), 201 ... Control part, 202 ... Communication part, 203 ... Recording part, 204 ... Display drive part, 205 ... Shutter drive part, 206 ... Optical system, 207 ... Operation part, 301 ... Display part , 301a ... LCD panel, 301b ... back light, 302 ... optical part, 302a ... free-form surface prism, 302b ... half mirror, 302c ... correction prism, 303 ... shutter

Claims (13)

In a camera system having a camera and a wearable image display device configured to be freely wearable on a user's eyes and operating in cooperation with the camera,
The above camera
An imaging unit that captures an image of a subject and acquires an image;
A transmission permission / inhibition determination section that determines whether transmission of an image acquired by the imaging section is possible;
When the transmission of the image is permitted, a camera side communication unit that transmits the image acquired by the imaging unit to the wearable image display device;
Comprising
The wearable image display device includes:
A display device side communication unit that receives an image transmitted from the camera side communication unit;
When the image is received by the display device side communication unit, the received image is guided to the eyes of the user, and when the image is not received by the display device side communication unit, the wearable image is displayed. An optical system for guiding an image based on light from the outside of the display device to the eyes of the user;
A camera system comprising:   2. The transmission permission / inhibition determination unit detects that the transmission of the image is permitted when the camera side communication unit is able to communicate with the display device side communication unit. Camera system.   2. The transmission permission determination unit according to claim 1, wherein the transmission permission determination unit detects that the transmission of the image is permitted when the wearable image display device is in a position facing the back surface of the camera. Camera system. The above camera
A recording unit for recording an image acquired by the imaging unit;
An integral display unit that is provided integrally with the camera and displays an image recorded in the recording unit;
Further comprising
The camera-side communication unit attaches the image being displayed on the integrated display unit when an image is displayed on the integrated display unit and transmission of the image is permitted by the transmission permission determination unit. The camera system according to claim 1, wherein the camera system transmits the image to a type image display device.   The integrated display unit terminates display of the integrated display unit after an image being displayed on the integrated display unit is transmitted to the wearable image display device by the camera side communication unit. The camera system according to claim 4. The optical system is
A display unit for displaying an image received in the display device side communication unit;
An optical unit for guiding light from the display unit toward the eyes of the user and guiding light from outside the wearable image display device toward the eyes of the user;
A light shielding member that shields light from outside the wearable image display device from entering the optical unit while an image is displayed on the display unit;
The camera system according to claim 1, further comprising: The optical system is
An auxiliary imaging unit that acquires an image based on light from the outside of the wearable image display device;
When the image is received by the display device side communication unit, the received image is displayed. When the image is not received by the display device side communication unit, the image acquired by the auxiliary imaging unit is displayed. A display unit to display;
An optical unit that guides light from the display unit toward the eyes of the user;
A light shielding member that shields light from the outside of the wearable image display device so as not to enter the optical unit;
The camera system according to claim 1, further comprising: In a camera that operates in conjunction with a wearable image display device configured to be freely wearable on the user's eyes,
An imaging unit that captures an image of a subject and acquires an image;
A transmission permission / inhibition determination section that determines whether transmission of an image acquired by the imaging section is possible;
When the transmission of the image is permitted, a camera side communication unit that transmits the image acquired by the imaging unit to the wearable image display device;
A camera comprising: A recording unit for recording an image acquired by the imaging unit;
An integral display unit that is provided integrally with the camera and displays an image acquired by the imaging unit or an image recorded in the recording unit;
Further comprising
The integrated display unit, after an image acquired by the imaging unit by the camera side communication unit is transmitted to the wearable image display device, terminates the display of the currently displayed image. Item 9. The camera according to Item 8. In a wearable image display device configured to be freely wearable on the user's eyes and operating in conjunction with a camera,
A display device side communication unit for receiving an image from the camera;
When the image is received by the display device side communication unit, the received image is guided to the eyes of the user, and when the image is not received by the display device side communication unit, the wearable image is displayed. An optical system for guiding an image based on light from the outside of the display device to the eyes of the user;
A wearable image display device comprising: The optical system is
A display unit for displaying an image received in the display device side communication unit;
An optical unit for guiding light from the display unit toward the eyes of the user and guiding light from outside the wearable image display device toward the eyes of the user;
A light shielding member that shields light from outside the wearable image display device from entering the optical unit while an image is displayed on the display unit;
The wearable image display device according to claim 10, further comprising: The optical system is
An auxiliary imaging unit that acquires an image based on light from the outside of the wearable image display device;
When the image is received by the display device side communication unit, the received image is displayed. When the image is not received by the display device side communication unit, the image acquired by the auxiliary imaging unit is displayed. A display unit to display;
An optical unit that guides light from the display unit toward the eyes of the user;
A light shielding member that shields light from the outside of the wearable image display device so as not to enter the optical unit;
The wearable image display device according to claim 10, further comprising:   11. The apparatus according to claim 10, further comprising: a control unit that sends an instruction to turn on the camera to the camera via the display device side communication unit when an image from the camera is not received. The wearable image display device described in 1.

Images