JP2015029219A - Electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately project information corresponding to a subject being photographed.SOLUTION: An electronic apparatus 1 comprises: a photographing unit 10; a projection unit 20 that projects an image on a subject being photographed by the photographing unit; and a control unit 70 that controls the projection unit to perform projection with a first area in the image moved to a second area different from the first area. Or, the electronic apparatus comprises: a photographing unit; a projection unit that is disposed on the opposite side of the photographing unit, and performs projection on a photographer; and a control unit that controls the projection unit to project an image to which a subject is allowed to pay attention.

Description

  The present invention relates to an electronic device.

  An electronic device equipped with a camera unit and a projector unit is known (see Patent Document 1).

JP 2006-80875 A

  In the prior art, it is difficult to project information on the subject of the camera unit (imaging unit).

An electronic apparatus according to a first aspect of the present invention includes a photographing unit, a projecting unit that projects an image onto a subject photographed by the photographing unit, and a first region of the image that is different from the first region. And a control unit that controls the projection unit so that the projection unit is moved and projected.
An electronic apparatus according to an eighth aspect of the present invention is configured to project an image capturing unit, a projecting unit that is disposed on the opposite side of the image capturing unit, and that projects an image focused on the subject. And a control unit for controlling the unit.

  In the electronic apparatus according to the present invention, information on the subject can be appropriately projected.

It is a figure which illustrates the external appearance of the projector mounting camera by 1st embodiment of this invention. FIG. 2 is a block diagram illustrating a configuration of a projector-mounted camera in FIG. 1. It is a figure explaining the scene which performs human body communication. It is a figure explaining the scene where a puzzle projection mode is used. FIG. 5A is a diagram in which the puzzle pieces are arranged in the original region, and FIG. 5B is a diagram in which the puzzle pieces are arranged in a region different from the original region. It is a flowchart explaining the flow of the process by the program which CPU performs in puzzle projection mode. FIG. 7A is a diagram including the front of the projector-equipped camera according to the second embodiment, and FIG. 7B is a diagram including the rear of the projector-equipped camera. It is a figure explaining the imaging | photography assistance scene by a projector unit. It is a flowchart explaining the flow of the process by the program which CPU performs in imaging | photography assistance projection mode.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a diagram illustrating the appearance of a projector-mounted camera 1 according to the first embodiment of the invention. In FIG. 1, a photographing optical system 11 and a projection optical system 21 are provided in front of the projector-mounted camera 1. An operation member 90 is provided on the upper surface of the projector-mounted camera 1.

  The projector-equipped camera 1 has a projection function for projecting information such as an image from the projection optical system 21 onto a screen or the like in addition to a photographing function for capturing a subject image through the photographing optical system 11. In the first embodiment, a case where the shooting direction and the projection direction are the same will be described. That is, the camera unit 10 described later captures a subject image including an image projected by the projector unit 20 described later.

  FIG. 2 is a block diagram illustrating the configuration of the projector-equipped camera 1 of FIG. The projector-equipped camera 1 includes a camera unit (imaging unit) 10, a projector unit (projection unit) 20, an LCD monitor 30, a communication control unit 40, a RAM 50, a flash memory 60, a CPU 70, a memory card interface ( I / F) 80 and an operation member 90. A removable memory card 100 is attached to the memory card I / F 80.

<Camera unit 10>
The camera unit 10 includes a photographing optical system 11, an image pickup device 12, an image pickup control unit 13, and an optical system driving unit 14. As the image sensor 12, a CMOS image sensor or the like is used. In response to an instruction from the CPU 70, the imaging control unit 13 drives and controls the imaging device 12 and the optical system driving unit 14, and performs predetermined image processing on the image signal read from the imaging device 12. Image processing includes gamma processing, interpolation processing, white balance adjustment processing, and the like.

  The imaging optical system 11 forms a subject image on the imaging surface of the imaging element 12. The imaging control unit 13 causes the imaging device 12 to start imaging in response to an imaging start instruction, and reads an image signal from the imaging device 12 after the imaging is completed. The imaging control unit 13 further performs image processing on the read image signal and sends the image data after the image processing to the CPU 70.

  The optical system driving unit 14 drives a focus lens (not shown) constituting the photographing optical system 11 forward and backward in the optical axis direction based on the focus adjustment signal output from the imaging control unit 13. Further, the optical system driving unit 14 advances and retracts a zoom lens (not shown) constituting the photographing optical system 11 in the optical axis direction (tele side or wide side) based on the zoom adjustment signal output from the imaging control unit 13. To drive.

<Focus adjustment>
The focus adjustment of the camera unit 10 is performed by moving a focus lens constituting the photographing optical system 11 in the optical axis direction. The imaging control unit 13 that performs autofocus adjustment includes an integrated value (a so-called value) of high frequency components included in an image signal corresponding to a predetermined focus detection area (for example, the center of the shooting screen) among the image signals captured by the image sensor 12. A focus adjustment signal is sent to the optical system drive unit 14 so as to maximize the focus evaluation value. The position of the focus lens that maximizes the focus evaluation value is a focus position that eliminates blurring of the edge of the subject image captured by the image sensor 12 and maximizes the contrast of the image.

<Zoom adjustment>
The zoom adjustment of the camera unit 10 is performed by moving the zoom lens constituting the photographing optical system 11 in the optical axis direction. The imaging control unit 13 that performs zoom adjustment sends a zoom adjustment signal to the optical system drive unit 14 in accordance with a zoom operation signal sent from a zoom switch (not shown) that constitutes the operation member 90 via the CPU 70.

<Projector unit 20>
The projector unit 20 includes a projection optical system 21, a liquid crystal panel 22, an LED light source 23, an optical system driving unit 24, and a projection control unit 25. The projection control unit 25 supplies a drive current to the LED light source 23 in response to a projection instruction from the CPU 70. The LED light source 23 illuminates the liquid crystal panel 22 with brightness according to the supplied current.

  The projection control unit 25 further generates a liquid crystal panel drive signal according to the image data sent from the CPU 70, and drives the liquid crystal panel 22 with the generated drive signal. Specifically, a voltage corresponding to the image signal is applied to the liquid crystal layer for each pixel. In the liquid crystal layer to which a voltage is applied, the arrangement of liquid crystal molecules changes, and the light transmittance of the liquid crystal layer changes. Thus, the liquid crystal panel 22 generates an optical image by modulating the light from the LED light source 23 in accordance with the image signal.

  As image data used for projection, image data read from the memory card 100, image data output from the camera unit 10, and image data received by the communication control unit 40 can be used.

  The projection optical system 21 projects the light image emitted from the liquid crystal panel 22 onto a screen or the like. The optical system driving unit 24 drives the projection optical system 21 to advance and retreat in a direction orthogonal to the optical axis based on the offset adjustment signal output from the projection control unit 25. Further, the optical system driving unit 24 drives a focus lens (not shown) constituting the projection optical system 21 to advance and retreat in the optical axis direction based on the focus adjustment signal output from the projection control unit 25. The optical system drive unit 24 further drives the zoom lens (not shown) constituting the projection optical system 21 to advance and retreat in the optical axis direction based on the zoom adjustment signal output from the projection control unit 25.

<Offset of projected image>
The offset adjustment of the projection image is performed by shifting the projection optical system 21 in a direction orthogonal to the optical axis. By shifting the projection optical system 21, the emission direction of the light beam emitted from the projector unit 20 changes, and the projection image is offset. The offset of the projection image may be performed by shifting the projection optical system 21 and shifting the liquid crystal panel 22 and the LED light source 23 in the direction perpendicular to the optical axis.

<Keystone correction of projected images>
When a part of the projection optical system 21, the liquid crystal panel 22, and the LED light source 23 is shifted in the direction perpendicular to the optical axis, keystone correction is performed on the data to be projected in accordance with the shift amount. Since the projection image changes to a trapezoidal shape only by giving the offset to the projection image, the projection control unit 25 performs keystone correction by image processing to correct the projection image from the trapezoidal shape to the rectangular shape. The memory in the projection control unit 25 stores an initial correction value for correcting the projected image into a square shape in advance. The projection control unit 25 reads an initial correction value corresponding to the offset adjustment amount, performs a keystone correction process on the image data to be projected based on the read initial correction value, and based on the image data after the keystone correction process, the liquid crystal panel 22. Drive.

<Focus adjustment of projected image>
The focus adjustment of the projector unit 20 is performed by shifting the focus lens constituting the projection optical system 21 in the optical axis direction. The projection control unit 25 that performs autofocus adjustment includes an integrated value (so-called focus evaluation) of high-frequency components included in the image signal corresponding to the focus detection area (for example, the center of the shooting screen) among the image signals captured by the camera unit 10. The focus adjustment signal is sent to the optical system drive unit 24 so as to maximize the value. The position of the focus lens that maximizes the focus evaluation value is a focus adjustment position that eliminates blurring of the edge of the projected image and maximizes the contrast of the projected image.

<Zoom adjustment of projected image>
Zoom adjustment of the projector unit 20 is performed by moving the zoom lens constituting the projection optical system 21 in the optical axis direction. The projection control unit 25 that performs zoom adjustment sends a zoom adjustment signal to the optical system driving unit 24 in accordance with a zoom operation signal sent from a zoom switch (not shown) constituting the operation member 90 via the CPU 70.

  The LCD monitor 30 is constituted by a liquid crystal display panel, and displays an image, an operation menu screen, and the like according to an instruction from the CPU 70. The communication control unit 40 controls communication with an external device in accordance with an instruction from the CPU 70. The communication control unit 40 includes a wireless communication circuit, and transmits and receives radio waves via the antenna 40a. In the present embodiment, wireless communication is performed with another projector-equipped camera having the same configuration as the projector-equipped camera 1, a mobile phone having a short-range wireless communication function, or the like. The wireless communication is short-range wireless communication by Bluetooth (registered trademark), for example.

  The communication control unit 40 further includes a known human body communication function that performs communication via the human body in response to an instruction from the CPU 70. Specifically, on the surface of the housing of the projector-mounted camera 1 illustrated in FIG. 1, the transmitting / receiving electrode 40b is disposed so as to be exposed. As illustrated in FIG. 3, the user A of the projector-mounted camera 1a and the user B of the other projector-mounted camera 1b touch the transmission / reception electrodes 40b of their own projector-mounted cameras 1a and 1b, respectively. When the projector-mounted cameras 1a and 1b are held with one hand and both users A and B touch each other with the other hand not holding the projector-mounted cameras 1a and 1b (for example, shaking hands), the human body and the capacity between the human bodies Communication between the projector-equipped cameras 1a and 1b is performed using both human bodies as antennas by a closed circuit formed by coupling.

  The RAM 50 is used as a work memory for the CPU 70. The flash memory 60 stores a program to be executed by the CPU 70. The CPU 70 controls the operation of the projector-equipped camera 1 by executing a program stored in the flash memory 60.

  The memory card I / F 80 has a connector (not shown), and the memory card 100 is connected to the connector. The memory card I / F 80 writes data to the connected memory card 100 and reads data from the memory card 100. The memory card 100 is configured by a nonvolatile memory such as a flash memory.

  The operation member 90 includes a release button, a projection button, a mode switch, a zoom switch for the camera unit 10, a zoom switch for the projector unit 20, and the like. The operation member 90 sends an operation signal corresponding to each operation such as a release operation, a projection operation, and a mode switching operation to the CPU 70.

<Puzzle projection mode>
Since the present embodiment has a feature in the operation when the projector-mounted camera 1 is switched to the puzzle projection mode, the following description will be focused on the control processing performed by the CPU 70 in the puzzle projection mode. In the normal projection mode, an image based on image data read out from the memory card 100 is projected as it is by the projector unit 20, whereas in the puzzle projection mode, the main part included in the original image is divided into a plurality of puzzle pieces, The difference is that a plurality of puzzle pieces are arranged in a different area (second area) from the original area (first area) and projected by the projector unit 20.

  FIG. 4 is a diagram illustrating a scene in which the puzzle projection mode is used. The projector-mounted camera 1 may be set on a tripod or held by the person A with one hand. In FIG. 4, an image of a puzzle piece is projected toward a person A from the projector unit 20 of the projector-equipped camera 1. In the example of FIG. 4, based on the image of the human internal organs read from the memory card 100, the main organs included in the image are used as puzzle pieces. For example, the CPU 70 divides a visceral image for each organ to form a puzzle piece, and generates a puzzle image in which the formed puzzle piece is rearranged from the original region (first region) to a different region (second region). Then, this puzzle image is projected from the projector unit 20 toward the person A. FIG. 5 is a diagram illustrating a puzzle image. FIG. 5 (a) is a diagram in which the puzzle pieces are arranged in the original region, and FIG. 5 (b) is a diagram of the puzzle pieces in FIG. 5 (a) shown in FIG. It is the figure rearranged from the original area to a different area. Here, when the puzzle piece is rearranged from the original area to a different area, at least one puzzle piece may be arranged in a different area. Further, the size of the puzzle piece may be changed when arranging in different areas. The relationship between the original region (first region) and the different region (second region) may be an overlapping region. That is, the first and second areas are not completely overlapped, and if there is a part that does not overlap at all, the second area is a different area from the original area (first area). And

  The camera unit 10 repeats imaging at a predetermined frame rate (for example, 60 fps) so that the screen includes the person A on which the puzzle image is projected. The person B solves the puzzle by performing a gesture operation on the puzzle image projected on the person A so as to move the puzzle piece to the original correct area. In addition, you may comprise the imaging | photography optical system 11 of the camera unit 10 with a fisheye lens so that the face of the person B who is solving the puzzle may be included on the screen.

―Generation of projection image―
The CPU 70 of the projector-equipped camera 1 detects the size of the person A based on the image data acquired by the camera unit 10 and adjusts the size of the puzzle image so that the projected puzzle image is superimposed on the person A. A projection image is generated. The size detection of the person A can be performed based on the size of the person A in the screen acquired by the camera unit 10 and the focal length information of the photographing optical system 11, for example. The CPU 70 determines the size of the puzzle piece according to the size of the person A so that the puzzle piece reflected in the person A does not protrude from the person A.

  In addition, the CPU 70 estimates the position and orientation of the person A based on the image data acquired by the camera unit 10, performs a process on the puzzle image so that the puzzle image to be projected is superimposed on the person A, and outputs the projected image. Is generated. Here, since the person A is not always stationary, image processing is performed on the puzzle image so that the projection position of the puzzle image is moved according to the position of the person A. Furthermore, when the puzzle image projected on the person A is deformed into a trapezoid, a trapezoid correction process is performed.

  Furthermore, since the costume that the person A is actually wearing is not necessarily white, the CPU 70 determines the color and pattern of the clothes that the person A originally wears based on the color information of the image data transmitted from the camera unit 10. In order to make the detected color and pattern inconspicuous while the projected puzzle image stands out, the puzzle image is subjected to image processing for changing the color and brightness to generate a projected image. By projecting the projection image generated as described above onto the person A, the puzzle piece superimposed on the person A is observed.

  An image processing method for a projection image in the above-described projection mapping is described in, for example, Non-Patent Documents: Takuma Nakamura, Akio Watanabe, Naoki Hashimoto, “Dynamic Projection Mapping”, ACM SIGGRAPH, Proc. Of ACM SIGGRAPH2012, 2012/08 The techniques described can be used.

-Gesture operation-
In FIG. 4, when the person B puts his hand on the puzzle piece P reflected in the person A, the CPU 70 determines that the puzzle piece P is selected based on the image data transmitted from the camera unit 10. The CPU 70 notifies that the puzzle piece P has been selected by making the projection color of the puzzle piece P different from the projection color of the other puzzle pieces in the puzzle image. Instead of making the projection color of the puzzle piece P different, the projection brightness of the puzzle piece P may be made different from the projection brightness of other puzzle pieces, or the puzzle piece P may be blinked.

  When the position of the hand that overlaps the puzzle piece P reflected in the person A moves, the CPU 70 performs image processing on the puzzle image so as to change the projection position of the puzzle piece P in accordance with the movement of the hand position. Specifically, the CPU 70 detects the position of the hand based on the image data transmitted from the camera unit 10 and changes the puzzle image so as to project the puzzle piece P to the position corresponding to the detected hand. As a result, the puzzle piece P projected onto the person A is observed as if being dragged by the person B.

  When the person B moves his / her hand in the direction of the projector-equipped camera 1, the proportion of the hand in the screen shot by the camera unit 10 increases. The CPU 70 determines that the selection of the puzzle piece P has been canceled when the proportion of the hand occupying the screen acquired by the camera unit 10 increases, and the puzzle image P is restored to the original projection color so that the projection color of the puzzle piece P is returned to the original projection color. Image processing. As described above, the person B performs the task of solving the puzzle by shifting the projection position of each puzzle piece using the hand.

<Description of flowchart>
FIG. 6 is a flowchart for explaining the flow of processing by a program executed by the CPU 70 of the projector-equipped camera 1a in the puzzle projection mode. When an operation signal for instructing the CPU 70 to switch to the puzzle projection mode is input from the mode switch constituting the operation member 90, the CPU 70 activates the process illustrated in FIG.

  In step S101 of FIG. 6, the CPU 70 selects a puzzle projection mode in accordance with the operation signal, and proceeds to step S102. In step S102, the CPU 70 instructs the start of the puzzle projection operation and proceeds to step S103. In step S103, the CPU 70 determines whether the captured image projection mode or the registered image projection mode. The captured image projection mode is a mode for generating a puzzle image based on an image captured by the camera unit 10. The registered image projection mode is a mode in which a puzzle image is generated based on a registered image recorded in advance on the memory card 100.

  The CPU 70 proceeds to step S104 when the operation signal from the operation member 90 indicates the captured image projection mode, and proceeds to step S106 when the operation signal from the operation member 90 indicates the registered image projection mode.

  In step S <b> 104, the CPU 70 proceeds to step S <b> 105 upon receiving a shooting instruction (pressing operation of a release button constituting the operation member 90) in the shooting image projection mode operation. In step S105, the CPU 70 sends an instruction to the imaging control unit 13 of the camera unit 10 to capture an image that is the original form of the puzzle image to be projected, and then proceeds to step S108.

  On the other hand, in step S106, the CPU 70 receives a read instruction in the registered image projection mode (operation of a read switch constituting the operation member 90), and proceeds to step S107. In step S107, the CPU 70 sends an instruction to the memory card I / F 80, reads an image (an image registered in the memory card 100), which is the original form of the puzzle image to be projected, from the memory card 100, and proceeds to step S108.

  In step S <b> 108, the CPU 70 sends an instruction to the projection control unit 25 and starts projection from the projector unit 20. The CPU 70 causes the projector unit 20 to project a puzzle image generated based on the image acquired by the camera unit 10 in step S105 or the image read from the memory card 100 by the memory card I / F 80 in step S107. Note that the CPU 70 may perform control such that the projection of the image is terminated when the puzzle image to be projected is projected for a predetermined time (for example, 10 minutes).

  In step S109, the CPU 70 creates a puzzle for the projected image. Specifically, the CPU 70 divides the main subject included in the projected image into a plurality of puzzle pieces. The CPU 70 further generates a puzzle image in which the puzzle pieces are rearranged from the original region (region corresponding to the original image of the puzzle image) to a different region, and projects the puzzle image from the projector unit 20 to step S110. move on. A puzzle image in which the size of each puzzle piece is changed to a size different from the original size may be generated.

  In step S110, the CPU 70 selects a puzzle piece. In response to the gesture operation described above, the CPU 70 selects the puzzle piece P that is observed while overlapping the hand of the person B based on the image data transmitted from the camera unit 10, and proceeds to step S111. The CPU 70 makes the projection color of the selected puzzle piece P different from the projection color of other puzzle pieces.

  In step S111, the CPU 70 moves the selected puzzle piece P. The CPU 70 moves the puzzle piece P to a position corresponding to the hand of the person B detected based on the image data transmitted from the camera unit 10, and proceeds to step S112.

  In step S112, the CPU 70 changes the size of the selected puzzle piece P. The CPU 70 changes the projection size of the puzzle piece P in accordance with the pinch-in operation or the pinch-out operation by the hand of the person B detected based on the image data transmitted from the camera unit 10, and proceeds to step S113. Note that if the size of the puzzle piece has not been changed to a size different from the original size, step S112 may be skipped.

  In step S113, the CPU 70 performs a clear determination. When the current puzzle piece area (position and size) matches the original correct puzzle piece area (position and size) based on the image data transmitted from the camera unit 10, the CPU 70 performs step 113. An affirmative determination is made and the process proceeds to step S114. If the current puzzle piece area (position and size) does not match the original puzzle piece area (position and size), the CPU 70 makes a negative determination in step 113 and returns to step S110. When returning to step S110, the above-described processing is repeated. In addition, when it corresponds with the area | region (position and size) of the original correct puzzle piece, you may make it the projection which emphasizes the projection of the puzzle piece P. FIG. For example, you may perform emphasis which projects the outline part of a puzzle piece deeply. Note that the CPU 70 may perform a clear (positive) determination as a clear determination even if the current puzzle piece area (position and size) does not completely match the original puzzle piece area (position and size). Good. The range of matching may be changed as appropriate, and if the size error is within ± 5% compared to the original size of the puzzle piece, it may be determined that the size matches. . Further, if the positional deviation between the center position of the current puzzle piece and the center position of the current puzzle piece is within 5% of the size of the puzzle piece, it may be determined that the position of the puzzle piece matches. Further, if the center position of the current puzzle piece matches the center position of the original correct puzzle piece, an affirmative (clear) determination may be made. That is, even if the sizes do not necessarily match exactly (even if they are not included within the above 5%), it may be determined that they match if the center positions of the puzzle pieces are all aligned. This is because, as in the example shown in FIG. 4, when projecting a person's built-in, the position of the built-in becomes important, and thus the size may not necessarily be determined accurately. Contrary to the above, if the current size of the puzzle piece matches the size of the original correct puzzle piece, an affirmative (clear) determination may be made.

  The process proceeds to step S114 when the person B solves the puzzle. In this case, predetermined data is sent from the person A's projector-equipped camera 1a to the person B's projector-equipped camera 1b. The data is, for example, an original image before being divided into puzzle pieces, a portrait image of the person A, or image data taken by the person A on the projector-mounted camera 1a.

  In step S114, the CPU 70 determines whether or not human body communication is possible. If the human body communication is possible between the projector-mounted camera 1a of the person A and the camera-mounted camera 1b of the person B as illustrated in FIG. 3, the CPU 70 makes a positive determination in step S114 and proceeds to step S115. When the human body communication is not possible between the projector-mounted camera 1a and the projector-mounted camera 1b, the CPU 70 makes a negative determination in step S114 and proceeds to step S116. If human body communication is not possible before a predetermined time (for example, 10 seconds) elapses after the clear determination, the CPU 70 makes a negative determination in step S114.

  In step S115, the CPU 70 sends an instruction to the communication control unit 40, and the original image before being divided into puzzle pieces from the projector-mounted camera 1a of the person A to the projector-mounted camera 1b of the person B via human body communication, Of the portrait image of the person A and the data of the image taken by the person A on the projector-mounted camera 1a, the information permitted to be transmitted in advance is transmitted. If CPU70 is made to transmit the above information, it will progress to step S118.

  In step S116, the CPU 70 sends an instruction to the communication control unit 40, and the original image before being divided into puzzle pieces from the person A projector-mounted camera 1a to the person B projector-mounted camera 1b via wireless communication, Of the portrait image of the person A and the data of the image taken by the person A on the projector-mounted camera 1a, the information permitted to be transmitted in advance is transmitted. If CPU70 is made to transmit the above information, it will progress to step S118.

  In step S118, the CPU 70 determines whether or not an end operation has been performed. When an operation signal instructing switching from a mode switching switch constituting the operation member 90 to a mode different from the puzzle projection mode is input, the CPU 70 makes an affirmative determination in step S118 and ends the processing in FIG. When the operation signal instructing switching to a mode different from the puzzle projection mode is not input, the CPU 70 makes a negative determination in step S118, returns to step S103, and repeats the above-described processing.

According to the first embodiment described above, the following operational effects can be obtained.
(1) The projector-mounted camera 1 includes a camera unit 10, a projector unit 20 that projects an image onto a subject (person A) photographed by the camera unit 10, and a subject (person A) photographed by the camera unit 10. Since the CPU 70 that controls the projector unit 20 to project an image according to the above is provided, an image can be appropriately projected onto the person A.

(2) Since the CPU 70 has controlled the projector unit 20 to project an image according to the size of the subject (person A), the CPU 70 can appropriately project the image so that it does not deviate from the person A.

(3) Since the CPU 70 has controlled the projector unit 20 so as to project the image in a manner different from the original image, it is suitable for projecting a puzzle image divided into a plurality of pieces, for example.
(4) The CPU 70 has controlled the projector unit 20 to project (rearrange) the image in the first area of the image by moving (rearranging) the image to the second area different from the first area. This is suitable for projecting a puzzle image in which the arrangement of pieces is changed.

(5) A CPU 70 that accepts a change operation of the projection image mode to be projected from the projector unit 20 is provided, and the CPU 70 controls the projector unit 20 to change the projection image mode according to the received change operation. Projection suitable for solving a puzzle image can be performed.

(6) Since the CPU 70 determines whether or not the aspect of the projected image matches the original image, it can appropriately determine whether the puzzle has been solved, for example.

(7) Since the CPU 70 transmits predetermined information to the external device when the match is determined, for example, the information can be sent on the condition that the puzzle is correct.
(8) The person A projector mounted camera 1a includes a communication control unit 40 for communicating with an external device (person B projector mounted camera 1b), and the communication control unit 40 includes the external device (person B projector mounted camera). Since information related to the projector-mounted camera 1a is transmitted to 1b), for example, a portrait image of the person A, an image taken by the person A, and the like can be transmitted to the projector-mounted camera 1b of the person B.

(Modification 1)
In the above step S116, when transmitting information related to the projector mounted camera 1a from the projector mounted camera 1a to the person B projector mounted camera 1b via wireless communication, in addition to the transmission of the person B to the projector mounted camera 1b, Alternatively, instead of transmitting the person B to the projector-mounted camera 1b, information regarding the projector-mounted camera 1a may be transmitted to the person B's mobile phone.

  Further, when transmitting from the person A's projector-equipped camera 1a to the person's B mobile phone, information relating to the projector-equipped camera 1a includes an original image before being divided into puzzle pieces, a portrait image of the person A, and a person A. In addition to image data taken by the projector-equipped camera 1a, the mobile phone number, mail address, etc. of the person A may be included.

(Modification 2)
In the description of the above embodiment, the projector-equipped camera 1 (1a, 1b) has been described as an example of the electronic device. However, a mobile phone equipped with a projector unit and a camera unit may be used as the electronic device. In the case of the second modification, information related to the mobile phone equipped with the projector of the person A is transmitted from the mobile phone equipped with the projector of the person A to the mobile phone of the person B via the short-range wireless communication using Bluetooth (registered trademark). Information sent from the mobile phone equipped with the projector of the person A to the mobile phone of the person B includes the original image before being divided into puzzle pieces, the portrait image of the person A, and the data of the image taken by the person A on the mobile phone equipped with the projector In addition, the telephone number and mail address of the projector-equipped mobile phone can be included. Moreover, you may send what is called a friend application and an invitation for using SNS (Social Networking Service).

(Modification 3)
In the above description, a puzzle image is generated by dividing the main part of the image that is the original shape of the puzzle image to be projected to form a puzzle piece, and rearranging the formed puzzle piece from the original area to a different area. In the puzzle image, the orientation of the individual puzzle pieces may be displayed in a direction different from the original direction (for example, rotated 90 degrees to the right or flipped up and down).

(Modification 4)
As described above, the technique of projecting an internal image on a person's clothes and projecting it may be used in an educational setting such as a school. According to FIG. 4, it is possible to easily project which organ corresponds to which position (or region) of the human body. In this case, a skeleton sample image may be projected on a person's clothes instead of the internal organ image. It is possible to easily project which skeleton corresponds to which position (or region) of the human body.

(Second embodiment)
In the second embodiment, a case where the shooting direction by the camera unit 10 and the projection direction by the projector unit 20 are different will be described. FIG. 7 is a diagram illustrating the appearance of a projector-mounted camera 1X according to the second embodiment of the invention. FIG. 7A is a diagram including the front of the projector-equipped camera 1X, and FIG. 7B is a diagram including the back of the projector-equipped camera 1X. In FIG. 7A, a photographing optical system 11 and a light source 110 are provided in front of the projector-mounted camera 1X. In FIG. 7B, an LCD monitor 30, a projection optical system 21, and an operation member 90 are provided on the back of the projector-mounted camera 1X. A part of the operation member 90 is also provided on the upper surface of the projector-mounted camera 1X.

  The projector-mounted camera 1X is configured to be able to assist shooting by the camera unit 10 by projection from the projector unit 20. FIG. 8 is a diagram for explaining a shooting assist scene by the projector unit 20. In FIG. 8, a person A is about to photograph an infant C with the projector-mounted camera 1X.

  The infant C does not understand that he / she is photographed, and therefore does not face the projector-mounted camera 1 </ b> X. Therefore, the projection image Q is projected from the projector unit 20 onto the person A, and the attention of the infant C is attracted by the projection image Q. At this timing, the person A performs a release operation to photograph the infant C.

<Description of flowchart>
FIG. 9 is a flowchart for explaining the flow of processing by a program executed by the CPU 70 of the projector-mounted camera 1X in the photographing assist projection mode. When an operation signal for instructing the CPU 70 to switch to the photographing assist projection mode is input from the mode switching switch constituting the operation member 90, the CPU 70 activates the process of FIG.

  In step S201 in FIG. 9, the CPU 70 selects the photographing assist projection mode according to the operation signal, and proceeds to step S202. In step S202, the CPU 70 instructs the start of the photographing assist projection operation and proceeds to step S203. In step S <b> 203, the CPU 70 sends an instruction to the projection control unit 25 of the projector unit 20 and starts projection from the projector unit 20. As an image to be projected, for example, image data such as an animation character that the infant C is interested in is recorded in the memory card 100 in advance. The CPU 70 projects the projection image Q generated based on the image data read from the memory card 100 by the memory card I / F 80 from the projector unit 20 toward the person A.

  In step S204, the CPU 70 sends an instruction to the projection control unit 25 to adjust the focus of the projection image, and proceeds to step S205. In step S205, the CPU 70 causes the light source 110 to emit light and proceeds to step S206. The light source 110 emits light to attract the attention of the infant C toward the projector-mounted camera 1X. The light source 110 may be an AF auxiliary light source or an imaging auxiliary light source. In the case of using a photographing auxiliary light source, it is preferable to emit light with low luminance like monitor light emission. When the infant C notices the light emitted from the light source 110 and looks up at the direction of the projector-mounted camera 1X, the infant C notices the projected image Q projected on the clothes of the person A. Thereafter, even if the light emission of the light source 110 stops, the infant C is attracted to the projection image Q by the projector unit 20 and pays attention to the direction of the person A (that is, the projector-mounted camera 1X).

  In step S <b> 206, the CPU 70 performs known gaze detection based on the image data acquired by the camera unit 10. For example, the feature amount of the “eye” of the infant C is obtained based on the image of the “face” region of the infant C among the images acquired by the camera unit 10. The feature amount of “eye” is expressed by the distance between the pupil center and the cornea reflection image, for example. The cornea reflection image is an image observed when the light from the light source 110 is reflected by the eyeball of the infant C.

  If the CPU 70 determines that the line of sight of the infant C calculated based on the “eye” feature amount is facing the projector-mounted camera 1X, the CPU 70 proceeds to step S207. In step S207, the CPU 70 notifies that the infant C is facing the projector-mounted camera 1X, and proceeds to step S208. The notification is performed, for example, by sounding an electronic sound or turning on an LED as an indicator.

  In step S208, the CPU 70 determines whether or not the automatic shooting mode is set. The automatic shooting mode is a mode in which shooting processing is automatically started when it is detected that the line of sight of the infant C is directed toward the projector-mounted camera 1X, and the automatic shooting mode is turned on or off in advance by operating the mode switch. Is set. If the automatic shooting mode is set to on, the CPU 70 makes a positive determination in step S208 and proceeds to step S209. If the automatic shooting mode is set to off, the CPU 70 makes a negative determination in step S208 and proceeds to step S210. Proceed to

  In step S209, the CPU 70 sends an instruction to the imaging control unit 13 of the camera unit 10 to execute a predetermined imaging process, and proceeds to step S211. In step S <b> 210, the CPU 70 causes the camera unit 10 to execute a predetermined shooting process in response to the pressing operation of the release button constituting the operation member 90, and proceeds to step S <b> 211.

  In step S211, the CPU 70 determines whether an end operation has been performed. When an operation signal instructing switching to a mode different from the photographing assist projection mode is input from the mode switching switch constituting the operation member 90, the CPU 70 makes an affirmative determination in step S211 and ends the processing in FIG. When the operation signal instructing switching to a mode different from the photographing assist projection mode is not input, the CPU 70 makes a negative determination in step S211 and returns to step S203 to repeat the above-described processing.

According to the second embodiment described above, the following operational effects can be obtained.
(1) The projector-mounted camera 1X is arranged on the side opposite to the camera unit 10 and the camera unit 10, and pays attention to the projector unit 20 that projects the photographer (person A) and the subject (infant C). Since the CPU 70 that controls the projector unit 20 to project the image to be projected is provided, the image for the infant C can be appropriately projected.

(2) Since an image to which attention is paid to the subject (infant C) is projected, it is possible to perform projection suitable for shooting assistance, for example.

(3) Since the CPU 70 controls the projector unit 20 so as to project a plurality of images in order, it is possible to increase the possibility of attracting attention from the infant C as compared with the case of projecting one image.

(4) Since the CPU 70 controls the projector unit 20 to preferentially project the image focused on the previous time, the CPU 70 can project an image that is likely to be focused by the infant C first.

(Modification 5)
In the second embodiment, image data such as an animation character that the infant C is interested in is recorded in the memory card 100 in advance, and a projection image Q generated based on this image data is transferred from the projector unit 20 to the person A. Is projected toward the screen (S203). Instead of this, in addition to the animation character, a plurality of image data such as an aircraft, a train, and a car are recorded in advance in the memory card 100, and the projection image generated based on these image data is sequentially switched to switch the person A. You may make it project toward.

  If the CPU 70 does not detect that the line of sight of the infant C is facing the direction of the projector-equipped camera 1X even after a predetermined time (for example, 3 seconds) has elapsed after projecting one projection image, the CPU 70 switches to the next projection image. . When the CPU 70 detects that the line of sight of the infant C is directed toward the projector-mounted camera 1X, the CPU 70 proceeds to the processing after step S207.

  The CPU 70 in the fifth modification records and learns information indicating the image projected from the projector unit 20 in the flash memory 60 when it is detected that the line of sight of the infant C is directed toward the projector-mounted camera 1X. In the next shooting assist projection mode, the image indicated by the recording information in the flash memory 60 is projected with priority.

  According to the modified example 5 described above, it is possible to appropriately assist the photographing so that the line of sight of the infant C is directed toward the projector-mounted camera 1X.

(Modification 6)
In the above description, the shooting assist scene in the case where the person A projects the projected image Q from the projector mounted camera 1X on his / her body and captures the infant C facing the projector mounted camera 1X is illustrated. Alternatively, the person A and the infant C can be photographed by the projector-mounted camera 1X. In the sixth modification, the person A and the infant C are located on the front side of the projector-equipped camera 1X, and the wall or screen is located on the rear side of the projector-equipped camera 1X. For example, a person A holds an infant C near a wall or a screen, and a so-called self-portrait is performed with the front of the projector-equipped camera 1X facing the person A and the infant C.

  The infant C does not understand that he / she is photographed, and therefore does not face the projector-mounted camera 1 </ b> X. Therefore, the projected image Q is projected from the projector unit 20 onto the wall or screen on the back side of the projector-mounted camera 1X, and the attention of the infant C is attracted by the projected image Q. The face of the infant C watching the projected image Q on the wall or screen inevitably faces the front of the projector-equipped camera 1X. The person A performs the release operation at this timing, and the person A and the infant C are photographed.

  Also in the modified example 6 described above, it is possible to appropriately perform shooting assistance so that the line of sight of the infant C is directed toward the projector-mounted camera 1X.

  The above description is merely an example, and is not limited to the configuration of the above embodiment.

DESCRIPTION OF SYMBOLS 1,1X ... Camera 10 with a projector ... Camera unit 20 ... Projector unit 30 ... LCD monitor 40 ... Communication control part 70 ... CPU
90 ... Operation member

Claims (10)

A shooting section;
A projection unit for projecting an image onto a subject photographed by the photographing unit;
A control unit that controls the projection unit to project the first region of the image by moving the first region to a second region different from the first region;
An electronic device comprising: The electronic device according to claim 1,
An operation receiving unit that receives a change operation of a mode of a projected image projected from the projection unit;
The said control part controls the said projection part so that the aspect of the said projection image may be changed according to the change operation received in the said operation reception part, The electronic device characterized by the above-mentioned. The electronic device according to claim 2,
The electronic device according to claim 1, wherein the control unit determines whether or not a form of the projected image matches the original image. The electronic device according to claim 3,
The electronic device according to claim 1, wherein the control unit transmits predetermined information to an external device when the match is determined. The electronic device according to claim 4,
A transmission unit for communicating with the external device;
The transmission unit transmits information related to the electronic device to the external device. The electronic device according to any one of claims 1 to 5,
The electronic device according to claim 1, wherein the control unit controls the projection unit to project the image corresponding to a subject photographed by the photographing unit. The electronic device according to claim 6,
The electronic device according to claim 1, wherein the control unit controls the projection unit to project the image according to a size of the subject. A shooting section;
A projection unit that is disposed on the opposite side of the imaging unit and that projects to the photographer;
A control unit that controls the projection unit to project an image of interest to the subject;
An electronic device comprising: The electronic device according to claim 8,
The said control part controls the said projection part to project a some image in order, The electronic device characterized by the above-mentioned. The electronic device according to claim 9,
The electronic device according to claim 1, wherein the control unit controls the projection unit to preferentially project an image focused on the previous time.

Images