JP2010072025A - Electronic device with projector - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic device with a projector, wherein a projection surface suited to projection is looked for without projecting an image. <P>SOLUTION: The electronic device includes a projection part 42 for projecting an image, an imaging part for imaging an object including the projection surface of the image, a display part 16 for displaying the imaged image picked up by the imaging part, an image element extraction part 46 for extracting at least one of image elements suited to projection by the projection part from the image data of the imaged image, and a display control unit 30 for superimposing and displaying the image element as a projection candidate area on the imaged image displayed on the display part. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an electronic apparatus with a projector.

A camera including a projector is known (for example, see Patent Document 1). In this camera, by using the projector function, a large number of people can enjoy a photographed image at the same time, and by storing the projector unit and the photographing unit in a small space, the camera is small and excellent in portability. it can.
JP 2005-250392 A

  However, in this camera with a projector, it is necessary for the user to search for a projection plane suitable for projection in a state where an image is projected from the projector, and there is a risk that light emitted from a light source such as an LED will be accidentally directed to human eyes. there were.

  The objective of this invention is providing the electronic device with a projector which can look for the projection surface suitable for projection, without projecting an image.

  An electronic device with a projector according to the present invention includes a projection unit that projects an image, an imaging unit that captures a subject including a projection surface on which the image is projected, and a display unit that displays a captured image captured by the imaging unit. An image element extraction unit that extracts at least one image element suitable for projection by the projection unit from the image data of the captured image, and the image element is superimposed on the captured image displayed on the display unit as a projection candidate area And a display control unit for displaying.

  According to the electronic apparatus with a projector of the present invention, it is possible to search for a projection plane suitable for projection without projecting a projection image.

  Hereinafter, a camera with a projector according to a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view showing a front surface of a camera with a projector according to an embodiment. The camera 2 is a digital camera equipped with a projector, and a shooting window 4 for projecting subject light, a projector projection window 6 for projecting an image, a flash window 8 for emitting light to illuminate the subject, and an image at the time of imaging. Is equipped with an auxiliary lamp 10 used for distance measurement for autofocusing and distance measurement with the projection surface at the time of projection, and a release instruction is given on the upper surface by full pressing, and a focus instruction or projection at the time of shooting by half pressing. A release button 12 for instructing extraction of the projection candidate area at the time and a focus lever 14 for focusing the image projected by the projector are provided.

  FIG. 2 is a diagram illustrating the back of the camera with a projector according to the embodiment. On the back of the camera 2, an LCD display unit 16 that displays a captured image, a switching button 18 that switches between a shooting mode for capturing an image of a subject and a projection area guide mode for projecting an image by guiding a projection area on the projection plane, A multi selector 20 for selecting an image to be projected and a projection candidate area, a playback button 22 for instructing the start of projection, and a stop button 24 for instructing the end of projection are provided.

  FIG. 3 is a block diagram showing a system configuration of the camera with a projector according to the embodiment. The camera 2 includes a CPU 26. The CPU 26 displays an LCD display such as an image element suitable for projection superimposed on the captured image displayed on the auxiliary lamp 10, the operation unit 28, and the LCD display unit 16 as a projection candidate area. A display control unit 30 that performs display control of the unit 16; an imaging device 32 configured by a CCD or a CMOS that captures an image of a subject through an imaging lens and generates an imaging signal (analog signal as accumulated charge); An image storage unit 34 that stores image data generated by A / D conversion of an imaging signal output from the A / D converter (not shown), and image data based on the imaging signal output from the imaging device 32, The image processing unit 36 that performs image processing such as white balance adjustment, contour compensation, and gamma correction, and the light emitted from the auxiliary lamp 10 are counteracted by the subject. A distance measuring unit 38 for measuring the distance from the subject to the camera 2 based on the light such as infrared light, a projection unit 42 for projecting an image or various data recorded in the image recording unit 34 or the memory card 44, A memory card 44 that stores an image to be projected and various data, and an image element extraction unit 46 that extracts an image element suitable for projection based on an imaging signal output from the imaging device 32, and the like are connected.

  Here, the operation unit 28 includes a release button 12, a focus lever 14, a switching button 18, a multi selector 20, a playback button 22, a stop button 24, and the like, and the projection unit 42 turns on and off the LED 50 that is a light source. The power supply control unit 52 includes a projection control unit 56 that performs display control of an LCOS (reflection type liquid crystal element) 54 that displays an image to be projected.

  Next, projection candidate area display processing of the camera with a projector according to the first embodiment will be described with reference to the flowchart shown in FIG. When the projection area guide mode is selected by the operation of the switch button 18 and the release button 12 is half-pressed, the projection candidate area display process is started, so that an imaging operation such as a wall for projecting an image is performed (step S1). Next, the captured image data is generated from the captured image signal output from the image sensor 32 and temporarily stored in the image storage unit 34, and the captured image is displayed on the LCD display unit 16 as shown in FIG. 5 (step S2). ).

  Here, the captured image 50 shown in FIG. 5 includes an image of a signboard posted on the upper right of a white wall, and an image of two black lines drawn near the floor, with the back of the whiteboard in the center. Images are included. Here, the back surface of the whiteboard has a low contrast but is not white, and has a certain area.

  Next, the image element extraction unit 46 extracts, as an image element, a region in which the contrast change is equal to or less than a predetermined value using the contrast measured by the image processing unit 36 based on the imaging signal output from the imaging element 32 (step). S3). Here, for example, when the area has a length of 1/10 or more of the screen in both the vertical and horizontal directions, and the maximum luminance value in the area is Lmax and the minimum luminance value is Lmin, (Lmax−Lmin) ) / Lmin ≦ a is defined as a region with little contrast change, and is extracted as an image element. Here, the predetermined value a is a threshold value for determining an area where the contrast change is small. For example, the threshold value a can be appropriately changed according to the projection environment such as ambient brightness, such as 1, 0.1, 0.01, and the like. . In the case of the captured image 50 shown in FIG. 5, areas 52, 54, 56, and 58 are extracted as image elements whose contrast change is equal to or less than a predetermined value, as shown in FIG.

  When the image element cannot be extracted in the process of step S3 (step S4), the display control unit 30 notifies the LCD display unit 16 that the image element does not exist (step S15). ). On the other hand, when the image element is extracted, the distance to the projection plane is measured based on light such as infrared light emitted from the auxiliary lamp 10 and reflected by the subject by the distance measuring unit 38 (step S5). The image element extraction unit 46 calculates the area of the projection area (projection area) and the length and width of the projection area on the projection plane of the image projected using the distance from the projection plane to the camera 2 (step S6). Image elements that are larger than the projected area compared with the area of the image element extracted in step S3 are extracted, and image elements having an area smaller than the projected area are excluded (step S7). In step S7, the vertical and horizontal lengths of the image elements are compared with the vertical and horizontal lengths of the projection area, and image elements whose vertical length and horizontal length are both greater than or equal to the projection area are extracted. Image elements having at least one of the horizontal lengths smaller than the projection area are excluded. Here, for example, the vertical length Av of the screen element, which is an image element on the projection plane, is Ah, the vertical length of the projection area is Pv, and the horizontal length is Ph. In this case, image elements that satisfy Av ≧ Pv and Ah ≧ Ph are extracted. In the case of the captured image 50 shown in FIG. 6, the area of the projection area and the vertical and horizontal lengths, which are the projection sizes, are calculated as in the projection area 60 shown in FIG. In the present embodiment, the projection area 60 is not displayed on the LCD display unit 16, but is shown in the area 54 in FIG. Then, out of the areas 52, 54, 56, and 58, the areas 52, 54, and 56 having an area equal to or larger than the projection size of the projection area 60 and the vertical and horizontal lengths are extracted, and the area 58 is excluded.

  The projected area may be calculated assuming that the size of the projected image has an aspect ratio of 3: 4. That is, since Ph = 4Pv / 3, image elements satisfying Av ≧ Pv and Ah ≧ 4Pv / 3, or image elements satisfying Av ≧ 3Ph / 4 and Ah ≧ Ph are extracted. In addition, when an image to be projected is selected from the images stored in the memory card 44 by the multi selector 20 before imaging in step S1, the projection area may be calculated based on the selected image. That is, the projection area is calculated based on the selected image, and image elements satisfying the above Av ≧ Pv and Ah ≧ Pv are extracted. Then, it is confirmed whether or not the image element has been extracted (step S8). When the extracted image element does not exist, the display control unit 30 notifies that there is no image element on the LCD display unit 16 (step S15).

  When image elements are extracted, the image element extraction unit 46 extracts image elements at a height suitable for projection, and therefore exists in the vicinity of the upper end and the lower end of the shooting angle of view among the extracted image elements. Objects are deleted, and other image elements are extracted (step S9). For example, in the case of deleting image elements included in the region 1/4 from the upper end and the region 1/4 from the lower end, in order to perform the process in step S9 on the captured image 50 shown in FIG. As shown in FIG. 4, the captured image 50 displayed on the LCD display unit 16 is divided into a quarter region from the top, a quarter region from the bottom, and a central region. At this time, the area 52 is divided into areas 52a, 52b, and 52c, and the area 54 is divided into areas 54a and 54b. Then, as shown in FIG. 9, the areas 52a, 52c, and 54b included in the ¼ area from the upper end or the ¼ area from the lower end are deleted, and the areas 52b, 54a, and 56 are extracted as image elements. As a result of dividing the image element, when the area of the image element becomes smaller than the projected area of the projection area 60 shown in FIG. 7, the image element is deleted.

  Then, it is confirmed whether or not image elements can be extracted (step S10). When the extracted image element does not exist, the display control unit 30 notifies that there is no image element on the LCD display unit 16 (step S15).

  When the image element is extracted, the image element extraction unit 46 uses the chromaticity measured by the image processing unit 36 based on the color signal included in the imaging signal output from the imaging element 32, and uses the chromaticity. Is extracted in the white area, and image elements not in the white area are deleted (step S11). Here, for example, when the chromaticity coordinates in the XYZ color system are included in the region corresponding to white in the xy chromaticity diagram, it is determined that the chromaticity is in the white region. In the captured image 50 shown in FIG. 9, the area 56 is deleted because it is determined not to be in the white area, and as shown in FIG. 10, the areas 52b and 54a are determined to be in the white area and extracted as image elements. Then, it is confirmed whether or not the image element has been extracted (step S12). When the extracted image element does not exist, the display control unit 30 notifies that there is no image element on the LCD display unit 16 (step S15).

  When the image element is extracted, the image element extraction unit 46 uses the luminance value measured by the image processing unit 36 based on the imaging signal output from the imaging element 32, and the image element having the highest luminance value. Is selected as a projection candidate area (step S13). The display control unit 30 then superimposes the projection candidate area on the captured image displayed on the LCD display unit 16 (step S14). When the average luminance value of the area 54a is higher than the average luminance value of the area 52b in the captured image 50 shown in FIG. 10, the area 54a is displayed on the LCD display unit 16 as a projection candidate area as shown in FIG. It is superimposed on the image. Then, the user installs the camera 2 at a position where the image is projected on the area 54a, and starts projecting the image by operating the playback button 22.

  According to the camera with a projector according to the present embodiment, it is possible to search for a projection plane suitable for projection without projecting an image. Therefore, the user can easily set a suitable projection plane without taking time and effort.

  In addition, since a projection plane suitable for projection can be searched without projecting an image, the light source of the projector is not wasted and power consumption can be saved.

  In the present embodiment, the image processing unit 36 measures the contrast, the luminance value, and the chromaticity, and the image element extraction unit 46 performs the determination for extracting the image elements. The processing unit 36 measures contrast, luminance value, and chromaticity. In the projection area guide mode, the image element extraction unit 46 performs determination of contrast, luminance value, chromaticity, and image element extraction. It is good also as a structure.

  Further, in the extraction processing of the height suitable for projection in the present embodiment, it has been described that the image elements included in the ¼ area from the upper end and the ¼ area from the lower end are deleted. The image element included in the area 3 and the area 1/3 from the lower end may be deleted, or the user may arbitrarily set the area from which the image element is deleted.

  Further, in the present embodiment, the configuration using the XYZ color system for white determination has been described as an example, but other color systems, JIS standards, original standards, etc. may be used for white determination. .

  Further, in the present embodiment, in the projection candidate area display process, an area with a small change in contrast, an area that is equal to or larger than the projection size on the projection plane, an area where the height is not near the upper and lower ends, an area that has white chromaticity, The configuration in which the image element extraction processing is performed in the order of the areas having relatively high luminance values has been described as an example, but all of the image element extraction processing may not be performed. That is, the projection candidate area display process may be performed by combining one of these image element extraction processes or two or more image element extraction processes. Further, when combining two or more image element extraction processes, the order in which the image element extraction processes are performed is not limited to the above-described embodiment, and the image extraction process may be performed in any order such as a setting by the user. May be performed.

  Further, in the present embodiment, the configuration in which the captured image is displayed on the LCD display unit in step S2 of the flowchart shown in FIG. 4 is described. However, the captured image does not necessarily have to be displayed on the LCD display unit. The projection candidate area is extracted by performing the processes after S3.

  Next, a camera according to a second embodiment of the present invention will be described with reference to the drawings. Note that in the camera with a projector according to the first embodiment, one projection candidate area is superimposed on the captured image displayed on the LCD display unit 16, but with the projector according to the second embodiment. The camera includes a ranking unit 60, and displays a plurality of projection candidate areas ranked by the ranking unit 60 in a superimposed manner on the captured image displayed on the LCD display unit 16 in a state where the ranking is identifiable. Therefore, a detailed description of the same configuration as that of the first embodiment is omitted, and only different portions will be described in detail. Further, the same components as those in the first embodiment will be described with the same reference numerals.

  FIG. 12 is a block diagram showing a system configuration of a camera with a projector according to the second embodiment. The camera 2 includes a CPU 26. The CPU 26 includes an auxiliary lamp 10, an operation unit 28, a display control unit 30, an image sensor 32, an image storage unit 34, an image processing unit 36, a distance measurement unit 38, a projection unit 42, and a memory card 44. The image element extraction unit 46 and a ranking unit 60 that ranks the projection candidate areas in an order suitable for projection are connected.

  FIG. 13 is a flowchart showing the display process of the projection candidate area of the camera with projector according to the second embodiment. The processing in steps S21 to S32 is the same as the processing in steps S1 to S12 shown in the flowchart of FIG. When there are image elements extracted in step S32, the ranking unit 60 ranks the image elements as projection candidate areas in descending order of the luminance value obtained from the imaging signal output from the imaging device 32 (step S33). . Then, the display control unit 30 superimposes the ranked projection candidate areas on the captured image displayed on the LCD display unit 16 in a state in which the order can be identified (step S34). In the captured image 50 shown in FIG. 10, when the luminance value of the area 54a is higher than the luminance value of the area 52b, the ranking unit 60 ranks the areas 54a and 52b in order, and the area 54a is assigned to the area 54a as shown in FIG. “1” is displayed in the area 52b as “2” in a recognizable state, and the area 54a and the area 54b are superimposed on the captured image displayed on the LCD display unit 16 as a projection candidate area. Then, using the multi-selector 20, the user selects one projection candidate area, installs the camera 2 at a position where an image is projected on the selected area, and starts projecting an image by operating the playback button 22. At this time, when one projection candidate area is selected, only the selected projection candidate area may be displayed.

  In this embodiment, the rank is displayed in a recognizable state by displaying numbers. However, the line thickness of the projection candidate area is changed according to the rank. For example, the higher the projection candidate area, the thicker the line. It is good also as a state which can be recognized so that it may be displayed. Alternatively, the order may be displayed in a recognizable state by defining the color according to the order and changing the display color of the projection candidate area.

  Further, although the description has been given of the configuration in which the projection candidate area is selected using the multi-selector 20, it is not necessary to use an operation member such as the multi-selector 20 when selecting the projection candidate area. An area may be selected.

It is a perspective view which shows the front surface of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure which shows the back surface of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the system configuration | structure of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the projection candidate area display process of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure which shows the display in the display part of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image element extraction process of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image element extraction process of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image element extraction process of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image element extraction process of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the image element extraction process of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a figure which shows the display in the display part of the camera with a projector which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the system configuration | structure of the camera with a projector which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the projection candidate area display process of the camera with a projector which concerns on the 2nd Embodiment of this invention. It is a figure which shows the display in the display part of the camera with a projector which concerns on the 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 2 ... Camera, 4 ... Shooting window, 6 ... Projector projection window, 12 ... Release button, 16 ... LCD display part, 22 ... Reproduction button, 26 ... CPU, 30 ... Display control part, 32 ... Image sensor, 38 ... Ranging 40, projection unit, 46, image element extraction unit, 50, LED, 54, LCOS, 60, ranking unit.

Claims (10)

A projection unit for projecting an image;
An imaging unit for imaging a subject including a projection surface onto which the image is projected;
A display unit for displaying a captured image captured by the imaging unit;
An image element extraction unit that extracts at least one image element suitable for projection by the projection unit from image data of the captured image;
An electronic device with a projector, comprising: a display control unit that superimposes and displays the image element as a projection candidate area on the captured image displayed on the display unit.   The image element extraction unit includes a contrast comparison unit that extracts, as the image element, an area in which the contrast change of the captured image is a predetermined value or less based on the contrast of the captured image measured from the image data. The electronic device with a projector according to claim 1. A distance measuring unit for measuring the distance to the projection surface;
3. The projector-equipped electronic device according to claim 2, wherein the image element extraction unit includes a projection size comparison unit that extracts the image element that is equal to or larger than a projection size of the image on the projection plane calculated from the distance. machine.   The image element extraction unit includes a luminance value comparison unit that extracts a region where the measured luminance is relatively high as the image element based on the luminance value of the subject measured from the image data. The electronic device with a projector according to claim 2 or 3.   3. The image element extraction unit includes a chromaticity determination unit that extracts the image element having the chromaticity in a white region based on the chromaticity of the subject measured from the image data. Or the electronic device with a projector of 3.   The said image element extraction part is provided with the height determination part which extracts the said image element which is not located in the vicinity of the upper and lower ends among the image data of the said captured image, The any one of Claims 2-5 characterized by the above-mentioned. An electronic device with a projector described in 1. When there are a plurality of projection candidate areas,
The display control unit superimposes and displays one projection candidate area most suitable for projection among the plurality of projection candidate areas on the captured image displayed on the display unit. An electronic device with a projector according to any one of the above. A ranking unit that ranks the projection candidate areas in an order suitable for projection when there are a plurality of projection candidate areas;
The display control unit superimposes and displays the plurality of projection candidate areas on the captured image displayed on the display unit in a state in which the order of the plurality of projection candidate areas can be identified. The electronic device with a projector as described in any one of -6.   The image element extraction unit notifies that there is no image element suitable for projection when the image element cannot be extracted from the image data of the captured image. The electronic device with a projector as described in any one of -6.   The projector-equipped electronic device according to claim 1, wherein the electronic device is a digital camera.

Images