JP2012112856A - Undulation observation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an undulation observation device allowing a user to easily perform a self-check of sagging of the face, a body type and the like at home without enlarging a device configuration.SOLUTION: A camera 200 with an undulation observing function, or an undulation observation device, includes: a pattern data storage unit 90 for storing projection pattern data; an image projection unit 20 for projecting a pattern image to an observation object using the projection pattern data; a photographing unit 30 for photographing the observation object; and an image processing unit 50 for generating an image formed by highlighting the undulation state of the observation object by superposing the projection pattern data and the image data photographed by the photographing unit 30.

Description

  The present invention relates to a relief observation apparatus.

  A moire type body observation device is known as a body shape observation device for observing sagging, distortion, wrinkles and the like of skin and body shape. A moire type body shape observation apparatus is an apparatus capable of observing sagging, distortion, wrinkles, etc. of skin and body shape by generating and reading an interference pattern (contour lines) by projecting a lattice image onto the surface of a human body. . This moire type body type observation apparatus does not irradiate radiation that is harmful to the human body like X-rays, but observes the undulations on the body surface using moire images that are expressed by rays that are harmless to the human body. Widely used in various fields such as oriental medicine, beauty and sports.

  There are a moire lattice irradiation type and a lattice projection type device for generating a moire image. The moiré grating irradiation type apparatus illuminates a parallel linear grating with a point light source, and forms bright and dark shadows of the grating on the surface of the observation object. Then, by placing the observation point at a distance equivalent to the point light source from the lattice and observing bright and dark lattice stripes through the lattice, it is possible to observe the uneven shape on the surface of the observation object. In addition, the moiré projection type device forms a deformed grating image formed on the surface of the observation object on an observation reference grating (imaging grating) using an imaging lens system, and forms this image. By observing the contour line moire fringes, it is possible to observe the uneven shape of the surface of the observation object (see, for example, Patent Document 1).

JP 2005-214807 A

  By the way, it goes without saying that it is for the purpose of beauty, and even if it is for the purpose of medical treatment, there are many people who do not like being known to others by their body shape. For this reason, when observing sagging, distortion, wrinkles, etc. of the skin and body shape, it has been desired to develop an apparatus that can easily self-check at home without helping others.

  However, the conventional moire grating irradiation type apparatus requires a moire grating with black thin lines and a frame for holding the moire grating. Will be expensive. In addition, the conventional moiré projection type apparatus is large in size similarly to the moiré grating irradiation type apparatus in order to simultaneously observe the deformed grating image formed on the surface of the object to be measured and the reference grating image. There was a problem of becoming something.

  The present invention has been made in view of such problems, and provides a undulation observation apparatus that can easily check for sagging of the face, body shape, etc. at home while having a simple apparatus configuration. With the goal.

  In order to solve the above-described problem, the undulation observation apparatus according to the present invention includes a pattern data storage unit that stores projection pattern data, and an image projection unit that projects a pattern image onto an observation object using the projection pattern data. An image in which the undulation state of the observation object is emphasized by superimposing the imaging unit that images the observation object and the projection pattern data stored in the pattern data storage unit and the image data captured by the imaging unit. And an image processing unit to be generated.

  In such an undulation observation apparatus, the projection pattern data consists of pattern data for generating moire, and the image processing unit stores the projection pattern data stored in the pattern data storage unit and the imaging data captured by the imaging unit. It is preferable to generate an image that emphasizes the undulation state of the observation object by generating moire by superimposing and.

  Further, in such a undulation observation apparatus, the image processing unit uses transparent data other than the line portion in the projection pattern data, and the line portion data is synchronized with the color attribute of the imaging data, so that the projection pattern data and the imaging data are obtained. Are preferably overlapped.

  In addition, such an undulation observation apparatus controls the pitch of the projection pattern data based on the distance measurement unit that measures the distance from the imaging unit to the observation object and the distance data measured by the distance measurement unit. And a pattern pitch control unit.

  In addition, such an undulation observation apparatus has a positioning data storage unit that stores positioning data for positioning the observation object, and the image projection unit projects a positioning image onto the observation object using the positioning data. It is preferable to do.

  In such a undulation observation apparatus, it is preferable that the positioning data can be created based on a user instruction.

  In such a undulation observation apparatus, it is preferable that the image projection unit stop projecting an image when imaging is performed by the imaging unit.

  In such a undulation observation apparatus, the image projection unit preferably projects an image using near infrared rays.

  In addition, such a undulation observation apparatus includes an image data storage unit that stores at least one of imaging data of an observation object and image data after image processing, and at least imaging data and image data stored in the image data storage unit. It is preferable to include a display control unit that performs control to continuously display one of the images in the order of photographing.

  According to the undulation observation apparatus according to the present invention, since it can be a simple apparatus configuration applying a conventional digital camera or the like, it is easy to sag or form a face at home without using a complicated and large-scale apparatus. Etc. can be self-checked.

It is a block diagram showing the structure of a camera with a undulation observation function. It is a perspective view which shows the external appearance of a camera with a undulation observation function. It is a schematic diagram which shows the state which projected the positioning image on the observation target object. It is a schematic diagram which shows the thumbnail display of image data.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. First, an outline of a camera with a undulation observation function, which is an example of the undulation observation apparatus according to the present embodiment, will be described with reference to FIGS. 1 and 2. A camera with undulation observation function 200 according to the present embodiment is applied to a digital camera having an image projection function, as shown in FIG. 2, and a projection optical system 21 and an imaging optical system are provided on the front surface of a housing 210. 31 is arranged. Although not shown, the present embodiment includes other functions necessary for a general digital camera.

  As shown in FIG. 1, the camera with undulation observation function 200 includes a control unit (CPU) 10, an image projection unit 20, an imaging unit 30, a distance measurement unit 40, an image processing unit 50, an image data storage unit 60, a display / display unit. An input unit 70, a display control unit 80, a pattern data storage unit 90, and a positioning data storage unit 100 are provided, and each unit operates to exert its function under the control of the control unit (CPU) 10.

  The image projection unit 20 includes a projection optical system 21 and a light valve 22, and projects a pattern image onto the observation object using the projection pattern data stored in the pattern data storage unit 90. That is, illumination light from a light source (not shown) is irradiated onto the light valve 22 and spatial light modulation is performed by the light valve 22 using the projection pattern data, and then a pattern image is formed on the surface of the observation target by the projection optical system 21. The projection pattern data stored in the pattern data storage unit 90 includes, for example, a striped pattern or a lattice line. This projection pattern data is configured to generate moire by being superimposed on an image projected on the surface of the observation object. Further, the image projection unit 20 of the present embodiment has a function of projecting a positioning image onto an observation object using the positioning data stored in the positioning data storage unit 100. The pitch of the projection pattern data is configured such that the pattern pitch can be arbitrarily controlled by a pattern pitch control unit 91 described later.

  The imaging unit 30 includes an imaging optical system 31 and an imaging element 32, and images an observation object. That is, imaging data is obtained by detecting light from the observation object by forming an image on the imaging element 32 by the imaging optical system 31. Imaging data captured by the imaging unit 30 is displayed by a display / input unit 70 (for example, a liquid crystal display device including a touch panel). Further, the imaging data is stored in the image data storage unit 60 in response to an instruction from the user or automatically. At this time, if necessary, the image processing unit 50 performs image processing on the image data, and the image data after the image processing is stored in the image data storage unit 60.

  The distance measuring unit 40 measures the distance from the image sensor 32 to the observation object, and can use a distance measuring function mounted on a general digital camera such as an active method or a passive method. The pattern pitch of the pattern image can be appropriately adjusted by the projection magnification determined based on the distance from the image sensor 32 measured by the distance measuring unit 40 to the observation object. Alternatively, when the photographer properly focuses with the focus ring of the projection lens that constitutes the projection optical system 21, the pattern pitch of the pattern image can be appropriately adjusted by the projection magnification that can be understood from the focus position information. it can. Note that adjustment of the projection magnification of the pattern image is performed in the image projection unit 20.

  The image processing unit 50 generates an image in which the undulation state of the observation target is emphasized by superimposing the projection pattern data and the imaging data of the observation target on which the pattern image is projected. In particular, in this embodiment, since the pattern data for projection employs pattern data for generating moire like a striped pattern or a grid line, the pattern data for projection and the imaging of the observation object on which the pattern image is projected are captured. When the data is superimposed, moire is generated, and a contour image in which the undulation state of the observation object is emphasized can be generated.

  The pattern data storage unit 90 stores a plurality of projection pattern data having different patterns, and the user can select an arbitrary pattern according to the type of the observation object by operating the display / input unit 70. . The control unit 10 includes a pattern pitch control unit 91. The pattern pitch control unit 91 changes the distance to the observation target so that the pitch of the pattern images projected by the projection optical system 21 is the same as the distance to the observation target. Accordingly, the pattern pitch width of the projection pattern data stored in the pattern data storage unit 90 is changed.

  The image data storage unit 60 is for storing imaging data of an observation object imaged by the imaging unit 30 and image data subjected to image processing by the image processing unit 50. For example, a camera with a undulation observation function Any device may be used such as a memory built in the camera 200 or a portable memory card that can be attached to and detached from the camera 200 with the undulation observation function. The image data stored in the image data storage unit 60 includes data such as a shooting date and time, a file format, a resolution, and a flag indicating that the shot image and the pattern image are superimposed.

  The display / input unit 70 is configured by a liquid crystal display device having a touch panel function. The display / input unit 70 includes a monitor function for displaying an image being captured and an image stored in the image data storage unit 60, strobe light emission, and backlight correction. It has a function to select and display various shooting conditions. In the present embodiment, a function for creating positioning data of an observation object is provided.

  The display control unit 80 performs control to continuously display the image data stored in the image data storage unit 60 in the order of shooting. As described above, since the image data stored in the image data storage unit 60 can include shooting date / time data, the display control unit 80 sorts the image data in the order of shooting date / time based on the shooting date / time data. Can be displayed. That is, in this embodiment, as shown in FIG. 4, a plurality of images 70a can be displayed as thumbnails on one screen of the display / input unit 70. Although not shown, a plurality of images may be displayed as a slide show. Thereby, the time-dependent change (for example, time-dependent body shape change) of the observation object can be grasped. In particular, by setting the slide show display interval short, the temporal change of the observation object can be expressed as a moving image.

  Next, specific image projection in the image projection unit 20 according to the present embodiment will be described. As described above, the image projecting unit 20 according to the present embodiment projects the pattern image onto the observation object using the projection pattern data stored in the pattern data storage unit 90. At this time, an operation screen for adjusting or selecting the pattern pitch is displayed on the display / input unit 70, and the user can perform an optimum operation according to the type of the observation object by operating the display / input unit 70, for example. After the pattern pitch is adjusted or selected to be the pattern pitch, it is registered in the camera 200. The registered pattern pitch data is stored in the pattern data storage unit 90. When the user changes the date and captures the observation object again, the pattern pitch control unit 91 in the control unit 10 is measured by the pattern pitch data stored in the pattern data storage unit 90 and the distance measurement unit 40. Based on the distance from the image sensor 32 to the observation object (subject), the pitch of the pattern on the observation object of the pattern image projected by the image projection unit 20 is the same as the pitch projected for the first time. Adjust as follows. In other words, even when the distance from the image sensor 32 to the observation object is different, the pattern data storage unit 90 stores the pattern image projected onto the surface of the observation object so that the size of the pattern image is substantially constant. By adjusting the pitch of the pattern of the projection pattern data, it is possible to always observe the undulations of the observation object under the same conditions. In the state where the pattern image is projected, the user can change the pitch of the projection pattern data by, for example, an operation on the display / input unit 70. The pattern data storage unit 90 can store a plurality of pattern pitch data, and the user can further register the changed pattern pitch data. For example, the user can select and project a desired stored pattern pitch each time the observation target is changed. For example, when the observation object is changed from body distortion imaging to face distortion imaging, it is preferable to change the line width finely. The finer the pattern image (for example, the line spacing of the lattice), the finer the interference pattern appears when the images are superimposed, so that even fine undulations can be observed well. Specifically, the line width is preferably 1/5 or less of the expected undulation size. In addition, since pixels are regularly arranged in the vertical and horizontal directions in a digital camera, if a light and dark pattern with a pitch exceeding 1/2 the pixel pitch is photographed, false resolution occurs and a good image cannot be obtained. Should be noted. If a plurality of pattern pitch data are stored in association with the representative image of the observation object, the user can select a desired image by selecting the representative image of the observation object displayed on the display / input unit 70. It becomes possible to set the pitch.

  Further, as described above, the image projecting unit 20 according to the present embodiment can project the positioning image onto the observation object using the positioning data stored in the positioning data storage unit 100. . The positioning data stored in the positioning data storage unit 100 is, for example, for creating a positioning image 110 such as a circle surrounding the face position of the observation target object (photographing target person) 120 as shown in FIG. It consists of data.

  This positioning data can be created based on a user instruction. For example, the image stored in the image data storage unit 60 is called up and displayed on the display / input unit 70, and the positioning image 110 surrounding the face portion of the person is created by using the touch panel function. Is stored in the positioning data storage unit 100. Then, when the user performs photographing, positioning data is called from the positioning data storage unit 100, and the positioning image 110 is projected onto the observation object (capturing target person) 120 by the image projection unit 20, as shown in FIG. . Thereby, for example, when observing a change in body shape over time, it is possible to take an image with the observation object positioned at substantially the same position in the image. The positioning image 110 is not limited to a circle, and may have any shape and form such as a crosshair or a blinking cursor.

  Further, the image projection unit 20 according to the present embodiment can stop projecting an image when the imaging unit 30 performs imaging. That is, when imaging is performed by the imaging unit 30, unnecessary data (positioning image) is not mixed in the imaging data by stopping the projection of the positioning image. Also, when the user presses the shutter, if the user has a function of continuously capturing images, the first image is projected by projecting a pattern image or a positioning image, and the second image is captured by a pattern. Only the image of the observation object is captured without projecting the image or positioning image. Thus, for example, when a face image of a person is photographed, both a general face image and a face image for moiré observation can be photographed by performing only one photographing operation.

  When the imaging unit 30 according to the present embodiment has a zoom function (magnification function) that can change the imaging field angle from the wide-angle end to the telephoto end, the control unit 10 stores the pattern data storage unit 90 in the pattern data storage unit 90. The image projection unit 20 projects the pattern pitch data according to the stored pattern pitch data and the imaging magnification of the imaging unit 30 based on the distance from the imaging element 32 measured by the distance measuring unit 40 to the observation target (subject). After adjusting the pattern image pattern pitch on the observation target of the pattern image to be the same as the pattern pitch projected for the first time, the image is projected as the field angle is changed from the wide-angle end to the telephoto end by the zoom function. The pattern image on the observation object projected by the unit 20 may be projected with a relatively narrow pitch. That is, the control unit 10 according to the present embodiment projects a pattern image having a relatively wide line spacing on the wide angle side, and projects a pattern image having a relatively narrow line spacing as moving to the telephoto side. It can also be configured. As a result, when the user changes the observation object greatly, for example, when the entire body is observed, but the face is anxious and zooming is performed as it is, and the pattern image is set to be enlarged. You can continue observation without having to start over.

  In addition, the image projection unit 20 according to the present embodiment uses light rays in a wavelength range that cannot be detected by humans, such as near infrared rays, or in a wavelength range that does not cause glare even if humans can detect it (long wavelength range). It is preferable to project an image. By projecting an image with light in such a wavelength range, a person who has projected a pattern image on the face does not feel uncomfortable.

  Next, specific image processing in the image processing unit 50 according to the present embodiment will be described. As described above, in the image processing in the image processing unit 50 according to the present embodiment, the undulation state of the observation object is obtained by superimposing the projection pattern data and the captured image of the observation object on which the pattern image is projected. Generate an image that emphasizes. At this time, the image processing unit 50 determines the pattern pitch of the projection pattern data stored in the pattern data storage unit 90 and the pattern pitch of the captured image of the observation object on which the pattern image is projected (the captured image referred to here). The pattern pitch of the projection pattern data and the captured image are adjusted so that the pattern pitch is the same as the pattern pitch formed when the virtual plane is placed at the position of the observation object. At this time, the magnification of the captured image may be changed so as to be the same as the pitch of the projection pattern data, or vice versa, or both magnifications may be changed. Further, it is possible to calculate the ratio of the pitch of the projection pattern data stored in the pattern data storage unit 90 and the pitch of the pattern of the captured image from the projection magnification of the projection optical system and the imaging magnification of the imaging optical system. Therefore, the distance from the image sensor 32 measured by the distance measuring unit 40 to the observation object (subject), the projection magnification data of the projection optical system, and the imaging magnification data of the imaging optical system are recorded for each captured image. The magnification for superimposition may be adjusted based on the ratio between the projection pattern calculated from these data and the captured image. Thus, after adjusting the magnification (size) of the projection pattern data so that the line widths are approximately the same in both cases, a good moire image can be obtained by superimposing the projection pattern data on the captured image. it can.

  In addition, it is preferable that the data other than the line portion in the projection pattern data is transparent data, and the data of the line portion is synchronized with the color attributes (hue, saturation, brightness) of the image data, and the pattern image and the image data are superimposed. . Further, it is preferable to set the opacity of the pattern image to 50 to 80% and to superimpose it with the imaging data. The pattern image is adjusted in this way when the pattern image projected on the observation target and the pattern data for projection are significantly different in density and brightness. This is because it becomes difficult. In addition, depending on the state of the image captured by the image capturing unit 30, it may be better to reduce the saturation of the entire image so that it is close to a black and white photograph.

  In the image displayed on the display / input unit 70, the line width of the pattern image and the interval between adjacent lines are preferably thinner than 5 mm. This is because interference fringes are difficult to confirm if the pattern image (for example, the line spacing of the lattice) is too large. If it is difficult to confirm the interference fringe, the interference fringe portion may be enhanced by image processing in the image processing unit 50.

  Next, imaging of an observation object by the camera with undulation observation function 200 according to the present embodiment will be described. The camera with undulation observation function 200 according to the present embodiment is capable of self-checking easily at home or the like without the help of others when observing sagging, distortion, wrinkles, etc. of the skin and body shape. It has become.

  Prior to shooting, for example, a white wall is used as a background, and grid lines that are pattern images are projected onto the wall. Then, the size of the projected grid line is adjusted according to the distance between the camera 200 with the undulation observation function and the wall. In the present embodiment, the image projection unit 20 adjusts the projection magnification based on the distance data measured by the distance measuring unit 40 so that the size of the pattern image projected on the surface of the observation target is substantially constant. be able to. The user who desires self-checks such as skin and body shape is located on the front surface of the wall where the size of the grid line is adjusted, and the self-timer mechanism etc. is used to capture the captured image of the grid line. Can be obtained. Note that the step of adjusting the size of the grid lines to be the pattern image may be omitted, and the size of the grid lines may be adjusted by the above processing simultaneously with the photographing.

  Further, when shooting, a positioning image is projected onto a wall as a background, and the user can determine a standing position using the positioning image as a mark. Thereby, it is possible to perform photographing by positioning a measurement part such as a face at substantially the same position of the image every time. As described above, by stopping the projection of the positioning image when shooting, it is possible to obtain imaging data that does not include the positioning image. In addition, by performing imaging twice continuously by one imaging operation, it is possible to acquire imaging data in a state in which a pattern image is projected and imaging data in a state in which no pattern image is projected.

  The captured image data is superimposed on the projection pattern data by the image processing unit 50 to generate an image (moire image) that emphasizes the undulation state of the user's skin and body shape, and is displayed on the display / input unit 70 and is also displayed by the user. Based on the instruction or automatically, it is stored in the image data storage unit 60.

  The user can check his / her skin and body shape by looking at the image displayed on the display / input unit 70. In addition, by displaying a plurality of image data as thumbnails or as a slide show on the display / input unit 70, it is possible to confirm changes over time in one's own skin and body shape.

  As described above, according to the camera with undulation observation function 200 according to the present embodiment, it is possible to easily self-check for slack, distortion, wrinkles, and the like of the skin and body shape without helping others. For example, when a user's face is photographed, a contour line pattern appears from a high cheek, so that it is possible to easily recognize where the high cheek exists on the face. Then, after performing a beauty massage or a gymnastic exercise or the like, if it can be confirmed that a high cheek is formed on the upper part of the face, it is an encouragement to continue the beauty massage or the gymnastic exercise. In addition, the state of interference fringes makes it easy to confirm that the face is not subject to left and right, so you can pay attention to the engagement of the left and right teeth when eating, etc. It is possible to improve life with attention to health conditions.

DESCRIPTION OF SYMBOLS 20 Image projection part 30 Imaging part 40 Distance measuring part 50 Image processing part 60 Image data memory | storage part 80 Display control part 90 Pattern data memory | storage part 91 Pattern pitch control part 100 Positioning data memory | storage part 110 Positioning image 120 Observation object (person to be imaged) )
200 Camera with undulation observation function (undulation observation device)

Claims (9)

A pattern data storage unit for storing projection pattern data;
An image projection unit that projects a pattern image onto an observation object using the projection pattern data;
An imaging unit for imaging the observation object;
An image processing unit that generates an image in which the undulation state of the observation object is emphasized by superimposing the projection pattern data stored in the pattern data storage unit and the imaging data captured by the imaging unit;
An undulation observation device characterized by comprising: The projection pattern data consists of pattern data for generating moire,
The image processing unit generates a moire by superimposing the projection pattern data stored in the pattern data storage unit and the imaging data captured by the imaging unit, and the undulation state of the observation object The undulation observation apparatus according to claim 1, wherein an image with emphasis is generated.   The image processing unit uses transparent data other than the line portion in the projection pattern data, and the data of the line portion is synchronized with the color attribute of the imaging data to superimpose the projection pattern data and the imaging data. The undulation observation apparatus according to claim 1, wherein the undulation observation apparatus is provided. A distance measuring unit for measuring a distance from the imaging unit to the observation object;
The pattern pitch control part which determines the pitch of the said pattern data for projection based on the distance data measured by the said ranging part, The one of Claims 1-3 characterized by the above-mentioned. Rough observation device. A positioning data storage unit for storing positioning data for positioning the observation object;
The undulation observation apparatus according to claim 1, wherein the image projection unit projects a positioning image onto an observation object using the positioning data.   The undulation observation apparatus according to claim 5, wherein the positioning data can be created based on a user instruction.   The undulation observation apparatus according to claim 1, wherein the image projecting unit stops projecting the image when the image capturing unit captures an image.   The undulation observation apparatus according to claim 1, wherein the image projection unit projects the image using near infrared rays. An image data storage unit that stores at least one of imaging data of the observation object and image data after image processing;
A display control unit that performs control to continuously display at least one of the imaging data and the image data stored in the image data storage unit in the order of shooting;
The undulation observation device according to claim 1, wherein the undulation observation device is provided.

Images