WO2013132636A1

WO2013132636A1 - Indicator, and close-up lens unit

Info

Publication number: WO2013132636A1
Application number: PCT/JP2012/056025
Authority: WO
Inventors: 貞雄安達; 隆司松山
Original assignee: 株式会社洛洛.Com
Priority date: 2012-03-08
Filing date: 2012-03-08
Publication date: 2013-09-12

Abstract

The purpose of one aspect of the present invention is to enable the impact of camera function and performance, illumination light, light source, or similar, on an image that a user has acquired using a close-up lens to be reduced. An indicator according to one aspect of the present invention is provided with indicator sections having specific colours which, when a close-up lens mounted on a camera comes into contact with or comes close to a photographic subject and the photographic subject is captured, are present in positions that come close into contact with or come close to the photographic subject, and are at least partly included in the capture-range of the camera, thus are captured together with the photographic subject, and form analysis indicators for the image that has been captured by the camera.

Description

Index body and close-up lens unit

The present invention relates to an index body mainly used for a close-up lens and a technology of a close-up lens unit.

In

Patent Documents

1 and 2, a mobile phone terminal, a portable video game machine, a camera module mounted on a PC (Personal Computer), etc. is attached to a human skin or the like in a state of being in contact with or close to human skin. A close-up lens for photographing is disclosed.

Design Registration No. 1352831 Design Registration No. 1401884

In recent years, a service for analyzing skin and the like using an image obtained by allowing the user to photograph the skin and the like using such a close-up lens has begun to be provided. In order to receive such a service, the user must photograph the skin or the like of the part to be analyzed. However, there is a problem in that an image having a sufficient image quality to receive the service may not be obtained due to the influence of the shooting environment such as the function and performance of the camera, illumination light, and light source.

In one aspect, the present invention has been made in view of such problems, and is a shooting environment such as camera function and performance, illumination light, and light source for an image acquired by a user using a close-up lens. The purpose is to make it possible to reduce the effects of

The index body according to one aspect of the present invention is present at a position in contact with or close to the subject when the close-up lens attached to the camera is in contact with or close to the subject to photograph the subject, and at least one of them. And an index unit with a predetermined color as an index of analysis of an image captured by the camera, which is captured together with the subject when the unit is included in the capturing range of the camera.

According to the index body according to one aspect of the present invention, when a user acquires an image using a close-up lens, a predetermined color that is an index for analysis of an image photographed by a camera is attached to the subject. The indicator part is photographed.

Therefore, according to the index body according to one aspect of the present invention, it is possible to analyze the acquired image based on the index section photographed together with the subject. As a result, it is possible to reduce the influence of the shooting environment such as the function and performance of the camera, the illumination light, and the light source on the image acquired by the user using the close-up lens.

Further, as another form of the index body according to the one aspect, the index body is configured to capture the subject when the close-up lens mounted on the camera is in contact with or close to the subject and captures the subject. It may further include a mark indicating predetermined information that is photographed together with the subject and the indicator portion.

Further, as another form of the index body according to each of the above-described aspects, each of the index bodies is configured such that when the close-up lens mounted on the camera is in contact with or close to the subject and the subject is photographed, You may further provide opening in the part contained in an imaging | photography range.

Further, as another form of the index body according to the one aspect, the opening may be provided so that the center of the opening is located in the vicinity of the optical axis of the camera.

Further, as another form of the indicator body according to the one aspect, the indicator portion may be provided so as to surround an outer edge of the opening.

Further, as another form of the index body according to the one aspect, the opening may have a rotationally symmetric shape.

Further, as another form of the indicator body according to the above aspect, the indicator portion may have a color pattern arranged according to a predetermined regularity corresponding to the rotational symmetry of the opening.

Further, as another form of the index body according to each of the above-described one aspect, a plurality of the marks may be arranged according to a predetermined regularity corresponding to the rotational symmetry of the opening.

Further, as another form of the indicator body according to each of the above-described aspects, in the indicator body of each form, the indicator portion may have a step in the optical axis direction.

Further, as another aspect of the index body according to each of the above aspects, a close-up lens unit that realizes each of the above configurations may be used.

For example, a close-up lens unit according to one aspect of the present invention is used by being attached to a camera, and when attached to the camera, at least a part of the close-up lens unit is in contact with or close to a subject at the time of shooting. An index part with a predetermined color as an index of analysis of an image captured by the camera, which is captured with the subject by being included in the imaging range of
Is provided.

According to the present invention, it is possible to reduce the influence of the shooting environment such as the function and performance of the camera, the illumination light, and the light source on the image acquired by the user using the close-up lens.

FIG. 1 is a perspective view showing an example of a close-up lens to which a panel according to an embodiment is attached. FIG. 2 is a bottom perspective view showing an example of a close-up lens mounted with the panel according to the embodiment. FIG. 3 is a plan view showing an example of a close-up lens mounted with the panel according to the embodiment. FIG. 4 is a bottom view showing an example of a close-up lens mounted with the panel according to the embodiment. FIG. 5 is a front view showing an example of a close-up lens mounted with the panel according to the embodiment. FIG. 6 is a cross-sectional view taken along line AA of FIG. 3, showing an example of a close-up lens to which the panel according to the embodiment is attached. FIG. 7 is an exploded perspective view showing an example of a close-up lens mounted with the panel according to the embodiment. FIG. 8 is a bottom exploded perspective view showing an example of a close-up lens mounted with the panel according to the embodiment. FIG. 9 shows an example of using a close-up lens equipped with the panel according to the embodiment. FIG. 10 shows an example of a panel according to the embodiment. FIG. 11 is a perspective view showing another mounting example of the panel according to the embodiment. FIG. 12 is an exploded perspective view illustrating another mounting example of the panel according to the embodiment. FIG. 13 is a cross-sectional view showing another mounting example of the panel according to the embodiment. FIG. 14 shows an example of a panel according to another embodiment. FIG. 15A shows an example of a panel according to another embodiment. FIG. 15B shows an example of a panel according to another embodiment. FIG. 15C shows an example of a panel according to another embodiment. FIG. 15D shows an example of a panel according to another embodiment. FIG. 15E shows an example of a panel according to another embodiment. FIG. 15F shows an example of a panel according to another embodiment. FIG. 16 shows an example of a panel according to another embodiment. FIG. 17A shows an example of a panel according to another embodiment. FIG. 17B shows an example of a panel according to another embodiment. FIG. 17C shows an example of a panel according to another embodiment. FIG. 18 is a perspective view showing an example of a panel according to another embodiment. FIG. 19 is a cross-sectional view showing an example of a close-up lens mounted with a panel according to another embodiment. FIG. 20A shows an example of a panel according to another embodiment. FIG. 20B shows an example of a panel according to another embodiment. FIG. 21 illustrates an outline of a hardware configuration of the information processing system according to the embodiment. FIG. 22 illustrates a schematic hardware configuration of an information processing system according to another embodiment. FIG. 23 illustrates an outline of a functional configuration of the information processing system. FIG. 24 is a flowchart illustrating an example of an information processing procedure performed by the information processing system according to the embodiment. FIG. 25 shows an example of an image acquired in the information processing system according to the embodiment. FIG. 26 shows an example of a screen displayed during shooting in the information processing system according to the embodiment. FIG. 27 is a flowchart illustrating an example of a processing procedure of analysis processing and correction processing by the information processing system according to the embodiment. FIG. 28 illustrates data stored in the information processing system according to the embodiment.

Hereinafter, an embodiment according to one aspect of the present invention (hereinafter also referred to as “this embodiment”) will be described with reference to the drawings. However, the present embodiment described below is merely an example of the present invention in all points, and is not intended to limit the scope thereof. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. That is, in carrying out the present invention, a specific configuration according to each embodiment may be adopted as appropriate.

Although data appearing in this embodiment is described in a natural language, more specifically, it is specified by a pseudo language, a command, a parameter, a machine language, etc. that can be recognized by a computer.

§1 Close-up lens In this embodiment, a scene in which a user photographs his / her skin with a camera module connected to or mounted on a mobile phone terminal, a portable video game machine, a PC (Personal Computer) or the like is illustrated. . However, the application scene of the present invention is not limited to such an example. The present invention is widely applicable in scenes where close-ups of subjects are taken. In the present embodiment, even a device having another name is referred to as a “camera” if the device has or can have a camera function.

FIG. 1 is a perspective view showing an example of a close-up lens 50 to which a panel 40 according to this embodiment is attached. FIG. 2 is a bottom perspective view showing an example of the close-up lens 50 to which the panel 40 according to the present embodiment is attached. FIG. 3 is a plan view showing an example of the close-up lens 50 to which the panel 40 according to the present embodiment is attached. FIG. 4 is a bottom view showing an example of the close-up lens 50 to which the panel 40 according to the present embodiment is attached. FIG. 5 is a front view showing an example of the close-up lens 50 to which the panel 40 according to this embodiment is attached. FIG. 6 is a cross-sectional view taken along the line AA in FIG. 3, showing an example of the close-up lens 50 to which the panel 40 according to the present embodiment is attached. FIG. 7 is an exploded perspective view showing an example of the close-up lens 50 to which the panel 40 according to the present embodiment is attached. FIG. 8 is a bottom exploded perspective view showing an example of the close-up lens 50 to which the panel 40 according to the present embodiment is attached. FIG. 9 shows an example of using the close-up lens 50 to which the panel 40 according to this embodiment is attached. Note that a rear view, a left side view, and a right side view showing an example of a close-up lens to which the panel 40 according to the present embodiment is attached are each expressed in the same manner as the front view shown in FIG.

[Close-up lens]
The close-up lens 50 according to the present embodiment will be described mainly with reference to FIG. The close-up lens 50 according to the present embodiment is used to magnify a subject (skin). As shown in FIG. 6, the close-up lens 50 according to the present embodiment includes a lens unit 54 that realizes the function of the magnified photographing, and an outer portion that surrounds the lens unit 54.

The outer portion includes a bottom surface portion 51 that faces the camera when the close-up lens 50 is attached to the camera, a groove portion 52 to which a lens fixing clip used for attaching the close-up lens 50 to the camera is attached, and when photographing. And an upper end 53 that contacts or is close to the subject.

The bottom surface portion 51 is a portion that comes into contact with the camera when the close-up lens 50 is attached to the camera, as shown in FIG. Therefore, a detachable or reattachable adhesive for attaching the close-up lens 50 to the camera may be applied or affixed to the bottom surface portion 51.

The groove portion 52 is provided above the bottom surface portion 51 and around the lens portion 54 as shown in FIGS. 5 and 6. The groove portion 52 is a portion to which a lens fixing clip for attaching the close-up lens 50 to the camera is attached. The lens fixing clip is attached to the close-up lens 50 by sandwiching the groove formed by the groove 52 with the lens fixing clip. In addition, the groove part 52 exists so that the circumference | surroundings of the lens part 54 may be enclosed. Therefore, when the close-up lens 50 is attached to the camera, the close-up lens 50 may rotate around the optical axis.

The upper end portion 53 is a portion that comes into contact with or is close to the subject when the subject is photographed with the close-up lens 50 attached to the camera. As shown in FIGS. 6 and 7, a recess having substantially the same shape and size as the outer periphery of the panel 40 is formed inside the upper end portion 53 in order to fit a circular panel 40 described later.

The lens unit 54 has a convex lens shape to magnify a subject. The lens unit 54 is designed to be suitable for a subject to be processed. For example, when the skin of the hand or face is mainly taken as an object to be photographed, the lens unit 54 is designed so that the magnification of the lens is about 30 times as an example. For example, when the scalp is mainly taken as an imaging target, the lens unit 54 is designed so that the magnification of the lens is about 50 to 80 times as an example. In the present embodiment, as shown in FIG. 6, the lens portion 54 is formed integrally with the outer portion of the close-up lens 50.

The user attaches such a close-up lens 50 to the camera and shoots his / her skin as shown in FIG. The subject illustrated in FIG. 9 is his own skin (skin on the back of his hand). However, the subject is not particularly limited, and may be other than its own skin.

Note that the close-up lens 50 is made of a translucent member, for example. For example, the close-up lens 50 is made of a transparent plastic. The close-up lens 50 is made of a translucent member, so that ambient light can be taken in as illumination light even when photographing with the upper end 53 in contact with the subject.

[panel]
As shown in FIGS. 7 and 8, etc., a panel 40 is attached to the close-up lens 50 of the present embodiment. The panel 40 corresponds to an embodiment of the index body of the present invention. However, the index body of the present invention is not limited to the close-up lens panel exemplified by the panel 40.

FIG. 10 shows an example of the panel 40 according to the present embodiment. The panel 40 is present at a position where the close-up lens 50 attached to the camera is in contact with or close to the subject and the subject is in contact with or close to the subject, and at least a part of the panel 40 is in the shooting range 70 of the camera. An index unit 41 with a predetermined color as an index for analysis of an image captured by a camera that is captured with the subject by being included.

By using this panel 40 when photographing a subject, an index portion 41 with a predetermined color as an index for analysis of an image photographed by the camera is photographed together with the subject. In the present embodiment, the acquired image can be analyzed based on the index unit 41. As a result, it is possible to reduce the influence of the shooting environment such as the function and performance of the camera, the illumination light, and the light source on the image acquired by the user using the close-up lens.

Note that the shooting range 70 shown in FIG. 10 or the like is obtained when shooting is performed with each panel mounted on the close-up lens 50 and the close-up lens 50 mounted on a camera (a user terminal 2 described later). The range photographed by the camera on the panel is shown.

First, a method for mounting the panel 40 will be described. The panel 40 is attached to the close-up lens 50 by being fitted at the upper end portion 53. The upper end portion 53 is a portion that is in contact with or close to the subject at the time of shooting. Therefore, the panel 40 is present at a position in contact with or close to the subject at the time of shooting. In addition, an index portion 41 described later is provided on the surface of the panel 40 on the camera side. Therefore, an index unit 41 to be described later is also present at a position in contact with or close to the subject at the time of shooting.

In addition, the mounting method of the panel 40 which concerns on this embodiment is not limited to such a method. For example, the panel 40 may be bonded to the upper end portion 53 of the close-up lens 50. For example, the panel 40 may be attached to the close-up lens 50 by fitting the upper end portion 53 of the close-up lens 50 to the panel 40 as a cap of the close-up lens 50.

An example of another method for attaching the panel 40 to the close-up lens 50 will be described with reference to FIGS. FIG. 11 is a perspective view showing another mounting example of the panel 40 according to the present embodiment. FIG. 12 is an exploded perspective view showing another mounting example of the panel 40 according to the present embodiment. Moreover, FIG. 13 is sectional drawing which shows the other mounting example of the panel 40 which concerns on this embodiment. As shown in FIGS. 11 to 13, for example, when the cap 60 is attached to the close-up lens 50, the panel 40 is sandwiched between the close-up lens 50 and the cap 60. It may be attached to.

Next, the shape of the panel 40 will be described. As shown in FIG. 10, the shape of the panel 40 according to the present embodiment is a circle. However, the shape of the panel 40 may be other than circular. For example, the shape of the panel 40 may be a polygon. In the present embodiment, the panel 40 is fitted into a recess provided in the upper end portion 53 of the close-up lens 50. Therefore, the said recessed part is shape | molded according to the shape of the outer periphery of the panel 40. FIG.

FIG. 14 shows an example of variations in the shape of the panel 40. The panel 40A shown in FIG. 14 has a semicircular shape. Note that the panel 40A includes an indicator portion 41A that is a variation of the indicator portion 41 of the panel 40 according to the present embodiment. When the subject is photographed with the panel 40A attached to the close-up lens 50, the index portion 41A appears in the right half of the photographing range 70 and the subject appears in the left half of the photographed image.

Next, the shape of the index part 41 according to the present embodiment will be described. As shown in FIG. 10, the shape of the indicator portion 41 according to the present embodiment is a donut shape in which the outer periphery and the inner periphery of the indicator portion 41 are circular. As shown in FIG. 10, the indicator portion 41 is formed on the entire surface of the panel 40 except for the region of the opening 43. However, the index unit 41 only needs to be photographed together with the subject, and the shape of the index unit 41 is not limited to the shape shown in FIG. The shape of the index part 41 is appropriately selected.

The variation of the shape of the indicator portion 41 will be described with reference to FIGS. 15A to 15F. FIGS. 15A to 15F illustrate variations in the shape of the indicator portion 41, respectively. In addition, in each figure, the same code | symbol is attached | subjected to the opening of the same shape. The same type of mark is given the same symbol. In addition, when referring to a mark regardless of the type, it is referred to as a mark 44.

15A, the indicator portion 41B of the panel 40B has a donut shape like the indicator portion 41, but unlike the indicator portion 41, it is not formed on the entire surface of the panel 40B. Further, unlike the indicator portion 41, the color assigned to the indicator portion 41B is a single color.

15B, the shape of the outer periphery of the indicator portion 41C of the panel 40C shown in FIG. 15B is a regular polygon (regular dodecagon in the figure) unlike the indicator portion 41. Further, unlike the indicator unit 41, the indicator unit 41C has a color pattern in which four colors are arranged. The panel 40C has four types of marks (44a to 44d).

The shape of the outer periphery of the indicator portion 41D of the panel 40D shown in FIG. 15C is the same as the shape of the outer periphery of the indicator portion 41C. However, the index part 41D has a larger area than the index part 41C. Further, the index part 41D has a color pattern in which two colors are arranged, like the index part 41.

The shape of the outer periphery of the indicator portion 41E of the panel 40E shown in FIG. 15D is the same as the shape of the indicator portion 41. However, the indicator portion 41E does not cover the entire surface of the panel 40E. In addition, the index part 41E has a color pattern in which four colors are arranged, like the index part 41C. Note that a mark 44 described later may not be present in all color pattern regions, as shown on the panel 40E.

The shape of the outer periphery of the indicator portion 41F of the panel 40F shown in FIG. 15E is the same as the shape of the outer periphery of the indicator portion 41D. The index part 41F has the same area as the index part 41D. However, unlike the indicator portion 41D, the indicator portion 41F has a color pattern in which four colors are arranged.

It should be noted that the indicator unit 41 may or may not exist in order to realize information processing using a mark 44 described later. Therefore, as in the panel 40G shown in FIG. 15F, the indicator portion may not be present from the viewpoint of realizing information processing using a mark 44 described later.

Next, the predetermined color assigned to the indicator unit 41 according to the present embodiment will be described. The indicator unit 41 according to the present embodiment has a color pattern in which white and black are alternately arranged. However, the predetermined color or colors assigned to the index unit 41 may be any color as long as it is an index for analysis of an image captured by the camera, and may be selected as appropriate.

For example, as shown in the indicator portion 41B, the indicator portion 41 may be formed in a single color. Further, for example, the indicator unit 41 may be colored in cyan, magenta, yellow, black, and white. For example, the indicator unit 41 may be colored in red, green, blue, black, and white. As described above, the predetermined one or a plurality of colors attached to the indicator unit 41 may be appropriately selected.

FIG. 16 illustrates a variation of the color scheme of the indicator unit 41. As will be described later, the region of the opening 43 is a region where the subject is captured. The area (index part 41G) adjacent to the area where the subject is photographed on the panel 40H shown in FIG. 16 is arranged so as to gradually change from position B in the clockwise direction within the range of colors that the subject can take. The indicator unit 41 may be arranged in this way. The effects obtained by such color arrangement can be described as follows.

The color of the range that can be taken by the subject is arranged stepwise on the indicator 41G. Therefore, it is possible to specify the position (angle) of the index unit 41G to which the same color as the subject color is given on the acquired image. First, an identifiable position can be used as a reference for the color of a subject as an effect of color arrangement as in the indicator portion 41G.

Also, similar to the color of the index unit 41G, the color of the subject on the photographed image may be different from the actual color of the subject due to the influence of the photographing environment such as the function and performance of the camera, illumination light, and light source. Here, since the index unit 41G is disposed at a position adjacent to the subject, the index unit 41G is affected in substantially the same manner as the subject. Therefore, on the captured image, it can be estimated that the actual color of the index unit 41 at the position (angle) of the index unit 41G to which the same color as the subject color is given is almost the same as the actual color of the subject. It is. Therefore, the actual color of the subject can be estimated by analyzing the photographed image and specifying the position of the same color as the subject in the index portion 41G. In order to obtain such an effect, the indicator section 41 may be colored like the indicator section 41G shown in FIG.

As shown in FIGS. 7 and 8, the indicator 41 is provided not on the subject side surface of the panel 40 but on the camera side surface.

For example, the indicator 41 is provided by printing on the camera side surface of the panel 40 by oil-based offset printing, silk printing, or the like. However, if the index part 41 can be photographed, the index part 41 may be printed on the subject side of the panel 40. For example, when the panel 40 is made of a translucent member such as transparent plastic, the subject 41 can be photographed even if the index portion 41 is printed on the subject side of the panel 40.

Also, for example, the index portion 41 may be provided by sticking a sticker on which a picture of the index portion 41 is printed on the surface of the panel 40 on the camera side. However, if the index portion 41 can be photographed, the sticker may be attached to the subject side of the panel 40 as in the case of the printing. This also applies to the mark 44 described later.

It should be noted that the subject side surface of the panel 40 that cannot be photographed from the camera may be used arbitrarily.

In the present embodiment, the difference between the color of the index portion 41 on the acquired image and the actual color of the index portion 41 is used in the color correction and uneven illumination correction of the image, which will be described later. Specifically, a two-dimensional distribution in which the difference is obtained at a position where the index portion 41 is shown on the image is used. Therefore, in order to increase the accuracy of color correction and illumination unevenness correction, which will be described later, it is preferable that the index unit 41 exists in all directions around the area where the subject appears in the shooting range 70 of the camera.

Next, the mark 44 provided on the panel 40 will be described. Referring to FIG. 10 and the like, the panel 40 according to the present embodiment includes a mark 44 indicating predetermined information. The mark 44 is photographed together with the subject and the index unit 41 by being included in the photographing range 70 of the camera when photographing the subject with the close-up lens 50 attached to the camera being in contact with or close to the subject. In addition, the mark 44 may be attached | subjected to the area | region where the parameter | index part 41 exists, as FIG. 10 etc. show.

For example, the predetermined information indicated by the mark 44 is information for identifying that the close-up lens 50 is a regular lens. For example, the predetermined information indicated by the mark 44 is information for identifying the distributor who distributed the close-up lens 50 together with the panel 40. For example, the predetermined information indicated by the mark 44 is information on a product sold together with the panel 40 and the close-up lens 50.

Since such a mark 44 exists in the acquired image, for example, information processing such as identifying the acquired image based on predetermined information indicated by the mark 44 becomes possible. That is, the mark 44 may be handled as an identifier for performing predetermined identification.

Note that the mark 44 may be, for example, a barcode that represents information in accordance with a predetermined standard. The mark 44 may be a trademark of a distributor, a product manufacturer, a target product, etc., for example. The mark 44 may be set as appropriate.

In addition, the panel 40 may have a plurality of types of information by including a plurality of types of marks 44. For example, the panel 40 according to the present embodiment includes two types of marks, a mark 44a and a mark 44b. Further, for example, the panel 40C shown in FIG. 15B includes four types of marks 44a to 44d.

Note that the mark 44 may or may not exist in realizing image analysis using the index unit 41. Accordingly, as illustrated in FIG. 10 and the like, the mark 44 may not be present from the viewpoint of realizing image analysis using the index unit 41.

Next, the opening 43 provided in the panel 40 will be described. The panel 40 according to the present embodiment shown in FIG. 10 has an opening 43 in a portion included in the photographing range 70 of the camera when the close-up lens 50 attached to the camera is brought into contact with or close to the subject and the subject is photographed. Have The opening 43 is created, for example, by making a hole in the panel 40 by a processing method such as Thomson processing.

In the present embodiment, the region of the opening 43 in the shooting range 70 of the camera is a region where the subject can be seen from the camera side, in other words, a region where the subject is captured. That is, the opening 43 may not be provided in the panel 40 as long as the subject can be photographed. For example, when the panel 40 according to the present embodiment is made of a translucent member such as a transparent plastic, it is possible to capture the subject, and thus the opening 43 may not be provided.

Further, the panel 40 is not provided with the opening 43 and is not made of a translucent member, as long as the subject can be photographed as in the panel 40A shown in FIG. Good.

In photographing using a close-up lens, generally, an image near the optical axis of the close-up lens tends to be clearer. Therefore, in order to capture the subject more clearly, the opening 43 should be provided so as to include the optical axis. For example, the center of the opening 43 is provided in the vicinity of the optical axis of the camera (close-up lens 50). Preferably, the center of the opening 43 is provided so as to be located on the optical axis.

Further, the indicator portion 41 may be provided so as to surround the outer edge of the opening 43 provided so that the center is located near or on the optical axis. As a result, even if the panel 40 is mounted so as to be shifted vertically and horizontally, the index portion 41 exists around the opening 43, so that the index portion 41 can be included in the shooting range 70 of the camera.

Further, the opening 43 may have a circular symmetry shape. Thereby, even if the panel 40 rotates around the optical axis, the influence can be reduced or ignored.

For the same reason, as shown in FIG. 10 and the like, the indicator section 41 may have a color pattern arranged according to a predetermined regularity corresponding to the rotational symmetry of the opening 43. A plurality of marks 44 may be arranged according to a predetermined regularity corresponding to the rotational symmetry of the opening 43.

Here, the predetermined regularity is a regularity corresponding to the rotational symmetry of the opening 43. The predetermined regularity corresponds to, for example, the rotational symmetry of the opening 43, and an angle p at which the state of the index portion 41 or the mark 44 included in the imaging range 70 does not change before and after the rotation except for a multiple of 360 degrees. Is present (0 <p <360).

The shape of the opening 43 according to the present embodiment is a circle. However, the shape of the opening 43 is not limited to a circle. The shape of the opening 43 is appropriately selected. For example, the shape of the opening 43 includes a polygon, an ellipse, a star, and the like.

Variations of the opening 43 will be described with reference to FIGS. 17A to 17C. 17A-17C illustrate variations of the opening 43. FIG.

For example, the shape of the opening 43A of the panel 40I shown in FIG. 17A is a regular polygon as a shape having rotational symmetry. The indicator portion 41H of the panel 40I is provided on the entire surface of the panel 40I.

Also, for example, the indicator portion 41I of the panel 40J shown in FIG. 17B has a shape that protrudes toward the center of the opening 43B. And the indicator part 41J of the panel 40K shown by FIG. 17C has a shape which protrudes toward the center of the

opening

43B, and 2 color schemes of white and black are made | formed. The indicator portion 41J is provided with

marks

44a and 44b.

Note that when photographing a subject, the user brings the panel 40 (close-up lens 50) into contact with the subject, for example. In this case, when the subject is deformed, the subject may partially enter the close-up lens 50 through the opening 43.

In this embodiment, the index part 41 and the mark 44 are attached to the surface of the panel 40 on the camera side. Therefore, when the deformation of the subject is not taken into consideration, the index portion 41 and the mark 44 are positioned closer to the lens than the subject by the thickness of the panel 40 in the optical axis direction.

Due to these factors, there is a possibility that the index part 41 and the mark 44 exist at positions different from the subject in the optical axis direction. Therefore, when focusing on the subject, there is a possibility that the index unit 41 and the mark 44 may not be focused due to a difference in position in the optical axis direction.

In consideration of these possibilities, the indicator portion 41 may have one or a plurality of steps in the optical axis direction. The mark 44 may be attached to a surface perpendicular to the optical axis direction of each step formed in the panel 40.

18 and 19 show variations of the panel 40. FIG. FIG. 18 is a perspective view showing an example of a panel 40L in which one step is provided in the indicator portion 41K. FIG. 19 is a cross-sectional view showing an example of a panel 40L in which one step is provided in the indicator portion 41K.

By providing such a step, it is possible to reduce the positional deviation between the index portion 41 and the mark 44 and the subject in the optical axis direction. Therefore, it is possible to reduce the focus shift between the index portion 41 and the mark 44 when the subject is focused.

20A and 20B exemplify variations of the panel in which the index portion 41 has one step in the optical axis direction. A panel 40M shown in FIG. 20A is a modification of the panel 40B shown in FIG. 15A. The panel 40M has one step at the indicator portion 41L. Moreover, the panel 40N shown by FIG. 20B is a modification of the panel 40C shown by FIG. 15B. The panel 40N has one step at the indicator portion 41M.

[Other forms]
The panel 40 may be formed integrally with the close-up lens 50. A unit in which the panel 40 and the close-up lens 50 are integrated corresponds to an embodiment of the close-up lens unit of the present invention.

Further, the index body of the present invention may be a sticker that is attached to a subject and that exhibits the same function as the panel 40. The said seal | sticker can be demonstrated as a seal | sticker of the pattern which implement | achieves the surface of the panel 40 demonstrated using FIG. The user, for example, affixes a picture sticker that realizes the surface of the panel 40 to the subject, and contacts the close-up lens 50 on the sticker to photograph the subject. Thereby, the image to be photographed can obtain the same effect as that obtained by photographing using the panel 40.

It should be noted that such a sticker is mainly used by sticking to a subject. Therefore, instead of the opening 43 present in the center of the seal, for example, a transparent sheet that reacts with skin oil may be provided. Thus, the user can check the oil content of the skin when photographing the skin using the close-up lens.

§2 Information processing system Next, an information processing system that collects images taken using the close-up lens 50 and the panel 40 as described above will be described.

In the information processing system according to the present embodiment, when a close-up lens mounted on a camera is brought into contact with or close to a subject and the subject is photographed, predetermined information existing at a position in contact with or close to the subject is obtained. When the mark shown is included in the imaging range of the camera, an image shot with the subject is acquired. Then, the information processing system according to the present embodiment extracts a mark from the acquired image, and stores the image in association with information indicated by the extracted mark.

The information processing system according to the present embodiment operates as described above, and stores an image photographed using the close-up lens in association with information indicated by a mark. Therefore, the stored image can be identified based on information indicated by the mark. As a result, according to the present embodiment, it is possible to efficiently use the images captured and collected using the close-up lens.

[Hardware configuration]
FIG. 21 illustrates a hardware configuration of the information processing system 1 according to the present embodiment. An information processing system 1 according to the present embodiment includes a user terminal 2 and a server 3 connected via a network 5. Information transmission between the user terminal 2 connected to the network 5 and the server 3 is, for example, data communication via the network 5 such as a 3G (3rd Generation) network, the Internet, a telephone network, and a dedicated network. It is realized with. The type of the network 5 is appropriately selected according to each data communication.

The user terminal 2 includes a control unit 21 including a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and an auxiliary storage device 22 that stores programs executed by the control unit 21. The information processing apparatus includes a network interface 23 for performing communication via the network 5, an input device 24 including a camera module 26, and an output device 25 including a display 27, an LED, a speaker, and the like. In FIG. 21 and FIG. 22 described later, the network interface is described as “NW I / F”.

The specific hardware configuration of the user terminal 2 may be appropriately omitted, replaced, and added according to the embodiment. For example, the user terminal 2 may be further connected with a mouse, a keyboard, or the like as an input device. The control unit 21 may include a plurality of processors. Further, as the user terminal 2, for example, a PC, a mobile phone, a smartphone, a tablet terminal, a portable game machine, or the like may be used in addition to a terminal designed exclusively for the provided service.

In the present embodiment, the user photographs the subject using the camera module 26 provided in the user terminal 2. Specifically, the user attaches the close-up lens 50 attached with the panel 40 to the camera module 26 of the user terminal 2. Then, for example, as shown in FIG. 9, the user performs photographing in a state where the close-up lens 50 is in contact with or close to his / her skin. In the present embodiment, an image obtained by enlarging the skin, the index unit 41, and the mark 44 is acquired by shooting in this way.

The server 3 includes a control unit 31 including a CPU, a RAM, a ROM, and the like, an auxiliary storage device 32 that stores programs executed by the control unit 31, and a network interface 33 for performing communication via the network 5. And an information processing apparatus. In the present embodiment, images taken by the user are stored in the server 3.

As for the specific hardware configuration of the server 3, as with the user terminal 2, components may be omitted, replaced, and added as appropriate according to the embodiment. The server 2 may be implemented by one or a plurality of information processing devices.

Note that the information processing system 1 according to the present embodiment is not limited to the example realized by the two information processing apparatuses illustrated in FIG. For example, the information processing system 1 may be realized by one information processing apparatus or may be realized by three or more information processing apparatuses. With regard to the hardware configuration of the information processing system 1, it is possible to omit, replace, and add components according to the embodiment.

For example, FIG. 22 illustrates a variation of the hardware configuration of the information processing system 1 according to the present embodiment. An information processing system 1A shown in FIG. 22 is realized by a single information processing apparatus. The information processing system 1A includes a control unit 10 including a CPU, RAM, ROM, and the like, an auxiliary storage device 11 that stores a program executed by the control unit 10, and a network interface 12 for performing communication via a network. The information processing apparatus includes an input device 13 including a camera module 26 and an output device 14 including a display, an LED, a speaker, and the like. In addition, regarding the specific hardware configuration of the information processing apparatus, as in the case of the user terminal 2 and the server 3, the omission, replacement, and addition of components may be appropriately performed according to the embodiment.

[Function configuration]
FIG. 23 illustrates an outline of a functional configuration of the information processing system 1 according to the present embodiment. The information processing system 1 according to the present embodiment includes an image acquisition unit 15, an image processing unit 16, a storage unit 17, and a display control unit 18.

These functions are realized by the CPUs of the user terminal 2 and the server 3 interpreting and executing various programs developed in the respective RAMs to control each component. For example, the image acquisition unit 15 and the display control unit 18 are realized in the user terminal 2, and the image processing unit 16 and the storage unit 17 are realized in the server 3.

However, each function may be realized in either the user terminal 2 or the server 3. For example, the display control unit 18 may be realized in the server 3. Further, the image processing unit 16 may be realized in the user terminal 2.

Further, one function may be realized across a plurality of information processing apparatuses. For example, the image processing unit 16 may be realized across the user terminal 2 and the server 3. In this case, for example, the user terminal 2 and the server 3 realize the image processing unit 16 by sharing a plurality of processes executed by the image processing unit 16 described later. That is, a plurality of information processing apparatuses may realize the one function by sharing a plurality of processes in one function.

Thus, when the function of the information processing system 1 is realized by a plurality of information processing apparatuses, the plurality of information processing apparatuses cooperate with each other to realize the function of the information processing system 1. When the plurality of information processing apparatuses cooperate with each other, data communication for information exchange related to the cooperation is performed between the plurality of information processing apparatuses. In the present embodiment, the user terminal 2 and the server 3 perform data communication via the network 5 to cooperate with each other to realize the function of the information processing system 1 of the present embodiment.

In the present embodiment, an example in which these functions are realized by a general-purpose CPU is described. However, some or all of these functions may be realized by one or more dedicated processors.

Further, the functional configuration shown in FIG. 23 is only an example of the information processing system 1 according to the present embodiment. Therefore, the functions of the information processing system 1 may be appropriately omitted, replaced, and added according to the embodiment. For example, the display control unit 18 may be omitted when image display or the like at the time of shooting, which will be described later, is omitted.

When the close-up lens 50 mounted on the camera module 26 of the user terminal 2 is brought into contact with or close to the subject and the image acquisition unit 15 captures the subject, the image acquisition unit 15 is located at a position in contact with or close to the subject. Is included in the shooting range of the camera module 26, and an image shot with the subject is acquired. The image processing unit 16 extracts the mark 44 from the image acquired by the image acquisition unit 15. Then, the storage unit 17 stores the image in association with the information indicated by the mark 44 extracted from the image.

Note that when the close-up lens 50 attached to the camera module 26 of the user terminal 2 contacts or approaches the subject and the image acquisition unit 15 captures the subject, the image acquisition unit 15 exists at a position that contacts or approaches the subject. The index unit 41 with a predetermined color that serves as an index for analyzing an image captured by the camera module 26 is included in the imaging range of the camera module 26 so that the subject and the mark are included. An image taken together with 44 may be acquired. The image processing unit 16 may extract the index unit 41 from the image acquired by the image acquisition unit 15. Further, the image processing unit 16 may execute an analysis process on the acquired image based on the predetermined color of the extracted index unit 41. Further, the image processing unit 16 may perform a correction process on the acquired image based on the result of the analysis process of the image. Then, the storage unit 17 may store the image that has been subjected to the correction processing by the image processing unit 16.

In addition, the image processing unit 16 may perform the subject analysis processing on the portion related to the subject of the image acquired by the image acquisition unit 15. Then, the storage unit 17 may store the result of the subject analysis process executed by the image processing unit 16 in association with the image acquired by the image acquisition unit 15.

The image processing unit 16 may instruct the image acquisition unit 15 to acquire an image again when the subject analysis processing fails.

Further, the image acquisition unit 15 may acquire an image including a mark indicating a position where the close-up lens 50 is attached in the camera module 26 of the user terminal 2. The image processing unit 16 may determine whether or not the mark is included in a predetermined area on the image acquired by the image acquisition unit 15. If the image processing unit 16 determines that the mark is not included in the predetermined area on the acquired image, the image processing unit 16 may notify that the mounting position of the close-up lens 50 is incorrect.

Further, the display control unit 18 indicates an image acquired by the camera module 26 while the camera module 26 of the user terminal 2 captures a subject, and a position where the close-up lens 50 is mounted on the camera module 26. An image including the mark may be output, and guidance information indicating a reference for the position where the close-up lens 50 is attached to the mark may be output on the output image.

[Operation example]
Next, an operation example of the information processing system 1 according to the present embodiment will be described with reference to FIGS. Note that the operation example described below is merely an example of information processing of the information processing system 1 according to the present embodiment. Therefore, the order of the processes may be changed within a possible range unless there is a reason that the result of the process executed before each process must be used. Further, processing may be omitted, replaced, and added as appropriate according to the embodiment.

FIG. 24 shows an example of the processing procedure of the information processing system 1 according to the present embodiment. In FIG. 24 and FIG. 27 described later, the step is abbreviated as “S”.

First, for example, according to the operation of the user terminal 2 by the user, the program stored in the auxiliary storage device 22 is expanded in the RAM or the like of the control unit 21. Then, the program developed in the RAM or the like of the control unit 21 is executed by the CPU of the control unit 21. In this way, the information processing system 1 starts processing.

In Step 100, when the close-up lens 50 attached to the camera module 26 of the user terminal 2 is brought into contact with or close to the subject and the subject is photographed by the image acquisition unit 15, the image acquisition unit 15 is brought into contact with or close to the subject. The existing mark 44 indicating the predetermined information is included in the shooting range of the camera module 26, whereby an image shot with the subject is acquired.

For example, the user attaches the close-up lens 50 with the panel 40 attached to the camera module 26 of the user terminal 2. Then, the user operates the user terminal 2 with the close-up lens 50 in contact with or close to his / her skin. In response to the operation of the user terminal 2, the control unit 21 controls shooting by the camera module 26 and acquires an image related to the shooting from the camera module 26. Thereby, the information processing system 1 acquires an image in which the mark (44a, 44b) is photographed together with the subject (skin).

FIG. 25 illustrates an image 80 captured by the camera module 26 of the user terminal 2. The region 81 corresponds to the region of the opening 43 of the panel 40 and is a region where the subject (skin) is captured. An area 82 corresponds to an area where the index portion 41 and the mark 44 of the panel 40 exist, and is an area where the index portion 41 and the mark 44 are reflected. The boundary 83 is a boundary between the region 81 and the region 83 and corresponds to the boundary between the opening 43 and the indicator portion 41.

As described above, the image acquisition unit 15 according to the present embodiment may acquire an image in which the index unit 41 is photographed together with the subject and the mark 44. On the other hand, when a panel 40G (FIG. 15F) that does not include the index part 41 is used in the shooting range 70, the image acquisition unit 15 acquires an image that does not include the index part 41. The information processing system 1 according to the present embodiment may process an image that does not include such an index unit 41.

Here, the boundary 83 corresponds to the boundary between the opening 43 and the index portion 41, that is, the edge that defines the opening 43. The panel 40 provided with the opening 43 is mounted so as to be fitted into the upper end portion 53 of the close-up lens 50. Therefore, when viewed from the camera module 26 of the user terminal 2, the position of the edge that defines the opening 43 corresponds to the position where the close-up lens 50 to which the panel 40 is mounted is present. That is, the position of the edge that defines the opening 43 is determined according to the position where the close-up lens 50 exists, and further, the position of the boundary 83 on the acquired image is determined. Therefore, the boundary 83 serves as a mark indicating the position where the close-up lens 50 is attached in the camera module 26 of the user terminal 2.

As described above, in this embodiment, the image acquisition unit 15 acquires an image including a mark indicating a position where the close-up lens 50 is mounted in the camera module 26 of the user terminal 2. In addition, the said mark is not limited to the boundary 83 illustrated by this embodiment. The mark only needs to indicate the positional relationship between the camera module 26 of the user terminal 2 and the close-up lens 50. For example, as a mark indicating the position where the close-up lens 50 is mounted in the camera module 26 of the user terminal 2, an edge in the color pattern of the index unit 41, the mark 44, or the like may be used. Further, as a mark indicating the position where the close-up lens 50 is mounted in the camera module 26 of the user terminal 2, a predetermined pattern or the like provided at a position on the close-up lens 50 included in the shooting range of the camera module 26 is used. May be.

In this case, the image processing unit 16 may determine whether or not the boundary 83 is included in a predetermined area on the acquired image. When the image processing unit 16 determines that the boundary 83 is not included in the predetermined region on the acquired image, the image processing unit 16 may notify that the close-up lens 50 is mounted in the wrong position. Note that an area 84 shown in FIG. 25 is an example of the predetermined area. The predetermined area may be arbitrarily set.

For example, the control unit 21 may extract the boundary 83 from the image acquired by the camera module 26 by edge extraction or the like. Further, the control unit 21 may determine whether or not the extracted boundary 83 is included in the region 84.

When the control unit 21 determines that the boundary 83 is not included in the region 84, the control unit 21 operates the speaker included in the output device 25 to notify the user that the close-up lens 50 is mounted incorrectly. May be output. In addition, an image that informs the user that the close-up lens 50 is mounted in an incorrect position may be displayed on the display 27.

Thereby, the user can know that the mounting position of the close-up lens 50 is wrong. Further, at this time, the control unit 21 controls the output device 25 to perform audio output or screen output instructing the user of the mounting position of the close-up lens 50, thereby making it difficult to adjust the mounting position of the close-up lens 50. It may be reduced.

On the other hand, if the control unit 21 determines that the boundary 83 is included in the region 84, the sound for notifying the user that the position of the close-up lens 50 is correct by operating the speaker included in the output device 25. May be output. Further, a screen for informing the user that the close-up lens 50 is mounted correctly may be displayed on the display 27. Thus, the user can recognize that the close-up lens 50 is mounted correctly.

It should be noted that the process related to determining whether or not the boundary 83 is included in the region 84 may be executed in an analysis process in step 200 described later. Further, the server 3 may execute a process related to a determination as to whether or not the boundary 83 is included in the region 84. For example, the user terminal 2 may transmit the acquired image to the server 3. If the server 3 determines that the boundary 83 is not included in the region 84, the server 3 may notify the user terminal 2 that the close-up lens 50 is mounted incorrectly. The user terminal 2 may execute the above-described audio output, screen output, and the like by receiving the notification.

Further, the display control unit 18 indicates an image acquired by the camera module 26 while the camera module 26 of the user terminal 2 captures a subject, and a position where the close-up lens 50 is mounted on the camera module 26. An image including the mark (boundary 83) may be output, and guidance information indicating a reference of the position where the close-up lens 50 is attached to the mark (boundary 83) may be output to the display 27 on the output image. .

FIG. 26 illustrates a screen display of the display 27 according to the present embodiment. For example, the control unit 21 outputs images continuously acquired by the camera module 26 during shooting to the display 27. At this time, the control unit 21 outputs a guide line 91 to the display 27 as guide information indicating the reference of the mounting position of the close-up lens 50 with respect to the boundary 83 on the output image.

That is, on the display 27, a guide line 91 indicating the reference of the boundary 83 is displayed together with an image as shown in FIG. Thus, the user can mount the close-up lens 50 at the correct mounting position by determining the mounting position of the close-up lens 50 so that the imaged boundary 83 is aligned with the guide line 91. That is, by displaying such a guide line 91, the difficulty associated with the adjustment of the mounting position of the close-up lens 50 can be reduced.

In this embodiment, the shape of the guide line 91 that is guide information indicating the reference of the mounting position of the close-up lens 50 corresponds to the shape of the boundary 83 that is a mark indicating the position where the close-up lens 50 is mounted. However, the guide line 91 is not limited to a shape corresponding to the shape of the boundary 83. The shape of the guide line 91 may be selected as appropriate.

In addition, the guide information according to the present embodiment is limited to a sign indicating a position to match a mark (boundary 83) indicating a position where the close-up lens 50 is mounted, such as the guide line 91 according to the present embodiment. is not. For example, the guidance information may be a sign indicating the direction in which the close-up lens 50 is moved, or may be a character display indicating the mounting position of the close-up lens 50. The guide information is appropriately set according to the embodiment.

Since the close-up lens 50 is a lens used for magnified photographing, a small shift in the mounting position has a great influence on the photographed image. When the mounting position of the close-up lens 50 is not fixed in the camera module 26, the user must adjust the mounting position of the close-up lens 50 so that such a small shift does not occur. There was a scene with difficulty. The guide information reduces the difficulty in such a situation by indicating a reference of the mounting position of the close-up lens 50 with respect to a mark indicating the position where the close-up lens 50 is mounted.

In this operation example, an image taken by an apparatus included in the information processing system 1 is acquired. However, the information processing system 1 may acquire an image taken by another device that is not included in the information processing system 1. The camera that captures an image is not limited to the camera module 26 of the user terminal 2.

Further, the information processing system 1 may acquire an image from another device. For example, the information processing system 1 may acquire an image in which the mark 44 is photographed together with the subject from another information processing apparatus connected to the network 5.

Further, the image to be processed by the information processing system 1 may be an image that is continuously acquired during shooting by a camera such as the camera module 26 of the user terminal 2 or the shutter of the camera is released. The image obtained in (1) may be used.

In step 200, the image processing unit 16 executes analysis processing and correction processing. A specific example of the analysis process and the correction process is shown in FIG. Below, the server 3 shows the example which performs these processes. However, these processes may be executed in either the user terminal 2 or the server 3. Further, the user terminal 2 and the server 3 may share these processes and execute them. When these processes are shared by the user terminal 2 and the server 3, the user terminal 2 and the server 3 exchange data to be processed by data communication via the network 5 and switch processing subjects.

FIG. 27 is a flowchart illustrating an analysis process and a correction process by the information processing system 1 according to this embodiment. The server 3 receives the image acquired from step 100 and transmitted from the user terminal 2. Then, the server 3 performs analysis processing and correction processing on the received image. Specifically, the process is executed as follows.

In step 201, the control unit 31 extracts the index unit 41 from the image acquired in step 100. For example, the control unit 31 extracts a region 82 in which the index unit 41 is shown from the image 80 shown in FIG. Note that this processing corresponds to an example of image analysis processing according to the present invention.

In this embodiment, the indicator unit 41 has a color pattern in which white and black are alternately arranged. The control unit 31 estimates a region with a color approximated to white or black as a region 82 in which the index unit 41 is reflected, and extracts the region.

Specifically, the index unit 41 refers to the RGB value of each pixel of the image 80. If the difference between the referenced RGB value and the RGB value indicating white (255, 255, 255) is within a predetermined threshold value, the control unit 31 selects a pixel having the RGB value as a white region of the index unit 41. It is determined that the pixel is included in the captured area. If the difference between the referenced RGB value and the RGB value (0, 0, 0) indicating black is within a predetermined threshold, the control unit 31 determines that the pixel having the RGB value is the black value of the index unit 41. The pixel is determined to be included in the region where the region is reflected. When the referenced RGB value does not satisfy the above two conditions, the control unit 31 determines that the pixel having the RGB value is a pixel that is not included in the region where the index unit 41 is captured. The control unit 31 estimates and extracts the region 82 in which the index unit 41 is captured by making these determinations for each pixel of the image 80.

Note that when the subject has a color close to white or black, the pixel in the region (region 81) in which the subject is captured may be erroneously determined as the pixel in the region (region 82) in which the index portion 41 is captured.

In order to cope with such a case, the control unit 31 may store the shape of the opening 43 or the shape of the index unit 41 in advance in the auxiliary storage device 32 or the like. Then, the control unit 31 erroneously determines the pixel of the region 81 as the pixel of the region 82 by referring to the information such as the shape of the opening 43 stored in advance and estimating the position of the region 81 or the region 82. You may avoid that.

Further, the control unit 31 extracts the boundary 83 and determines in advance the position of the boundary between the region 81 and the region 82, thereby avoiding erroneous determination of the pixel in the region 81 as the pixel in the region 82. May be.

Further, the control unit 31 may specify the position of the boundary 83 from the extracted region 82. And the control part 31 may determine whether the mounting position of the close-up lens 50 mentioned above is correct. For example, the control unit 31 may determine whether the region 84 includes the boundary 83 that specifies the position. If the control unit 31 determines that the boundary 83 is not included in the region 84, the control unit 31 may notify the user terminal 2 of a message indicating that the close-up lens 50 is mounted in the wrong position. On the other hand, when it is determined that the boundary 83 is included in the region 84, the control unit 31 may notify the user terminal 2 of a message indicating that the close-up lens 50 is mounted correctly.

In this way, the control unit 31 tries to extract the region 82 in which the index unit 41 is captured from the image 80. Note that the method of extracting the region 82 is not limited to such a method, and may be appropriately selected according to the embodiment.

If the area 82 cannot be extracted from the image 80, the control unit 31 ends the analysis and correction process (“NO” in step 201). On the other hand, if the area 82 can be extracted from the image 80 (“YES” in step 202), the control unit 31 advances the process to step 203.

In step 203, the control unit 31 performs image blur correction. For example, the control unit 31 determines an area where the image 80 is out of focus. And the control part 31 performs a defocus correction | amendment by sharpening the image of the area | region where the said blur has arisen using a sharpening filter etc. Note that the process of determining the area where the defocus is generated corresponds to an example of the image analysis process of the present invention. Further, the process of sharpening the image of the area where the blur is generated corresponds to an example of the correction process of the present invention.

In the present embodiment, the control unit 31 determines whether or not defocusing has occurred using the boundary (edge) between white and black in the color pattern of the index unit 41 that is captured in the region 82 extracted in step 201. . As the focus is not achieved, the change (gradient) of the pixel value (RGB value) at the edge becomes gentler. Therefore, the control unit 31 determines whether or not a blur has occurred based on a change in the pixel value (RGB value) at the edge.

And the control part 31 sharpens the image of the area | region where the said blur has arisen by applying a sharpening filter etc. to the area | region determined that the blur has arisen. Thereby, the control unit 31 performs defocus correction of the image 80. Note that the method of correcting the defocus of the image is not limited to such a method, and may be appropriately selected according to the embodiment.

In step 204, the controller 31 corrects image color and illumination unevenness. For example, an image having a color different from the actual color may be obtained depending on the function and performance of the camera. In addition, the illumination may be uneven due to the influence of the illumination light and the light source, and an image having a color different from the actual color may be obtained. In step 204, the control unit 31 analyzes the influence of these photographing environments and corrects the image so as to reduce the influence. The process for analyzing the influence of the shooting environment corresponds to an example of the image analysis process of the present invention. Further, the process of correcting an image so as to reduce the influence of the shooting environment corresponds to an example of the correction process of the present invention.

The indicator section 41 shown in the area 82 of the image 80 has a color pattern in which white and black are alternately arranged. Pixels included in the white pattern region should have the same RGB value. Also, the pixels included in the black pattern region should have the same RGB value.

However, when affected by the shooting environment such as the function and performance of the camera, illumination light, and light source, the RGB value of each pixel becomes a value different from the actual color according to the influence. Therefore, when affected by these shooting environments, variations in RGB values occur in regions that should have the same RGB values. By correcting the RGB values so as to eliminate this variation, the control unit 31 performs color correction and illumination unevenness correction.

For example, the control unit 31 uses the actual color of each area as a reference (reference color) for each of the area including the white pattern and the area including the black pattern, and the RGB values of the pixels included in each area And the difference (shift) between the RGB value of the reference color and the reference color.

Specifically, the control unit 31 obtains the difference between the RGB value of each pixel included in the region and the RGB value indicating white in the region where the white pattern is captured, thereby determining the color of each pixel and the reference Measure the difference from the color. Thereby, the control unit 31 obtains a two-dimensional distribution indicating the difference between the color of each pixel and the reference color in the region where the white pattern is reflected. In addition, the control unit 31 similarly measures a region where a black pattern is captured, and obtains a two-dimensional distribution indicating a difference between the color of each pixel and the reference color.

Then, the control unit 31 obtains the color of the pixel included in the region 81 and the reference color from the waveform of the two-dimensional distribution obtained for the pixel included in the region 82 and the difference between the color of each pixel and the reference color. A two-dimensional distribution related to the difference is estimated. For example, by filling a blank area (area 81) of the two-dimensional distribution created in the area 82 with a predetermined interpolation calculation, a two-dimensional distribution related to the difference between the color of the pixel included in the area 81 and the reference color is estimated. .

Thereby, since the two-dimensional distribution indicating the difference between the color of the pixel and the reference color is obtained in the entire image 80, the control unit 31 corrects the RGB value of each pixel using the two-dimensional distribution. Thus, color correction and uneven illumination correction are realized.

Note that the reference color may be set as appropriate. However, from the viewpoint of bringing the color of the subject close to the actual color, it is desirable to use the actual color of each area as a reference as in the present embodiment.

The color of the subject shown in the image can be brought close to the actual color by the correction in step 204. Therefore, it is possible to improve the accuracy of skin analysis described later. Also, since the color of the subject can be brought close to the actual color, the color recognition accuracy is improved, and for example, the number of colors that can be used in a code system that expresses information using a two-dimensional array of colors is increased. Can do.

In step 205, the control unit 31 corrects image distortion. For example, the control unit 31 determines a region where distortion is generated in the image 80. And the control part 31 correct | amends the distortion of the area | region determined that distortion has arisen. Note that the process of determining a region where distortion occurs corresponds to an example of an image analysis process of the present invention. The process for correcting the distortion corresponds to an example of the correction process of the present invention.

In the present embodiment, the control unit 31 determines whether or not distortion has occurred using an edge in the color pattern of the index unit 41 shown in the region 82 extracted in step 201. The shape of the edge in the color pattern of the index unit 41 is a straight line. Therefore, the control unit 31 determines whether or not distortion has occurred by determining whether or not the shape of the edge exceeds the threshold and is no longer a straight line.

Then, the control unit 31 corrects the distortion of the region determined to be distorted by converting the shape of the edge determined to be no longer a straight line beyond the threshold value so as to become a straight line. Note that the method for correcting image distortion is not limited to such a method, and may be appropriately selected according to the embodiment.

In step 206, the control unit 31 extracts the mark 44 from the image 80. For example, the control unit 31 uses the pattern of the mark 44 stored in advance in the auxiliary storage device 32 or the like, and detects the pattern that matches the pattern of the mark 44 from the image 80, thereby extracting the mark 44 from the image 80. Do (pattern matching). In the panel 40 shown in FIG. 10, two types of marks 44, that is, marks 44a and 44b are extracted.

For example, the mark 44a indicates that the close-up lens 50 to which the panel 40 is attached is a regular product. Further, for example, the mark 44b indicates a business operator (A trader) of a product sold together with the close-up lens 50 and the panel. Based on the pattern used for the extraction, the control unit 31 recognizes the predetermined information as indicated by the mark 44 attached to the panel 40.

As a variation of the panel 40, there is a panel 40L having a step in the index portion. As shown in FIG. 18, the panel 40 </ b> L has a step around the opening, and includes an index portion 41 </ b> K and marks (44 a, 44 b) at each step. When such a panel 40L is used to photograph in focus with the skin (subject), the position in the optical axis direction is different, so that one of the images in the stage is clearer than the image in the other stage.

Therefore, the information processing system 1 changes the place (stage) from which an image is acquired according to the scene by using a panel having a step as described above, thereby providing a clearer image including the index unit 41 and the mark 44. It becomes possible to get. That is, it is possible to reduce the shift of the focus between the index portion 41 and the mark 44 when the subject is focused.

In step 207, the image processing unit 16 executes subject analysis processing. In the present embodiment, since the subject is the human skin, the control unit 31 analyzes the skin (skin analysis) shown in the image 80. For example, the control unit 31 binarizes and thins the image of the area 81 in which the subject is captured. And the control part 31 detects the regularity by a frequency analysis, etc., and detects the texture, the pore, the stain, etc. in an image.

In this embodiment, skin analysis is exemplified as the subject analysis processing. However, the subject analysis process is not limited to skin analysis, and may be set as appropriate according to the subject.

Further, as a variation of the panel 40 shown in FIG. 16, there is a panel 40H in which the indicator portions are colored stepwise. When the skin (subject) is photographed using such a panel 40H, the information processing system 1 compares each color of the index unit 41G with the color of the subject, so that the position of the same color as the subject (in the index unit 41G ( Angle) can be specified. Then, the information processing system 1 can estimate the color of the subject on the basis of the color of the index unit 41G attached to the specified position (angle).

This completes the image analysis processing and correction processing. Then, the process proceeds to step 300.

Note that the order of the processes in steps 201 to 207 may be changed as appropriate according to the embodiment. For example, the control unit 31 may change the order of correction processing in steps 203 to 205. Further, the control unit 31 may execute the process of step 206 before step 201. Further, the control unit 31 may change the order of the correction processing in steps 203 to 205.

Further, processing may be omitted, replaced, and added as appropriate according to the embodiment. For example, the indicator portion does not exist in the panel 40G shown in FIG. 15F. Therefore, the control unit 31 may omit the processes in steps 201 to 205.

In the present embodiment, description has been made using RGB as a color expression. However, the color expression method that can be used in the present embodiment is not limited to RGB, and may be appropriately selected.

Referring back to FIG. 24, in step 300, the image processing unit 16 determines whether the image acquisition unit 15 is to acquire an image again. For example, if the index unit 41 cannot be extracted in step 201 described above, or if the mark 44 cannot be extracted in step 206, the control unit 31 does not succeed in subject (skin) analysis processing in step 207. In such a case, the image acquisition unit 15 determines to acquire the image again. And the control part 31 returns a process to step 100 by performing the notification for making the user terminal 2 acquire an image again. On the other hand, if there is no such situation, the control unit 31 advances the process to step 400.

In step 400, the display control unit 18 outputs the analysis result of the subject in step 207. For example, the control unit 31 of the server 3 notifies the user terminal 2 of the analysis result of the subject obtained in step 207. Then, the control unit 21 of the user terminal 2 presents the analysis result of the subject to the user by outputting the received analysis result of the subject to the display 27.

In step 500, the storage unit 17 stores the image on which each correction process has been executed, the predetermined information indicated by the mark 44, and the analysis result of the subject in association with each other. For example, the auxiliary storage device 32 of the server 3 includes a database for storing the acquired information.

FIG. 28 illustrates a database record used by the information processing system 1 according to the present embodiment for storing images. Specifically, FIG. 28 illustrates a list of records related to the user A.

The database used to store the acquired information includes an ID field for storing an identifier for identifying a record, a shooting date / time field for storing the shooting date / time of the acquired image, and a file for storing the file name of the acquired image A name field, an attribute information field for storing predetermined information indicated by a mark 44, and an analysis result field for storing an analysis result of a subject (skin).

The control unit 31 creates a record in which fields are filled so as to match the image on which each correction process has been executed, the predetermined information indicated by the mark 44 extracted in step 206, and the analysis result of the subject in step 207. Add the created record to the database. Thereby, the control unit 31 accumulates the image on which each correction process has been executed, the predetermined information indicated by the mark 44, and the analysis result of the subject in association with each other.

1 ... information processing system, 2 ... user terminal,
3 ... server, 5 ... network,
15 ... Image acquisition unit, 16 ... Image processing unit,
17 ... Accumulation unit, 18 ... Display control unit,
21 ... Control unit, 22 ... Auxiliary storage device,
23 ... Network interface,
24 ... input device, 25 ... output device,
26 ... Camera module, 27 ... Display,
31 ... control unit, 32 ... auxiliary storage device,
33 ... Network interface,
40 ... Panel, 41 ... Indicator part, 43 ... Opening, 44 ... Mark,
50 ... close-up lens, 51 ... bottom surface, 52 ... groove,
53 ... upper end part, 54 ... lens part,
60 ... cap, 70 ... shooting range,
80: Image, 81, 82, 84: Area, 83: Border, 91: Guide line

Claims

When photographing the subject with a close-up lens attached to the camera in contact with or close to the subject, the close-up lens is in contact with or close to the subject, and at least a part thereof is included in the shooting range of the camera An indicator portion with a predetermined color as an indicator of analysis of an image taken by the camera, taken with the subject at
An indicator body comprising
When the close-up lens attached to the camera is in contact with or close to the subject and the subject is photographed, it is included in the photographing range of the camera so that it is photographed together with the subject and the index unit. Information mark,
Further comprising
The indicator body according to claim 1.
When the close-up lens mounted on the camera is in contact with or close to the subject and the subject is photographed, the camera further includes an opening in a portion included in the photographing range of the camera.
The indicator body according to claim 1 or 2.
The opening is provided such that the center of the opening is located near the optical axis of the camera.
The indicator body according to claim 3.
The indicator portion is provided so as to surround an outer edge of the opening.
The indicator body according to claim 4.
The opening is a shape having rotational symmetry.
The indicator body according to claim 5.
The indicator portion has a color pattern arranged according to a predetermined regularity corresponding to the rotational symmetry of the opening.
The indicator body according to claim 6.
A plurality of the marks are arranged according to a predetermined regularity corresponding to the rotational symmetry of the opening,
The indicator body according to claim 6 or 7.
The indicator portion has a step in the optical axis direction.
The indicator body according to any one of claims 1 to 8.
A close-up lens unit used by being mounted on a camera,
An image photographed by the camera, which is photographed together with the subject when at least a part thereof is included in the photographing range of the camera at a position in contact with or close to the subject at the time of photographing when mounted on the camera. An indicator part with a predetermined color as an indicator of the analysis of
Comprising
Close-up lens unit.