KR102297599B1 - Automatic shooting device for image matching and automatic shooting program for image matching - Google Patents

Abstract

A display unit, and through the display unit, a facial image of the person to be photographed, an outer indicator reflecting the distance to the photographed person, a reference composition indicator for displaying a composition to be photographed in relation to the operation of the photographed person, and the photographed person A current composition indicator indicating the current composition of When located within the exterior indicator, the image matching automatic photographing apparatus is provided, including a controller for controlling the camera so that the photographed person is automatically photographed.

Description

Automatic shooting device for image matching and automatic shooting program for image matching}

The present invention relates to an automatic image matching apparatus and an automatic image matching photographing program, and more particularly, to an automatic image matching apparatus and an automatic image matching photographing program, which are controlled so that overlapping photographing compositions are automatically photographed once. .

Plastic surgery or surgery (hereinafter referred to as plastic surgery) is widely used for cosmetic purposes or for restoration of wounded body parts.

From the point of view of a subject who has undergone such a cosmetic procedure, there is a desire to observe the subject's face, which changes over time after the cosmetic procedure.

However, without a specific guide, there is a limit to photographing the subject's face with the same distance, brightness, and composition every time.

In addition, unnecessary energy may be wasted by repeatedly photographing overlapping compositions.

Accordingly, there is a need for an image matching automatic photographing apparatus or image matching automatic photographing program, which takes pictures with the same distance, brightness and the same composition before and after the procedure, but can automatically photograph the overlapping photographing composition once.

One technical problem to be solved by the present invention is to provide an image matching automatic photographing device or image matching automatic photographing program, which is photographed with the same distance and the same composition before and after the procedure, but the overlapping photographing composition can be automatically photographed once there is

Another technical problem to be solved by the present invention is to provide an image matching automatic photographing apparatus or image matching automatic photographing program capable of photographing at a constant magnification before and after a procedure.

Another technical problem to be solved by the present invention is to provide an image matching automatic photographing apparatus or image matching automatic photographing program capable of photographing with a constant brightness before and after a procedure.

The technical problem to be solved by the present invention is not limited to the above.

In order to solve the above technical problem, the present invention provides an image matching automatic photographing apparatus.

According to an embodiment, the image matching automatic photographing apparatus includes a display unit and, through the display unit, a facial image of a person to be photographed, an outer indicator reflecting the distance to the photographed person, and photographing in connection with a procedure of the photographed person A reference composition indicator indicating a composition to be taken and a current composition indicator indicating the current composition of the subject are displayed, wherein the distance condition with the subject according to the outer indicator is satisfied, and the reference composition indicator and the current composition are displayed. When the indicator is located within a predetermined criterion and the face of the person to be photographed is located within the exterior indicator, a controller may include a controller for controlling the camera so that the person to be photographed is automatically photographed.

According to an embodiment, when at least one photographing composition is required in relation to the plurality of procedures, the controller may control so that the overlapping photographing composition among the photographing compositions of each of the plurality of procedures is automatically photographed once. have.

According to an embodiment, the control unit displays the face image of the to-be-photographed person through the display unit, wherein the facial image is a three-dimensional object for the face of the photographed person obtained through an object recognition sensor measuring a distance For example, it may be an image obtained by overlapping a facial image obtained through a camera.

According to an embodiment, the control unit may drive a lamp unit disposed toward the subject during the automatic photographing.

According to an embodiment, the controller may adjust the magnification of the camera according to a predetermined criterion during the automatic photographing, and the predetermined criterion may be adjusted in consideration of the distance to the photographed subject.

In order to solve the above technical problem, the present invention provides an image matching automatic photographing program.

According to an embodiment, the image matching automatic photographing program should be photographed in relation to the facial image of the person to be photographed, an outer indicator having a predetermined width and varying the width according to the distance to the photographed person, and the operation of the photographed person. displaying a reference composition indicator indicating a composition to be used, and a current composition indicator indicating a current composition of the subject; If it is located within a predetermined standard, the subject may be stored in the medium in order to execute the step of controlling the camera so that the photograph is automatically taken.

According to an embodiment of the present invention, a display unit, and through the display unit, a facial image of the person to be photographed, an outer indicator reflecting the distance to the photographed person, and a composition to be photographed in relation to the operation of the photographed person are displayed. A reference composition indicator and a current composition indicator indicating the current composition of the subject are displayed, wherein the distance condition with the subject according to the outer indicator is satisfied, and the reference composition indicator and the current composition indicator are within a predetermined criterion. Location and when the face of the photographed person is located within the exterior indicator, the image matching automatic photographing apparatus including a control unit for controlling the camera so that the photographed person is automatically photographed may be provided.

In addition, the control unit may drive a lamp unit disposed toward the subject during the automatic photographing, and adjust the magnification of the camera according to a predetermined criterion in consideration of the distance to the photographed subject.

Accordingly, it is possible to obtain a facial image of the same distance, the same composition, a constant magnification, and a constant brightness before and after the procedure of the subject.

1 and 2 are diagrams for explaining an automatic image matching apparatus according to an embodiment of the present invention.
3 is a view for explaining an automatic image matching apparatus according to the first embodiment of the present invention.
4 to 13 are diagrams for explaining an automatic image matching method according to the first embodiment of the present invention.
14 is a view for explaining an automatic image matching apparatus according to a second embodiment of the present invention.
15 is a view for explaining an automatic image matching apparatus according to a third embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the technical spirit of the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed content may be thorough and complete, and the spirit of the present invention may be sufficiently conveyed to those skilled in the art.

In this specification, when a component is referred to as being on another component, it means that it may be directly formed on the other component or a third component may be interposed therebetween. In addition, in the drawings, shapes and thicknesses of regions are exaggerated for effective description of technical content.

In addition, in various embodiments of the present specification, terms such as first, second, third, etc. are used to describe various components, but these components should not be limited by these terms. These terms are only used to distinguish one component from another. Accordingly, what is referred to as a first component in one embodiment may be referred to as a second component in another embodiment. Each embodiment described and illustrated herein also includes a complementary embodiment thereof. In addition, in the present specification, 'and/or' is used to mean including at least one of the elements listed before and after.

In the specification, the singular expression includes the plural expression unless the context clearly dictates otherwise. In addition, terms such as "comprise" or "have" are intended to designate that a feature, number, step, element, or a combination thereof described in the specification is present, and one or more other features, numbers, steps, configuration It should not be construed as excluding the possibility of the presence or addition of elements or combinations thereof. Also, in the present specification, the term “connection” is used to include both indirectly connecting a plurality of components and directly connecting a plurality of components.

In addition, terms such as “…unit”, “…group”, and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. have.

In addition, in the following description of the present invention, if it is determined that a detailed description of a related well-known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted.

Hereinafter, an automatic image matching apparatus according to an embodiment of the present invention will be described with reference to the drawings.

1 and 2 are diagrams for explaining an automatic image matching apparatus according to an embodiment of the present invention.

Referring to FIG. 1 , the image matching automatic photographing apparatus 1000 may automatically photograph the subject's face at the same distance and in the same composition before (bf) and after (af) the operation of the subject. Herein, the subject may be a person receiving a procedure, but may be a subject photographed through the image matching automatic photographing device. In other words, in this specification, the subject is, that is, the subject. Hereinafter, the subject may be understood as the same concept as the subject.

Accordingly, the subject can observe the treatment site at the same distance and the same composition before (bf) and after (af) the treatment. Here, the operation may be understood as a concept including surgery. In addition, in relation to the molding to be described later, in the present specification, molding may be understood as a concept including both cosmetic molding and molding for the restoration of a wounded body part.

Alternatively, the image matching automatic photographing apparatus 1000 is not limited to the procedure, and may automatically photograph the user's face at the same distance and in the same composition as time passes.

Accordingly, the user can compare pictures taken at the same distance and the same composition from the past-present time point. That is, the present invention is not necessarily limited to treatment.

Alternatively, the image matching automatic photographing apparatus 1000 is not limited to the face, and may automatically photograph a body part other than the user's face at the same distance and in the same composition as time passes. That is, the present invention is not necessarily limited to facial imaging.

Hereinafter, it is assumed that the image matching automatic photographing apparatus 1000 photographs the face of the subject before (bf) and after (af) the operation. However, as described above, the present invention is not limited thereto.

To this end, the image matching automatic photographing apparatus 1000 includes, as shown in FIGS. 1 and 2 , a procedure information obtaining unit 50 , a camera unit 100 , an object recognition sensor unit 200 , and an image processing unit ( 300 ), a display unit 400 , a lamp unit (not shown), and a controller 500 .

According to an embodiment, the automatic image matching apparatus may be a terminal including each of the above-described components. Here, the terminal may be understood as a concept including a desktop, a laptop computer, a web pad, or a smart phone. In addition, of course, the terminal may be provided in a hospital visited by the subject receiving the procedure. Accordingly, the subject receives the procedure through the hospital web, and the facial image before (bf) and after (af) the subject photographed through the camera unit 100 can be observed through the hospital web. of course there is

Hereinafter, each configuration of the present invention will be described.

The operation information acquisition unit 50 may acquire information related to the operation of the subject.

The procedure information acquisition unit 50 may provide, for example, a procedure input button ip1 through the display unit 400 to obtain information related to the operation of the subject (FIG. 5 (a)). Reference).

Accordingly, when there is a treatment, the subject may select the treatment input button ip1 provided through the display unit 400 . Hereinafter, it is assumed that the subject has undergone a plurality of procedures.

When the treatment input button ip1 is selected, the treatment information acquisition unit 50 provides, through the display unit 400, a treatment input box, for example, to receive information related to the plurality of treatments of the subject. For example, the procedure 1 (op1) input field (ip2-1) and the procedure 2 (op2) input field (ip2-2) may be provided (see FIG. 5(b) ).

Accordingly, the procedure 1 (op1) input field (ip2-1) and the procedure 2 (op2) input field (ip2-2) provided through the display unit 400 are selected to the subject, and the type of treatment is selected from the subject. can be entered. Hereinafter, it is assumed that the subject has undergone a double eyelid surgery as the procedure 1 (op1) and a nose surgery as the procedure 2 (op2). Accordingly, a double eyelid surgery operation may be input to the operation 1 (op1) input field ip2-1, and a nose molding operation may be input to the operation 2 (op2) input field ip2-2.

In this case, at least one photographing composition may be required for each of the plurality of procedures. Here, the at least one photographing composition may mean a composition to be photographed in relation to the procedure. More specifically, the at least one photographing composition may be a predetermined photographing composition in order to facilitate observation of the operation according to the type of the operation. This is in consideration of the fact that the composition for easy eye observation in the double eyelid surgery and the composition in which the nose is easily observed in the rhinoplasty are different for each procedure. For example, when the procedure 1 (op1) is a double eyelid surgery procedure, the photographing composition for facilitating observation of the double eyelid surgery operation is: Right side photographing composition 1-1 (st1-1), frontal photographing composition with eyes closed 1-2 (st1-2), frontal composition with eyes open 1-3 (st1-3), frontal composition with eyes closed 1-4 (st1-4), left side composition 1-5 (st1-5) , at least one of composition 1-6 (st1-6) for photographing the front with the head raised, and composition 1-7 (st1-7) for photographing the front with the head down. Or, for another example, when the procedure 2 (op2) is a rhinoplasty procedure, the photographing composition for facilitating the observation of the rhinoplasty operation is the right side photographing composition 2-1 (st2-1), the right half Side view composition 2-2 (st2-2), open eyes composition 2-3 (st2-3), left half-side composition composition 2-4 (st2-4), left side view composition 2-5 (st2- 5), at least one of composition 2-6 (st2-6) for photographing the front with the head raised, and composition 2-7 (st2-7) for photographing the front with the head down.

Accordingly, the procedure information acquisition unit 50 may provide information related to a plurality of procedures requiring the at least one shooting composition, for example, when the procedure 1 (op1) is a double eyelid surgery procedure, the photographing composition 1 -1 (st1-1) to 1-7 (st1-7) and when the procedure 2 (op2) is a rhinoplasty procedure, the photographing composition 2-1 (st2-1) to 2-7 (st2-7) can be obtained.

Accordingly, the procedure information obtaining unit 50, through the display unit 400, the photographing composition 1-1 (st1-1) to 1-7 (st1-7) corresponding to the procedure 1 (op1) and a button for photographing the photographing compositions 2-1 (st2-1) to 2-7 (st2-7) corresponding to the procedure 2 (op2), for example, in the form of a photographing icon for each composition. There is (see Fig. 5 (c)).

On the other hand, when information related to the plurality of procedures (here, procedure 1 (op1) and procedure 2 (op2)) is obtained in the procedure information acquisition unit 50 , the control unit 500 to be described later provides the plurality of procedures Selection of a photographing composition and automatic photographing of the selected photographing composition may be controlled so that the overlapping photographing composition among the respective photographing compositions of the procedure is automatically photographed once. This will be described later with reference to FIGS. 6 and 7 .

The camera unit 100 may automatically photograph the subject. More specifically, the camera unit 100 may automatically photograph the operation site of the subject, here as previously assumed, the subject's face. Accordingly, an image of the subject's face may be obtained. Here, the image may be understood as a concept including both a still image and a moving image. For example, the camera unit 100 may be a camera provided in the terminal described above.

To this end, of course, the camera unit 100 may be provided to face the subject. For example, according to the first embodiment 1000a of the present invention, which will be described later, when two automatic image matching apparatuses 1000a1 and 1000a2 are provided, the camera unit 100 may display an image adjacent to the subject. It may be disposed on the front side 1000a1_f of the matching automatic photographing apparatus 1000a1 (refer to FIG. 3 ). Or, for another example, according to the second embodiment 1000b of the present invention, which will be described later, when the image matching automatic photographing apparatus is provided as one and includes the double-sided display units 400b1 and 400b2, the camera unit 100 ) may be disposed on the rear surface 1000b_b of the image matching automatic photographing apparatus 1000b provided with the rear display unit 400b2 facing the subject (see FIG. 14 ). Or, for another example, according to the third embodiment 1000c of the present invention, which will be described later, when the image matching automatic photographing apparatus is provided as one and includes a single-sided display unit 400c facing the subject, the camera unit Reference numeral 100 may be disposed on the front side 1000c_f of the image matching automatic photographing apparatus 1000c provided with the single-sided display unit 400c (refer to FIG. 15 ).

Meanwhile, the camera unit 100 may be controlled so that the subject is automatically photographed by a control unit 500 to be described later. This will be described later with reference to FIGS. 9 and 10 .

Meanwhile, the camera unit 100 may be controlled such that the magnification of the camera unit 100 is adjusted according to a predetermined standard by a control unit 500 to be described later during the automatic photographing. In this case, the predetermined criterion may be adjusted in consideration of the distance from the subject. For example, when the predetermined criterion is 1.5 m and the distance between the camera unit 100 and the subject is 0.5 m, the magnification of the camera unit 100 may be adjusted to be 3 times higher. Or, for another example, when the predetermined criterion is 1.5 m and the distance between the camera unit 100 and the subject is 0.3 m, the magnification of the camera unit 100 may be adjusted to be 5 times higher. .

Alternatively, during the automatic photographing, the distance between the camera unit 100 and the subject may be adjusted based on a predetermined standard for each procedure. For example, if the predetermined standard for the double eyelid surgery with the procedure 1 (op1) is 1.5 m, and the predetermined standard for the nose surgery with the procedure 2 (op2) is 1.3 m, the predetermined standard for each procedure The distance between the camera unit 100 and the subject may be adjusted to correspond to .

As described above, the distance adjustment between the camera unit 100 and the subject is a predetermined reference width Wo and a current width Wc of the exterior indicator ic_o displayed through the display unit 400 to be described later. It can be adjusted by moving the subject to be positioned within a predetermined criterion.

Accordingly, in the automatic photographing of the subject, a facial image of a certain magnification may be obtained according to a predetermined criterion. The control unit 500 will be described later.

The object recognition sensor unit 200 may acquire a three-dimensional object for the operation part of the subject, here, the face of the subject as previously assumed.

To this end, the object recognition sensor unit 200 may measure a distance (distance d in FIGS. 6 and 7 ) from the subject. For example, the object recognition sensor unit 200 may be an infrared sensor, lidar, or the like for measuring the distance to the subject.

Also, for this purpose, of course, the object recognition sensor unit 200 may be provided to face the subject. For example, according to the first embodiment 1000a of the present invention to be described later, when the image matching automatic photographing apparatus is provided with two 1000a1 and 1000a2, the object recognition sensor unit 200 is It may be disposed on the front side 1000a1_f of the adjacent image matching automatic photographing apparatus 1000a1 (see FIG. 3 ). Or, for another example, according to the second embodiment 1000b of the present invention, which will be described later, when the image matching automatic photographing apparatus is provided as one and includes the double-sided display units 400b1 and 400b2, the object recognition sensor unit Reference numeral 200 may be disposed on the rear surface 1000b_b of the image matching automatic photographing apparatus 1000b provided with the rear display unit 400b2 facing the subject (see FIG. 14 ). Or, for another example, according to the third embodiment 1000c of the present invention to be described later, when the image matching automatic photographing apparatus is provided as one and includes a single-sided display unit 400c facing the subject, the object recognition The sensor unit 200 may be disposed on the front surface 1000c_f of the image matching automatic photographing apparatus 1000c provided with the single-sided display unit 400c (refer to FIG. 15 ).

Accordingly, in the control unit 500 to be described later, the face image obtained through the camera unit 100 described above is overlapped with the three-dimensional object of the subject's face obtained by the object recognition sensor unit 200 ( overlap) and the obtained facial image may be displayed through the display unit 400 . This will be described later with reference to FIG. 8 .

The image processing unit 300 may provide a user interface (UI) through the display unit 400 . More specifically, the image processing unit 300, through the display unit 400, as shown in FIG. 9 (a), has a predetermined width and the width is variable according to the distance from the subject, the outer indicator (ic_o) can be provided as a user interface. For example, the outer indicator ic_o may be provided in the form of a picture frame. Accordingly, as the distance between the subject and the camera unit 100 increases, the width of the outer indicator ic_o in the form of the picture frame may become thinner (refer to FIG. 9A ). On the other hand, as the distance between the subject and the camera unit 100 increases, the width of the outer indicator ic_o in the form of the picture frame may increase (see FIG. 9(b) ). In this case, it is assumed that the face of the subject is located within the outer indicator ic_o in the form of the picture frame.

In this case, the distance between the subject and the camera unit 100 may be numerically displayed on the display unit 400 along with the width of the outer indicator ic_o in the form of the picture frame. This is only an example, and the image processing unit 300 may display only the distance between the subject and the camera unit 100 numerically while maintaining the width of the outer indicator ic_o constant. However, for convenience of explanation, it is assumed that the image processing unit 300 changes the width of the outer indicator ic_o according to the distance between the camera and the subject.

The image processing unit 300 may determine whether the distance is matched based on whether the outer indicator ic_o has a predetermined reference width Wo. In other words, the image processing unit 300 may determine whether the width of the outer indicator ic_o meets a predetermined reference width Wo.

In this case, in order to match the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400 with the predetermined reference width Wo, the photographer is on the display unit 400 . The distance between the displayed face of the subject and the camera unit 100 may be adjusted.

More specifically, as shown in (a) of FIG. 9 , the current distance between the subject and the camera unit 100 is greater than the distance corresponding to the predetermined reference width Wo of the exterior angle indicator ic_o. to assume that For example, it is assumed that the predetermined reference width Wo of the outer indicator ic_o is 3 mm, and accordingly the distance between the subject and the camera unit 100a is 30 cm. When the current distance between the subject and the camera unit 100a is 50 cm, the width Wc of the outer indicator ic_o displayed on the user interface through the display unit 400a may be 2.4 mm. Accordingly, the subject, in order to match the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400a with the predetermined reference width Wo, that is, 3 mm, the display unit ( 400a), the distance may be adjusted so that the distance between the face of the subject displayed on the image and the camera unit 100 is closer.

On the other hand, as shown in (b) of FIG. 9 , the current distance between the subject and the camera unit 100 is greater than the distance corresponding to the predetermined reference width Wo of the exterior angle indicator ic_o. Let's assume something close. For example, if the current distance between the subject and the camera unit 100a is 10 cm, the width Wc of the outer indicator ic_o displayed as a user interface through the display unit 400a may be 3.6 mm. have. Accordingly, in order to match the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400a with the predetermined reference width Wo, that is, 3 mm, the subject The distance may be adjusted so that the distance between the face of the subject displayed on 400a and the camera unit 100 is increased.

In the image processing unit 300 , the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400 matches the predetermined reference width Wo, so that the distance matching is performed. When it is determined that there is, the control unit 500 to be described later may control the camera unit 100 so that the subject is automatically photographed. This will be described later with reference to FIG. 9 .

Meanwhile, when the facial image of the subject is obtained, the facial image may be post-corrected (cropped) (see FIG. 13 ). Here, the post-correction may be understood as a concept including the operation of aligning the center of the acquired facial image of the subject.

In addition, the operation of aligning the center of the facial image here refers to, for example, the center of the facial image of the operator (ct1) shown in FIG. 13 (a) in the plurality of facial images of the operator, and (b) ) can be understood as a concept including aligning the center (ct2) of the operator's face image shown in FIG. To this end, the face image may be cropped, that is, a partial outer region is cut based on the face image centers ct1 and ct2.

At this time, as shown in (a) of FIG. 13 , when a partial outer area is cut to match the center of the operator's face image ct1, the frame frame area of the outer indicator ic_o described above will be used. can This assumes a case in which the center of the operator's facial image ct1 is biased to one side, as shown in FIG. 13A .

That is, in the present invention, the outer indicator ic_o in the form of the picture frame frame may be provided with a predetermined width in consideration of cutting out a portion of the outer region to match the center ct1 of the face image.

Accordingly, the present invention can match the center of the face in the plurality of face images, even when a plurality of face images are photographed.

On the other hand, the image processing unit 300, as shown in FIG. 10, a reference composition indicator ( ic_s) and a current composition indicator ic_c indicating the current facial composition of the subject through the camera unit 100 may be provided as a user interface (refer to FIG. 10(a) ).

The image processing unit 300 may determine whether the composition matches whether the reference composition indicator ic_s and the current composition indicator ic_c are located within a predetermined criterion. At this time, the photographer adjusts the posture of the subject's face displayed on the display unit 400 in order to position the current composition indicator ic_c within the predetermined reference according to the reference composition indicator ic_s, The orientation angle of the image matching photographing apparatus according to the embodiment, specifically, the camera unit 100 may be adjusted.

When the image processing unit 300 determines that the composition matching has been achieved by determining that the reference composition indicator (ic_s) and the current composition indicator (ic_c) are located within a predetermined criterion (see (b) of FIG. 10 ) ), the control unit 500 to be described later may control the camera unit 100 so that the subject is automatically photographed. This will be described later with reference to FIG. 10 .

The display unit 400 may display at least one of the face image of the subject, the reference composition indicator ic_s, and the current composition indicator ic_c. Here, the image may be understood as a concept including both a still image and a moving image, as described above.

In addition, the face image is a face obtained by overlapping the face image obtained through the camera unit 100 on the three-dimensional object for the face of the subject obtained from the object recognition sensor unit 200 . Of course, it can be an image. Here, the overlap may be understood as a concept including applying a high-quality facial image obtained through the camera unit 100 to the facial curves of the subject obtained by the object recognition sensor unit 200 . .

Accordingly, the display unit 400 may provide the face image with a lively feeling as if it is alive through the overlap as described above.

The lamp unit (not shown) may irradiate a lamp light toward the subject during the automatic photographing.

To this end, the lamp unit (not shown) may be arranged to irradiate the lamp light toward the face of the subject. For example, according to the first embodiment 1000a of the present invention, which will be described later, when the two automatic image matching apparatuses 1000a1 and 1000a2 are provided, the lamp unit may include an image matching automatic photographing apparatus adjacent to the subject. It may be disposed on the front surface 1000a1_f of 1000a1 (see FIG. 3 ). Or, for another example, according to the second embodiment 1000b of the present invention to be described later, when the image matching automatic photographing apparatus is provided as one and includes the double-sided display units 400b1 and 400b2, the lamp unit, The rear display unit 400b2 facing the subject may be disposed on the rear surface 1000b_b of the image matching automatic photographing apparatus 1000b provided (see FIG. 14 ). Or, for another example, according to the third embodiment 1000c of the present invention to be described later, when the image matching automatic photographing apparatus is provided as one and includes a single-sided display unit 400c facing the subject, the lamp unit , the single-sided display unit 400c may be disposed on the front surface 1000c_f of the image matching automatic photographing apparatus 1000c provided (see FIG. 15 ).

Accordingly, in the automatic photographing of the subject, a facial image having a constant brightness within a predetermined reference range may be obtained. Here, the predetermined reference range may be understood as a concept in which the brightness of the facial image of the subject observed through each of the above-described photographing compositions includes the same level as the naked eye.

To this end, the controller 500, which will be described later, may drive the lamp unit disposed toward the subject so that, during the automatic photographing, a facial image having a constant brightness within the predetermined reference range is obtained. This will be described later.

The control unit 500, as described above, when the information related to the plurality of procedures (here, procedure 1 (op1) and procedure 2 (op2)) is obtained from the procedure information acquisition unit 50 , selection of a shooting composition and automatic shooting of the selected shooting composition may be controlled so that the overlapping shooting composition among the shooting compositions of each of the plurality of procedures is automatically captured once.

More specifically, referring to FIG. 6 , when the procedure 1 (op1) is a double eyelid surgery procedure, the photographing composition 1-1 (st1-1) is the right side, and the photographing composition 1-2 (st1-2) is the eye Closed front view, shooting composition 1-3 (st1-3) with eyes open, shooting composition 1-4 (st1-4) with half-closed eyes, front view, shooting composition 1-5 (st1-5) left side, shooting composition 1-6 (st1-6) may be front with head raised, and shooting composition 1-7 (st1-7) may be front with head bowed. In addition, referring to FIG. 7 , when the procedure 2 (op2) is a rhinoplasty procedure, the photographing composition 2-1 (st2-1) is the right side, and the photographing composition 2-2 (st2-2) is the right half side , Shooting composition 2-3 (st2-3) is front with eyes open, composition 2-4 (st2-4) is the left half, composition 2-5 (st2-5) is the left side, composition 2-6 (st2-6) can be front with head raised, and shooting composition 2-7 (st2-7) can be front with head bowed.

At this time, the photographing composition 1-1 (st1-1) and the photographing composition 2-1 (st2-1), the photographing composition 1-3 (st1-3) and the photographing composition 2-3 (st2-3), The photographing composition 1-5 (st1-5) and the photographing composition 2-5 (st2-5), the photographing composition 1-6 (st1-6) and the photographing composition 2-6 (st2-6), and the photographing composition The photographing composition 1-7 (st1-7) and the photographing composition 2-7 (st2-7) may be an overlapping photographing composition (dark shadows in FIGS. 6 and 7). Meanwhile, the photographing composition 1-2 (st1-2), the photographing composition 2-2 (st2-2), and the photographing composition 1-4 (st1-4) and the photographing composition 2-4 (st2-4) may be different shooting compositions with non-overlapping (light shades in FIGS. 6 and 7 ).

Accordingly, the control unit 500 controls the shooting composition 1-1 (st1-1), the photographing composition 1-3 (st1-3), and the photographing composition 1-5 (st1-) among the overlapping photographing compositions. 5), the photographing composition 1-6 (st1-6), and the photographing composition 1-7 (st1-7) are selected and controlled to be photographed, or the photographing composition 2-1 (st2-1), the photographing composition 2-3 (st2-3), the shooting composition 2-5 (st2-5), the shooting composition 2-6 (st2-6), and the shooting composition 2-7 (st2-7) That is, the overlapping photographing composition may be selected and controlled to be automatically photographed once.

Accordingly, the control unit 500 may select 9 of the 14 total shooting compositions required for the procedure 1 (op1) and the procedure 2 (op2) and control them to be automatically photographed once. More specifically, the control unit 500 controls the shooting composition 1-1 (st1-1) and the shooting composition 1 among the 14 total shooting compositions required in the procedure 1 (op1) and the procedure 2 (op2). -3 (st1-3), the shooting composition 1-5 (st1-5), the shooting composition 1-6 (st1-6), and the shooting composition 1-7 (st1-7) and the shooting composition 1- 2 (st1-2), the photographing composition 2-2 (st2-2), the photographing composition 1-4 (st1-4), and the photographing composition 2-4 (st2-4) are selected and controlled to be photographed; , the photographing composition 2-1 (st2-1), the photographing composition 2-3 (st2-3), the photographing composition 2-5 (st2-5), the photographing composition 2-6 (st2-6), and The photographing composition 2-7 (st2-7), the photographing composition 1-2 (st1-2), the photographing composition 2-2 (st2-2), the photographing composition 1-4 (st1-4), and the photographing composition It is possible to select and control shooting composition 2-4 (st2-4) to be photographed, and to select nine and control so that they are automatically photographed once.

On the other hand, the control unit 500, as described above, the outer indicator (ic_o) displayed on the display unit 400 has a predetermined reference width (Wo), the reference composition indicator (ic_s) and when the current composition indicator ic_c is located within a predetermined criterion, the camera unit 100 may be controlled to automatically photograph the subject (refer to FIGS. 9 and 10 ).

On the other hand, the control unit 500, during the automatic shooting, as described above, but adjust the magnification of the camera unit 100 according to the predetermined criterion, the predetermined criterion is the distance to the subject can be adjusted taking into account. For example, when the predetermined criterion is 1.5 m and the distance between the camera unit 100 and the subject is 0.5 m, the control unit 500 increases the magnification of the camera unit 100 by 3 times. can be adjusted to Or for another example, when the predetermined criterion is 1.5 m and the distance between the camera unit 100 and the subject is 0.3 m, the control unit 500, the magnification of the camera unit 100 is 5 It can be adjusted to double the height.

Accordingly, by the control of the magnification of the camera unit 100 as described above of the control unit 500, in the automatic photographing of the subject, a facial image of a certain magnification can be obtained according to a predetermined criterion, of course. .

In addition, the control unit 500 controls so that the lamp light is irradiated from the lamp unit (not shown) so that, as described above, a facial image with a constant brightness within the predetermined reference range is obtained during the automatic photographing. can do.

Meanwhile, the control unit 500 may control to display the automatically photographed face image of the subject as a lively face image as if it were alive through the display unit 400 .

To this end, the control unit 500 controls to obtain a face image through the camera unit 100, while controlling to obtain a 3D object for the subject's face through the object recognition sensor unit 200. can

The control unit 500, when the face image is obtained through the camera unit 100, and a three-dimensional object for the subject's face is obtained through the object recognition sensor unit 200, the face of the subject It is possible to control to display the facial image obtained by overlapping the facial image on the 3D object through the display unit 400 .

Accordingly, the automatic image matching apparatus 1000 according to an embodiment of the present invention may observe the treatment site at the same distance and in the same composition before (bf) and after (af) the operation of the subject.

Also, as described above, the image matching automatic photographing apparatus 1000 may observe the treatment site through a facial image of a constant magnification and constant brightness before (bf) and after (af) the operation of the subject.

As described above, the image matching automatic photographing apparatus 1000 according to an embodiment of the present invention has been described.

Hereinafter, embodiments will be described with reference to the drawings.

The arrangement of each component included in the image matching automatic photographing apparatus in Embodiments 1 to 3 of the present invention to be described below will be described with reference to Table 1 below.

first embodiment second embodiment third embodiment camera unit Rear facing the subject (when using the camera unit of 1000a2) and/or the front facing the subject (when using the camera unit of 1000 a1) rear facing subject front facing the subject object recognition sensor Front facing the subject (using the object recognition sensor unit of 1000a1) rear facing subject front facing the subject display unit Front facing the subject (display of 1000a1) and/or front facing the photographer (display of 1000a2) The back facing the subject and/or the front facing the cinematographer front facing the subject lamp part Front facing the subject (when using the lamp unit of 1000a1) or the rear facing the photographer (when using the lamp unit of 1000a2) rear facing subject front facing the subject

3 is a view for explaining an automatic image matching apparatus according to the first embodiment of the present invention.

Referring to FIG. 3 , in the first embodiment 1000a of the present invention, the two image matching automatic photographing apparatuses 1000a1 and 1000a2 may be provided to be adjacent to each other. In this case, the two image matching automatic photographing apparatuses 1000a1 and 1000a2 may communicate with each other to be paired. To this end, it goes without saying that a communication unit (not shown) may be provided in each of the two image matching automatic photographing apparatuses 1000a1 and 1000a2 .

Hereinafter, among the two automatic image matching automatic photographing apparatuses 1000a1 and 1000a2, the image matching automatic photographing apparatus adjacent to the subject is referred to as the first image matching automatic photographing apparatus 1000a1, and the image adjacent to the photographing company photographing the subject It is assumed that the matching automatic photographing apparatus is the second image matching automatic photographing apparatus 1000a2 . The photographer may be, for example, a doctor or a nurse photographing the subject.

The automatic image matching apparatus 1000a according to the first embodiment of the present invention includes the procedure information acquisition unit 50a, the camera unit 100a, the object recognition sensor unit 200a, which have been described with reference to FIG. 2 above, It may include at least one of an image processing unit 300a, a display unit 400a, a lamp unit (not shown), and a control unit 500a.

In the first embodiment 1000a of the present invention, as summarized in Table 1, a camera unit, an object recognition sensor unit, a display unit, and a lamp unit are disposed in the first and second image matching automatic photographing apparatuses 1000a1 and 1000a2 can be For reference, in the first embodiment, the front surface may mean a surface on which the display unit is located.

Meanwhile, in the first embodiment 1000a of the present invention, the display units 400a1 and 400a2 are provided in each of the first image matching automatic photographing apparatus 1000a1 and the second image matching automatic photographing apparatus 1000a2 can be More specifically, on the front side 1000a1_f of the first image matching automatic photographing apparatus 1000a1 facing the subject, the first-first display unit 400a1 and the second image matching automatic photographing apparatus 1000a2 are photographed A 1-2 display unit 400a2 may be provided on the front surface 1000a2_f facing the yarn, respectively. Alternatively, the display unit 400a may be provided in the second image matching automatic photographing apparatus 1000a2 . More specifically, a 1-2 display unit 400a2 may be provided on the front surface 1000a2_f of the second automatic image matching apparatus 1000a2 facing the photographer. This may mean that the display is not provided in the first automatic image matching apparatus 100a2. Hereinafter, for convenience of explanation, it is assumed that the display units 400a1 and 400a2 are provided in each of the first image matching automatic photographing apparatus 1000a1 and the second image matching automatic photographing apparatus 1000a2. .

On the other hand, in the first embodiment (1000a) of the present invention, the procedure information obtaining unit (50a), the image processing unit (300a), and the control unit (500a), the first image matching automatic photographing device (1000a1) and It may be provided in at least one of the second image matching automatic photographing apparatus 1000a2.

The procedure information obtaining unit 50a, the camera unit 100a, the object recognition sensor unit 200a, the image processing unit 300a, and the 1-1 according to the first embodiment 1000a of the present invention and the 1-2 display units 400a1 and 400a2, the lamp unit (not shown), and the control unit 500a, the procedure information obtaining unit 50 and the camera unit 100 of the embodiment of the present invention described above. , the object recognition sensor unit 200 , the image processing unit 300 , the display unit 400 , the lamp unit (not shown), and the control unit 500 , which are duplicated in the first embodiment 1000a of the present invention. A description will be omitted.

Hereinafter, an automatic image matching method according to a first embodiment of the present invention will be described with reference to the drawings.

4 to 12 are diagrams for explaining an automatic image matching method according to the first embodiment of the present invention.

Referring to FIG. 4 , in the automatic image matching method according to the first embodiment, the photographing composition selection step (S110), the photographing preparation step (S120), the distance matching determination step (S130), the composition matching determination step (S135) , an automatic photographing step (S140), and a post-correction step (S150) may include at least one.

Hereinafter, each step is described. In each step described below, each configuration of the present invention described above, for example, the procedure information acquisition unit 50, the camera unit 100, the object recognition sensor unit 200, the image processing unit 300, the display unit ( 400), the lamp unit (not shown), and the description overlapping with the control unit 500 may be omitted. Meanwhile, it goes without saying that even if the overlapping description of each configuration is omitted below, the embodiments of each configuration described above may be implemented in the same way.

Step S110

In step S110, the control unit 500a may select the shooting composition.

To this end, first, referring to FIG. 5A , as described above, the procedure information obtaining unit 50a includes the display unit 400a, for example, to obtain information related to the subject's treatment. , for example, a procedure input button ip1 may be provided through the 1-2 display unit 400a2.

Thereafter, referring to FIG. 5B , when the treatment input button ip1 is selected, the treatment information obtaining unit 50a, through the display unit 400a, performs the plurality of treatments of the subject. A procedure input field for receiving information related to , for example, a procedure 1 (op1) input field (ip2-1) and a procedure 2 (op2) input field (ip2-2) may be provided.

As previously assumed, when the subject received a double eyelid plastic surgery as the procedure 1 (op1) and a nose surgery as the procedure 2 (op2), the procedure 1 (op1) input field (ip2-1) contains the double eyelid surgery procedure is inputted, and a rhinoplasty procedure may be input in the operation 2 (op2) input field (ip2-2).

Accordingly, the procedure information obtaining unit 50a, as described above, provides information related to the plurality of procedures requiring the at least one photographing composition, for example, the procedure 1 (op1) is a double eyelid surgery procedure. In the case where the photographing compositions 1-1 (st1-1) to 1-7 (st1-7) and the procedure 2 (op2) are rhinoplasty procedures, the photographing compositions 2-1 (st2-1) to 2- 7 (st2-7) can be obtained.

When the procedure information acquisition unit 50a acquires the at least one photographing composition related to the plurality of procedures, the controller 500a may select the photographing composition.

More specifically, referring to FIGS. 6 and 7 , as described above, the photographing composition 1-1 (st1-1), the photographing composition 2-1 (st2-1), and the photographing composition 1-3 (st1) -3) and the shooting composition 2-3 (st2-3), the shooting composition 1-5 (st1-5), the shooting composition 2-5 (st2-5), the shooting composition 1-6 (st1-6) ) and the shooting composition 2-6 (st2-6), and the shooting composition in which the shooting composition 1-7 (st1-7) and the shooting composition 2-7 (st2-7) overlap (in FIGS. 6 and 7 ) dark shadow), while the photographing composition 1-2 (st1-2) and the photographing composition 2-2 (st2-2), and the photographing composition 1-4 (st1-4) and the photographing composition 2-4 ( It is assumed that st2-4) are different non-overlapping photographing compositions (light shades in FIGS. 6 and 7).

In this case, the control unit 500a controls so that the overlapping shooting composition is selected only once among the 14 total shooting compositions required in the procedure 1 (op1) and the procedure 2 (op2) to select a total of 9. can More specifically, the control unit 500a controls the shooting composition 1-1 (st1-1) and the shooting composition 1 among the 14 total shooting compositions required in the procedure 1 (op1) and the procedure 2 (op2). -3 (st1-3), the shooting composition 1-5 (st1-5), the shooting composition 1-6 (st1-6), and the shooting composition 1-7 (st1-7) and the shooting composition 1- 2 (st1-2), the photographing composition 2-2 (st2-2), the photographing composition 1-4 (st1-4), and the photographing composition 2-4 (st2-4) are selected, or the photographing composition 2-1 (st2-1), the photographing composition 2-3 (st2-3), the photographing composition 2-5 (st2-5), the photographing composition 2-6 (st2-6), and the photographing composition 2 -7 (st2-7), the photographing composition 1-2 (st1-2), the photographing composition 2-2 (st2-2), the photographing composition 1-4 (st1-4), and the photographing composition 2- By controlling to select 4 (st2-4), a total of 9 can be selected.

When the photographing composition is selected, the control unit 500a, as shown in FIG. 5(c), through the display unit 400a, the selected photographing composition, for example, a total of nine selected A button for photographing a photographing composition may be provided in the form of, for example, a photographing icon for each composition.

Accordingly, when the photographing icon for each composition is selected, the reference composition indicator ic_s may be provided on the display unit 400a for each composition to automatically photograph the subject in a step to be described later.

Step S120

In step S120, shooting may be prepared.

More specifically, referring to FIG. 8 , the photographing preparation step of this step S120 includes a three-dimensional object acquisition step (S121), a facial image acquisition step (S122), and a step (S123) of applying a facial image to the three-dimensional object. It may include at least one.

Hereinafter, each step of this step S120 will be described in detail.

Step S121

In step S121, the object recognition sensor unit 200a may obtain a 3D object for the face of the subject.

To this end, referring to FIGS. 6 and 7 , the object recognition sensor unit 200 may measure a distance (d distance) from the subject. For example, the object recognition sensor unit 200 may be an infrared sensor, lidar, or the like for measuring the distance to the subject.

Step S122

In step S122, a facial image of the subject may be acquired by the camera unit 100a.

Step S123

In step S123, the face image may be overlapped with the 3D object. Here, the overlap refers to, as described above, applying a high-quality facial image obtained through the camera unit 100a to the facial curves of the subject obtained by the object recognition sensor unit 200a. can be understood as a concept.

Preparation for photographing through step S120 including steps S121 to S123 described above may be displayed on the display unit 400a as the lively face image through the overlap as described above.

Step S130

In step S130, the image processing unit 300a may determine the distance matching.

To this end, referring to FIG. 9A , the image processing unit 300a may provide a user interface (UI) through the display unit 400a as described above. More specifically, the image processing unit 300a, through the display unit 400a, has a predetermined width as shown in FIG. (ic_o) can be provided as a user interface. For example, the outer indicator ic_o may be provided in the form of a picture frame. Accordingly, as shown in FIG. 9A , as the distance between the subject and the camera unit 100 increases, the width of the outer indicator ic_o in the form of the picture frame may become thinner. On the other hand, as shown in FIG. 9B , as the distance between the subject and the camera unit 100 increases, the width of the outer indicator ic_o in the form of the picture frame may increase. In this step, the distance matching determination of the image processing unit 300a assumes that the face of the subject is located within the outer indicator ic_o in the form of the picture frame.

In this case, it goes without saying that the distance between the subject and the camera unit 100 may be numerically displayed on the display unit 400 along with the width of the outer indicator ic_o in the form of the picture frame.

The image processing unit 300a may determine whether the distance is matched based on whether the outer indicator ic_o has a predetermined reference width Wo. In other words, the image processing unit 300 may determine whether the width of the outer indicator ic_o meets a predetermined reference width Wo.

In this case, the subject is placed on the display unit 400 to match the width Wc of the outer indicator ic_o displayed on the display unit 400 as a user interface with the predetermined reference width Wo. The distance between the displayed face of the subject and the camera unit 100 may be adjusted.

More specifically, as shown in (a) of FIG. 9 , the current distance between the subject and the camera unit 100 is greater than the distance corresponding to the predetermined reference width Wo of the exterior angle indicator ic_o. to assume that For example, it is assumed that the predetermined reference width Wo of the outer indicator ic_o is 3 mm, and accordingly the distance between the subject and the camera unit 100a is 30 cm. When the current distance between the subject and the camera unit 100a is 50 cm, the width Wc of the outer indicator ic_o displayed on the user interface through the display unit 400a may be 2.4 mm. Accordingly, the subject, in order to match the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400a with the predetermined reference width Wo, that is, 3 mm, the display unit ( 400a), the distance may be adjusted so that the distance between the face of the subject displayed on the image and the camera unit 100 is closer.

On the other hand, as shown in (b) of FIG. 9 , the current distance between the subject and the camera unit 100 is greater than the distance corresponding to the predetermined reference width Wo of the exterior angle indicator ic_o. Let's assume something close. For example, if the current distance between the subject and the camera unit 100a is 10 cm, the width Wc of the outer indicator ic_o displayed as a user interface through the display unit 400a may be 3.6 mm. have. Accordingly, in order to match the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400a with the predetermined reference width Wo, that is, 3 mm, the subject The distance may be adjusted so that the distance between the face of the subject displayed on 400a and the camera unit 100 is increased. In the image processing unit 300a, as shown in FIG. When it is determined that the distance matching has been achieved by the indicator ic_o having the predetermined reference width Wo, the control unit 500a controls the camera unit 100a so that the subject is automatically photographed in a step to be described later. can control

Meanwhile, in this step, the distance between the camera unit 100 and the subject according to the outer indicator ic_o may be adjusted based on a predetermined standard for each procedure. For example, if the predetermined standard for the double eyelid surgery with the procedure 1 (op1) is 1.5 m, and the predetermined standard for the nose surgery with the procedure 2 (op2) is 1.3 m, the predetermined standard for each procedure is The distance between the camera unit 100 and the subject may be adjusted to correspond to it.

In this case, as described above, the image processing unit 300a may provide, as a user interface, the outer indicator ic_o, the width of which varies according to the distance from the subject, through the display unit 400a. is of course

As described above, the distance between the camera unit 100 and the subject is controlled by the width Wc of the outer indicator ic_o displayed as a user interface on the display unit 400a and the predetermined criterion. It goes without saying that the width Wo can be adjusted by moving the subject so that the distance from the camera unit 100 is close to or farther away so that the width Wo is matched.

Step S135

In step S135, the image processing unit 300a may determine the composition matching.

To this end, referring to FIG. 10 , the image processing unit 300a may provide a user interface (UI) through the display unit 400a as described above. More specifically, the image processing unit 300a is, through the display unit 400a, as shown in FIG. 10 , the photographing composition obtained by the operation information obtaining unit 50a, that is, photographing in connection with the operation. A reference composition indicator ic_s indicating a composition to be composed and a current composition indicator ic_c indicating a current facial composition of the subject through the camera unit 100a may be provided as a user interface (FIG. 10 (a) ) Reference).

The image processing unit 300a may determine whether the composition matches whether the reference composition indicator ic_s and the current composition indicator ic_c are located within a predetermined criterion. In this case, the subject moves the subject's face displayed on the display unit 400a back and forth, that is, left and right, in order to position the current composition indicator ic_c within the predetermined criterion according to the reference composition indicator ic_s. Of course, it can move up and down.

The image processing unit 300a determines that the reference composition indicator (ic_s) and the current composition indicator (ic_c) are located within a predetermined standard as shown in FIG. 10B , and the composition matching is performed. When it is determined that there is, in a step to be described later, the controller 500a may control the camera unit 100a so that the subject is automatically photographed.

Step S140

In step S140 , the control unit 500a may control the camera unit 100a to automatically capture the image.

More specifically, when it is determined that the composition is matched by the image processing unit 300a through the above-described step S135, the control unit 500a may control the automatic shooting through the camera unit 100a. there will be In this case, the automatic photographing may be performed on the assumption that a subject, for example, a face, is located within the outer indicator ic_o.

That is, step S140 may be performed when the distance condition to the subject, the condition for the subject to be located within the outer indicator ic_o, and the composition matching condition all meet.

In this case, of course, the control unit 500a may control the magnification of the camera unit 100a to be adjusted according to a predetermined criterion. Accordingly, in the automatic photographing of the subject, a facial image of a certain magnification may be obtained according to a predetermined criterion.

Also, of course, the control unit 500a may drive a lamp unit (not shown) disposed toward the subject during the automatic photographing. Accordingly, in the automatic photographing of the subject, a face image having a constant brightness within the predetermined reference range may be obtained.

Accordingly, referring to FIG. 11 , the subject is subjected to the procedure, for example, before (bf) and after the procedure, for the double eyelid surgery with the procedure 1 (op1) and the nose surgery with the procedure 2 (op2), In (af), the treatment site can be observed through a facial image of the same distance, the same composition, a constant magnification, and a constant brightness.

In addition, as described in the previous step S110, the control unit 500a is configured to select the overlapping shooting composition only once among the 14 total shooting compositions required in the procedure 1 (op1) and the procedure 2 (op2). It goes without saying that since a total of nine are selected by controlling, in this step, the control unit 500a may control so that the selected total of nine shooting compositions are automatically shot once.

Accordingly, as shown in FIG. 12 , the selected photographing composition, for example, the total of nine photographing compositions may be automatically photographed once.

Although it is shown in FIG. 12 that the selected photographing composition is after the operation (af), it can be applied to the selected photographing composition before the operation (bf), for example, the total nine photographing compositions. am.

Accordingly, the face of the subject can be contrasted at the same distance and in the same composition before (bf) and after (af) the procedure.

In addition, as described above, the embodiment of the present invention is not limited to the above-described procedure, and may be applied to the user's past-present time point.

Accordingly, as shown in FIG. 12 , the user's face photos are accumulated over time, so that the user's past-present can be compared cumulatively.

Step S150

In step S150 , referring to FIG. 13 , the facial image may be post-corrected (cropped). Here, the post-correction may be understood as a concept including the operation of aligning the center of the acquired facial image of the subject.

In addition, as described above, the operation of aligning the center of the facial image here refers to, for example, the center (ct1) of the operator's face image shown in FIG. 13 (a) in the plurality of facial images of the operator and , can be understood as a concept including aligning the center (ct2) of the operator's face image shown in Fig. 13 (b). To this end, the face image may be cropped, that is, a partial outer region is cut based on the face image centers ct1 and ct2.

At this time, as shown in (a) of FIG. 13 , when a partial outer area is cut to match the center of the operator's face image ct1, the frame frame area of the outer indicator ic_o described above will be used. can This assumes a case in which the center of the operator's facial image ct1 is biased to one side, as shown in FIG. 13A .

That is, in the present invention, the outer indicator ic_o in the form of the picture frame frame may be provided with a predetermined width in consideration of cutting out a portion of the outer region to match the center ct1 of the face image.

Accordingly, it goes without saying that the present invention can match the center of the face in the plurality of face images, even when a plurality of face images are photographed.

Above, the first embodiment of the present invention has been described.

Although each of the steps S110 to S150 described above has been sequentially described, the embodiment of the present invention is not limited thereto, and the order of each step may be changed or may be performed simultaneously. For example, although steps S130 and S135 have been sequentially described, otherwise, step S135 may be performed first and then step S130 may be performed. Or, for another example, steps S130 and S135 may be performed simultaneously.

Hereinafter, second and third embodiments of the present invention will be described. In the second and third embodiments of the present invention described below, each configuration of the present invention described above, for example, the procedure information obtaining unit 50 , the camera unit 100 , the object recognition sensor unit 200 , and the image The description overlapping with the processing unit 300 , the display unit 400 , the lamp unit (not shown), and the control unit 500 may be omitted. In addition, a description overlapping with the first embodiment described above may be omitted. On the other hand, it goes without saying that the embodiment and the first embodiment of each configuration described above may be implemented in the same way even if the overlapping description of each configuration is omitted below.

14 is a view for explaining an automatic image matching apparatus according to a second embodiment of the present invention.

Referring to FIG. 14 , in the second embodiment 1000b of the present invention, unlike the first embodiment 1000a described above, the image matching automatic photographing apparatus is provided with one double-sided display unit 400b1, 400b2. may include. Alternatively, in the second embodiment 1000b of the present invention, the display unit 400b1 facing the photographer may be included. That is, the second embodiment is different from the first embodiment in that it is premised that the image matching automatic photographing apparatus according to the embodiment is implemented in hardware having a double-sided display, unlike the first embodiment.

Hereinafter, among the double-sided display units 400b1 and 400b2, a display unit adjacent to a photographer photographing the subject is referred to as a 2-1 display unit 400b1, and a display unit adjacent to the subject is referred to as a 2-2 display unit 400b2. ) is assumed.

The image matching automatic photographing apparatus 1000b according to the second embodiment of the present invention includes the procedure information obtaining unit 50b, the camera unit 100b, the object recognition sensor unit 200b, which have been described with reference to FIG. 2 above, It may include at least one of an image processing unit 300b, a display unit 400b, a lamp unit (not shown), and a control unit 500b.

In the second embodiment 1000b of the present invention, at least one of the camera unit 100b, the object recognition sensor unit 200b, and the lamp unit (not shown) may include the image matching automatic photographing apparatus 1000b. ) may be provided on the rear surface 1000b_b facing the subject. For reference, in the second embodiment, the face facing the photographer is defined as the front side, and the face facing the subject is defined as the back side.

According to a second embodiment 1000b of the present invention, the procedure information obtaining unit 50b, the camera unit 100b, the object recognition sensor unit 200b, the image processing unit 300b, and the 2-1 and 2-2 display units 400b1 and 400b2, the lamp unit (not shown), and the control unit 500b, the procedure information obtaining unit 50 and the camera unit 100 of the embodiment of the present invention described above. , the object recognition sensor unit 200 , the image processing unit 300 , the display unit 400 , the lamp unit (not shown), and the control unit 500 , which are duplicated in the second embodiment 1000b of the present invention. A description will be omitted.

15 is a view for explaining an automatic image matching apparatus according to a third embodiment of the present invention.

Referring to FIG. 15 , in the second embodiment 1000c of the present invention, unlike the first embodiment 1000a described above, the image matching automatic photographing apparatus is provided as one single-sided display unit facing the subject ( 400c).

Accordingly, in the first and second embodiments described above, as described above, the photographer is optimized for the structure in which the subject is photographed, while in the third embodiment of the present invention, the subject takes a selfie. structure can be optimized.

The image matching automatic photographing apparatus 1000c according to the third embodiment of the present invention includes the procedure information acquisition unit 50c, the camera unit 100c, the object recognition sensor unit 200c, which have been described with reference to FIG. 2 above, It may include at least one of an image processing unit 300c, a display unit 400c, a lamp unit (not shown), and a control unit 500c.

In the third embodiment 1000c of the present invention, at least one of the camera unit 100c, the object recognition sensor unit 200c, and the lamp unit (not shown) may include the image matching automatic photographing apparatus 1000c ) may be provided on the front surface 1000c_f facing the subject.

According to a third embodiment 1000c of the present invention, the procedure information obtaining unit 50c, the camera unit 100c, the object recognition sensor unit 200c, the image processing unit 300c, and the display unit 400c ), the lamp unit (not shown), and the control unit 500c, the procedure information acquisition unit 50, the camera unit 100, the object recognition sensor unit 200, and the image processing unit of the embodiment of the present invention described above. Bars corresponding to 300 , the display unit 400 , the lamp unit (not shown), and the control unit 500 , the overlapping description in the third embodiment 1000c of the present invention will be omitted.

On the other hand, the image matching automatic photographing method according to the second and third embodiments of the present invention includes each step of the image matching automatic photographing method according to the first embodiment of the present invention described above, specifically steps S110 to S150; Of course, steps S121 to S123 configuring step S120 may be applied.

However, in the image matching automatic photographing method according to the second and third embodiments, as described above, the number of the image matching automatic photographing apparatus or the arrangement of each component included in the image matching automatic photographing apparatus is different it will only do

In the above, an automatic image matching apparatus and an automatic image matching method for photographing according to embodiments of the present invention have been described.

According to an embodiment, the image matching automatic photographing method may be implemented through an image matching automatic photographing program stored in a medium.

More specifically, the image matching automatic shooting program includes the above-described shooting composition selection step (S110), shooting preparation step (S120), distance matching determination step (S130), composition matching determination step (S135), automatic shooting step ( S140), and the post-correction step (S150) may be stored in the medium to execute at least any one.

Here, the term "medium" may be understood as a concept including a predetermined terminal such as a desktop, a notebook computer, a web pad, or a smart phone, as described above. In addition, of course, the terminal may be provided in a hospital visited by the subject receiving the procedure. Accordingly, the subject receives the procedure through the hospital web, and the facial image before (bf) and after (af) the subject photographed through the camera unit 100 can be observed through the hospital web. of course there is

In addition, even when the image matching automatic photographing method is implemented through the image matching automatic photographing program, in the image processing unit 300, the outer indicator ic_o has a predetermined reference width Wo through step S130. , when it is determined that the distance matching has been made, and the reference composition indicator (ic_s) and the current composition indicator (ic_c) are located within a predetermined standard through step S135, and when it is determined that the composition matching has been made, the control unit ( It goes without saying that 500a) can control the camera unit 100a so that the subject is automatically photographed. Also, it goes without saying that the control unit 500a may control the shooting composition selected through step S110 to be automatically shot once. Also, of course, through step S150, the facial image may be post-corrected.

As mentioned above, although the present invention has been described in detail using preferred embodiments, the scope of the present invention is not limited to specific embodiments and should be construed according to the appended claims. In addition, those skilled in the art should understand that many modifications and variations are possible without departing from the scope of the present invention.

50: procedure information acquisition unit
100: camera unit
200: object recognition sensor unit
300: image processing unit
400: display unit
500: control
1000: Image matching automatic shooting device

Claims (6)

a display unit for displaying a visual indicator visually indicating a photographing situation of a person to be photographed; and
including; a control unit that controls the camera so that the person to be photographed is automatically photographed;
The visual indicator includes an outer indicator, a current composition indicator, and a reference composition indicator,
The outer indicator has a predetermined width on the display unit, and is displayed on a user interface to reflect the distance from the photographed subject;
The current composition indicator displays, on the display unit, a current facial composition that moves according to the facial movement of the subject as a user interface,
The reference composition indicator displays, on the display unit, a composition to be photographed in connection with the procedure of the photographed subject as a user interface,
The control unit may be configured such that the width has a predetermined reference width because the distance condition with the photographed subject is satisfied according to the outer indicator, the reference composition indicator and the current composition indicator are located within a predetermined standard, and the face of the photographed person is When located within the outer indicator, the image matching automatic photographing apparatus for controlling the camera so that the photographed person is automatically photographed.
According to claim 1,
In connection with the plurality of procedures, when at least one shooting composition is required,
The control unit, the image matching automatic photographing apparatus for controlling the overlapping photographing composition among the photographing composition of each of the plurality of procedures to be automatically photographed once.
According to claim 1,
The control unit, but displaying the face image of the subject through the display unit,
The face image is an image obtained by overlapping a face image obtained through a camera on a three-dimensional object of the subject's face obtained through an object recognition sensor for measuring distance, image matching automatic shooting Device.
According to claim 1,
The control unit is configured to drive a lamp unit disposed toward the subject during the automatic photographing.
According to claim 1,
The control unit, during the automatic shooting, but adjust the magnification of the camera according to a predetermined standard,
The predetermined criterion is an automatic image matching apparatus that is adjusted in consideration of a distance from the subject to be photographed.
On the display unit, an outer indicator having a predetermined width and displaying a user interface to reflect the distance from the subject to be photographed, and displaying the current facial composition moving according to the facial movement of the subject on the display unit as a user interface displaying a visual indicator including a current composition indicator and a reference composition indicator for displaying a composition to be photographed in relation to the procedure of the subject on the display unit through a user interface; and
When the outer indicator has a predetermined reference width and the reference composition indicator and the current composition indicator are located within a predetermined reference width, controlling the camera so that the person to be photographed automatically takes an image; image stored in the medium to execute Matching automatic shooting program.

Images