KR102497691B1 - System and method for correcting facial asymmetry linked to smart phone using correction mirror - Google Patents

Abstract

The present invention expresses the asymmetric position of the user's face through a mirror surface and expresses training information for face asymmetry correction through a mirror surface, so that the user performs asymmetric correction training while recognizing the asymmetry state of his or her face while looking in the mirror. It's about the technology that makes it possible.
A smartphone-linked facial asymmetry correction service system and method using a correction mirror according to the present invention include a half-mirror structured mirror plate, a grid plate with grid-shaped grooves formed on the rear surface of the mirror plate, and a constant edge portion of the grid plate. An LED lighting unit disposed at intervals, a mirror surface including an LED matrix disposed on the rear surface of the grid and having RGB LEDs disposed at each intersection of the grid, and the LED lighting unit communicating with the smartphone according to a control signal provided from the smartphone. And a correction mirror configured to include an electronic module for controlling on/off of each RGB LED of the LED matrix, and communicating with the correction mirror according to the execution of the face correction application to provide facial asymmetric training information through the correction mirror, By driving the LED lighting part of the mirror, the LED light is scattered into the groove formed in the grid plate so that the grid pattern is displayed on the mirror surface, and the reference line is displayed by driving the RGB LEDs at the predetermined line position of the LED matrix In this state, a correction image is obtained by photographing the user's face in a state where the face is arranged based on the reference line, and an asymmetrical position of the face is extracted from the correction image, and the RGB LED of the LED matrix corresponding to the asymmetrical position is operated with the first color. and a smart phone for controlling the RGB LEDs of the LED matrix corresponding to the training position and training direction corresponding to the asymmetrical position to operate in the second color.

Description

System and method for correcting facial asymmetry linked to smart phone using correction mirror {System and method for correcting facial asymmetry linked to smart phone using correction mirror}

The present invention expresses the asymmetric position of the user's face through a mirror surface and expresses training information for face asymmetry correction through a mirror surface, so that the user can naturally perceive the asymmetry state of his or her face while looking in the mirror and perform asymmetric correction training. It's about technology that allows you to do it.

The movement of the face interacts with the numerous muscles that make up the face by being connected to 22 bone pieces. Facial asymmetry is a phenomenon that appears as a result of these complex causes of the musculoskeletal system, and it appears as facial asymmetry.

This facial asymmetry, that is, the main cause of facial asymmetry, is very closely related to the individual's lifestyle (masticating, sleeping posture, resting the chin with the hand, posture imbalance of the upper and lower body), and these habits affect the musculoskeletal system of the face for a long time. As a result, the contraction and relaxation and tension of the facial muscles, whether or not they are used, and the changes in the skeleton of the face and head due to the muscles appear.

Also, the consequences of facial asymmetry can have a very profound effect on the balance and movement of the temporomandibular joint.

The temporomandibular joint is a part that regulates the meridian system and brain activity, and the temporomandibular joint is also the root of brain activity treatment. The reason is that numerous nerves and blood vessels pass around the temporomandibular joint, so when facial asymmetry occurs, it becomes the balance of the nervous system. This is because breaking can cause many problems.

If left unattended, it can cause chronic headaches, edema, color changes, shoulder hangs, dizziness, vomiting, difficulty in chewing, and disorders of the nervous and muscular system, such as abnormal secretion of hormones. It is necessary to prevent its progress.

In addition, facial asymmetry can not only give a bad impression on interpersonal relationships, but also negatively affect self-efficacy in social relationships because it causes appearance stress and complexes.

This is a factor that lowers self-confidence, leading to psychological passivity in accurately conveying one's intentions to the other person or persuading the other person, affecting the area of leading emotional expression and self-reliance, and limiting or reducing one's social influence to subordinate to the environment. The easier it is to go in that direction.

As a result of these results, facial asymmetry is not limited to disease problems, but it is very closely related to psychological issues in life related to individual sociality and self-efficacy, so it is necessary to solve this problem.

For this purpose, procedures or surgical methods related to facial asymmetry have been used, but currently used procedures or surgical methods related to facial asymmetry have a disadvantage in that they use specialized equipment in hospitals and require a lot of cost.

Meanwhile, a means by which a user can most commonly recognize an asymmetry state of his or her face is a mirror.

That is, the user can check the difference by observing his or her face symmetrically up and down while looking in the mirror.

However, since there is no reference line in the case of a general mirror, it is difficult to recognize an asymmetrical state if it is not an asymmetrical state of more than a certain angle.

1. Korean Patent Publication No. 10-2015-0059629 (Name: Mirror that can grasp the balance of the human body) 2. Korea Registered Utility No. 20-0363142 (Name: Mirror for height)

Therefore, the present invention was created in view of the above circumstances, and expresses the lattice pattern and the asymmetric position of the user's face through the mirror surface, as well as expressing training information for face asymmetry correction through the mirror surface, so that the user can Its technical purpose is to provide a smartphone-linked facial asymmetry correction service system and method using a correction mirror that allows you to easily recognize your face asymmetry while looking in the mirror and more easily perform face asymmetry correction training. there is

여기서, X 와 Y 는 보정된 각 픽셀의 위치좌표, X0 와 Y0 는 제1 교정영상의 우측 첫 위치 좌표, X1 과 Y1 은 제2 교정영상의 우측 첫 위치 좌표, σ는 스마트 폰 카메라의 고유 왜곡보정율, θ 는 제1 교정영상에서 사용자 얼굴의 왼쪽과 오른쪽 눈썹의 상단을 연결한 직선과 수평선 대비 기울기이다.According to one aspect of the present invention for achieving the above object, a mirror plate having a half mirror structure, a grid plate having grid-shaped grooves formed on the rear surface of the mirror plate, and an LED lighting unit disposed at regular intervals at an edge portion of the grid plate, A mirror surface including an LED matrix disposed on the rear surface of the grid and having RGB LEDs disposed at each intersection of the grid, and each RGB of the LED lighting unit and the LED matrix according to a control signal provided from the smartphone by communicating with the smartphone. A correction mirror composed of an electronic module for controlling LED on/off, a smartphone cradle disposed on one side of the mirror surface of the correction mirror and holding a smartphone, and communicating with the correction mirror according to the execution of the face correction application Provides face asymmetric training information through the correction mirror, drives the LED lighting unit of the correction mirror to scatter the LED light into the grooves formed on the grid plate so that the grid pattern is displayed on the mirror surface, and the predetermined line position of the LED matrix In a state where the reference line is displayed and output by driving the RGB LEDs, a correction image is obtained by photographing the user's face in a state in which the face is arranged based on the reference line, and the asymmetric position of the face is extracted from the correction image to display the asymmetric position. A configuration including a smart phone for controlling the operation of the RGB LED of the corresponding LED matrix as the first color and the operation of the RGB LED of the LED matrix corresponding to the training position and training direction corresponding to the asymmetrical position as the second color The smartphone takes a first correction image of a face state of looking at a mirror surface and a second correction image of a face state of looking at a smartphone while being mounted on the smartphone holder, and uses the following equation. to generate a synchronization image, which is a face image displayed as a mirror surface, from the first correction image, and to match the synchronization image with LED matrix information to control the RGB LED corresponding to the asymmetric position and training information. Calibration characterized in that Smartphone-linked facial asymmetry correction service using a mirror system is provided.

Here, X and Y are the position coordinates of each corrected pixel, X0 and Y0 are the coordinates of the first right position of the first calibration image, X1 and Y1 are the coordinates of the first right position of the second calibration image, and σ is the inherent distortion of the smartphone camera The correction rate, θ, is the slope of a line connecting the tops of the left and right eyebrows of the user's face and the horizontal line in the first correction image.

In addition, the smartphone stores grid pattern information formed by grooves formed in the grid plate of the calibration mirror and reference line information in advance, and is mounted on the smartphone holder to display the previously stored grid pattern and reference line on the display window of the calibration mirror. A smartphone-linked facial asymmetry correction service system using a correction mirror is provided, characterized in that a second correction image is obtained by photographing a user's face in a state in which the face is arranged according to a reference line in a display output state through a camera. .

delete

In addition, the smart phone is a smart phone using a correction mirror, characterized in that configured to display and output training status information performed through a correction mirror on a display window, and to provide a dashboard function for changing a training schedule by a user An interlocking facial asymmetry correction service system is provided.

In addition, the correction mirror is configured by additionally combining a mirror cover of a general mirror structure for covering the mirror surface on the upper side of the mirror surface to open and close in a folder shape, and the smart phone provides information on the opening and closing state of the mirror cover from the correction mirror. There is provided a smartphone-linked face asymmetry correction service system using a correction mirror, characterized in that configured to transmit a control signal for driving the LED lighting unit to the correction mirror when the mirror cover is opened.

여기서, X 와 Y 는 보정된 각 픽셀의 위치좌표, X0 와 Y0 는 제1 교정영상의 우측 첫 위치 좌표, X1 과 Y1 은 제2 교정영상의 우측 첫 위치 좌표, σ는 스마트 폰 카메라의 고유 왜곡보정율, θ 는 제1 교정영상에서 사용자 얼굴의 왼쪽과 오른쪽 눈썹의 상단을 연결한 직선과 수평선 대비 기울기이다.In addition, according to another aspect of the present invention for achieving the above object, according to the execution of the face correction application installed in the smartphone, the face is communicated with the correction mirror for displaying and outputting the grid pattern through the RGB LED provided in the correction mirror. In the smartphone-linked facial asymmetry correction service method using a correction mirror providing asymmetric training information, in a state where the smartphone is mounted on a smartphone cradle disposed on one side of the correction mirror, the smartphone displays a lattice pattern and A first step of controlling to express a reference line for face photographing, a second step of acquiring a correction image by photographing a user's face in a state in which the face is arranged based on the reference line through the camera of the smartphone, in the smartphone The third step of analyzing the correction image to extract the asymmetrical position of the face, and operating the RGB LED disposed at the grid intersection corresponding to the asymmetrical position with the first color through the correction mirror, correcting the face corresponding to the asymmetry state in the smartphone Based on the training information including the training position and training direction for , the RGB LED disposed at the lattice intersection of the correction mirror is operated as the second color, and the RGB LED corresponding to the training position is driven. It is configured to include a fourth step of operating the RGB LED by a predetermined length to correspond to the training direction, and the second step is to acquire a first correction image of a face looking at a correction mirror through a camera of the smartphone. And, acquiring a second corrected image of a face state watching the smartphone through the camera of the smartphone, using the following equation in the smartphone to obtain a synchronization image, which is a face image displayed as a mirror surface, from the first corrected image Generating step, transmitting a control signal for driving RGB LEDs corresponding to the face asymmetric position and training information in the synchronized image in the smartphone to the calibration mirror, and the calibration mirror based on the control signal applied from the smartphone Calibration characterized by comprising the step of supplying driving power to the RGB LED A service method for correcting facial asymmetry linked to a smartphone using a mirror is provided.

Here, X and Y are the position coordinates of each corrected pixel, X0 and Y0 are the coordinates of the first right position of the first calibration image, X1 and Y1 are the coordinates of the first right position of the second calibration image, and σ is the inherent distortion of the smartphone camera The correction rate, θ, is the slope of a line connecting the tops of the left and right eyebrows of the user's face and the horizontal line in the first correction image.

delete

In addition, the smartphone acquires a second calibration image looking at the camera in a state in which the face is arranged based on the reference line in a state in which the same grid pattern and reference line represented by the calibration mirror are displayed on the display window. Provided is a smartphone-linked facial asymmetry correction service method using a correction mirror to

In addition, the fourth step is configured to display and output training status information progressing through the correction mirror to a display window on the smartphone, and to provide a dashboard function for changing the training schedule by the user Correction mirror, characterized in that Provided is a smartphone-linked facial asymmetry correction service method using

According to the present invention, the asymmetric position of the user's face is expressed through the mirror surface, and training information for face asymmetry correction is expressed through the mirror surface, so that the user can easily recognize the asymmetry state of his or her face while looking in the mirror. , face asymmetry correction training can be performed more easily.

1 is a diagram showing a schematic configuration of a smartphone-linked face asymmetry correction service system using a correction mirror according to a first embodiment of the present invention.
FIG. 2 is a view for explaining the configuration of the mirror surface 110 shown in FIG. 1;
Figure 3 is a block diagram showing the functional separation of the internal configuration of the smart phone 200 shown in Figure 1;
FIG. 4 is a functional block diagram of the controller 260 shown in FIG. 3, showing a modularized functional configuration of a face correction application.
5 is a flowchart for explaining the operation of the smartphone-linked facial asymmetry correction service system using a correction mirror according to the present invention.
6 is a diagram illustrating expression information output through the mirror surface 110 of the correction mirror 100 in the operation of FIG. 5;
FIG. 7 is a diagram illustrating a synchronization image generation process in the operation of FIG. 5;
8 is a diagram illustrating a configuration of a training dashboard output through a display window 222 of a smartphone.

The embodiments described in the present invention and the configurations shown in the drawings are only preferred embodiments of the present invention, and do not represent all the technical ideas of the present invention, so the scope of the present invention is limited to the embodiments and drawings described in the text. should not be construed as being limited by That is, since the embodiment can be changed in various ways and can have various forms, it should be understood that the scope of the present invention includes equivalents capable of realizing the technical idea. In addition, since the object or effect presented in the present invention does not mean that a specific embodiment should include all of them or only such effects, the scope of the present invention should not be construed as being limited thereto.

All terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs, unless defined otherwise. Terms defined in commonly used dictionaries should be interpreted as being consistent with meanings in the context of related art, and cannot be interpreted as having ideal or excessively formal meanings that are not clearly defined in the present invention.

1 is a diagram showing a schematic configuration of a smartphone-linked facial asymmetry correction service system using a correction mirror according to a first embodiment of the present invention.

Referring to FIG. 1, the smartphone-linked facial asymmetry correction service system using a correction mirror according to the present invention communicates with a correction mirror 100 and the correction mirror 100 to control the operation of the correction mirror 100. Includes a phone (200).

The calibration mirror 100 is integrally provided with a smartphone holder 120 capable of holding the smartphone 200 on one side of the mirror surface 110. At this time, the smartphone holder 120 may be configured to automatically communicate with the mirror surface 110 when the smartphone 200 is mounted, and may be configured to be connected by physical connection between communication terminals or by a wireless communication method such as Bluetooth. there is. In addition, the smartphone holder 120 is provided with a sensor 121 for detecting whether the smartphone 200 is mounted.

In addition, a mirror cover 130 having a general mirror structure for covering the mirror surface 110 is provided on the upper side of the mirror surface 110 . The mirror cover 130 has a size that covers the mirror surface 110 and is coupled to the upper side of the mirror surface 110 in a folder shape to set an open/closed state. That is, when the mirror cover 130 covers the mirror surface 110, the calibration mirror 100 is used as a general mirror, and when the mirror cover 130 is opened from the mirror surface 110, the calibration mirror 100 ) is used as a calibration mirror according to the present invention. At this time, a sensor for detecting the open/closed state of the mirror cover 130 may be additionally provided on one side of the mirror surface 110, and the sensor transmits open/closed state information of the mirror cover 130 to the electronic module 140. can

In addition, around the mirror surface 110, for example, on the lower side of the rear surface or inside the pedestal, an electronic module 140 and a power supply unit 150 for providing a facial asymmetry correction service through the mirror surface 110 in conjunction with the smartphone 200 ) is provided.

On the other hand, as shown in FIG. 2, the mirror surface 110 includes a mirror plate 111 having a half mirror structure having a certain area and a grid plate having grooves formed in a grid shape while being disposed on the rear surface of the mirror plate 111 ( 112), an LED lighting unit 113 disposed at regular intervals on the edge of the grid 112, and an LED matrix disposed on the rear surface of the grid 112 and having RGB LEDs disposed at each intersection of the grid 112 ( 114).

The mirror plate 111 is formed by coating an 80% silver nitrate aqueous solution on the rear surface of a plate-shaped glass or plastic substrate, and the grid plate 112 disposed on the rear surface is transmitted through the mirror plate 111 without shading treatment. It consists of a half-mirror structure displayed on the top.

The grating plate 112 is formed by forming grooves of horizontal and vertical lines at regular intervals and thicknesses on a substrate of the same material and size as the mirror plate 111 .

The LED lighting unit 113 is disposed on the edge of the grid plate 112 and scatters light to groove lines formed on the grid plate 112, thereby making the grid plate 112 shine in a grid shape.

The LED matrix 114 is configured by arranging RGB LEDs (D) at each intersection of the grid plate 112 on a substrate having the same size as the grid plate 112 .

Here, the LED lighting unit 113 and the LED matrix 114 are electrically connected to the electronic module 140 and operated according to a control signal of the electronic module 140 .

The electronic module 140 communicates with the smartphone 200 mounted on the holder 120 based on the smartphone mounting detection signal applied from the sensor 121, and according to the control signal provided from the smartphone 200 Each RGB LED (D) of the LED lighting unit 113 and the LED matrix 114 is individually controlled on/off.

In particular, the electronic module 140 controls the LED matrix 114 to display the asymmetrical position of the user's face reflected on the mirror surface 110, and provides training information for correcting the asymmetrical part as training direction information at the training position. Control to display output.

In addition, the electronic module 140 receives information on the opening and closing state of the mirror cover 130 from the calibration mirror 100 from a sensor (not shown) to drive the LED lighting unit to the calibration mirror when the mirror cover 130 is opened. It may be configured to transmit a control signal. That is, when the mirror reservoir 130 is opened, a lattice pattern is automatically expressed through the mirror surface 110 .

The power supply unit 150 supplies driving power to the electronic module 140 and the detection sensor 121, and is connected to the LED lighting unit 113 and the LED matrix 114 according to a control signal applied from the electronic module 150. Power to each RGB LED (D) of the LED lighting unit 113 and the LED matrix 114 is supplied or cut off.

Figure 3 is a block diagram showing the internal configuration of the smart phone 200 shown in Figure 1, information input unit 210, information output unit 220, camera 230, communication unit 240, data memory 250 and a control unit 260.

The information input unit 210 includes an input pad 211 configured in the form of an input button or a touch pad and a microphone 212 for voice recognition.

The information output unit 220 includes a speaker 221 for audio output of information and a display window 222 for displaying and outputting information.

The communication unit 240 includes a wired or wireless communication interface such as Bluetooth.

The data memory 250 includes a face correction application operated in conjunction with the correction mirror 100, a grid pattern expressed by grooves formed on the grid plate of the correction mirror 100, a reference line, and the LED matrix 114 corresponding thereto. Various types of information for facial asymmetry correction service including RGB LED (D) position, correction mirror information including communication protocol, asymmetric position and corresponding training information are stored.

The controller 260 communicates with the correction mirror 100 according to the face correction application to provide a face asymmetry correction service through the correction mirror 100. The face correction application is a communication connection module 261 as shown in FIG. ), an image acquisition module 262, an image synchronization module 263, and a calibration service module 264.

The communication connection module 261 performs Bluetooth pairing or is physically connected to communication while being mounted on the cradle 120 of the correction mirror 100, and uses a face correction application based on a pairing signal received from the correction mirror 100. automatically run

The image acquisition module 262 transmits a control signal to the calibration mirror 100 in a state where the calibration application is automatically executed to drive the LED lighting unit 113 and, through the LED matrix 114, the image corresponding to the reference line. The RGB LED (D) is operated, and an image when a preset motion such as a user blinks twice is recognized is acquired as a calibration image.

At this time, the image acquisition device 262 acquires a first correction image of a face state of looking at the mirror surface 110 of the correction mirror 100 and a second correction image of a face state of gaze of the camera 230 of a smartphone. do.

The image synchronization module 263 analyzes the first correction image and the second correction image using the OpenCV algorithm, and calculates the position and size of each part of the face of the second correction image necessary for generating the synchronization image and training schedule.

In addition, the image synchronization module 263 synchronizes the image reflected on the mirror surface 110 of the correction mirror 100 with the image captured by the smart phone 200 so that the first correction image is captured by the correction mirror ( 100) is converted into a synchronization image in the same state as the face image displayed on the mirror plate 110. In this case, the image synchronizing module 263 may also generate a synchronized image by tracking a positional change of a preset feature point in the first calibration image. This is in consideration of the change in the position of the user's face reflected in the correction mirror 100 .

The calibration service module 264 analyzes the second correction image to search for an asymmetric position of the user's face, and matches the position of the RGB LED (D) of the LED matrix 114 with the synchronized image to match the RGB LED (D) corresponding to the asymmetric position. ) is generated as a first color and transmitted to the calibration mirror 100 .

In addition, the calibration service module 264 generates training information including the training position, direction, and number of times (time) corresponding to the asymmetrical position according to a preset calibration algorithm, and the synchronization image and the RGB LEDs of the LED matrix 114 ( D) By matching the positions, a control signal for driving the RGB LEDs (D) corresponding to the training position and the training direction around the training position in the second color is generated and transmitted to the calibration mirror 100.

In addition, the calibration service module 264 may output training information as audio through the speaker 221 or display it through the display window 222 . In particular, the calibration service module 264 may be configured to display and output training status information performed through the calibration mirror 100 to the display window 222 and provide a dashboard function for changing a training schedule by the user. .

Next, the operation of the smartphone-linked facial asymmetry correction service system using the correction mirror having the above configuration will be described with reference to FIGS. 5 to 8. 5 is a flowchart for explaining the operation of a smartphone-linked facial asymmetry correction service system using a correction mirror, and FIG. 6 illustrates expression information output through the mirror surface 110 of the correction mirror 100 in the operation of FIG. 7 is a diagram illustrating a process of generating a synchronization image in the operation of FIG. 5, and FIG. 8 is a diagram illustrating a configuration of a training dashboard output through the display window 222 of a smartphone.

First, a face correction application that operates in conjunction with the correction mirror 100 is pre-installed in the smart phone 200, and a face asymmetry correction service is provided using the correction mirror 100 according to the face correction application.

When the smart phone 200 is placed on the cradle 120 of the correction mirror 100, communication is connected according to a mutually preset communication method, and the face correction application installed on the smart phone 200 is automatically executed (ST100). At this time, Bluetooth communication may be performed between the smart phone 200 and the calibration mirror 100 .

The smart phone 200 transmits a lighting control signal to the calibration mirror 100 to set the LED lighting unit 113 to an ON state. Accordingly, as shown in FIG. 6(A), a grid pattern is displayed through the mirror surface 110 of the correction mirror 100 (ST200). At this time, the smart phone 200 transmits a control signal for driving the LED lighting unit 113 to the calibration mirror 100 when receiving open state information of the mirror cover 130 from the calibration mirror 100. can be sent to

In addition, the smart phone 200 transmits an RGB control signal to the correction mirror 100 to drive RGB LEDs (D) corresponding to reference lines for face photographing in the LED matrix 130 . The smart phone 200 sets the RGB LEDs (D) disposed on the horizontal lines corresponding to the vertical 1/3 and 2/3 points of the LED matrix 130 with the calibration mirror 100 to an ON state. . That is, the first to third reference lines L1, through the mirror surface 110 of the calibration mirror 100 as shown in FIG. Reference lines of L2 and L2) are expressed (ST300).

Here, the first to third reference lines L1, L2, and L3 are reference lines for locating the user's face area, and the eyebrows and chin of the user's face are the first reference line L1 and the second reference line L2. ), and is a reference line for positioning the nose on the third reference line (L3).

In the above state, the smart phone 200 monitors an image of the user in a state of looking at the calibration mirror 100 through the camera 230, and when a preset confirmation motion is recognized in the user image, the calibration mirror 100 is displayed. An image of the face being watched is acquired as a first calibration image (ST400).

At this time, the smart phone 200 outputs, through the speaker 221, a guide voice requesting the location of a preset face part in the inner region of the first to third reference lines L3 displayed and output by the correction mirror 100. can do.

In addition, the smart phone 200 analyzes the user image received through the camera 221, and when a preset confirmation motion, for example, a motion of blinking one eye twice in succession appears, it is determined that all face parts are located in the reference line area. By recognizing and photographing a face image at a corresponding point in time, a first correction image is acquired.

That is, the first correction image is the cradle of the correction mirror 100 in a state where the user's face is located in the inner region of the first to third reference lines L3 expressed on the mirror surface 110 of the correction mirror 100 ( 120) is a facial image looking at the correction mirror 100 photographed by the smart phone 200 in a state of being mounted.

Next, the smart phone 200 displays and outputs the calibration background screen consisting of the same grid pattern represented by the calibration mirror 100 and the first to third reference lines on the display window 222 of the smartphone 200, and With the user's face positioned in the same way as in the correction mirror 100 based on the first to third reference lines of 222, a face image of the user's face is taken while staring at the camera 230, thereby focusing on the smartphone. A second calibration image of the state is acquired (ST500). At this time, the smart phone 200 may obtain a second correction image by determining that the user blinks one eye twice in succession and capturing a face image at that time.

In addition, the smart phone 200 analyzes the first calibration image obtained in step ST400 and the second calibration image obtained in step ST500 using the OpenCV algorithm, and uses a preset equation to generate the first calibration image. A synchronization image for the first step is generated (ST600).

That is, the smart phone 200 transmits a trapezoid-shaped first correction image tilted to one side to synchronize an image reflected on the mirror surface 110 of the correction mirror 100 with an image captured by the smart phone 20. Convert to the same rectangle as the image expressed in (110). For example, when the smart phone 200 is located on the right side of the correction mirror 100 as shown in FIG. 2, the trapezoidal shape inclined to the left is converted into a rectangle.

In the present invention, a synchronization image is generated using the correction function of Equation 1 based on the first position coordinates on the right of the first and second correction images.

Here, X and Y are the position coordinates of each corrected pixel, X0 and Y0 are the coordinates of the first right position of the first calibration image, X1 and Y1 are the coordinates of the first right position of the second calibration image, and σ is the inherent distortion of the smartphone camera The correction rate, θ, is the slope of a line connecting the tops of the left and right eyebrows of the user's face and the horizontal line in the first correction image. σ may be provided by a smartphone camera manufacturer or may be obtained by calculating a perspective-related distortion correction rate of a camera lens through a known equation. (The known equation is an equation for calculating the perspective distortion correction rate of a camera lens that is already known, and explains that various known equations can be applied.)

That is, as shown in FIG. 7 , the face displayed as the mirror surface 110 of the correction mirror 100 when the first correction image taken by the smart phone 200 in a state of staring at the correction mirror 100 is captured. It is converted into a synchronized image in the same state as the image.

Meanwhile, the smart phone 200 analyzes the second correction image to search for an asymmetric position of the user's face, compares the synchronized image and the LED matrix 114, and compares the RGB corresponding to the asymmetric position information found in the LED matrix 114. The position of the LED(D) is determined, and a control signal for driving the RGB LED(D) at the corresponding position in the first color is generated and transmitted to the calibration mirror 100. Accordingly, as shown in FIG. 6 (C), information on the asymmetric position (P1) is also displayed and output on the user's face looking at the correction mirror 100 through the mirror surface 110 of the correction mirror 100 (ST700). ).

At this time, the smart phone 200 changes the synchronization image correspondingly whenever the first correction image captured through the camera 230 is changed in consideration of the change in the position of the user's face reflected in the correction mirror 100, As the position of the user's face reflected on the mirror surface 110 of the correction mirror 100 changes, the asymmetrical position P1 is also changed and expressed.

In addition, the smart phone 200 generates training information including the training position, direction, and number of times (time) corresponding to the asymmetric position, and a training control signal for outputting the training position and training direction information of the LED matrix 114. is transmitted to the calibration mirror 100 so that training information is displayed and output through the calibration mirror 100 (ST800). At this time, as shown in FIG. 6 (D), the training information includes training position (P2) and training direction (P3) information, and is expressed through the mirror surface 110 of the correction mirror 100. Here, the training direction information is expressed around the training position, and by setting the RGB LEDs (D) corresponding to the corresponding direction at the position to be sequentially accumulated for a certain length, it can be displayed so that the directionality appears, The stronger the training intensity, the longer the length representing the training direction can be displayed.

Thereafter, the smart phone 200 analyzes the training state of the user based on the first calibration image captured through the camera to determine the accuracy of the training operation, determines whether the training operation is performed as many times as the training number, and When it is determined that the operation is completed, all the RGB LEDs (D) of the LED matrix 130 are set to an off state.

On the other hand, in the present invention, the smart phone 200 can output training information through a speaker 221 or display it through a display window 222, and the display window 222 can be used as a dashboard for training services. . For example, as shown in FIG. 8 , training images and training dashboard information including the current training status may be displayed through the display window 222 of the smart phone 200 .

100: correction mirror, 110: mirror surface,
111: mirror plate, 112: grid plate,
113: LED lighting unit, 114: LED matrix,
120: smartphone cradle, 130: mirror cover,
140: electronic module, 150: power unit,
200: smart phone, 210: information input unit,
220: information output unit, 230: camera,
240: communication unit, 250: data memory,
260: control unit, 261: communication connection module,
262: image acquisition module, 263: image synchronization module,
264 Calibration Services module.

Claims (9)

A mirror plate with a half-mirror structure, a grid plate with lattice-shaped grooves disposed on the rear surface of the mirror plate, an LED lighting unit disposed at regular intervals around the edge of the grid plate, and RGB LEDs disposed on the rear surface of the grid plate at each intersection of the grid plate. A mirror surface including an LED matrix on which is disposed, and an electronic module that communicates with a smartphone and controls the LED lighting unit and each RGB LED of the LED matrix on / off according to a control signal provided from the smartphone. correction mirror,
A smartphone cradle disposed on one side of the mirror surface of the correction mirror and holding a smartphone;
According to the execution of the face correction application, it communicates with the correction mirror to provide face asymmetric training information through the correction mirror. In addition, in a state in which the reference line is displayed and output by driving the RGB LEDs at the predetermined line position of the LED matrix, the user's face is photographed in a state in which the face is arranged based on the reference line to obtain a correction image, The asymmetric position of the face is extracted from the correction image, the RGB LED of the LED matrix corresponding to the asymmetric position is operated as the first color, and the RGB LED of the LED matrix corresponding to the training position and training direction corresponding to the asymmetric position is used as the second color. It is configured to include a smart phone that is controlled to operate as,
The smartphone captures a first correction image of a face state watching a mirror surface and a second correction image of a face state watching a smartphone while being mounted on the smartphone holder, and uses the following equation to obtain a correction image. 1 A correction mirror characterized in that a synchronization image, which is a facial image displayed as a mirror surface, is generated from the correction image, and the synchronization image and LED matrix information are matched to control the RGB LED corresponding to the asymmetric position and training information to be driven. A smartphone-linked facial asymmetry correction service system.

Here, X and Y are the position coordinates of each corrected pixel, X0 and Y0 are the coordinates of the first right position of the first calibration image, X1 and Y1 are the coordinates of the first right position of the second calibration image, and σ is the inherent distortion of the smartphone camera The correction rate, θ, is the slope of the line connecting the tops of the left and right eyebrows of the user's face in the first correction image and the horizontal line.
delete According to claim 1,
The smartphone pre-stores grid pattern information formed by grooves formed in the grid plate of the calibration mirror and reference line information,
Obtaining a second correction image by photographing the user's face in a state in which the face is arranged according to the reference line in a state in which the grid pattern and the reference line stored in advance are displayed on the display window of the correction mirror mounted on the smartphone holder through the camera A smartphone-linked facial asymmetry correction service system using a correction mirror, characterized in that.
According to claim 1,
The smart phone is configured to display and output training status information performed through a correction mirror on a display window, and to provide a dashboard function for changing a training schedule by a user Face linked to a smartphone using a correction mirror, characterized in that Asymmetric correction service system.
According to claim 1,
The correction mirror is configured by additionally coupling a mirror cover of a general mirror structure for covering the mirror surface to the upper side of the mirror surface to open and close in a folder shape,
The smart phone is configured to transmit a control signal for driving the LED lighting unit to the correcting mirror when the mirror cover is opened by receiving information on the opening and closing state of the mirror cover from the correcting mirror. Asymmetric correction service system.
Smartphone-linked face asymmetry correction service method using a correction mirror that communicates with a correction mirror that displays and outputs a lattice pattern according to the execution of a face correction application installed in a smartphone and provides facial asymmetry training information through RGB LEDs provided in the correction mirror in
A first step of controlling the smartphone to express a grid pattern and a reference line for photographing a face through a calibration mirror in a state where the smartphone is mounted on a smartphone cradle disposed on one side of the calibration mirror;
A second step of acquiring a correction image by photographing a user's face in a state in which the face is arranged based on a reference line through a camera of a smartphone;
A third step of extracting an asymmetric position of the face by analyzing a correction image in a smartphone, and operating an RGB LED disposed at a grid intersection corresponding to an asymmetric position with a first color through a correction mirror;
Based on the training information including the training position and training direction for face correction corresponding to the face asymmetry in the smartphone, the RGB LED disposed at the lattice intersection of the correction mirror is operated as a second color, and the RGB corresponding to the training position In addition to driving the LED, it is configured to include a fourth step of operating the RGB LED around the training position by a certain length to correspond to the training direction,
The second step includes acquiring a first correction image of a face gazing at a correction mirror through a camera of the smartphone, and obtaining a second correction image of a face gazing at the smartphone through a camera of the smartphone. step of generating a synchronization image, which is a face image displayed as a mirror surface of the first correction image, using the following equation in a smartphone, and generating RGB LEDs corresponding to the asymmetric position of the face and training information in the synchronization image in the smartphone Transmitting a control signal for driving to the calibration mirror, and supplying driving power to the corresponding RGB LED based on the control signal applied from the smartphone in the calibration mirror. Smartphone linkage facial asymmetry correction service method.

Here, X and Y are the position coordinates of each corrected pixel, X0 and Y0 are the coordinates of the first right position of the first calibration image, X1 and Y1 are the coordinates of the first right position of the second calibration image, and σ is the inherent distortion of the smartphone camera The correction rate, θ, is the slope of the line connecting the tops of the left and right eyebrows of the user's face in the first correction image and the horizontal line.
delete According to claim 6,
Calibration characterized in that the smart phone obtains a second calibration image looking at the camera in a state where the face is arranged based on the reference line in a state where the same grid pattern and reference line represented by the calibration mirror are displayed on the display window A service method for correcting facial asymmetry linked to a smartphone using a mirror.
According to claim 6,
The fourth step is configured to display and output training status information progressing through the correction mirror to a display window on the smart phone, and to provide a dashboard function for changing the training schedule by the user Using a correction mirror, characterized in that Smartphone linkage facial asymmetry correction service method.

Images