KR20220030502A - Skin care device based on augmented reality - Google Patents

Abstract

The present invention relates to an augmented reality-based skin care device, wherein a user is allowed to visually check an operation procedure and an amount of energy irradiation. The augmented reality-based skin care device of the present invention comprises: a skin care device including a care module and an AR display unit; and a smart device including a camera, a display unit, a smart device control unit, and an AR application.

Description

Augmented reality-based skin beauty device {SKIN CARE DEVICE BASED ON AUGMENTED REALITY}

The present invention relates to an augmented reality-based skin care device, and more particularly, by matching an output energy irradiation point invisible to the naked eye with an augmented reality (AR) image when using a skin beauty device, the treatment process and energy It relates to an augmented reality-based skin care device that allows you to visually check the amount of irradiation.

The skin covering the surface of the human body is a complex tissue layer that protects the internal tissues of the human body from the external environment and maintains homeostasis. It is a very important body organ that performs several functions.

Such skin tissue produces collagen according to the activity of fibroblasts, and this collagen functions to give elasticity to the skin. However, as the skin ages, the activity of fibroblasts decreases, and the aging phenomenon in which collagen is not sufficiently produced proceeds, which causes a decrease in elasticity of the skin and the generation of wrinkles.

Modern people are investing a lot of money and time to maintain healthy and beautiful skin as interest in their appearance increases.

As a general skin care method, functional cosmetics that emphasize various effects such as maintaining skin elasticity and improving wrinkles are widely used. Because it cannot penetrate, skin care using cosmetics has limitations due to the lack of effectiveness.

In recent years, the use of skin hospitals and specialized skin care centers that not only treat dead skin cells, freckles, blemishes and acne, but also maintain skin elasticity, improve wrinkles, and provide skin whitening, are rapidly increasing. In order to solve the inconvenience caused by the cost burden and time constraints associated with the use of skin hospitals and skin care rooms, the demand for self-service skin care devices that can easily manage skin anytime, anywhere is increasing.

Recently, as the development of skin care devices has been active, many of the procedures that were treated in skin hospitals and specialized skin care rooms are being replaced at home, and the technology is also rapidly developing. is increasing

Most skin care devices that are currently attracting attention in the market apply LED light source, ultrasound, focused ultrasound (HIFU), high frequency and low frequency, etc. as basic principles, but there is a problem that the output energy wavelength of these skin care devices is invisible .

In addition, operators working in skin hospitals and specialized skin care rooms may experience problems such as omission and over-treatment in specific areas due to negligence due to accumulated fatigue from repeated actions, and users who use self-treatment skin care devices. Also, due to carelessness, overlapping treatment in the same location, excessive treatment in a specific area, and non-uniform treatment in the treatment area may be performed, which has a problem in that the skin is damaged or the effect of sufficient skin improvement is not obtained.

In particular, in HIFU (High Intensity Focused Ultrasound), a non-invasive treatment method, since energy is focused in the skin, the details of the procedure cannot be confirmed with the naked eye. There were also possible problems.

Republic of Korea Patent Registration No. 10-1673113 (Registered on October 31, 2016) Republic of Korea Patent Registration No. 10-1676012 (Registered on Nov. 8, 2016)

The present invention was devised to solve the problems of the prior art as described above, and by matching the output energy irradiation point invisible to the naked eye with the augmented reality (AR) image when using a skin beauty device, the treatment process and the energy irradiation amount It is an object of the present invention to provide an augmented reality-based skin beauty device that can be visually confirmed and can solve problems and side effects caused by overlapping and over-treatment of specific areas.

In order to achieve the above object, the present invention includes a configuration in which a care module for generating physical stimulation for the purpose of skin improvement is formed on one side of the main body corresponding to the outer housing, and an AR display unit is formed on the other side skin care device; And, a camera that acquires an image by photographing a skin treatment site, a display unit that visually outputs an image, a smart device control unit that controls the overall operation, and augmented reality by recognizing an AR display unit in the image and generating a virtual image A smart device including an AR application that provides an image; includes and configures.

The AR display unit is configured to be distinguished in the image through color differentiation or shape differentiation.

The AR application, the treatment area recognition unit for recognizing the treatment area by extracting the feature points of the treatment target area from the image taken through the camera; a coordinate recognition unit that generates coordinates of the corresponding position when the AR display unit is located in the treatment area in the image; a virtual image generating unit that creates and synthesizes a virtual image at the coordinate point where the AR display unit is located; an accumulation counter generating unit that accumulates and counts repeatedly generated values when the virtual image is repeatedly generated at the same coordinates; and a color conversion unit that changes the color according to the accumulated count value when the virtual image is repeatedly generated at the same coordinates.

According to the augmented reality-based skin care device according to the present invention, it is possible to visually check the energy irradiation point or the irradiation amount invisible to the naked eye through the augmented reality image, and in particular, when overlapping or excessively repeated treatment of a specific part of the skin, it is visually It has the effect of determining the contents of the future treatment while confirming it, and preventing side effects due to user negligence so that the procedure can proceed safely.

In addition, the present invention has the effect of improving the effect of skin improvement from a uniform treatment for the entire treatment area, and allowing non-specialists to easily access and perform self-treatment from safe treatment through images.

1 is a block diagram illustrating an augmented reality-based skin care device according to an embodiment of the present invention.
2 is an exemplary diagram of a usage state of an augmented reality-based skin care device according to an embodiment of the present invention.
3 is an enlarged view of the use state of the augmented reality-based skin beauty device according to an embodiment of the present invention.
4 is an exemplary diagram illustrating a virtual image color change according to the same location overlapping procedure in the augmented reality-based skin care device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to preferred embodiments of the present invention and the accompanying drawings, but the same reference numerals in the drawings will be described on the premise that they refer to the same components.

When it is said that any one component "includes" another component in the detailed description or claims of the invention, it is not construed as being limited to only the component, unless otherwise stated, other components It should be understood that more may be included.

1 to 4 show an augmented reality-based skin care device according to an embodiment of the present invention, FIG. 1 is an overall block diagram, and FIGS. 2 to 4 are a use state for an augmented reality-based skin care device It is also an example.

As described above, the configuration of the present invention includes the skin beauty device 100 and the smart device 200, and the invisible procedure is applied to the naked eye by applying augmented reality technology, so the reliability of the procedure is provides

The skin care device 100 is to generate physical stimulation for the purpose of improving the skin of the subject to be treated, the main body 110, the power supply unit 120, the input/output unit 130, the beauty device control unit 140 and , a care module 150 , and an AR display unit 160 .

The main body 110 corresponds to the outer housing of the skin care device 100, and a form for receiving or fixing and supporting the care module 150 that irradiates output energy to the skin of a subject to be treated is applied.

The power supply unit 120 supplies operating power to each component including the care module 150 , and according to various embodiments of the present invention, DC power is supplied to each circuit component from the battery mounted inside the body 110 . Alternatively, after receiving AC power from the outside of the skin care device 100, it may be converted into DC power to supply power to each circuit component.

The input/output unit 130 includes an input means for selecting the operating environment and whether to drive the skin care device 100, and a display means for visually displaying the current operating state, and the input means and the display means are one. It is also possible to apply a touch screen panel consisting of

The beauty device control unit 140 controls the overall operation of the skin care device 100 including the care module 150 , and is set when an input signal for operating the care module 150 is transmitted from the input/output unit 130 . The operation electric signal is transmitted to the care module 150 according to the program, and the current state value or various information values according to the operation of the device are transmitted to the display means 132 . Preferably, the beauty device control unit 140 may further include a memory function capable of storing operation setting values or treatment data.

The care module 150 is connected to or accommodated on either side of the main body 110 and generates a physical stimulus to the skin of a subject to be treated, and includes ultrasound, LED, micro-current, plasma, vibration, negative ions, far-infrared rays, and high-frequency waves. And various principles having an effect on skin beauty, such as low frequency can be applied. In addition, the care module 150 corresponds to the output terminal of the care module 150 at a position opposite to the skin treatment site of the subject to be treated in order to efficiently deliver the physical energy having an effect on skin beauty to the exact treatment location of the subject's skin. The energy irradiation unit 151 is configured to be disposed. That is, while the energy irradiator 151 is positioned at a position in contact with or close to the skin of the subject to be treated, various physical energies having a therapeutic effect are delivered.

The AR display unit 160 is formed in the opposite direction to the position of the energy irradiator 151 of the care module 150 with respect to the main body 110 to predict the coordinate position of the energy irradiator 151 . That is, as shown in FIG. 3 , an energy irradiation unit 151 , which is an output terminal of the care module 150 , is formed on one side of the body 110 of the skin care device 100 , and an AR display unit is formed on another side of the same line. (160) is formed so that the position configuration corresponding to 'AR display unit 160 - energy irradiation unit 151 - skin treatment site' in a straight line can be made. Preferably, the AR display unit 160 can increase the recognition rate in the smart device 200 through a shape or color distinguished from the surroundings, which is a mark made of a color differentiated from the surroundings is applied, or a mark made of a specific shape. , or different wavelength signal values such as infrared rays may be applied.

More preferably, when operating power is applied to the care module 150 , the AR display unit 160 may include an LED light emitting device that emits light together.

The smart device 200 can take pictures and videos, can visually output images, and has calculation and control functions, data storage functions, and the like, so that various electronic devices that can drive applications are applied, and smart phones , tablet PCs, etc. already known smart devices may be applied. In addition, the smart device 200 includes a camera 210 , a display unit 220 , a smart device control unit 230 , and an AR application 240 as main components.

The camera 210 takes pictures and videos, and in the present invention, the user's skin treatment process is captured as a real-time video while acquiring image data.

According to various embodiments of the present invention, at least one camera 210 may be used according to a direction. That is, when shooting is performed only in one direction, coordinate points are implemented for a 2D image, and when shooting is performed in various directions, coordinate points are implemented for a 3D image, thereby realizing more accurate coordinate points. In addition, when realizing a 3D image through shooting in multiple directions, it is preferable to use at least three cameras to obtain images corresponding to the front, left, and right sides. In this case, a method of connecting and using an additional camera 210 to one smart device 200 and a method of using a plurality of smart devices 200 by interworking with each other may be applied.

The display unit 220 outputs visual image data, and in the present invention, augmented reality technology is applied using real image data captured through the camera 210 and a virtual image received through the AR application 240 . Visually print the grafted procedure. In addition, it is preferable that the display unit 220 is applied with a touch screen panel in which an input function and an output function are integrated.

The smart device control unit 230 controls the overall operation of the smart device 200 and includes an arithmetic device, a control device, a memory device, etc. It instructs the input/output device, etc. to operate, so that the application can be driven.

The AR application 240 generates an augmented reality image by synthesizing a virtual image with the real image data taken through the camera 210, and the user performs the procedure using the skin care device 100 continuously. Real image data is acquired while shooting in the form of a video, and the AR application 240 is a virtual image at the coordinates where the AR display unit 160 of the skin care device 100 is located from the real image data taken through the camera 210 . is inserted and synthesized to create an augmented reality image.

In more detail, when the AR application 240 is functionally classified according to each image data processing process, the treatment site recognition unit 241, the coordinate recognition unit 242, the virtual image generation unit 243, and the accumulation It can be divided into a form including a counter generating unit 244 and a color converting unit 245 .

The treatment site recognition unit 241 recognizes the treatment area by extracting the feature points of the treatment target area when the user attempts a skin treatment using the skin care device 100 . For example, when a user treats a face part using the skin care device 100, the treatment part recognition unit 241 extracts the positions of the eyes, nose, mouth, ears, etc., which are feature points of the face, to determine the overall contour of the user's face Predict and set the area to be treated.

The coordinate recognition unit 242 is the position coordinates of the AR display unit 160 when the treatment target area is set through the treatment site recognition unit 241 and the AR display unit 160 of the skin care device 100 enters the treatment target area. set and recognize the location. In this case, the position coordinates of the AR display unit 160 may be relative coordinates based on the outline of the treatment target site or a certain feature point.

The virtual image generating unit 243 creates a virtual image at the position coordinates of the AR display unit 160 and then synthesizes it. In this case, the virtual image may be in the form of a dot, and the generated and synthesized virtual image is Many are displayed cumulatively in the augmented reality image.

Preferably, the virtual image generating unit 243 is the AR display unit 160 when the AR display unit 160 is located in the treatment target area set through the treatment site recognition unit 241 in the image captured by the camera 210 . ), a virtual image in the form of a dot is synthesized with the coordinates of the position.

According to an embodiment of the present invention, the virtual image generated by the virtual image generating unit 243 is repeatedly generated according to a preset time interval, which is generated by the energy in the care module 150 of the skin care device 100 . The operation time irradiated by is synchronized with the time when a virtual image is generated through the virtual image generator 243 so that the operation of the care module 150 and the generation of the virtual image can be performed with the same time difference. For example, if the care module 150 irradiates physical energy at 0.5 second intervals, the virtual image generating unit 243 also creates a dot-shaped virtual image at 0.5 second intervals, and the treatment area in the captured image A virtual image in the form of a dot is synthesized and displayed at the coordinate point where the AR display unit 160 is located.

According to another embodiment of the present invention, the virtual image generated by the virtual image generator 243 is a virtual image through transmission of an operation signal from the skin care device 100 and reception of an operation signal from the smart device 200 . You can decide when to create it. For example, when the care module 150 transmits an operation signal at the time of irradiating physical energy, the smart device 200 receives the corresponding signal, and at this time, the coordinates of the AR display unit 160 within the treatment area in the photographed image are located. A dot-shaped virtual image is synthesized and displayed on a dot. In this process, a wireless signal transmission/reception means between the skin care device 100 and the smart device 200 is further required.

When the virtual image generated and synthesized by the virtual image generator 243 is repeatedly generated at the same coordinates, the cumulative counter generator 244 cumulatively counts the repeatedly generated values.

When the virtual image generated and synthesized by the virtual image generator 243 is repeatedly displayed at the same coordinates, the color conversion unit 245 changes only the image color according to the accumulated value while maintaining the previous image shape. That is, when the virtual image is repeatedly overlapped at the same location, only the accumulated number of overlapping images is secured through the accumulation counter generating unit 244 , and only the color of the image is obtained from the color conversion unit 245 according to the accumulated number of times. change For example, in generating a plurality of virtual images according to the movement of the AR display unit 160, if a yellow dot form is primarily generated, when a secondary virtual image is created to be overlapped at the same location, the existing primary image form is used. Changing only the image color to green, etc. while maintaining indicate

The data storage unit 246 stores various data generated in driving the AR application 240, and augmented reality image data may be stored, and data such as accumulated treatment values for the user's treatment site may be stored. there is.

Hereinafter, the operation of the augmented reality-based skin care device according to an embodiment of the present invention will be described.

First, when the AR application 240 of the smart device 200 is driven, the camera 210 takes a picture of the user, and when the user takes a picture of a desired skin treatment area, the treatment site recognition unit 241 detects the characteristic points of the area. Extract and recognize the area to be treated.

Assuming that the user is to treat a face part, when acquiring an image while photographing the user's face through the camera 210 of the smart device 200, the AR display unit of the skin beauty device 100 in the facial contour, which is the area to be treated in the image When 160 is located, the coordinate recognition unit 242 determines the corresponding coordinates and inserts and synthesizes the virtual image generated by the virtual image generation unit 243 .

The accumulation counter generating unit 244 determines the number of times the virtual image is generated according to the coordinate value, and when the virtual image is repeatedly generated at the same location, the color conversion unit 245 changes the color to be distinguished while maintaining the shape of the virtual image. make it

The data storage unit 246 can store the operating environment and treatment details, and through the AR application 240, the user can determine the treatment target area and treatment time while checking the data performed within a certain period in numerical or image form. there is.

As described above, the present invention can visually confirm the energy irradiation point or amount of irradiation invisible to the naked eye in the skin care procedure through the augmented reality image. It has a feature that can determine the contents of the procedure and prevent side effects caused by the user's negligence.

Although the present invention has been described with reference to the accompanying drawings in terms of preferred embodiments, it will be apparent to those skilled in the art that many various obvious modifications can be made without departing from the scope of the present invention from these descriptions. Accordingly, the scope of the present invention should be construed by the appended claims including examples of many such modifications.

100: skin beauty device
110: body
120: power supply
130: input/output unit
140: beauty device control unit
150: care module
151: Energy Investigation Department
160: AR display unit
200: smart device
210: camera
220: display unit
230: smart device control unit
240: AR application
241: treatment site recognition unit
242: coordinate recognition unit
243: virtual image generator
244: cumulative counter generation unit
245: color conversion unit
246: data storage unit

Claims (13)

Based on the main body 110 corresponding to the external housing, a care module 150 for generating physical stimulation for the purpose of skin improvement is formed on one side, and an AR display unit 160 is formed on the other side. beauty device 100;
A camera 210 that acquires an image by photographing a skin treatment site, a display unit 220 that visually outputs an image, a smart device controller 230 that controls the overall operation, and an AR display unit 160 in the image A smart device 200 including an AR application 240 that recognizes and generates a virtual image to provide an augmented reality image;
Augmented reality-based skin beauty device, characterized in that it comprises a.
The method of claim 1,
The care module 150 is an augmented reality-based skin care device, characterized in that it is configured by applying at least one principle of ultrasound, LED, micro-current, plasma, vibration, negative ion, far-infrared, high-frequency, and low-frequency for the purpose of skin improvement. .
The method of claim 1,
The care module 150 is an augmented reality-based skin care device, characterized in that the energy irradiator 151 corresponding to the output terminal is disposed on one side, and the AR display unit 160 and the energy irradiator 151 are disposed on the same line. .
The method of claim 1,
The AR display unit 160 is an augmented reality-based skin care device, characterized in that it is distinguished in the image through color differentiation.
The method of claim 1,
The AR display unit 160 is an augmented reality-based skin care device, characterized in that it is distinguished in the image through the differentiation of the shape.
The method of claim 1,
The AR display unit 160 is an augmented reality-based skin care device, characterized in that an LED element is applied.
The method of claim 1,
The camera 210 is an augmented reality-based skin care device, characterized in that at least one divided according to the direction is applied.
8. The method of claim 7,
The camera 210 is an augmented reality-based skin care device, characterized in that it can generate 3D coordinates from images obtained by photographing the front, left, and right sides of the treatment target.
The method of claim 1,
The AR application 240 includes a treatment site recognition unit 241 for recognizing a treatment area by extracting feature points of a treatment target area from an image taken through the camera 210;
a coordinate recognition unit 242 for generating coordinates of the corresponding position when the AR display unit 160 is located in the operation area in the image;
a virtual image generating unit 243 that creates and synthesizes a virtual image at the coordinate point where the AR display unit 160 is located;
Augmented reality-based skin beauty device comprising a.
10. The method of claim 9,
Augmented reality-based skin care device, characterized in that the time point and time interval at which the virtual image is generated by the virtual image generator (243) are set to be the same as the time point and time interval at which energy is irradiated from the care module (150).
10. The method of claim 9,
The skin beauty device 100 and the smart device 200 each other further comprises a wireless signal transmitting and receiving means,
Augmented reality-based skin beauty, characterized in that the time when the virtual image is generated by the virtual image generator 243 is determined at the time when the smart device 200 receives the operation signal transmitted from the skin care device 100 device.
10. The method of claim 9,
The AR application 240 includes: an accumulation counter generating unit 244 that accumulates and counts repeatedly generated values when the virtual image is repeatedly generated at the same coordinates;
a color conversion unit 245 for changing a color according to an accumulated count value when the virtual image is repeatedly generated at the same coordinates;
Augmented reality-based skin beauty device, characterized in that it further comprises.
The method of claim 1,
The AR display unit 160 is an augmented reality-based skin care device, characterized in that an infrared signal is applied.

Images