KR102173146B1 - Headline provision system using head and skin tone - Google Patents

Abstract

The present invention is provided with a camera for photographing, a portable terminal on which a hairline application that provides information on a hairline is installed, and in connection with the portable terminal to receive an image shot from the camera, the head image from the received image Using the head image and skin tone configured including a service providing server that detects and facial skin tone, and displays the detected hairline on the mobile terminal based on the detected head image, skin tone, character personality, and the situation (development) of the story. It relates to a hairline providing system.
A hairline providing system using a head and skin tone according to the present invention for solving the above problems includes: a portable terminal equipped with a camera for photographing and a hairline application providing information on the hairline; And receiving an image captured from the camera in connection with the mobile terminal, detecting a head and facial skin tone from the received image, detecting a character hairline based on the detected head, skin tone, and character information, and detecting the detected character. It is configured to include a service providing server for displaying the hairline on the mobile terminal, and the photographed image is characterized in that at least three images including the front of the front, left, right, rear, and upper surfaces.

Description

Hairline provision system using head and skin tone}

The present invention relates to a system for providing a hairline using a head and skin tone, and more particularly, a portable terminal equipped with a camera for photographing and installed with a hairline application providing information on a hairline, and the portable terminal In conjunction with receiving an image captured from the camera, detecting the head and facial skin tone from the received image, and displaying the detected hairline on the mobile terminal based on the detected head image, skin tone, character personality, and story development. It relates to a hairline providing system using a head and skin tone that is configured including a service providing server.

Hairline refers to a presentation line where hair begins to grow biologically, but from the viewpoint of makeup that makes use of the character's characteristics in a play or movie, the line of the bangs also belongs to the category of hairline.

On the other hand, in terms of aesthetics, there are various hairlines, but there are ideal aesthetic hairlines that each country and each era pursue and aim for. Representatively, in the early 1900s in Korea, under the influence of Confucianism, a decent feminine beauty was pursued, and with this influence, make-up techniques that made the forehead look wider were developed. A cosmetic technique was used.

In modern times, it is stiff and pursues a round forehead line that is not wide or large in proportion to the size of the upper, middle, and lower eyes of the face. For this purpose, the presentation line is drawn neatly so that it looks like a round hairline, and when hair loss occurs, a desired forehead is produced through a hair transplant surgery.

In the West, in the Middle Ages, a beautiful woman was a woman with a round and wide hairline. To maintain a wide hairline, I first defined the wider hairline and applied a mixture of orange arsenic and quicklime or oil-boiled lime to the hair being pulled out. The hairline was modified artificially by applying a substance that was thought to prevent the ugly hair from growing again.

As such, hairline transformation and makeup have been made according to each era and country, and effective hairline has to be produced in consideration of aesthetics.

Like a hairstyle, hairline also has a shape that suits the person's head, face shape, and skin tone, and it is necessary to create a hairline that best suits the character according to the character's character in the play and the development of the story.

As a technology for providing a hairstyle, Korean Patent Publication No. 10-1498513 discloses a method for providing a virtual hairstyle using a social network service.

The technology provides an image after applying a hairstyle by receiving an image before applying a hairstyle through a social network service, and secondary processing the hairstyle stored in the hairstyle database to provide a more realistic and realistic virtual hairstyle. It's about how.

In addition, a recommendation system based on face recognition and a method thereof are disclosed in Korean Patent Publication No. 10-2012-0046652.

The technology extracts facial feature information from a user image, recognizes facial features from the extracted facial feature information, and searches hair style information matching the recognized facial features from among previously learned hairstyle information for each facial feature. It features recommended.

However, the above techniques provide a hair style that fits an individual's facial features, and there is a problem in that it cannot provide a hairline suitable for the character's personality in the play.

On the other hand, as in a play or a movie, makeup for an actor is usually made by an artist based on experience. In other words, the character makeup performed in the play must be changed according to the actor's hairline, skin tone, character personality, and the development of the story, and there is no data that objectively provides information on this, so it is dependent on experienced artists.

KR 10-1498513 B1 (2015.02.26) KR 10-2012-0046652 A (2012.05.10)

The present invention has been devised to meet the above needs, and the problem to be solved in the present invention is to create a hairline for an actor suitable for a character in a play based on the head image, skin tone, and character information input in the hairline application of the mobile terminal. It is to provide a hairline providing system using the head and skin tone that can be provided.

A hairline providing system using a head and skin tone according to the present invention for solving the above problems includes: a portable terminal equipped with a camera for photographing and a hairline application providing information on the hairline; And receiving an image captured from the camera in connection with the mobile terminal, detecting a head and facial skin tone from the received image, detecting a character hairline based on the detected head, skin tone, and character information, and detecting the detected character. It is configured to include a service providing server for displaying the hairline on the mobile terminal, and the photographed image is characterized in that at least three images including the front of the front, left, right, rear, and upper surfaces.

Here, the character information may include gender, age, personality, and story content.

In addition, the service providing server may include a head image detector for detecting a head image from the received photographed image; A skin tone detector configured to detect skin tone from the received photographed image; A character information detector configured to parse data including character information transmitted from the portable terminal to detect information on a character; A database for storing and managing hairlines according to head, skin tone, and character information; And detecting a character hairline matching the hairline stored in the database based on the data detected by the head detection unit, the skin tone detection unit, and the character information detection unit, and controlling the detected character hairline to be transmitted to and displayed in the mobile terminal. It characterized in that it comprises a hairline detection unit.

In addition, the hairline application includes an image input unit receiving an image captured from the camera; A character information input unit for inputting gender, age, personality and story content; A memory unit for storing and managing information input to the image input unit and the character information input unit; And controlling the image information input from the image input unit and the information stored in the character information input unit to be stored in the memory unit, and controlling the image information and character information stored in the memory unit to be transmitted to the service providing server. , It may be configured to include a control unit for receiving and displaying the result transmitted from the service providing server.

According to the present invention, a hairline suitable for the development of the actor's head, skin tone, character of the character, and the story can be provided through a mobile terminal at the set or stage, so that makeup according to the character's character and story development in the play without professional experience There is an advantage to be able to do it.

1 is an overall configuration diagram of a hairline providing system using a head and skin tone according to the present invention.
2 is a schematic configuration diagram of a hairline application applied to a hairline providing system using a head and skin tone according to the present invention.
3 is a diagram illustrating an image input interface for inputting an image applied to a hairline providing system using a head image and skin tone according to the present invention.
4 is a diagram illustrating a character information input interface for inputting character information applied to a hairline providing system using a head and skin tone according to the present invention.
5 is a schematic configuration diagram of a service providing server applied to a hairline providing system using a head and skin tone according to the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in more detail with reference to the accompanying drawings.

The present invention is provided with a camera for photographing, a portable terminal on which a hairline application that provides information on a hairline is installed, and in connection with the portable terminal to receive an image shot from the camera, the head image from the received image Using the head image and skin tone configured including a service providing server that detects and facial skin tone, and displays the detected hairline on the mobile terminal based on the detected head image, skin tone, character personality, and the situation (development) of the story. It relates to a hairline providing system.

In addition, in the present invention, the hairline refers to a presentation line where face and hair meet, including a bang line, which is a form of a hair design suitable for character characteristics.

1 is an overall configuration diagram of a hairline providing system using a head and skin tone according to the present invention.

Referring to FIG. 1, a hairline providing system using a head and skin tone according to the present invention includes a portable terminal 10 and a service providing server 20.

The portable terminal 10 is equipped with a camera for photographing and a hairline application 100 that provides information on a hairline is installed, and a program can be installed and a service is provided through a communication network (or Internet network). A mobile device capable of communicating with the server 20 is sufficient.

As such a portable terminal 10, a laptop computer, a smart phone, a tablet PC, a personal digital assistant (PDA), an enterprise digital assistant (EDA), a digital still camera , Digital Video Camera, Portable Multimedia Player (PMP), Personal Navigation Device or Portable Navigation Device (PND), Mobile Internet Device (MID), and e-Book Can be done.

The hairline application 100 installed in the mobile terminal 10 is to receive a virtual hairline, and image information captured from a camera equipped with the mobile terminal 10 according to a user's manipulation (or request) and Character information input through an input interface is received and stored and managed, and is connected to the service providing server 20 through a communication module provided in the portable terminal 10.

2 is a schematic configuration diagram of a hairline application 100 applied to a hairline providing system using a head and skin tone according to the present invention.

2, the hairline application 100 may include an interface 110, an image input unit 120, a character information input unit 130, a memory unit 140, and a control unit 150. .

The interface 110 controls to display information on the screen of the terminal 10 in connection with a graphic user interface (GUI) according to activation of the hairline application 100.

The interface 110 includes an image registration icon for capturing and displaying an image and a character information icon for inputting and displaying character information.

According to the selection of the image registration icon, icons for photographing the head and skin of the performer from various angles using the camera provided in the portable terminal 10 are displayed, and the character information, example, according to the selection of the character information icon is displayed. For example, it is configured to display an interface for inputting or selecting gender, age, personality, and story development.

The interface 110 recognizes selection and drag of an image or input window displayed as needed, and an icon for moving, deleting, or storing the image by dragging may be displayed in response thereto.

The image input unit 120 is for inputting image information taken according to selection of an image registration icon displayed on the interface 110.

3 illustrates an image input interface for inputting an image applied to a hairline providing system using a head and skin tone according to the present invention, and is an interface displayed according to a selection of the image registration icon 121.

Referring to FIG. 3, a camera icon 122 for photographing and an image import icon 123 for checking the photographed image are displayed according to the selection of the image registration icon 121.

When the camera icon 122 is selected by the user's manipulation, the performer's front 124, left side 125, right side 126, rear side 127, and top side 128 are used to capture images from multiple angles. An image display interface 129 in which an icon and an image captured by shooting are displayed is displayed.

Accordingly, an image photographed at the front side while the front 124 icon is selected is displayed on the image display interface 129, and an image photographed at the rear side while the rear 127 icon is selected is displayed on the image display interface 129 ), and a corresponding side of the captured images is displayed on the image display interface 129 even by selecting the remaining icons.

Through the interface as described above, the front 124, the left side 125, the right side 126, the rear side 127 and the top side 128 are selected for the performer, and the corresponding part of the head is photographed, and You can check the video immediately.

When the image import icon 123 is selected, images of the front side 124, the left side 125, the right side 126, the rear side 127, and the top side 128 are checked by selecting the camera icon 122. The interface that can be used is displayed.

In this case, the part that greatly influences the image of the actor may be the image of the front. That is, the image taken from the front side of the performer may be set as an essential image, and three or more images including the front image of the performer may be input to enable storage.

In addition, in order to provide a hairline, the front image of the actor must be input to facilitate detection of the head and facial skin tone, and at least three images including the front must be input to detect the appropriate hairline. .

In addition, although not indicated by reference numerals, a delete button for deleting a captured image and a storage button for storing an input image or content may be provided.

The character information input unit 130 is an interface for inputting character information, and performs a function of inputting information on a character in charge of an actor.

4 is a diagram showing a character information input interface of an embodiment for inputting character information applied to a hairline providing system using a head and skin tone according to the present invention, and an interface displayed according to selection of the character information 131 icon to be.

4, according to the selection of the character information icon 131, icons for gender 132, age 133, personality 134, story content 135, and corresponding icons according to selection of each icon A selection interface 136 is displayed for entering or selecting information.

When the gender 132 icon is selected, a check box for selecting male or female may be displayed.

When the age 133 icon is selected, a check box for selecting an age in the play of the character from 10 to 70 years old may be displayed.

When the personality 134 icon is selected, a check box for selecting the propensity of the character among sincerity, sympathy, nervousness, openness, and extroversion may be displayed.

At this time, the character's personality can be subdivided into a sub-class for extroversion, introversion, nervousness, self-esteem, sincerity, impulsivity, affinity, antisociality, openness, and occlusion, and sub-classes for each of the upper classes, and can be configured to be selected have. Here, the sub-classification may consist of adjective classifications such as'careful','mild','worried','poor','fun' and'friendly'.

In addition, it can be configured to select types such as human, inhuman, neutral, etc., if necessary, and in addition to this, an icon to select a role (protagonist, supporting role, etc.), country, era, race, etc., and corresponding checkboxes are provided. Can be configured.

When the story content 135 icon is selected, a check box for selecting a situation in the play, such as fight, escape, reconciliation, love, regret, separation, meeting, death, reincarnation, etc. may be displayed.

In addition, although not indicated by reference numerals, a delete button for canceling or deleting a selection and a save button for storing inputted content may be provided.

The memory unit 140 performs a function of storing and managing information input to the image input unit 120 and the character information input unit 130, and a storage device provided in the portable terminal 10 may be used.

The control unit 150 controls the image information input from the image input unit 120 and information stored in the character information input unit 130 to be stored in the memory unit 140 according to a user's manipulation (or request). And, at the request of the user, control to transmit the image information and character information stored in the memory unit 140 to the service providing server 20, and receive and display the result transmitted from the service providing server 20 It performs the function of making it.

The service providing server 20 (refer to FIG. 1) receives the captured image and character information of the performer transmitted from the portable terminal 10, detects the head and face skin tone based on the received captured image, and character information Based on the function of finally detecting a hairline suitable for a character, and controlling the detected hairline to be transmitted to the portable terminal 10.

5 is a schematic configuration diagram of a service providing server applied to a hairline providing system using a head and skin tone according to the present invention.

5, the service providing server 20 includes a head detection unit 21, a skin tone detection unit 22, a character information detection unit 23, a database 24, and a hairline detection unit 25. do.

The head image detection unit 21 performs a function of detecting the head image from the received photographed image, and detects the appearance of the actor's head image from the image received from the portable terminal 10.

At this time, the detected head is classified into frontal bone, temporal bone, sphenoid bone, ethmoid bone, fibula, maxillary bone, mandibular bone, zygomatic bone, parietal bone, and occipital bone, and detected by combining the detected regions.

In the present invention, the head image refers to a form in which facial muscles, skull bones, and skin tissues present on the face of the face are harmonized, and as the hair style is included in the photographed image, the frontal bone forming the front part of the head, the fibula forming the nose, It may be configured to be detected with the maxillary bone forming the upper jawbone, the mandible bone forming the lower jawbone and the zygomatic bone forming the cheekbones as major parts.

On the other hand, the forehead of a person occupies 1/3 of the total area of the face, and is a part that has a great influence on the formation of impressions, and many contemplative scholars consider the forehead as the most important part of the face.

Accordingly, the head detection unit 21 is configured to detect the shape, width, and speech line of the forehead from the front image.

The skin tone detection unit 22 performs a function of detecting a skin tone from a received photographed image, and may be configured to be detected from a front, left, and right image.

In this case, the skin tone is to be detected in the area determined as the skin area. From the received image (image), the area including eyes, nose, and mouth corresponding to the basic arrangement shape of the facial area is detected as a face area, and the detected face The area may be configured to be detected as an average value of the set area for the skin color.

For example, in the process of detecting skin tone, the osteophytes that form the cheekbones protrude to the front side and may appear brightly colored by illumination, so the osteophytes may be configured to be excluded, and the facial area close to the background area Can be configured to be excluded because it can be photographed relatively darker than the skin color of the character.

That is, the area in which the skin tone is detected in the face area may be formed between the forehead, the eye and the cheekbone, and between the cheekbone and the lips, and an RGB value using the skin color detected in the setting area as an average value may be detected as the skin tone.

Here, a process of detecting the average value of the set area for the skin color will be described.

In the process of detecting the average color value, the average color value for a predetermined area may be determined using various algorithms. For example, in the algorithm for determining the average color value, the image is divided into a plurality of grids, and a color histogram is obtained for each divided cell, and the maximum value is calculated as the area representative color value for the cell. There are algorithms that determine the average value of the color histogram as the representative color value of the area, and the algorithm that determines the main hue vector as the representative color value of the area.

In the present invention, a pixel list may be created by searching for pixels existing in a predetermined area, and RGB information may be collected from each pixel included in the pixel list. An average RGB value may be calculated based on the collected RGB information and coded to determine an average color code. The pixels included in the pixel list may be all pixels existing in a predetermined area, but are not limited thereto, and the pixel list may be determined based on some randomly selected pixels for simplification of the operation process.

In this case, the predetermined area may have the same size.

The character information detection unit 23 parses data including character information transmitted from the portable terminal 10 to detect information on a character.

Here, the character information is information input through the character information input unit 130 and is used as important information for dressing up a character.

The database 24 stores and manages the hairline according to the head, skin tone, and character information.

Hairline varies according to gender, especially males have a deep relationship with baldness, and are derived differently according to age.

For example, the M-shaped forehead is reminiscent of a personality with an intelligent head, a strong creative mind, and a rich sensitivity. The rounded forehead is reminiscent of an obedient, gentle and sincere personality, and the angular type is reminiscent of a character with high determination and responsibility. In addition, the narrow hyung is reminiscent of a personality that has a lot of hardships and has no tips, and the broad hyung is reminiscent of the intelligent while working in the office. In addition, the monkey type is a form commonly seen in women, reminiscent of a present-looking wife or an emotional rebellious type, and the tertiary type (參差形) is reminiscent of the owner of rebellion and violent personality.

Accordingly, the database 24 stores and manages information on gender, age, and story content, including the personality according to the hairline type, but may consist of a collection of data items composed of a standardized table. It can be configured in a form in which the structure and the location of the data to be configured are predetermined.

The hairline detection unit 26 is a character suitable for a performer matching the hairline stored in the database 25 based on the data detected by the head detection unit 21, the skin tone detection unit 22, and the character information detection unit 23. The hairline is detected, and the detected character hairline is transmitted to and displayed on the portable terminal 10.

Here, a semantic web may be used to detect a character hairline made by the hairline detector 26.

In the case of the information transmitted from the portable terminal 10, the connection relationship between the image of the actor and character information on the role played by the actor may be ambiguous.

The Semantic Web is a framework that allows computers to process information about resources and the relationship-semantics between resources.

In relation to the Semantic Web, Ontology is defined as a system that specifically describes the concept that is the smallest unit of information that can be understood by a computer, and explains these specifically described concepts through relationships and conditions. Can also be described as a database for the Semantic Web

In addition, the hairline detection unit 26 transmits information including the shape, position, and height of the eyebrows based on the head image detected by the head image detection unit 21 to the mobile terminal 10 It is to be displayed through the line application 100.

In addition, the skin tone detection unit 22 transmits information including a makeup color and a makeup thickness suitable for the character's personality or story situation to the mobile terminal 10 based on the skin tone, and the hairline application 100 To be displayed.

According to the present invention, a hairline suitable for the development of the actor's head, skin tone, character of the character, and the story can be provided through a mobile terminal at the set or stage. There is an advantage of being able to perform makeup.

Although the preferred embodiments of the present invention have been described above, the scope of the present invention is not limited thereto, and it should be understood that the scope of the present invention extends to the scope substantially equal to the embodiment of the present invention. Various modifications may be implemented by those of ordinary skill in the technical field to which the present invention pertains within the scope not departing from the spirit of the invention.

10: mobile terminal 20: service providing server
21: head detection unit 22: skin tone detection unit
23: character information detection unit 24: database
25: hairline detection unit 100: hairline application
110: interface 120: video input unit
121: image registration icon 122: camera icon
123: image import icon 130: character information input unit
140: memory unit 150: control unit

Claims (4)

In the hairline providing system for providing a hairline suitable for the development of the actor's head, skin tone, character's personality, and story through a portable terminal at the set or stage,
A portable terminal equipped with a camera for photographing and installed with a hairline application providing information on a hairline; And
Receives an image captured from the camera in connection with the mobile terminal, detects a head and facial skin tone from the received image, detects a character hairline based on the detected head, skin tone, and character information, and detects character hair A service providing server for displaying a line on the mobile terminal;
It is composed including,
The captured image,
There are more than 3 images including the front of the front, left, right, rear, and top,
The hairline application,
An interface for controlling to display information on the screen of the terminal in connection with a graphic user interface (GUI) according to activation of the hairline application;
An image input unit receiving an image captured from the camera;
A character information input unit for inputting gender, age, personality and story content;
A memory unit for storing and managing information input to the image input unit and the character information input unit; And
The image information input from the image input unit and the information input from the character information input unit are controlled to be stored in the memory unit, and the image information and character information stored in the memory unit are transmitted to a service providing server, A control unit for receiving and displaying a result transmitted from the service providing server;
It is composed including,
In the video input unit,
For inputting image information taken according to the selection of the image registration icon displayed on the interface, an image registration icon, camera icon, image import icon, bottom, left, right, rear, top, and image display interfaces are provided. Become,
The character information input unit,
As an interface for inputting character information, there is provided an icon for gender, age, personality, story content according to the selection of the character information icon, and a selection interface for inputting or selecting corresponding information according to the selection of each icon,
The service providing server,
A head image detector configured to detect a head image from the received photographed image;
A skin tone detector configured to detect skin tone from the received photographed image;
A character information detector configured to parse data including character information transmitted from the mobile terminal to detect information on a character;
A database for storing and managing hairlines according to head, skin tone, and character information; And
Hair that detects a character hairline matching the hairline stored in the database based on data detected by the head detection unit, skin tone detection unit, and character information detection unit, and controls the detected character hairline to be transmitted to and displayed in the mobile terminal A line detection unit;
Hairline providing system using the head and skin tone, characterized in that it comprises a. delete delete delete

Images