JP7269309B1 - Information processing device, image presentation method, and program - Google Patents

Abstract

An information processing device, an image presentation method, and a program capable of recommending to a user a hairstyle that can be applied according to the user's current hair condition among a plurality of hairstyles are provided. A treatment information processing server 2, based on a user image representing the condition of the user's hair taken after treatment and an elapsed period from the treatment to a specific timing, calculates the hair after the elapsed period. estimating the condition of the user's hair, and based on the estimated condition of the hair, specifying a hairstyle image representing a hairstyle that can be applied to the user from among a plurality of pre-stored hairstyle images. , to present the identified hairstyle image to the user. [Selection drawing] Fig. 10

Description

The present invention relates to a technical field such as a system for recommending a hairstyle to a user after the user's hair has been treated.

Conventionally, the system disclosed in Patent Document 1 is known as a system for recommending hairstyles to users. In this system, the hairstyle in the user's current image is replaced with the hairstyle in the past image and displayed, thereby visually conveying the image of the hairstyle desired by the user this time.

Japanese Patent Application Laid-Open No. 2021-2047

However, it is not always the case that the user desires the past hairstyle this time according to the current hair condition of the user. It is not possible to recommend a hairstyle that can be applied to the user according to the condition of the hair.

Therefore, the present invention provides an information processing device, an image presentation method, and a program capable of recommending to a user a hairstyle that can be applied according to the user's current hair condition from among a plurality of hairstyles. One of the challenges is to provide

In order to solve the above-mentioned problems, the invention according to claim 1 is an information processing apparatus for presenting a hairstyle image to a user at a specific timing after a user's hair is treated by a hairdresser, Based on the hair tip position specified with reference to a specific part of the human body and the length corresponding to the elapsed period from the treatment to the specific timing in the user image representing the condition of the hair captured after estimating means for estimating the position of the tip of the hair afterward and calculating a first distance between the estimated tip position and the specific part ; calculating a second distance between the specified hair tip position and the specified part based on the specified part of the hair whose second distance is greater than or equal to the first distance among the plurality of hairstyle images specifying means for specifying a hairstyle image representing a style as a hairstyle image representing a hairstyle that can be applied to the user; and presenting means for presenting the hairstyle image specified by the specifying means to the user. and. Accordingly, it is possible to recommend to the user a hairstyle that can be applied according to the user's current hair length from among a plurality of hairstyles.

The invention according to claim 2 is the information processing apparatus according to claim 1 , wherein the estimating means includes a hair tip position and the elapsed period specified based on each of a plurality of specific parts of the human body in the user image. estimating the tip position of the hair after the elapsed period for each of the specific parts based on the length corresponding to the length corresponding to the specified part, and calculating a first distance between the estimated tip position and the specific part for each of the specific parts and calculating a second distance between a tip position of the hair specified in the hairstyle image based on each of the plurality of specific parts of the human body and the specific parts for each of the specific parts, and identifying a hairstyle image representing a hairstyle in which the second distance is equal to or greater than the first distance in the specific part of the. This makes it possible to recommend a more suitable hairstyle to the user.

The invention according to claim 3 is the information processing apparatus according to claim 1 or 2 , wherein a plurality of user images each representing a plurality of hair states having different treatment dates included in the user's treatment history are displayed. and calculating the length according to the elapsed period based on the number of days of the treatment days and the amount of change. and Accordingly, it is possible to calculate an appropriate hair length according to the characteristics of the user's hair.

The invention according to claim 4 is the information processing apparatus according to any one of claims 1 to 3 , wherein a plurality of treatment dates included in the treatment history of the user are specified, and the specified treatment dates are specified. Further comprising first determining means for determining the specific timing based on the number of days, wherein the presenting means presents the hairstyle image to the user at the specific timing determined by the first determining means. Characterized by Accordingly, it is possible to recommend to the user a hairstyle that can be applied at an appropriate specific timing according to the history of the user's actions.

The invention according to claim 5 is the information processing apparatus according to claim 4 , wherein the first determination means further specifies the content of the treatment included in the treatment history of the user, and determines the specified treatment days. The specific timing is determined according to the treatment content based on the number of days and the treatment content. Accordingly, it is possible to recommend to the user a hairstyle that can be applied at an appropriate specific timing according to the user's hairstyle preference.

The invention according to claim 6 is an information processing device that presents a hairstyle image to the user at a specific timing after the user's hair is treated by the practitioner, and a second determining means for identifying a hairstyle of interest and determining the specific timing based on the identified hairstyle; a user image representing the state of the hair captured after the treatment; estimating means for estimating the state of the hair after the elapsed period based on the elapsed period from the treatment to the specific timing determined by the second determining means; and the state of the hair estimated by the estimating means. specifying means for specifying, from among a plurality of pre-stored hairstyle images, a hairstyle image representing a hairstyle that can be applied to the user, based on the hairstyle image specified by the specifying means; and presenting means for presenting the to the user . Accordingly, it is possible to recommend to the user a hairstyle that can be applied at an appropriate specific timing according to the user's recent hairstyle preferences. The invention according to claim 7 is the information processing apparatus according to claim 6, wherein the estimation means specifies the length of hair growing from a specific part of the head in the user image, Based on the length and the length corresponding to the elapsed period, the length of the hair after the elapsed period is estimated as a first length, and the specifying means, for each of the plurality of hairstyle images stored in advance, A hairstyle in which a second length of hair growing from the specific portion of the head in the hairstyle image is specified, and the second length is equal to or less than the first length among the plurality of hairstyle images. is characterized by specifying a hairstyle image representing Accordingly, it is possible to recommend to the user a hairstyle that can be applied according to the user's current hair length from among a plurality of hairstyles. According to an eighth aspect of the present invention, there is provided the information processing apparatus according to the seventh aspect, wherein the estimating means has a length of hair growing from each of a plurality of specific parts of the head in the user image and the elapsed time. estimating the first length for each of the specific parts based on the corresponding length, and the specifying means estimates the second length of the hair growing from each of the plurality of the specific parts of the head in the hairstyle image. is specified for each specific part, and among the plurality of hairstyle images, a hairstyle image representing a hairstyle in which the second length is equal to or less than the first length in each of the specific parts is specified. Characterized by This makes it possible to recommend a more suitable hairstyle to the user.

According to a ninth aspect of the present invention, there is provided an image presenting method executed by an information processing device for presenting a hairstyle image to a user at a specific timing after the hair of the user is treated by the hairdresser, the image presenting method comprising: Based on the tip position of the hair identified with reference to a specific part of the human body and the length corresponding to the elapsed period from the treatment to the specific timing in the user image taken later showing the condition of the hair, after the elapsed period estimating a tip position of the hair and calculating a first distance between the estimated tip position and the specific part ; calculating a second distance between a tip position of the hair specified based on the specific part and the specific part, and selecting a hairstyle having the second distance greater than or equal to the first distance among the plurality of hairstyle images; identifying a hairstyle image to represent as a hairstyle image representing a hairstyle that can be applied to the user; and presenting the identified hairstyle image to the user. and According to a tenth aspect of the invention, there is provided an image presenting method executed by an information processing device for presenting a hairstyle image to a user at a specific timing after a user's hair has been treated by a hairdresser, the image presenting method comprising: identifying a hairstyle that the user is interested in from the browsing history of the user, determining the specific timing based on the identified hairstyle; estimating the condition of the hair after the elapsed period based on the person image and the elapsed period from the treatment to the determined specific timing; and based on the estimated hair condition, identifying a hairstyle image representing a hairstyle that can be applied to a user from among a plurality of pre-stored hairstyle images; and presenting the identified hairstyle image to the user. , is characterized by including

According to an eleventh aspect of the invention, there is provided a computer included in an information processing device that presents a hairstyle image to the user at a specific timing after the user's hair is treated by the hairdresser. Based on the tip position of the hair specified with reference to a specific part of the human body in the user image representing the state of the hair and the length corresponding to the elapsed period from the treatment to the specific timing, the tip position of the hair after the elapsed period and an estimating means for calculating a first distance between the estimated tip position and the specific part; calculating a second distance between the specified hair tip position and the specified part; as a hairstyle image representing a hairstyle that can be applied to the user, and as a presentation means for presenting the hairstyle image specified by the specifying means to the user. and According to a twelfth aspect of the invention, a computer included in an information processing device that presents a hairstyle image to the user at a specific timing after the user's hair has been treated by the hairdresser can obtain the hair style image from the browsing history of the user. a second determining means for identifying a hairstyle in which a user is interested and determining the specific timing based on the identified hairstyle; and a user image showing the state of the hair captured after the treatment. and an estimating means for estimating the state of the hair after the elapsed period based on the elapsed period from the treatment to the specific timing determined by the second determining means; and the hair estimated by the estimating means. specifying means for specifying, from among a plurality of pre-stored hairstyle images, a hairstyle image representing a hairstyle that can be applied to the user based on the state of the hair specified by the specifying means; It is characterized by functioning as presentation means for presenting the style image to the user.

Advantageous Effects of Invention According to the present invention, it is possible to recommend a hairstyle that can be applied to a user from among a plurality of hairstyles according to the user's current hair condition.

It is a figure which shows the outline|summary structure example of treatment information provision system S. FIG. (A) is a block diagram showing a schematic configuration example of the treatment information processing server 2, and (B) is a diagram showing an example of functional blocks of the system control unit 23. FIG. It is a figure showing an example of the specific part of the head. FIG. 10 is a diagram showing an example of a first hair length estimated based on the length of hair growing from the top section of the target user in the user image and the length according to the elapsed time from the treatment to the specific timing; FIG. 10 is a diagram showing an example of the tip position of hair estimated based on the tip position of the hair specified based on the eyes of the target user in the user image and the length corresponding to the elapsed time from the treatment to the specific timing; . It is a figure which shows an example of the number of days of the past treatment days, the change amount of hair, and the elapsed period from the last treatment to specific timing. It is a figure which shows the comparative example of the 1st hair length in a user image, and the 2nd hair length in a hairstyle image. It is a figure which shows the comparative example of the 1st distance in a user image, and the 2nd distance in a hairstyle image. 4 is a diagram showing a display screen example of a hairstyle image displayed on the user terminal 1. FIG. 5 is a flowchart showing an example of processing of the system control unit 23 in Embodiment 1; It is a flow chart which shows an example of hair length specification processing in Step S7. FIG. 11 is a flow chart showing an example of processing of the system control unit 23 in the second embodiment; FIG.

Embodiments of the present invention will be described below with reference to the drawings. The following embodiments are embodiments in which the present invention is applied to a treatment information providing system. In the following embodiments, a shop (hereinafter referred to as a "salon") that serves as a beauty salon (also referred to as a beauty salon or a beauty salon) and a barber shop (also referred to as a barber shop or barber shop) is used to treat the hair of a user. A case in which a treatment is performed for the patient will be described as an example.

[ 1. Configuration and Function Overview of Treatment Information Providing System S ]
First, with reference to FIG. 1, the configuration and functional overview of a treatment information providing system S according to this embodiment will be described. FIG. 1 is a diagram showing a schematic configuration example of a treatment information providing system S. As shown in FIG. As shown in FIG. 1, the treatment information providing system S includes a user terminal 1, a treatment information processing server 2, and the like. The user terminal 1 and the treatment information processing server 2 are each connected to the network NW. The network NW is composed of, for example, the Internet, a mobile communication network and its radio base stations. Although one user terminal 1 is shown in the example of FIG. 1, there are actually a plurality of user terminals.

A user terminal 1 is a terminal used by a user. The user terminal 1 includes an operation/display section, a communication section, a storage section, a control section, and the like. The operation/display unit includes, for example, a display (touch panel) having an input function for accepting operations such as selection by a person's finger or pen, and a display function for displaying various screens. The storage unit stores programs such as an operating system (OS), a treatment reservation application, and a browser. The control unit includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. For the user terminal 1, for example, a personal computer (PC), smart phone, tablet, mobile phone, portable game machine, or the like can be applied. The user accesses the facility information providing site from the user terminal 1 via the network NW using a treatment reservation application or a browser, and the screen provided from the facility information providing site displayed on the display of the user terminal 1 ( For example, it is possible to browse treatment menu information and make treatment reservations through a web page).

The treatment information processing server 2 (an example of the information processing apparatus of the present invention) is composed of one or more server computers, and provides a facility information providing site to which a specific URL (Uniform Resource Locator) is assigned on the network NW. . FIG. 2A is a block diagram showing a schematic configuration example of the treatment information processing server 2. As shown in FIG. As shown in FIG. 2A, the treatment information processing server 2 includes a communication section 21, a storage section 22, a system control section 23, and the like. The communication unit 21 has a function of connecting to the network NW and performing communication. The storage unit 22 is composed of, for example, a hard disk drive, etc., and stores an operating system, a server program (including the program of the present invention), and the like. Further, databases such as a salon database (DB) 221 and a user database (DB) 222 are constructed in the storage unit 22 .

The salon database 221 is a database for storing (registering) salon information relating to salons for which accounts have been created in the treatment information providing system S. FIG. For example, the salon database 221 stores salon IDs, salon names, addresses, e-mail addresses, practitioner information, treatment menu information, treatment reservation information, treatment history, etc. in association with each salon. Here, the salon ID is identification information for identifying the salon, and is used, for example, for logging into the facility information providing site.

The practitioner information includes the practitioner ID of the practitioner who belongs to the salon, the practitioner name, and the like. The operator ID is identification information for identifying the operator. The treatment menu information includes information about treatment menus (treatment contents) and hairstyles that can be treated at the salon. Examples of the treatment menu include cut, perm, color, gray hair dye, straightening, and bleaching. Examples of hairstyles include long, semi-long, medium, short, Mrs., and bob hairstyles. Note that the hairstyle may include a hair color. The treatment reservation information includes the user ID (user ID) of the user who reserved the treatment at the salon, the hairstyle ID of the hairstyle image representing the hairstyle for which the treatment was reserved, and the reservation date when the treatment was reserved, etc. for each user. included separately. A user ID is identification information for identifying a user, and is used, for example, to log in to a facility information providing site. A hairstyle ID is identification information for identifying a hairstyle image. The treatment reservation information may include the operator ID of the operator scheduled to perform the treatment on the user.

In the treatment history, the user ID of the user who received treatment at the salon in the past, the treatment date when the treatment was performed for the user, the treatment menu, and the image taken after the treatment (for example, immediately after the treatment) Data such as a photographic image (hereinafter referred to as “user image”) representing the condition of (photographed) hair is included for each user. In this specification, the date may be the day (year, month, day) or the date and time. The date and time may be the date and time, or the date and time zone. According to the treatment history, the user's image immediately after each treatment is recorded as a history along with the dates of multiple treatments, taking into consideration the characteristics of the user's hair length (whether it grows easily or not). It is also possible to recommend the next recommended treatment date. In the salon, after the treatment, for example, until the user leaves the salon (for example, until several tens of minutes after the treatment is completed), the camera of the mobile terminal of the salon captures the state of the user's hair. The data of the user image imaged in this way is manually or automatically uploaded to the treatment information processing server 2 from the mobile terminal together with the salon ID of the salon. It should be noted that the user image may be an image in which the state of the hair is captured from the front, side, and back of the user.

The user database 222 is a database for storing user information on users whose accounts have been created in the treatment information providing system S. FIG. For example, the user database 222 stores user IDs, user names, addresses, telephone numbers, e-mail addresses, genders, browsing histories, etc. of users in association with each other. Here, the browsing history includes information about hairstyles browsed by the user, dates of browsing, and the like. The hairstyle information includes the name of the hairstyle. For example, the user can view information about a desired hairstyle on a screen provided from the facility information providing site and displayed on the display of the user terminal 1 . It should be noted that information related to hairstyles viewed on sites other than the facility information providing site may be included. In this case, the user ID of the user is common or associated between the facility information providing site and other sites.

The system control unit 23 (an example of a computer) includes a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and executes various processes according to a server program. FIG. 2B is a diagram showing an example of functional blocks of the system control unit 23. As shown in FIG. By executing a server program or the like, the system control unit 23 includes a recommendation timing determination unit 231, a hair condition estimation unit 232, a hairstyle image identification unit 233, a hairstyle image presentation unit 234, and a hair condition estimation unit 232, as shown in FIG. It functions as the reservation processing unit 235 and the like. Here, the recommendation timing determination unit 231 is an example of the first determination means and the second determination means. The hair condition estimation unit 232 is an example of estimation means and calculation means. The hairstyle image specifying unit 233 is an example of specifying means. The hairstyle image presenting unit 234 is an example of presenting means.

The recommendation timing determination unit 231 performs a treatment on the hair of a user (hereinafter referred to as a "target user") who has visited a salon (hereinafter referred to as a "target salon") to recommend to the user one or more times. (that is, the specific timing after the treatment by the practitioner) is determined. Here, the specific timing is, for example, the timing of recommending a hairstyle that can be applied according to the current hair condition of the target user in order to encourage the target user to visit the store again. or time zone). For example, the recommendation timing determination unit 231 identifies a plurality of treatment days included in the treatment history of the target user who has visited the target salon multiple times, and specifies the number of days (in other words, interval) of the identified treatment days. Based on this, the specific timing may be determined. This makes it possible to recommend to the target user a hairstyle that can be applied at an appropriate specific timing according to the behavior history of the target user. For example, based on the number of days between the previous treatment date and the last treatment date, the specific timing is determined to be the day after the previous treatment date or any time within the relevant day.

In addition to the plurality of treatment days, the recommendation timing determination unit 231 further identifies a treatment menu included in the treatment history of the target user, and based on the number of treatment days and the treatment menu that have been identified, the treatment menu You may determine the specific timing according to. As a result, it becomes possible to recommend to the target user a hairstyle that can be applied at an appropriate specific timing according to the target user's preference for the hairstyle. For example, in the case of a target user having different intervals for each treatment menu, the specific timing may be determined (that is, multiple determinations) for each treatment menu. In this case, for example, if the interval immediately before receiving a haircut and perm treatment is two months, and the interval immediately before receiving a haircut only treatment is one month, two specific timings are determined. . However, in this case, if the target user is to make a treatment reservation due to the first recommendation, there is no need to make the second recommendation to the target user. Alternatively, when the treatment menu that the target user is likely to receive can be estimated from the treatment history, the recommendation timing determination unit 231 may determine one specific timing according to the estimated treatment menu. This case corresponds to, for example, a case where the treatment menu in the most recent year is only haircut and perm, or a case where haircut and perm are frequently used.

In addition, the recommendation timing determination unit 231 identifies a hairstyle that the target user is interested in from the browsing history of the target user who has visited the target salon one or more times, and based on the specified hairstyle, A specific timing may be determined. As a result, it becomes possible to recommend to the target user a hairstyle that can be applied at an appropriate specific timing according to the target user's recent hair style preferences. For example, a hairstyle that is viewed relatively frequently after the previous treatment is identified as a hairstyle that the target user is interested in, and the number of days that have passed since the previous treatment date according to the identified hairstyle Alternatively, any time within the day is determined as the specific timing. Here, as the number of days corresponding to the hairstyle, for example, 180 days (about half a year) are set in advance for long hairstyles, and 60 days are set in advance for medium hairstyles. Note that the recommendation timing determining unit 231 may determine the specific timing to be a day on which the number of days corresponding to the gender has elapsed since the previous treatment date or any time within the day. Here, as the number of days according to gender, for example, 30 days for men and 60 days for women are set in advance.

The hair condition estimating unit 232 generates a user image representing the hair condition of the target user for whom the specific timing is determined by the recommendation timing determining unit 231 (at least, the hair captured after the previous hair treatment of the target user). Based on the user image representing the state of the target user) and the elapsed period from the previous treatment to the target user's hair until a specific timing, estimate the hair condition after the elapsed period (for example, at a specific timing) . Here, the user image used for estimating the state of the hair is at least one of the front user image, the side user image, and the back user image (that is, among a plurality of types of user images). The state of the hair after the elapsed period may be estimated for each of a plurality of types of user images, which is any one user image. Examples of hair conditions include hair color, hair wave shape, hair length, and hair growth.

For example, the hair condition estimation unit 232 identifies the color of hair growing from a specific part of the head in the user image of the target user, and based on the identified color and the color change according to the elapsed time, Estimate the hair color after the elapsed period. Here, the specified color may be represented by hue, lightness, and saturation, for example. The color change according to the elapsed time is, for example, color fading according to the elapsed time, and the degree of color fading may be represented by hue, brightness, and saturation. Then, based on the specified color and color fading according to the elapsed time, the hair color after the elapsed time is represented by hue, lightness, and saturation. Alternatively, the hair condition estimation unit 232 identifies the wave shape of hair growing from a specific part of the head in the user image of the target user, and determines the wave shape change according to the identified wave shape and the elapsed time. Based on this, the wave shape of the hair after the elapsed period is estimated. Here, the specified wave shape may be represented by, for example, curvature (degree of bending). The wave shape change according to the elapsed time may be represented by, for example, a curvature change according to the elapsed time. Then, the wave shape of the hair after the elapsed time is represented by the curvature based on the specified wave shape and the curvature change according to the elapsed time.

In addition, the hair condition estimation unit 232 identifies the length of hair growing from a specific part of the head in the user image of the target user, and based on the identified length and the length corresponding to the elapsed period , the hair length after the elapsed period is estimated as a first length (hereinafter referred to as “first hair length”). Here, the length corresponding to the elapsed period is the length of hair that grows during the elapsed period, and is the amount of change in hair length. Note that the length of the hair may be specified by the actual size (for example, centimeters) from the user image, or the horizontal width of the eye extracted from the user image, or the distance between the right eye and the left eye. It may be specified as a reference (one unit). Various known methods can be applied as a method of specifying the length of hair in actual dimensions. The actual length of the hair can be specified based on the number of pixels between the extracted points.

FIG. 3 is a diagram showing an example of a specific part of the head. In the example of FIG. 3, the head is divided into relatively wide regions (areas) of top section TS, middle section MS, and under section US. However, the specific part may be a narrower area than the section shown in FIG. 3, and may be, for example, the part above the forehead (hairline), the sideburns, the nape of the neck, and the like. These specific parts may vary depending on the type of user image (that is, front, side, and back) used for estimating the first hair length. For example, in the front user image, the upper part of the forehead is set as the specific part, in the side user image, sideburns are set as the specific part, and in the back user image, the nape part is set as the specific part. be. Note that the length of hair is not limited to the length of one hair, and may be the length of several hairs together. In addition, when specifying the length of the hair, it is not necessary to extract the hair in a part that is difficult to capture with a camera, such as the hairline.

FIG. 4 is a diagram showing an example of the first hair length estimated based on the length of the hair growing from the top section of the target user in the user image and the length corresponding to the elapsed time from the treatment to the specific timing. be. In the example of FIG. 4, the length obtained by adding the length L02 corresponding to the elapsed period to the length L01 of the hair growing from the top section, which is one of the specific parts of the target user in the user image, is the first length. Estimated as hair length L1. Here, the hair condition estimating unit 232, based on the length of hair growing from each of a plurality of specific parts of the head (for example, the top section and the under section) in the user image and the length according to the elapsed period , the first hair length may be estimated for each specific part. Also, the first hair length may be estimated for each of the plurality of types of user images described above for specific parts.

As another example, the hair condition estimating unit 232 determines the tip position of the hair specified based on the specific parts of the human body (here, the target user) in the user image of the target user and the length corresponding to the elapsed time. , the position of the tip of the hair after the elapsed period (that is, the degree of growth of the hair) may be estimated, and the first distance between the estimated position of the tip and the specific part may be calculated. Here, the first distance between the tip position of the hair and the specific part may be specified by the actual size from the user image, similar to the length of the hair, or the horizontal direction of the eye extracted from the user image. or the distance between the right eye and the left eye. Examples of specific reference parts include eyes, ears, jaws, and shoulders. These specific parts may vary depending on the type of user image (that is, front, side, and back) used for estimating the first hair length. For example, eyes are set as specific parts in the front user image, ears and chin are set as specific parts in the side user image, and shoulders are set as specific parts in the back user image.

FIG. 5 is an estimate based on the hair tip position specified based on the target user's eye (in this example, the upper end of the eye) in the user image and the length corresponding to the elapsed time from the treatment to the specific timing. FIG. 10 is a diagram showing an example of the position of the tip of the hair that has been cut. In the example of FIG. 5, the hair is extended in the gravitational direction (vertical direction) by the length corresponding to the elapsed period from the tip position P1 of the hair specified based on the eye position Pk of the target user in the user image. is estimated as the tip position P2, and the first distance D1 between the tip position P2 and the eye position Pk is calculated. Here, the hair condition estimating unit 232, based on the hair tip position and the length corresponding to the elapsed period, which are specified based on each of a plurality of specific parts of the human body (for example, eyes and shoulders) in the user image, A tip position of the hair after the elapsed period is estimated for each specific part, and a first distance between the estimated tip position and the specific part is calculated for each specific part.

In addition, the color change or wave shape change according to the elapsed period from the treatment to the specific timing is generally a color (e.g., hue, brightness, and saturation) that changes in a unit period (e.g., one month), or a wave Although it may be calculated based on an average shape (for example, curvature), it is preferable to calculate a color change or a wave shape change according to the target user in the user image. In the latter case, the hair condition estimating unit 232 estimates the hair color or wave on the treatment days based on a plurality of user images each representing a plurality of hair conditions with different treatment days included in the treatment history of the target user. The amount of change in the shape (curvature) is calculated, and based on the number of treatment days and the amount of change, the color change or wave shape change corresponding to the elapsed period from the treatment to the specific timing is calculated.

In addition, the length according to the elapsed period from the treatment to the specific timing may be generally calculated based on the average of the lengths extended in a unit period (for example, one month), but preferably, the user image It is preferable that the length corresponding to the target user in is calculated. In the latter case, the hair condition estimation unit 232 calculates the amount of hair change ( That is, the amount of change in hair length) is calculated, and the length corresponding to the elapsed time from the treatment to the specific timing is calculated based on the number of treatment days and the amount of change. This makes it possible to calculate an appropriate hair length according to the characteristics of the target user's hair (whether it grows easily or not). FIG. 6 is a diagram showing an example of the number of days of treatment days in the past, the amount of change in hair, and the elapsed period from the previous treatment to a specific timing. In the example of FIG. 6, the number of days (31 days) between the last treatment date and the previous treatment date, the amount of hair change (1 cm) during the treatment days, and the elapsed time from the previous treatment to a specific timing ( 20 days), the length X corresponding to the elapsed period is calculated.

Based on the hair condition estimated by the hair condition estimation unit 232, the hairstyle image specifying unit 233 associates a hairstyle image representing a hairstyle that can be applied to the target user with the salon ID of the target salon. A plurality of hairstyle images stored in advance are specified. In other words, a hairstyle image representing a hairstyle that cannot be applied to the target user based on the estimated hair condition of the target user is excluded from the identification target. For example, a hairstyle with hair longer than the current hair length of the target user is a hairstyle that cannot be applied.

In addition, the plurality of pre-stored hairstyle images are, for example, among the user images included in the treatment history stored in the salon database 221 (that is, the treatment history associated with the salon ID of the target salon). It is a user image of a user who permits the provision of a photographic image to others. In this case, it is preferable that the face portion of the user image of the user is subjected to mosaic processing. Alternatively, the plurality of pre-stored hairstyle images may be, for example, photographic images representing the condition of the hair of a model under contract with the target salon. As with the user image, the hairstyle image is at least one of the front hairstyle image, the side hairstyle image, and the back hairstyle image (that is, among a plurality of types of hairstyle images). It is one hairstyle image.

When the hair condition estimating unit 232 estimates the hair color, the hairstyle image specifying unit 233 determines the hair growing from a specific part of the head in the hairstyle image for each of a plurality of hairstyle images stored in advance. , and specifies, among the plurality of hairstyle images, a hairstyle image representing a hairstyle having a color brighter than the hair color estimated by the hair condition estimation unit 232, for example. When the hair condition estimation unit 232 estimates the wavy shape of the hair, the hairstyle image specifying unit 233 determines whether the hair grows from a specific part of the head in the hairstyle image for each of a plurality of hairstyle images stored in advance. A hairstyle image representing a hairstyle having a wave shape with a larger curvature than the wave shape of the hair estimated by the hair condition estimation unit 232, among the plurality of hairstyle images, is identified. Identify.

Further, when the hair condition estimating unit 232 estimates the first hair length, the hairstyle image specifying unit 233 determines, for each of a plurality of pre-stored hairstyle images, the length of hair growing from a specific part of the head in the hairstyle image. A second length of hair (hereinafter referred to as a “second hair length”) is specified, and a hairstyle image representing a hairstyle with the second hair length equal to or less than the first hair length is specified among the plurality of hairstyle images. . Here, the length of the hair may be specified by the actual size from the hairstyle image as in the user image, or the horizontal width of the eye extracted from the hairstyle image, or the distance between the right eye and the left eye. may be specified as a reference. As with the user image, the specific part can change depending on the type of hairstyle image (that is, the front, the side, and the back) used to specify the second hair length.

FIG. 7 is a diagram showing a comparison example between the first hair length in the user image and the second hair length in the hairstyle image. In the example of FIG. 7 , the second hair length L2 in the hairstyle image is shorter than the first hair length L1 in the user image, so the hairstyle image is identified by the hairstyle image identification unit 233 . Here, the hairstyle image specifying unit 233 may specify the second hair length of hair growing from each of a plurality of specific parts (for example, top section and under section) of the head in the hairstyle image for each specific part. Also, the second hair length may be specified for a specific portion in each of multiple types of hairstyle images. Then, the hairstyle image specifying unit 233 selects a hairstyle in which the second hair length is shorter than or equal to the first hair length (ie, all the specified parts satisfy this condition) in each specified part among the plurality of hairstyle images. A representative hairstyle image may be identified.

Further, when the first distance is calculated by the hair condition estimating unit 232, the hairstyle image specifying unit 233 specifies a specific part of the human body in the hairstyle image for each of a plurality of pre-stored hairstyle images. A second distance between the tip position of the hair and the specific part is calculated, and among the plurality of hairstyle images, a hairstyle image representing a hairstyle with the second distance equal to or greater than the first distance is specified as a presentation target. do. Here, the second distance between the position of the tip of the hair and the specific part may be specified by the actual size from the hairstyle image as in the user image, or the horizontal direction of the eye extracted from the hairstyle image. or the distance between the right eye and the left eye. Note that the specific part can change depending on the type of hairstyle image (that is, front, side, and back) used to calculate the second distance, similar to the user image.

FIG. 8 is a diagram showing a comparison example between the first distance in the user image and the second distance in the hairstyle image. In the example of FIG. 8, the hairstyle image is identified by the hairstyle image identification unit 233 because the second distance D2 in the hairstyle image is longer than the first distance D1 in the user image. Here, the hairstyle image specifying unit 233 may calculate the second distance between the tip position of the hair specified based on each of the plurality of specific parts of the human body in the hairstyle image and the specific part for each specific part. . Also, the second distance between each of the plurality of types of hairstyle images and the specific parts may be calculated. Then, the hairstyle image specifying unit 233 specifies, as presentation targets, hairstyle images representing hairstyles in which the second distance is equal to or greater than the first distance for each specific part (that is, all the specific parts satisfy this condition). do it.

The hairstyle image presenting unit 234 presents the hairstyle image specified by the hairstyle image specifying unit 233 as a presentation target to the target user at the specific timing determined by the recommendation timing determining unit 231 . For example, when the specific timing determined by the recommendation timing determining unit 231 arrives, the hairstyle image presenting unit 234 sends the display data including the hairstyle image to be presented to the user terminal 1 of the target user. Push delivery to the application that is Then, the user terminal 1 of the target user acquires display data including the push-delivered hairstyle image, and presents the hairstyle image to the target user by displaying the hairstyle image on the display. Thereby, the target salon can recommend to the target user a hairstyle that can be applied according to the current hair condition of the target user (that is, when the hairstyle is viewed).

Alternatively, when the specific timing determined by the recommendation timing determining unit 231 arrives, the hairstyle image presenting unit 234 receives the URL (Uniform Resource Locator) of the web page on which the hairstyle image to be presented is described. An e-mail may be sent to the e-mail address of the target user, or a short message describing the URL may be sent to the phone number of the target user by SMS (Short Message Service). Then, the user terminal 1 of the target user acquires the transmitted e-mail or short message, acquires the web page according to the URL described therein, and displays it on the display to display the hairstyle image as the target. present to the user.

FIG. 9 is a diagram showing a display screen example of a hairstyle image displayed on the user terminal 1. As shown in FIG. The display screen 51 shown in FIG. 9 displays the name of the target salon (salon XYZ) and hairstyle images I1 and I2 representing hairstyles that can be applied to the target user. A hairstyle ID is given to the hairstyle images I1 and I2 displayed in this way. Character strings C1 and C2 for transitioning to the treatment reservation screen are displayed in association with the hairstyle images I1 and I2, respectively. For example, when the target user designates the character string C1 associated with the hairstyle image I1 for which the user wishes to make an appointment, the hairstyle shown in the hairstyle image I1 is displayed. A treatment reservation screen (not shown) for making a reservation for the treatment is displayed. On the treatment reservation screen displayed in this way, it is possible to select the dates and time slots that can be reserved at the target salon. Then, a reservation request including the hairstyle ID, date and time zone of the selected hairstyle image I1, the user ID of the target user, and the salon ID of the target salon is sent from the user terminal 1 to the treatment information processing server 2. sent to.

The reservation processing unit 235 performs reservation processing in response to a reservation request from the user terminal 1 . In such reservation processing, the reservation processing unit 235 converts the treatment reservation information including the user ID, hairstyle ID, and reservation date (year/month/day and time zone) included in the reservation request into the salon ID included in the reservation request. They are registered in the salon database 221 in association with each other.

[ 2. Operation of Treatment Information Providing System S ]
Next, the operation of the treatment information providing system S when specifying the hairstyle image to be presented to the target user will be described separately for the first and second embodiments.

(Example 1)
First, the operation of the treatment information providing system S will be described with reference to FIG. In Example 1, the first hair length after the elapsed period is estimated based on the length of hair growing from a specific part of the head of the target user and the length corresponding to the elapsed period from the treatment to the specific timing. This is the behavior of the case. FIG. 10 is a flow chart showing an example of processing of the system control unit 23 according to the first embodiment. Note that the processing shown in FIG. 10 is executed every predetermined time (for example, 24 hours).

When the process shown in FIG. 10 is started, the system control unit 23 selects one salon ID from the target salon list in which the salon ID of the target salon (that is, the salon that makes recommendations to the user) is registered ( step S1). Subsequently, system control part 23 acquires salon information about an object salon specified by salon ID selected at Step S1 from salon database 221 (Step S2).

Next, the system control unit 23 is a target user whose treatment history is included in the salon information acquired in step S2 and is not registered in the recommendation target list associated with the salon ID selected in step S1 One user ID of the user is selected (step S3). Here, the recommendation target list includes the user ID of the target user to whom the hairstyle image is to be presented, the hairstyle ID of the hairstyle image to be presented, and the specific list for presenting the hairstyle image. This is a list in which timings and the like are associated with each user and registered. For example, the recommendation target list may be registered in the target salon list in association with the salon ID of the target salon, or may be registered in the salon database 221 for each salon. In step S3, the user ID of a target user who has not made a reservation for treatment at the target salon (that is, a target user whose treatment reservation information is not registered) may not be selected.

Next, the system control unit 23 identifies the treatment date and user image associated with the user ID selected in step S3 from the treatment history (step S4). The user image specified here is at least one of a front user image, a side user image, and a back user image. Moreover, when the target user has received a treatment multiple times in the past at the target salon, the user image is specified for each treatment date. Next, the system control unit 23 (recommendation timing determination unit 231) determines a specific timing from the treatment date specified in step S4 (step S5), and uses the determined specific timing as the user selected in step S3. It is stored in the RAM in association with the ID. The specific timing determined in step S5 may be registered in the user database 222, for example, in association with the user ID selected in step S3.

In addition, when the target user has received a treatment multiple times in the past at the target salon, the system control unit 23 identifies the previous treatment date and the last treatment date from among the treatment dates specified in step S4, The specific timing may be determined based on the number of days between the last treatment date and the last treatment date. In addition to the plurality of treatment days, the system control unit 23 further identifies the treatment menu from the treatment history, and determines specific timing according to the treatment menu based on the number of treatment days and the treatment menu. may Alternatively, the system control unit 23 acquires the browsing history associated with the user ID selected in step S3 from the user database 222, and identifies the hairstyle that the target user is interested in from the browsing history. , the specific timing may be determined based on the specified hairstyle.

Next, the system control unit 23 calculates the elapsed period up to the specific timing determined in step S5, and calculates the length (that is, the length of the hair that grows during the elapsed period) according to the calculated elapsed period ( step S6). For example, the system control unit 23 calculates the amount of hair change in the treatment days based on a plurality of user images with different treatment days (for example, the front user image) identified in step S4, Based on the number of days and the amount of change, the hair length corresponding to the elapsed period is calculated. Prior to step S6, the system control unit 23 may determine whether the specific timing determined in step S5 is within a predetermined period of time (for example, the current day, the current week, or the current month) from the current time point. As a result, target users whose specific timing is, for example, the latest or within the current month are picked up. In this case, when the system control unit 23 determines that the specific timing is within a predetermined period from the current time, the system control unit 23 calculates the elapsed period up to the specific timing, and calculates the length according to the calculated elapsed period. On the other hand, if it is determined that the specific timing is not within the predetermined period from the current time, the process returns to step S3 to select another target user (user ID).

Next, the system control unit 23 (hair condition estimating unit 232) executes hair length specifying processing for specifying the length of hair growing from the specific part of the head in the user image specified in step S4 ( step S7). Here, one or more specific sites are set in advance. FIG. 11 is a flow chart showing an example of the hair length specifying process in step S7. Note that if two or more types of user images (these are referred to as a set) of the front user image, the side user image, and the back user image are specified in step S4, the process shown in FIG. is performed for each user image.

In FIG. 11, the system control unit 23 smoothes the user image using a Gaussian filter (step S71). A Gaussian filter is a weighted averaging filter that assigns a greater weight to pixels closer to the pixel of interest. Next, the system control unit 23 obtains the magnitude and direction of the gradient in the smoothed user image using a Sobel filter, thereby emphasizing edges (step S72). The Sobel filter also emphasizes edges with small luminance differences in the user image. Next, the system control unit 23 thins the edge emphasized in the user image (step S73).

Next, the system control unit 23 performs hysteresis threshold processing on the user image whose edges have been thinned, and detects a plurality of edges as hair (hair) (step S74). In such hysteresis threshold processing, an edge with a gradient greater than a large threshold is determined as an edge. However, since the edge is discontinuous with only this, edges equal to or greater than the small threshold and less than the large threshold are regarded as edge candidates, and the larger threshold is used. Those adjacent to larger pixels are also edges. Next, the system control unit 23 determines the length of the hair based on the pixel resolution described above and the number of pixels forming the hair protruding from a preset specific portion among the plurality of hairs detected in step S74. are specified (basically a plurality of specified) (step S75). Here, the length of hair may be the length of one strand of hair or the length of a bundle of hair. Note that when there are a plurality of preset specific parts, the hair length is specified for each specific part.

Returning to the process of FIG. 10, the system control unit 23 adds the length calculated in step S6 (the length corresponding to the elapsed time) to the length of the hair specified in step S7, and is estimated (step S8). Note that when there are a plurality of preset specific parts, the first hair length is estimated for each specific part. Further, when the processing shown in FIG. 11 is executed for two or more types of user images of the front user image, the side user image, and the back user image, the first Hair length is estimated.

Next, the system control unit 23 permits provision of the photo image to others among the user images (excluding the user image specified in step S4) included in the treatment history in the salon information acquired in step S2. The user image of the user who has the hairstyle is specified as the hairstyle image (step S9). If the salon information does not contain multiple user images of a user who is permitted to provide photo images, the photo image representing the condition of the hair of the model contracted with the target salon is specified as the hairstyle image. may be Moreover, the hairstyle image specified in step S9 may include not only the user image photographed at the own salon but also the user image photographed at another salon. Furthermore, not only when there is no user image taken at the salon, but also a photographic image (for example, a catalog image) representing the condition of the model's hair may be specified as the hairstyle image. Further, when the processing shown in FIG. 11 is executed for two or more types of user images out of the front user image, the side user image, and the back user image, A set of hairstyle images is identified. For example, if performed on the front and back user images, the front and back hairstyle images are identified as a set.

Next, the system control unit 23 identifies the second hair length growing from the specific part of the head in the hairstyle image for each hairstyle image identified in step S9 (or for each set if identified as a set). A hair length specifying process for hair length is executed (step S10). Here, the specific parts are set in advance so that the position and number match the user image. Also in the hair length specifying process in step S10, it is preferable that the hair length specifying process shown in FIG. 11 is executed, similarly to the user image. Note that when two or more types of hairstyle images out of the front hairstyle image, the side hairstyle image, and the back hairstyle image are specified as a set in step S9, the processing shown in FIG. Executed on hairstyle images. Also, in the hairstyle image, the second hair length may be the length of one strand of hair or the length of a bundle of multiple strands of hair. Moreover, when there are a plurality of preset specific parts, the second hair length is specified for each specific part that is the same as the user image.

Next, the system control unit 23 selects one hairstyle image from the plurality of hairstyle images specified in step S9 (step S11). Here, the selected hairstyle image is preferably adjusted in size so that the person appearing there matches the size of the target user appearing in the user image identified in step S4. Note that when the processing shown in FIG. 11 is performed for two or more hairstyle images of the front hairstyle image, the side hairstyle image, and the back hairstyle image, the hairstyle images are selected as a set. be. Next, the system control unit 23 (hairstyle image specifying unit 233) determines the first hair length of the specific part in the user image specified in step S4 (that is, the first hair length estimated in step S8), and The second hair length of the specific part in the selected hairstyle image (that is, the second hair length specified in step S10) is compared with the second hair length, and it is determined whether or not the second hair length is equal to or shorter than the first hair length (step S12). ).

For example, a first hair length that is the longest and a second hair length that is the longest among a plurality of hair lengths identified in the specific region may be compared, or a plurality of hair lengths identified in the specific region may be compared. The average value of the predetermined number of first hair lengths from the longest side may be compared with the average value of the predetermined number of second hair lengths. Here, the inside of the specific site may be divided into a plurality of areas (for example, right area, center area, left area) and the above comparison may be performed for each area. When there are a plurality of preset specific parts, the first hair length and the second hair length are compared in each specific part. Note that when two or more types of hairstyle images out of the front hairstyle image, the side hairstyle image, and the back hairstyle image are selected as a set in step S11, the user image and hairstyle of the same type are selected. The process of step S12 is executed for each image.

Next, when the system control unit 23 (hairstyle image specifying unit 233) determines that the second hair length is equal to or shorter than the first hair length (step S12: YES), the hairstyle image selected in step S11 is set as a presentation target. (step S13), the hairstyle ID of the identified hairstyle image is stored in the RAM in association with the user ID selected in step S3, and the process proceeds to step S14. If there are a plurality of preset specific parts and the second hair length is equal to or shorter than the first hair length in each specific part, the hairstyle image selected in step S11 is specified as the presentation target. Further, when the process of step S12 is executed for each user image and hairstyle image of the same type, when the second hair length is shorter than or equal to the first hair length in a specific portion of the same type of user image and hairstyle image. Alternatively, the hairstyle image selected as a set in step S11 may be specified as a presentation target. On the other hand, if it is determined that the second hair length is not equal to or shorter than the first hair length (step S12: NO), the process proceeds to step S14.

In step S14, the system control unit 23 determines whether or not there is a hairstyle image that has not yet been selected among the plurality of hairstyle images specified in step S9. If it is determined that there is a hairstyle image that has not yet been selected (step S14: YES), the process returns to step S11, a hairstyle image that has not yet been selected is selected, and the processes after step S12 are performed. On the other hand, if it is determined that there is no unselected hairstyle image (step S14: NO), the process proceeds to step S15.

In step S15, the system control unit 23 determines whether or not there is one or more hairstyle images specified as presentation targets in step S13. When the system control unit 23 determines that there is one or more hairstyle images specified as presentation targets in step S13 (step S15: YES), the hairstyle ID of the hairstyle image specified as presentation targets in step S13 , the specific timing determined in step S5, and the user ID selected in step S3 are associated, and registered in the recommendation target list associated with the salon ID selected in step S1 (step S16), and processing to step S17. On the other hand, if it is determined that there is no hairstyle image specified in step S13 (step S15: NO), the process proceeds to step S17.

In step S17, the system control unit 23 is a target user whose treatment history is included in the salon information acquired in step S2, and is registered in the recommendation target list associated with the salon ID selected in step S1. It is determined whether or not there is a user ID that has not yet been selected among the user IDs of the target users that have not been selected. If it is determined that there is a user ID that has not yet been selected (step S17: YES), the process returns to step S3, a user ID that has not yet been selected is selected, and the processes after step S4 are performed. On the other hand, if it is determined that there is no user ID that has not been selected (step S17: NO), the process proceeds to step S18.

In step S18, the system control unit 23 determines whether or not there is a salon ID that has not yet been selected among the salon IDs registered in the target salon list. When it is determined that there is a salon ID that has not yet been selected (step S18: YES), the process returns to step S1, a salon ID that has not yet been selected is selected, and the processes after step S2 are performed. On the other hand, when it determines with there being no salon ID which is not selected (step S18: NO), the process shown in FIG. 10 is complete|finished.

Then, the system control unit 23 (hairstyle image presentation unit 234) checks the specific timing registered in the recommendation target list of each target salon and the current time at predetermined intervals, and detects that the specific timing has arrived. In this case, presentation processing is performed to present the hairstyle image specified by the hairstyle ID associated with the specific timing to the target user specified by the user ID associated with the specific timing. In such presentation processing, for example, as described above, the display data including the hairstyle image is pushed to the application residing in the user terminal 1 of the target user. In some cases, a set of two or more hairstyle images selected from the front hairstyle image, the side hairstyle image, and the back hairstyle image is presented to the target user.

According to the first embodiment, the treatment information processing server 2 specifies the length of hair growing from a specific part of the head in the user image, and the specified length and the length according to the elapsed period Based on this, the hair length after the elapsed period is estimated as the first hair length, and the second hair length of hair growing from a specific portion of the head in the hairstyle image is estimated for each of a plurality of hairstyle images stored in advance. to identify, among a plurality of hairstyle images, a hairstyle image representing a hairstyle in which the second hair length is equal to or less than the first hair length, and presenting the identified hairstyle image to the target user , it is possible to recommend a hairstyle that can be applied to the target user from among a plurality of hairstyles according to the current hair condition of the target user. Further, in the first embodiment, before step S6, according to the configuration of determining whether the specific timing determined in step S5 is within a predetermined period (for example, the current day, the current week, or the current month) from the current time, When the specific timing arrives, it is possible to make a recommendation that reflects relatively recently registered hairstyle images and the browsing history of the target user. Furthermore, even if the season or trend changes by the arrival of the specific timing (even if the user's span is long, such as six months), highly fresh information can be recommended.

(Example 2)
Next, the operation of the treatment information providing system S will be described with reference to FIG. In the second embodiment, the tip position of the hair after the elapsed period is estimated based on the tip position of the hair specified based on the specific part of the target user and the length corresponding to the elapsed period from the treatment to the specific timing. This is the behavior of the case. FIG. 12 is a flow chart showing an example of processing of the system control unit 23 according to the second embodiment. 12 are the same as steps S1 to S6 shown in FIG.

In step S27, the system control unit 23 (hair condition estimation unit 232) extracts the hair region from the user image specified in step S24, and specifies the human body in the user image from the edge of the extracted hair region. Identify the tip position of the hair based on the part. For example, the coordinates (x, y) where the edge of the hair region intersects with a line extending vertically from the specific part are specified as the tip position. Here, one or more specific parts are set in advance. When there are a plurality of preset specific parts, the tip position of the hair is specified for each specific part. Further, when two or more types of user images out of the front user image, the side user image, and the back user image are specified in step S24, the hair tip position is determined by each user image. specified for. As a method for extracting the hair region, for example, the user image is divided into regions of the same hue, etc., and after extracting the regions where the same hue is continuous, matching processing is performed using a predetermined template. It is preferable to extract the hair region. In addition, various known techniques can be applied as a method of extracting the hair region.

Next, the system control unit 23 estimates the coordinates (x, y) obtained by extending the length calculated in step S26 from the tip position specified in step S27 in the gravitational direction as the tip position of the hair after the elapsed period. (Step S28). Note that when there are a plurality of preset specific parts, the tip position of the hair is estimated for each specific part. Further, when the processing of step S27 is performed for two or more types of user images among the front user image, the side user image, and the back user image, the tip of the hair is displayed for each user image. Position is estimated.

Next, the system control unit 23 calculates the first distance between the tip position estimated in step S28 and the specific part (step S29). Note that when there are a plurality of preset specific parts, the first distance is calculated for each specific part. Further, when the process of step S28 is performed for two or more types of user images among the front user image, the side user image, and the back user image, the first distance is calculated for each user image. is calculated.

Next, in the same manner as in step S9, the system control unit 23 selects the user image of the user who is permitted to provide the photo image to others, among the user images included in the treatment history in the salon information acquired in step S22. is specified as a hairstyle image (step S30). As in the first embodiment, if the salon information does not include a plurality of user images of users who are permitted to provide photographic images, a photographic image representing the hair condition of a model contracted with the target salon is displayed. may be identified as the hairstyle image. Further, when the processing of step S29 is performed for two or more types of user images among the front user image, the side user image, and the back user image, the hair style suitable for the type of the user image is selected. A style image is specified in the set.

Next, the system control unit 23 (hairstyle image specifying unit 233) extracts a hair region from each of the plurality of hairstyle images specified in step S30, and extracts a hair region from the edge of the extracted hair region. , the tip position of the hair is specified with reference to a specific part of the human body in the hairstyle image (step S31). Next, the system control unit 23 calculates a second distance between the tip position identified in step S31 and the specific part (step S32). Note that if there are a plurality of preset specific parts that are set in advance such that the position and number match the user image, the tip position of the hair is specified for each specific part, and the second distance is calculated. Further, when two or more hairstyle images of the front hairstyle image, the side hairstyle image, and the back hairstyle image are selected as a set in step S30, steps S31 and S32 are performed for each hairstyle image. process is executed.

Next, the system control unit 23 selects one hairstyle image from the plurality of hairstyle images specified in step S30 (step S33). Next, the system control unit 23 (hairstyle image specifying unit 233) determines the first distance (that is, the first distance calculated in step S29) between the specific parts in the user image specified in step S24, A second distance (i.e., the second distance calculated in step S32) to the specific part in the hairstyle image selected in step S33 is compared to determine whether or not the second distance is greater than or equal to the first distance. (step S34). Note that when there are a plurality of preset specific parts, the first distance and the second distance are compared for each specific part. Further, when two or more types of hairstyle images out of the front hairstyle image, the side hairstyle image, and the back hairstyle image are selected as a set in step S30, the user image and hairstyle of the same type are selected. The process of step S34 is executed for each image.

Next, when the system control unit 23 determines that the second distance is equal to or greater than the first distance (step S34: YES), the system control unit 23 specifies the hairstyle image selected in step S33 as a presentation target (step S35). The hairstyle ID of the specified hairstyle image is associated with the user ID selected in step S23 and stored in the RAM, and the process proceeds to step S36. If there are a plurality of preset specific parts and the second distance from each specific part is equal to or greater than the first distance, the hairstyle image selected in step S33 is specified as the presentation target. Further, when the process of step S34 is performed for each user image and hairstyle image of the same type, the second distance is equal to or greater than the first distance for each of the specific parts of the user image and hairstyle image of the same type. In this case, the hairstyle image selected in the set in step S33 may be identified as the presentation target. On the other hand, if it is determined that the second distance to the specific part is not greater than or equal to the first distance (step S34: NO), the process proceeds to step S36.

Note that the processing of steps S36 to S40 shown in FIG. 12 is the same as the processing of steps S14 to S18 shown in FIG. Then, as in the first embodiment, the system control unit 23 (hairstyle image presentation unit 234) confirms the specific timing registered in the recommendation target list of each target salon and the current time at a predetermined cycle, and the specific timing is confirmed. for presenting the hairstyle image specified by the hairstyle ID associated with the specific timing to the user specified by the user ID associated with the specific timing when the arrival is detected; Perform presentation processing.

According to the second embodiment, the treatment information processing server 2, based on the tip position of the hair specified with reference to the specific part of the human body in the user image and the length according to the elapsed period, after the elapsed period estimating a hair tip position, calculating a first distance between the estimated tip position and a specific part, and calculating a first distance between the estimated tip position and a specific part; A second distance between the identified hair tip position and the specific part is calculated, and among the plurality of hairstyle images, a hairstyle image representing a hairstyle in which the second distance is equal to or greater than the first distance is identified. , Since the specified hairstyle image is presented to the user, a hairstyle that can be applied to the target user according to the current hair condition of the target user is recommended to the target user from among a plurality of hairstyles. can do.

As described above, according to the above-described embodiment, the treatment information processing server 2 includes a user image representing the condition of the user's hair taken after the treatment and the elapsed period from the treatment to the specific timing. Based on the estimated hair condition after the elapsed period, and based on the estimated hair condition, a plurality of hairstyle images representing hairstyles that can be applied to the user are stored in advance. and presenting the identified hairstyle image to the user, it is possible to perform a treatment according to the current hair condition of the user from among a plurality of hairstyles. A hairstyle can be recommended to the user.

Although one embodiment of the present invention has been described as above, the present invention is not limited to the above-described embodiment, and various modifications can be made to the above-described embodiment without departing from the gist of the present invention. It may be added, and that case is also included in the technical scope of the present invention. In the first and second embodiments described above, a hairstyle image representing a hairstyle that can be applied to the target user is presented to the target user based on the length and length of the hair as the estimated hair condition. However, instead of or in addition to the length and degree of growth of the hair, based on at least one of the hair color and wave shape, the hairstyle that can be applied to the target user is selected. It may be configured to present the hairstyle image to the target user. For example, when based on hair color in addition to hair length, in step S6 of FIG. Calculate the color change according to the period. Next, in step S7 of FIG. 10, the system control unit 23 specifies the hair color in the user image of the target user in addition to the length of the hair. Next, in step S8 of FIG. 10, the system control unit 23 estimates the hair color after the elapsed period based on the specified color and the color change according to the elapsed period in addition to the first hair length. Next, in step S10 of FIG. 10, the system control unit 23 specifies the hair color in each of the plurality of pre-stored hairstyle images in addition to the second hair length. Then, in steps S12 and S13 of FIG. 10, the system control unit 23 determines that the second hair length is equal to or shorter than the first hair length, and the hair color specified from the hairstyle image is the hair color estimated from the user image. If the color is brighter than the color, the hairstyle image is specified as a presentation target.

1 user terminal 2 treatment information processing server 21 communication unit 22 storage unit 23 system control unit 231 recommendation timing determination unit 232 hair condition estimation unit 233 hairstyle image identification unit 234 hairstyle image presentation unit 235 reservation processing unit S treatment information providing system

Claims (12)

An information processing device that presents a hairstyle image to a user at a specific timing after a user's hair is treated by a practitioner,
Based on the hair tip position specified with reference to a specific part of the human body in the user image representing the condition of the hair taken after the treatment and the length corresponding to the elapsed time from the treatment to the specific timing, estimating means for estimating the tip position of the hair after the elapsed period and calculating a first distance between the estimated tip position and the specific part;
calculating a second distance between a tip position of the hair specified with reference to the specific part of the human body and the specific part in the hairstyle image for each of a plurality of pre-stored hairstyle images, and calculating the plurality of hairstyles; identifying means for identifying, among images, a hairstyle image representing a hairstyle with the second distance equal to or greater than the first distance as a hairstyle image representing a hairstyle that can be applied to the user;
presentation means for presenting the user with the hairstyle image specified by the specifying means;
An information processing device comprising: The estimating means estimates the tip position of the hair after the elapsed period based on the tip position of the hair specified with reference to each of a plurality of specific parts of the human body in the user image and the length according to the elapsed period. estimating for each specific part, calculating a first distance between the estimated tip position and the specific part for each specific part;
The identifying means calculates a second distance between a hair tip position and the specific part, which are identified in the hairstyle image based on each of the plurality of specific parts of the human body, for each of the specific parts, 2. The information processing apparatus according to claim 1, wherein a hairstyle image representing a hairstyle in which the second distance is equal to or greater than the first distance in a specific part is specified. calculating the amount of change in the hair during the treatment days based on the plurality of user images representing the hair conditions of the plurality of treatment days that are included in the treatment history of the user, and calculating the number of treatment days 3. The information processing apparatus according to claim 1 , further comprising calculating means for calculating the length corresponding to the elapsed period based on the amount of change and the amount of change. Further comprising a first determination means for identifying a plurality of treatment days included in the user's treatment history and determining the specific timing based on the number of days of the identified treatment days,
4. The information processing apparatus according to claim 1, wherein said presenting means presents said hairstyle image to said user at said specific timing determined by said first determining means. . The first determination means further specifies the treatment content included in the treatment history of the user, and determines the specific timing according to the treatment content based on the specified number of treatment days and the treatment content. 5. The information processing apparatus according to claim 4 , wherein: An information processing device that presents a hairstyle image to a user at a specific timing after a user's hair is treated by a practitioner,
a second determining means for identifying a hairstyle that the user is interested in from the browsing history of the user and determining the specific timing based on the identified hairstyle;
Based on the user image representing the state of the hair taken after the treatment and the elapsed period from the treatment to the specific timing determined by the second determination means, the hair after the elapsed period an estimating means for estimating a state;
identifying means for identifying, from among a plurality of pre-stored hairstyle images, a hairstyle image representing a hairstyle that can be applied to the user based on the state of the hair estimated by the estimating means;
presentation means for presenting the user with the hairstyle image specified by the specifying means;
An information processing device comprising : The estimating means identifies the length of hair growing from a specific portion of the head in the user image, and determines the length of the hair after the elapsed period based on the identified length and the length corresponding to the elapsed period. estimating the length of as the first length,
The identifying means identifies a second length of hair growing from the specific portion of the head in the hairstyle image for each of the plurality of hairstyle images stored in advance, 7. The information processing apparatus according to claim 6 , wherein a hairstyle image representing a hairstyle in which the second length is equal to or less than the first length is specified. The estimating means estimates the first length for each specific part based on the length of hair growing from each of a plurality of specific parts of the head in the user image and the length corresponding to the elapsed period. ,
The identifying means identifies a second length of hair growing from each of the plurality of specific parts of the head in the hairstyle image for each of the specific parts, 8. The information processing apparatus according to claim 7 , wherein a hairstyle image representing a hairstyle in which the second length is equal to or less than the first length at a specific portion is specified. An image presentation method executed by an information processing device for presenting a hairstyle image to a user at a specific timing after a user's hair is treated by a hairdresser,
Based on the hair tip position specified with reference to a specific part of the human body in the user image representing the condition of the hair taken after the treatment and the length corresponding to the elapsed time from the treatment to the specific timing, estimating the tip position of the hair after the elapsed period, and calculating a first distance between the estimated tip position and the specific part ;
calculating a second distance between a tip position of the hair specified with reference to the specific part of the human body and the specific part in the hairstyle image for each of a plurality of pre-stored hairstyle images, and calculating the plurality of hairstyles; identifying, from among the images, a hairstyle image representing a hairstyle with the second distance equal to or greater than the first distance as a hairstyle image representing a hairstyle that can be applied to the user;
presenting the identified hairstyle image to the user;
An image presentation method comprising: An image presentation method executed by an information processing device for presenting a hairstyle image to a user at a specific timing after a user's hair is treated by a hairdresser,
identifying a hairstyle that the user is interested in from the browsing history of the user, and determining the specific timing based on the identified hairstyle;
A step of estimating the state of the hair after the elapsed period based on the user image representing the state of the hair captured after the treatment and the elapsed period from the treatment to the determined specific timing. and,
identifying, from among a plurality of pre-stored hairstyle images, a hairstyle image representing a hairstyle that can be applied to the user based on the estimated hair condition;
presenting the identified hairstyle image to the user;
An image presentation method comprising: A computer included in an information processing device that presents a hairstyle image to the user at a specific timing after the user's hair is treated by the practitioner,
Based on the hair tip position specified with reference to a specific part of the human body in the user image representing the condition of the hair taken after the treatment and the length corresponding to the elapsed time from the treatment to the specific timing, estimating means for estimating the tip position of the hair after the elapsed period and calculating a first distance between the estimated tip position and the specific part;
calculating a second distance between a tip position of the hair specified with reference to the specific part of the human body and the specific part in the hairstyle image for each of a plurality of pre-stored hairstyle images, and calculating the plurality of hairstyles; identifying means for identifying, among images, a hairstyle image representing a hairstyle with the second distance equal to or greater than the first distance as a hairstyle image representing a hairstyle that can be applied to the user;
A program functioning as presentation means for presenting the hairstyle image specified by the specifying means to the user. A computer included in an information processing device that presents a hairstyle image to the user at a specific timing after the user's hair is treated by the practitioner,
a second determining means for identifying a hairstyle that the user is interested in from the browsing history of the user and determining the specific timing based on the identified hairstyle;
Based on the user image representing the state of the hair taken after the treatment and the elapsed period from the treatment to the specific timing determined by the second determination means, the hair after the elapsed period an estimating means for estimating a state;
identifying means for identifying, from among a plurality of pre-stored hairstyle images, a hairstyle image representing a hairstyle that can be applied to the user based on the state of the hair estimated by the estimating means;
A program functioning as presentation means for presenting the hairstyle image specified by the specifying means to the user.

Images