JP6996762B2 - Virtual cut wig system and virtual cut wig program - Google Patents

Description

The present invention relates to a virtual cut wig system and a virtual cut wig program.

Conventionally, a virtual cut model device including a computer that senses the movement of scissors and a comb and calculates a virtual space and a spectacle-type monitor that displays the calculation result of the computer is known (see, for example, Patent Document 1).

According to the device of Patent Document 1, when the image of virtual hair displayed on the spectacle-type monitor is cut, the result of the cut is reflected in the image of the spectacle-type monitor, and the user makes virtual haircuts many times. Can also be practiced repeatedly.

Japanese Unexamined Patent Publication No. 2005-346313

Barbers and hairdressers should be specifically aware of what part of the customer's head should be cut and what length should be cut in order to facilitate haircuts. Is cutting.

Therefore, in order to make the user practice haircut effectively using the haircut practice software, specific information for smoothly proceeding with haircut according to the operation content for the virtual cut wig is provided. It is effective to practice repeatedly while being aware of it.

However, the device of Patent Document 1 can only display the result of cutting the virtual hair image displayed on the monitor, and is specific for smoothly advancing the haircut according to the operation content for the virtual cut wig. No consideration is given to making the information aware of the user.

In view of the above circumstances, the present invention provides a virtual cut wig system that allows the user to practice haircut effectively while making the user aware of specific information for smoothly proceeding with haircut. The purpose is to do.

The virtual cut wig system according to the present invention is
In a computer system having an output unit and an operation unit,
Virtual cut wig data showing a virtual cut wig that is a three-dimensional image of a virtual cut wig, and multiple parts of the virtual head of the virtual cut wig to make the virtual cut wig a predetermined hairstyle. A storage unit that stores design data including numerical information indicating the virtual hair length related to each of the above, and a storage unit.
A specific unit that specifies the virtual cut wig data and the design data used when outputting the virtual cut wig to the output unit, and
An output control unit that outputs the virtual cut wig to the output unit,
It has a recognition unit that recognizes the position and orientation of the output unit and the operation unit.
The operation unit is configured to receive input of information indicating the operation content for the virtual cut wig.
The output control unit is the virtual cut wig according to the positions and orientations of the output unit and the operation unit, information indicating the operation content for the virtual cut wig, and the specified virtual cut wig data and design data. It is configured to change the image of the wig and output it to the output unit, and the information indicating the operation content indicates that the user wants to output the support information which is the information for smoothly advancing the haircut. When the condition of the above is satisfied, the support information corresponding to the information indicating the operation content is output to the output unit.

In the virtual cut wig system of the present invention, a plurality of three-dimensional images of the virtual cut wig and a plurality of virtual heads of the virtual cut wig for making the virtual cut wig a predetermined hairstyle by a storage unit. Design data including numerical information indicating the virtual hair length related to each of the parts of the wig is stored.

In addition, the virtual cut wig data and design data used for the output of the virtual cut wig are specified by the specific unit, the output unit outputs the virtual cut wig by the output control unit, and the position and orientation of the output unit and the operation unit are output by the recognition unit. Is recognized, and the operation unit accepts the input of information indicating the operation content for the virtual cut wig.

Then, the output control unit changes the position and orientation of the output unit and the operation unit, the specified virtual cut wig data and design data, and the information indicating the operation content for the virtual cut wig. Video is output.

Further, when the information indicating the operation content of the user satisfies a predetermined condition indicating that the user is requesting the output of the support information which is the information for smoothly advancing the haircut, the output control unit performs the relevant information. Support information corresponding to the information indicating the operation content is output to the output unit.

As a result, the image of the virtual cut wig changes according to the position and orientation of the output unit and the operation unit and the information indicating the operation content for the virtual cut wig, so that the user can effectively see the virtual cut wig from various directions. You can practice cutting.

Then, a design including specific information such as numerical information indicating the length of the virtual hair related to each of the plurality of parts of the virtual head of the virtual cut wig for making the virtual cut wig a predetermined hairstyle. The image of the virtual cut wig changes according to the data, and support information according to the user's operation content is output, so the user practices cutting while being aware of specific information for smooth haircut. It can be carried out.

In the virtual cut wig system according to the present invention
When the output control unit recognizes that the virtual hair is cut shorter than the length for obtaining a predetermined hairstyle at one or more of the parts, the virtual hair is cut. Includes information urging the user to cut one or more parts other than the portion, depending on the length of the hair, shorter than the length of each of the virtual hairs to achieve the predetermined hairstyle. It is preferable that the support information is output to the output unit.

In the actual haircut, it is important to be able to respond appropriately even if the customer's hair is cut too much.

According to the virtual cut wig system of the present invention, when one or more parts are cut shorter than the virtual hair length for obtaining a predetermined hairstyle, the output control unit performs the virtual hair. Depending on the length of the hair after it has been cut, the user is asked to cut one or more parts other than the relevant part to be shorter than the virtual hair length for each predetermined hairstyle. Support information including prompting information is output to the output unit.

As a result, even if the customer's hair is cut too much, it is possible to practice cutting while being aware of specific information for appropriately responding.

As described above, according to the present invention, the hair is effectively used by the user while making the user aware of specific information for smoothly advancing the haircut according to the length of the virtual hair after being cut. You can practice cutting.

In the virtual cut wig system according to the present invention
The design data includes order data which is information indicating the cutting order of each part of the virtual cut wig for making the virtual cut wig a predetermined hairstyle.
The output control unit determines the current disconnection order based on the order data when the information indicating the operation content satisfies a predetermined condition indicating that the user wants an output based on the order data. It is preferable that the virtual hair from the site to the site of the cutting order after the predetermined order is output to the output unit in a manner different from that of the virtual hair of other sites.

For example, if the hair in other parts of the area remains long, it may interfere with cutting the hair in one part. It is more effective to practice.

In the virtual cut wig system of the present invention, the design data includes order data which is information indicating the cutting order of each part of the virtual cut wig for making the virtual cut wig a predetermined hairstyle. Then, when the information indicating the operation content satisfies a predetermined condition indicating that the user wants an output based on the order data, the output control unit determines a virtual cut wig included in the design data. Based on the information indicating the cutting order of each part of the virtual cut wig to make a hairstyle, the virtual hair from the part of the cutting order this time to the part of the cutting order after the predetermined order is the virtual hair of other parts. It is output to the output unit in a manner different from that of typical hair.

As a result, the user can practice cutting while being aware of the appropriate cutting order for achieving a predetermined hairstyle.

As described above, according to the present invention, it is possible for the user to practice haircut more effectively while being aware of the order in which the hair should be cut in order to obtain a predetermined hairstyle.

In the virtual cut wig system according to the present invention
It is preferable that the output control unit is configured to form the virtual hair into a flat plate shape for each part and output the hair to the output unit.

When actually cutting hair, barbers and hairdressers scissor the hair in the area they want to cut with a comb, then pinch it between their fingers and cut it into a flat plate. Hair is cut so that the desired hairstyle can be obtained. If you can reproduce such movements, haircut practice will be even more effective.

The virtual cut wig system of the present invention can display a virtual cut wig by forming virtual hair into a flat plate shape for each part.

As a result, for example, when cutting virtual hair, the virtual cut wig is placed in a state similar to the image of scooping up the hair in the part to be cut with a comb and then sandwiching it between fingers to make it flat. It can be displayed. Therefore, the user can practice the haircut more effectively through the operation close to the actual haircut operation.

As described above, according to the present invention, it is possible to make the user perform an operation close to the actual haircut operation, and to make the user practice the haircut more effectively.

The block diagram which shows an example of the whole structure of the virtual cut wig system of this embodiment. The figure which shows an example of the structure of the design data of the virtual cut wig system of this embodiment. The figure which shows an example of the structure of the head model data of the virtual cut wig system of this embodiment. The figure which shows an example of the structure of the hair model data of the virtual cut wig system of this embodiment. The flowchart which shows an example of the outline of the processing of the virtual cut wig system of this embodiment. The flowchart which shows an example of the initial state output processing of the virtual cut wig system of this embodiment. The flowchart which shows an example of the image change processing of the virtual cut wig system of this embodiment. The flowchart which shows an example of the support information generation processing of the virtual cut wig system of this embodiment. The figure which shows an example of the output content of the virtual cut wig system of this embodiment. The figure which shows an example of the output content of the virtual cut wig system of this embodiment. The figure which shows an example of the output content of the virtual cut wig system of this embodiment. The figure which shows an example of the output content of the virtual cut wig system of this embodiment.

First, the configuration of the virtual cut wig system of the present embodiment will be described with reference to FIG.

The virtual cut wig system of the present embodiment is composed of a server 10 and a user device 20, and the server 10 and the user device 20 are connected to each other by a communication network 30 so as to be communicable with each other.

The server 10 is a computer having a server storage unit 100, a server control unit 110, and a server communication unit 120.

The server storage unit 100 is composed of storage devices such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive), and includes a virtual cut wig data 101, design data 102, and server control. The processing result of the unit 110 is stored.

The virtual cut wig data 101 is a three-dimensional image of the virtual cut wig, and is composed of the head model data 1011 and the hair model data 1012.

The head model data 1011 is a database that stores one or more head model data which is a three-dimensional image of the head of a virtual cut wig, and as shown in FIG. 2A, for example, a head model ID and a head. Contains information on the part model name, head model image, and hair bundle point.

The head model ID is an ID that uniquely identifies the head model, and is composed of, for example, a combination of alphabets, numbers, and symbols.

The head model name is information indicating the name and type of the head model, and is composed of, for example, a combination of kanji, hiragana, katakana, alphabets, numbers, and symbols.

The head model image is data of a three-dimensional image that models the shape of the head according to the structure of the human body, and includes images of the human body such as an image only from the neck to the top and an image from the shoulder to the top. Can be changed as appropriate. The video data may be stored in various formats such as binary format and ASCII format, or in a format in which these formats are combined.

The hair bundle point is information indicating the position of the part of the head model, and in this embodiment, it is divided into areas such as "right side", "top", and "neckline", and each area is finer 1. It is divided into a plurality of parts such as 2 ... and stored in 28 parts, for example. The number of points may be changed as appropriate. The information indicating the position is expressed in a format such as coordinates.

The hair model data 1012 is a database that stores one or more hair model data that is a three-dimensional image of the hair portion of a virtual cut wig, and as shown in FIG. 2B, for example, a hair model ID, a hair model name, and the like. Contains information on the initial hair condition.

The hair model ID is an ID that uniquely identifies the hair model, and is composed of, for example, a combination of alphabets, numbers, and symbols.

The hair model name is information indicating the name and type of the head model, and is composed of, for example, a combination of kanji, hiragana, katakana, alphabets, numbers and symbols.

The initial hair state is information indicating the length and the angle of the end of the virtual hair of the hair model, and corresponds to each hair bundle point included in the head model data 1011. Includes end angle and.

The initial hair length is the length of the virtual hair in the initial state, for example, the length of each of both side portions of the panel when the virtual hair is displayed in the shape of a flat plate panel. The length is expressed numerically in centimeters, millimeters, inches, and pixels.

The end angle is information indicating the angle of the end of the virtual hair in the initial state, and is the angle formed by the straight line constituting each side portion of the panel and the straight line constituting the end portion of the panel. It is the angle of the internal angle and is expressed numerically in degrees or radians.

The design data 102 is information indicating how the virtual cut wig should be cut in order to make the virtual cut wig a predetermined hairstyle, and as shown in FIG. 2C, for example, a design data ID, a design data name, and the like. Contains information on the design hair condition.

The design data ID is an ID that uniquely identifies the design data, and is composed of, for example, a combination of alphabets, numbers, and symbols.

The design data name is a hairstyle name that can be obtained by cutting according to the design data, and is composed of, for example, a combination of katakana, kanji, hiragana, alphabets, numbers, and symbols.

The design hair condition is information indicating the design contents for obtaining a predetermined hairstyle, and corresponds to each hair bundle point included in the head model data 1011 with the completed hair length, the end angle, and the panel angle. Includes. Alternatively, the design hair condition may further include the cutting sequence and the affected site.

The finished hair length is the length of the virtual hair in the completed state. For example, when the virtual hair is displayed in the shape of a flat plate panel, the lengths of both sides of the panel (side 1 length). , Side 2 length), which is the length at which virtual hair should be left in order to obtain a predetermined hairstyle. The length is expressed numerically in centimeters, millimeters, inches, and pixels.

The end angle is information indicating the angle of the end portion in the completed state, and is the internal angle of the angle formed by the straight line constituting each side portion of the panel and the straight line constituting the cut portion of the end portion of the panel. It is an angle (side 1 angle, side 2 angle), and is expressed numerically in degrees (°) or radians.

The panel angle is an angle in the vertical direction that the panel should face when the virtual hair is displayed in the shape of a flat plate and cut. The angle is, for example, 0 ° when the panel is facing straight down, 90 ° when facing directly sideways (horizontal to the virtual floor surface), 180 ° when facing straight up, and so on (°). Is expressed numerically in units of. Alternatively, it may be expressed numerically in units of radians.

The cutting order is information indicating the order in which each part of the virtual cut wig should be cut in order to make the virtual cut wig a predetermined hairstyle. Since the same part may be cut again or multiple times after cutting another part, a plurality of values can be stored in the cutting order of one part.

The affected area should be cut shorter than the length of the finished hair, for example, if the part is cut shorter than the length of the finished hair, depending on the length of the hypothetical hair after cutting. This is information indicating a part other than the relevant part that should be urged to the user. When the virtual hair of one part is cut too much, there may be multiple parts other than the part that should be urged to cut shorter than the length of the completed hair, so the affected part of one part. Multiple values can be stored in.

The server control unit 110 is composed of an arithmetic processing unit such as a CPU (Central Processing Unit), a memory, an I / O (Input / Output) device, and the like. The server control unit 110 may be configured by one processor or may be configured by a plurality of processors capable of intercommunication. The server control unit 110 functions as an output control unit 111 by reading and executing a predetermined program.

The output control unit 111 is a program that outputs information about the virtual cut wig to the output unit 200. The output control unit 111 determines the position and orientation of the output unit 200 and the operation unit 210, the specified virtual cut wig data and design data, and the information indicating the operation content for the virtual cut wig by the user. The image of is changed and output to the output unit 200.

Further, when the information indicating the operation content of the user satisfies a predetermined condition indicating that the user is requesting the output of the support information which is the information for smoothly advancing the haircut, the output control unit 111 may use the output control unit 111. The output unit 200 is made to output the support information corresponding to the information indicating the operation content.

As a result, the image of the virtual cut wig changes according to the position and orientation of the output unit 200 and the operation unit 210 and the information indicating the operation content for the virtual cut wig, so that the user can see the virtual cut wig from various directions. You can practice cutting effectively.

Then, a design including specific information such as numerical information indicating the length of the virtual hair related to each of the plurality of parts of the virtual head of the virtual cut wig for making the virtual cut wig a predetermined hairstyle. The image of the virtual cut wig changes according to the data, and support information according to the user's operation content is output, so the user practices cutting while being aware of specific information for smooth haircut. It can be carried out.

Further, when the output control unit 111 is cut shorter than the virtual hair length for obtaining a predetermined hairstyle at one or more parts, the length after the virtual hair is cut. Correspondingly, the output unit outputs support information including information prompting the user to cut one or more parts other than the relevant part shorter than the length of each virtual hair for achieving the predetermined hairstyle. Output to 200.

As a result, even if the customer's hair is cut too much, it is possible to practice cutting while being aware of specific information for appropriately responding.

Further, the output control unit 111 determines the part of the current cutting order based on the order data when the information indicating the operation content satisfies a predetermined condition indicating that the user wants the output based on the order data. The virtual hair from the to the portion of the cutting order after the predetermined order is output to the output unit 200 in a manner different from that of the virtual hair of the other portion.

As a result, based on the order data, virtual hair from the portion of the current cutting order to the portion of the cutting order after the predetermined order is output to the output unit 200, so that the user can obtain a predetermined hairstyle. You can practice cutting while being aware of the appropriate cutting order.

Then, the output control unit 111 has a first display mode in which the virtual hair is displayed in a flat plate shape for each part, and a second display mode in which the virtual hair is displayed with a texture similar to that of a real cut wig. It is configured so that the virtual cut wig can be displayed on the output unit 200 by switching between the display mode and the display mode, and when the information indicating the operation content satisfies a predetermined condition indicating that the user wants to switch the display mode. , The display mode is switched and the virtual hair is output to the output unit 200.

As a result, for example, when cutting virtual hair, in the first display mode, which is close to the image of scooping up the hair in the part to be cut with a comb, sandwiching it between fingers and cutting it into a flat plate. When displaying the virtual cut wig and checking the state after cutting, the virtual cut wig can be displayed in the second display mode in which the texture is similar to that of the actual cut wig. Therefore, the user can practice the haircut more effectively through the operation close to the actual haircut operation.

If the information about the virtual cut wig includes voice information, the output control unit 111 causes the output unit 200 to reproduce the voice information.

The server communication unit 120 connects the server 10 and the communication network 30 by a wired communication cable or a communication method corresponding to a wireless communication standard such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or infrared communication. ..

The user device 20 has an output unit 200, an operation unit 210, a user device communication unit 230, and a recognition unit 220.

The output unit 200 is a device that outputs information to the user according to the processing result of the output control unit 111, and is, for example, a head-mounted display. Alternatively, for example, a smartphone that is detachably fixed to a headset or the like may be used as the output unit 200. The output unit 200 includes a display 201, a voice output unit 202, an output unit sensor 203, and an output communication unit 204.

The display 201 is a part that outputs visual information presented to the user by the output unit 200, and is, for example, a liquid crystal display or an organic EL display.

The audio output unit 202 is a unit that outputs audio information presented to the user by the output unit 200, and is, for example, a speaker, an earphone, or a headphone.

The output unit sensor 203 uses, for example, a three-dimensional acceleration sensor that detects acceleration in the three axes of the X-axis, Y-axis, and Z-axis of the output unit 200 at a predetermined frequency, and an angular velocity of the yaw, pitch, and roll of the output unit 200. It is an angular velocity sensor that detects at a predetermined frequency. The output unit sensor 203 functions as a part of the recognition unit 220 by causing the virtual cut wig system to recognize the direction of the output unit 200 based on the detected acceleration and angular velocity of the output unit 200 via the user device communication unit 230.

The output communication unit 204 is connected to the user device communication unit 230 by a communication unit corresponding to a wireless communication standard such as Bluetooth (registered trademark), Wi-Fi (registered trademark), or infrared communication, or a wired communication cable.

The operation unit 210 is a device that accepts input of operation contents to the virtual cut wig system including information indicating the operation contents for the virtual cut wig by the user, and is held by the user or detachably fixed to the user's hand. It is a controller of the virtual cut wig system to be used. In this embodiment, two operation units 210 are provided, a first operation unit 210a for the right hand and a second operation unit 210b for the left hand.

The operation unit 210 includes a specific unit 211, an operation unit sensor 212, and an operation communication unit 213.

The specific unit 211 is a unit that specifies virtual cut wig data and design data used when outputting a virtual cut wig to the output unit 200, and is, for example, a button, a trigger, a grip unit, a pad provided on the operation unit 210. Such as a switch.

The operation unit sensor 212 determines, for example, the angular velocity of the yaw, pitch, and roll of the three-dimensional acceleration sensor and the output unit 200 that detect the acceleration in the three axes of the X-axis, Y-axis, and Z-axis of the operation unit 210 at a predetermined frequency. It is an angular velocity sensor that detects at a predetermined frequency. The operation unit sensor 212 functions as a part of the recognition unit 220 by causing the virtual cut wig system to recognize the direction of the operation unit 210 based on the detected acceleration and angular velocity of the operation unit 210 via the user device communication unit 230.

The operation communication unit 213 is connected to the user device communication unit 230 by a communication unit corresponding to a wireless communication standard such as Bluetooth (registered trademark), Wi-Fi (registered trademark), or infrared communication, or a wired communication cable.

The recognition unit 220 is a device that recognizes the position of the output unit 200 and the position of the operation unit 210 at a predetermined frequency. The recognition unit 220 transmits the recognized position of the output unit 200 and the position of the operation unit 210 to the server 10 via the user device communication unit 230. In this embodiment, the two recognition units 220 are configured to recognize the position of the output unit 200 and the position of the operation unit 210.

The user device communication unit 230 is a communication network 30, an output unit 200, and an operation unit by a communication method corresponding to a wireless communication standard such as a wired communication cable or Wi-Fi (registered trademark), Bluetooth (registered trademark), or infrared communication. It is connected to 210 and the recognition unit 220.

The communication network 30 is, for example, a LAN (Local Area Network), a WAN (Wide Area Network), or an Internet communication network.

Next, the processing contents of the virtual cut wig system of the present embodiment will be described with reference to FIGS. 3A to 3C.

As shown in FIG. 3A, the virtual cut wig system of the present embodiment first executes the initial state output process (FIG. 3A / STEP10) when the process is started, and performs the process up to the output of the initial state of the virtual cut wig. ..

After that, the virtual cut wig system executes a video change process (FIG. 3A / STEP20). In this process, the virtual cut wig system accepts an operation on the virtual cut wig by the user, changes the virtual image including the virtual cut wig so as to correspond to the content of the operation, and outputs the operation to the user.

In addition to the virtual cut wig, the virtual image includes a virtual background, a user's virtual right and left hands, and images of combs and scissors held by the right or left hand.

Then, the virtual cut wig system determines whether or not the haircut is completed (FIG. 3A / STEP30).

If the determination is negative (FIG. 3A / STEP30: No), the virtual cut wig system repeats the processing after STEP20. On the other hand, if the determination is positive (FIG. 3A / STEP30: Yes), the virtual cut wig system ends the process.

The virtual cut wig system may determine whether or not the haircut is completed, for example, based on the fact that the hairstyle according to the specified design data is completed, or a predetermined time (for example, 20) from the start of the cut. Minutes, 30 minutes, etc. The length of the time can be changed as appropriate) may be determined, or the user inputs information indicating that the haircut is completed using the operation unit 210. It may be determined based on whether or not it is.

Further, since the processes of STEP 20 and STEP 30 are executed at high speed in a very short cycle, the user of the virtual cut wig system can get a sense of reality as if he / she actually cuts the cut wig in the virtual image. While doing so, you can practice haircuts repeatedly.

An example of each of the above processes will be described in detail below.

<Initial state output processing>
The virtual cut wig system of the present embodiment starts the initial state output process by an operation such as turning on the power switch by the user.

When the initial state output process is started, the user apparatus 20 first transmits the request data requesting the specific screen, which is the screen for specifying the head model data, the hair model data, and the design data, to the server 10 (FIG. 3B / STEP100). ..

Then, the output control unit 111 of the server 10 receives the request data of the specific screen of the head model data, the hair model data, and the design data from the user device 20 (FIG. 3B / STEP200), and the head model from the server storage unit. Acquire a data list, a hair model data list, and a design data list (Fig. 3B / STEP210), generate a specific screen for head model data, hair model data, and design data based on the acquired data, and generate the screen data. Is transmitted to the user device (FIG. 3B / STEP220).

Then, the output unit 200 of the user device 20 receives the head model data, the hair model data, and the design data specific screen (FIG. 3B / STEP300), and displays the head model data, the hair model data, and the design data specific screen. Output to the output section (Fig. 3B / STEP310).

As shown in FIG. 4A, the image of the specific screen is displayed, for example, in front of the left and right eyes of the user. The image V1 on the left eye side and the image V2 on the right eye side have a slight deviation in the left-right direction, and when the user views each image with the corresponding eyes, the image can be viewed three-dimensionally. ..

The image of the specific screen visible to the user is, for example, image V3 as shown in FIG. 4B, and panels (P1 to P6) showing each option of the head model, the hair model, and the hairstyle are displayed.

Subsequently, the specifying unit 211 of the user device 20 accepts the input of information for specifying the head model data, the hair model data, and the design data by the user (FIG. 3B / STEP320).

For example, the user presses a button provided as a specific unit 211 on the operation unit 210, pulls a trigger, grips the grip portion, or releases them, traces on a pad, turns on or off the switch, and the like. Operates the specific screen and inputs information for specifying the head model data, hair model data, and design data.

Alternatively, the operation unit 210 receives input of specific information of head model data, hair model data, and design data by, for example, operating the operation unit 210 itself in the up / down, left / right, and front / back directions.

That is, for example, the cursor C1 moves in the screen as shown in FIG. 4B in response to an operation in which the user moves the operation unit 210 itself in the up / down / left / right directions, and the specific unit 211 is placed on the operation unit 210 on an arbitrary panel. The head model data, the hair model data, and the hairstyle are selected by the operation of pressing the button provided as. In that state, for example, by pressing a button on the "start practice" panel P7, information for specifying the head model data, the hair model data, and the design data corresponding to the hairstyle is input.

Alternatively, when the user device 20 is provided with a voice input unit (not shown) such as a microphone, the voice input unit is used to input information for specifying the head model data, hair model data, and design data. It may be possible to accept a part.

Then, the user apparatus 20 transmits the specific information of the head model data, the hair model data, and the design data received in STEP 320 to the server 10 (FIG. 3B / STEP 330). The specific information includes a head model ID, a hair model ID and a design data ID.

Then, the output control unit 111 of the server 10 receives specific information of the head model data, the hair model data, and the design data (FIG. 3B / STEP400).

Next, the output control unit 111 refers to the server storage unit 100, and based on the head model ID, hair model ID, and design data ID included in the received specific information, the corresponding head model data, respectively. Acquire hair model data and design data (Fig. 3B / STEP410).

Then, the output control unit 111 generates a virtual image including the virtual cut wig based on the acquired data, and transmits it to the user device 20 (FIG. 3B / STEP420).

The output control unit 111 generates a virtual image including a virtual cut wig according to the following flow.

First, the "side 1 length", "side 1 angle", and "side 2" of each part ("right side 1" to "neckline 4", etc.) indicated by the initial hair condition included in the acquired hair model data. A hair model image is generated based on the information of "length" and "side 2 angles".

Next, the image of the virtual cut wig is generated by combining the generated image of the hair model and the image of the head model included in the acquired head model data.

At this time, the output control unit 111, based on the information on the cutting order of each part included in the design data, for example, after a predetermined order from the part of the first cutting order (for example, after 1st order, after 2nd order, after 3rd order). Etc. The value can be changed as appropriate.) A virtual cut that includes only the virtual hair image up to the part of the cutting order and the cutting order number is superimposed on the virtual hair image. Generate a video of the wig.

Then, the output control unit 111 further combines the image of the generated virtual cut wig with the virtual background, the user's virtual right and left hands, and the image of the comb or scissors held by the right or left hand to create a virtual image. To generate.

Next, the output unit 200 of the user apparatus 20 receives the virtual cut wig image (FIG. 3B / STEP500), outputs the virtual cut wig image to the output unit (FIG. 3B / STEP510), and ends the process.

<Video change processing>
When the image change processing is started, the operation unit 210 of the user device 20 first accepts the input of information indicating the operation content for the virtual cut wig and transmits it to the server 10 (FIG. 3C / STEP600), and at the same time, the recognition unit of the user device 20. 220 recognizes the positions and orientations of the output unit 200 and the operation unit and transmits them to the server 10 (FIG. 3C / STEP610).

In the flowchart, it is described that STEP 610 is executed after STEP 600 for convenience, but these two processes are performed at any time in parallel at any time.

That is, the operation unit 210 performs the processing of STEP 600 at any time in a predetermined cycle, and the recognition unit 220 performs the processing of STEP 610 at any time in a predetermined cycle. The predetermined period may be the same period or may be a different period.

In STEP 600, for example, the operation unit sensor 212 of the operation unit 210 recognizes an operation of moving the first operation unit 210a up and down, back and forth, and left and right. Alternatively, for example, the second operation unit 210b recognizes the operation of pulling the trigger provided on the operation unit 210.

Alternatively, the output unit sensor 203 of the output unit 200 recognizes the direction of the output unit 200 based on the acceleration in the three axes of the X, Y, and Z axes of the output unit 200 and the angular velocity of the yaw, pitch, and roll.

Further, in STEP 610, the two recognition units 220 receive, for example, a signal emitted by the output unit 200 in a predetermined cycle, and the difference in time when the signal transmitted from the output unit 200 arrives at the respective recognition units at the same timing. And the position of the output unit 200 is recognized from the direction in which the signal is received.

Alternatively, the camera provided in the recognition unit 220 captures the images of the output unit 200 and the operation unit 210, and recognizes the positions of the output unit 200 and the operation unit 210 from the positions of the output unit 200 and the operation unit 210 in the image. You may do it.

Then, the output control unit 111 of the server 10 receives information indicating the operation content for the virtual cut wig from the user device 20 (FIG. 3C / STEP700), and the position and orientation of the output unit 200 and the operation unit 210 from the user device 20. (Fig. 3C / STEP710). Similar to the above, in the flowchart, it is described that STEP710 is executed after STEP700 for convenience, but these two processes are performed at any time in parallel at any time.

Then, the output control unit 111 includes information indicating the positions and orientations of the output unit 200 and the operation unit 210, the operation content for the virtual cut wig, and the head model data, hair model data, and design data specified in STEP 410. , And generate an image in which the image of the virtual cut wig is changed (FIG. 3C / STEP720).

For example, when the operation of moving the first operation unit 210a up / down, front / back, left / right is received as information indicating the operation content for the virtual cut wig, the output control unit 111 uses the left-hand image in the virtual image as the first operation unit. The virtual image is changed so as to move the 210a up / down, front / back, and left / right according to the movement of the 210a up / down, front / back, and left / right.

Alternatively, when the operation is an operation of moving upward so as to lift the virtual hair in the virtual image, the output control unit 111 upwards the image of the comb held by the right hand and the right hand in the virtual image. The virtual image is changed so that the image of the virtual hair of the object to be lifted follows the image of the comb and is lifted upward.

The output control unit 111 determines, for example, whether the operation is an operation of moving upward so as to lift the virtual hair in the virtual image or simply an operation of moving the image of the right hand upward. Judgment is made based on the position of the virtual hair of the above and the position of the image of the right hand.

That is, for example, if virtual hair exists on the path in which the image of the right hand moves upward, the output control unit 111 determines that it is an operation of lifting the virtual hair in the virtual image, and determines that the operation is to lift the virtual hair of the right hand. As the image of the hair moves, the virtual hair image is also moved upward so that it can be lifted.

Alternatively, the movement is such that the hair is moved so as to be sandwiched between the image of the virtual hair in a state of being lifted and pulled toward the user, and the image of the scissors held by the right hand and the right hand in the virtual image. In the case of pulling the trigger provided in the operation unit 210 of the second operation unit 210b, the output control unit 111 closes the images of the scissors held by the right hand and the right hand in the virtual image. At the same time, the virtual image is changed so that the image of the virtual hair sandwiched between the scissors is cut off.

At this time, the output control unit 111 determines the length and end of the virtual hair after cutting according to the information on the position of the virtual hair in the virtual image and the position and orientation of the second operation unit 210b. Change the virtual image to change the angle.

Alternatively, if the operation is an operation of changing the direction of the output unit 200, the output control unit 111 changes the direction of the virtual image according to the change of the direction.

Alternatively, if the operation is an operation of changing the position of the output unit 200, the output control unit 111 changes the position of the virtual image according to the change in the orientation.

FIG. 5A shows the user side so that the virtual hair Np4 of the neckline 4 is lifted and then sandwiched between the two fingers of the left hand H1 so that the panel angle is 90 ° (horizontal to the virtual floor surface). It shows the state of being pulled to. In this embodiment, since it is set to display from the part of the current cutting order to the part of the cutting order after one order, the virtual hair Np4 of the neckline 4 and the cutting order after one order are displayed. The virtual hair Np3 of the neckline 3 which is the part of the hair is displayed.

As shown in FIG. 5A, a dotted line L1 representing a virtual hair length for a predetermined hairstyle may be displayed on the virtual hair Np4 of the neckline 4.

Alternatively, the respective cutting order (O1, O2) may be displayed on each virtual hair so that the user can recognize the virtual hair cutting order.

Subsequently, the output control unit 111 executes the support information generation display process to change the virtual image including the virtual cut wig according to the operation content of the user (FIG. 3C / STEP800), and the changed image is changed to the user device. It is transmitted to 20 (FIG. 3C / STEP900).

Then, the user apparatus 20 receives the video and outputs it to the output unit 200 (FIG. 3C / STEP1000) to end the process.

In this embodiment, a configuration in which both sides of the panel are displayed in a flat panel shape when the virtual hair is displayed in a flat panel shape is described, but the configuration is limited to this. Not done. For example, when the virtual hair is displayed in the shape of a flat panel, one side of the panel faces up and the other side faces down, or one side is diagonally lower left and the other. The output control unit 111 may be configured so that the side portions face in various directions with the center lines of both sides as the rotation centers, such as a state in which the side portions face diagonally upward to the right.

That is, for example, if virtual hair exists on the path in which the image of the right hand moves in the direction just beside the left, the output control unit 111 forms the virtual hair in the virtual image into a flat panel shape. It is determined that the operation is such that the predetermined one side portion faces upward and the other side portion faces downward, and the virtual hair image is changed as the image of the right hand moves.

Further, for example, the virtual hair is moved from the lower side to the upper side with respect to the image of the virtual hair pulled toward the user with one side of the panel facing up and the other side facing down. When the action of cutting toward is performed, the output control unit 111 changes the image of the scissors held by the right hand and the right hand in the virtual image so that the blade of the scissors closes, and is sandwiched between the scissors. The virtual image is changed so that the image of the virtual hair is cut from the lower side to the upper side.

Further, the output control unit 111 is, for example, cut laterally so that the side portion of the virtual hair of a certain portion is left with a length of 8.5 cm in a state where the side portion of the virtual hair of a certain portion is turned to the left and right, and then the virtual hair of the portion is virtually cut. When the operation of displaying the hair in a flat panel shape with the side of the hair facing up and down is performed, the virtual hair is displayed with a length of 8.5 cm remaining. In this way, the output control unit 111 has the remaining length of the virtual hair with the side facing in a certain direction and the virtual hair with the side facing in the other direction. Calculation is performed so that consistency with the length can be obtained, and output to the output unit 200 is performed.

<Support information generation process>
When the support information generation process is started, the output control unit 111 determines whether or not the virtual hair is cut shorter than the length for achieving a predetermined hairstyle at one or more of the parts (FIG. 3D / STEP810). ).

The output control unit 111 makes the determination based on whether or not the hair is cut shorter than the virtual hair length for achieving a predetermined hairstyle, for example, exceeding a predetermined threshold value. That is, for example, when the length of a certain part in the design data of a predetermined hairstyle is 10 cm and the predetermined threshold value is 1 cm (the value can be changed as appropriate), after cutting the virtual hair. If the length of the hair is less than 9 cm, it is determined that the hair is cut shorter than the virtual hair length for obtaining a predetermined hairstyle at the site.

Then, when the determination is negative (FIG. 3D / STEP810: No), the output control unit 111 executes the processing after STEP830 without executing the processing of STEP820.

On the other hand, when the determination is affirmative (FIG. 3D / STEP810: Yes), the output control unit 111 has one or more parts other than the part according to the length of the virtual hair after cutting. Support information including information that urges the user to cut shorter than the length of each virtual hair to make the predetermined hairstyle. Generates a changed image in addition to the image of the virtual cut wig (Fig.) 3D / STEP820).

For example, the short cut portion is the neckline 3, the length in the design data is 10 cm, and the length of the virtual hair after cutting is 8.5 cm (overcut length is 1.5 cm). When the affected part of the neckline 3 is the neckline 4, as shown in FIG. 5B, the output control unit 111 advises, for example, to cut the virtual hair Np4 of the neckline 4 by 1.5 cm. Add1 is included in the virtual image.

More specifically, the output control unit 111 recognizes, for example, that the affected portion of the neckline 3 is the neckline 4 based on the design data. Then, the output control unit 111 recognizes the length of the virtual hair Np3 of the neckline 3 after cutting and the current length of the virtual hair Np4 of the neckline 4, and balances the virtual hair Np3 of the neckline 3 with the virtual hair Np3. Calculate what length the virtual hair Np4 of the neckline 4 should be in order to take. In this embodiment, the current length of the virtual hair Np4 of the neckline 4 is 10 cm, and the length of the virtual hair Np3 of the neckline 3 after cutting is 8.5 cm. Support information Ad1a and Ad1b for urging the hair Np4 to be further cut by 1.5 cm and balanced are output to the output unit 200.

If there are a plurality of parts registered as affected parts, the output control unit 111 calculates the length of the virtual hair for each affected part in the same manner as described above. The output unit 200 is made to output the support information prompting the balance based on the calculation result. Further, all of the support information based on the calculation result may be output to the output unit 200 at the same time, or may be ordered by a cutting order or the like, and one by one or a plurality of the support information may be sequentially output.

Next, the output control unit 111 determines whether or not the information indicating the operation content satisfies a predetermined condition indicating that the user wants an output based on the order data (FIG. 3D / STEP830).

In the output control unit 111, for example, when the order of the parts to be cut this time is the first and the part from the part of the cutting order this time to the second order is the predetermined order, the user is the part of the first cutting order. When the operation of cutting the virtual hair is completed, it is recognized that the display of the virtual hair of the part after the second cutting order is requested from the part of the second cutting order, and the operation contents of the user are in order. It is determined that the predetermined condition indicating that the user wants the output based on the data is satisfied.

Alternatively, for example, the output control unit 111 has a predetermined threshold value (5 seconds) for the length of time from when the user finishes an operation such as cutting hair to a certain part to starting an operation such as cutting hair to the next part. When it exceeds 10 seconds, etc., the value can be changed as appropriate), it is recognized that the user is in a state of wondering which part should be cut next, and the operation content of the user is sequence data. It may be determined that the predetermined condition indicating that the user wants the output based on the above is satisfied.

Alternatively, for example, the output control unit 111 allows the user to hair when a predetermined time (10 minutes, 15 minutes, etc., the value can be changed as appropriate) has elapsed since the user started the operation on the virtual cut wig. It may be recognized that the user does not understand the order in which the cuts are efficiently performed, and it may be determined that the operation content of the user satisfies a predetermined condition indicating that the user wants an output based on the order data.

Then, when the determination is negative (FIG. 3D / STEP 830: No), the output control unit 111 executes the processing after STEP 850 without executing the processing of STEP 840.

On the other hand, when the determination is affirmative (FIG. 3D / STEP 830: Yes), the output control unit 111 virtually determines from the part of the current cutting order to the part of the cutting order after the predetermined order based on the order data. An image is generated in which the hair is changed in a manner different from that of the virtual hair in other parts (Fig. 3D / STEP840).

That is, for example, if the order of the parts to be cut this time is the first and the order from the part of the cutting order this time to the second order is the predetermined order, the output control unit 111 has the first to third cutting orders. The virtual hair of the second part is emphasized by displaying the number of the cutting order on the virtual hair image, for example, by displaying it in a different color from the virtual hair of other parts. And display. Alternatively, the output control unit 111 may display only the virtual hair in the first to third cutting order portions.

Alternatively, for example, in the output control unit 111, when the order of the parts to be cut this time is the first, and the order from the part of the cutting order this time to the second order is the predetermined order, the user has the first cutting order. When the operation of cutting the virtual hair of the part is finished, the highlighting of the virtual hair of the part of the first cutting order is stopped based on the order data, and the part of the fourth cutting order is finished. Start highlighting your virtual hair. Alternatively, at this time, the output control unit 111 erases the virtual hair of the first cutting order part and displays the virtual hair of the fourth cutting order part based on the order data. May be good.

Then, the output control unit 111 determines whether or not the information indicating the operation content satisfies a predetermined condition indicating that the user wants to switch the display mode (FIG. 3D / STEP850).

For example, when the output control unit 111 performs an operation of touching the virtual hair of a certain part while displaying in the second display mode, the user cuts the virtual hair of the part. It is recognized that the operation to be performed is started, and it is determined that the predetermined condition indicating that the user wants to switch to the first display mode is satisfied.

Alternatively, for example, the output control unit 111 performs an operation such as releasing the virtual hair of a certain part and then cutting the hair for the next part while displaying in the first display mode. When the length of time until the start of the wig exceeds a predetermined threshold value (1 second, 2 seconds, etc., the value can be changed as appropriate), the current state of the virtual cut wig is changed to the actual cut wig. It may be recognized that the user wants to display and confirm the texture with an approximate texture, and it may be determined that the predetermined condition indicating that the user wants to switch to the second display mode is satisfied.

Alternatively, for example, it is determined that the operation of pressing a predetermined button provided on the operation unit 210 satisfies a predetermined condition indicating that the user wants to switch from one display mode to the other display mode. May be good.

If the determination is negative (FIG. 3D / STEP850: No), the output control unit 111 ends the process without executing STEP860.

On the other hand, when the determination is affirmative (FIG. 3D / STEP850: Yes), the output control unit 111 switches the virtual hair display mode to generate a changed image (FIG. 3D / STEP860) and performs processing. finish.

That is, if the output control unit 111 is displaying in the first display mode, the output control unit 111 switches to the second display mode to generate an image in which the image is changed, and displays the image in the second display mode. If so, the first display mode is switched to generate an image in which the image is changed.

<Other embodiments>
In the above, the embodiment of the so-called non-transmissive head-mounted display in which the output unit 200, which is a part of the user device 20, is used so as to cover the entire field of view of the user of the virtual cut wig system has been described. Not limited to this.

That is, for example, as the output unit 200, a so-called transmissive head-mounted display may be used in which the user can operate the virtual cut wig system while seeing through the actual background.

In this case, the display 201 of the output unit 200 includes, for example, a half mirror that can show the image generated by the output control unit 111 to the user while transmitting the actual background. Therefore, the user can see the actual background through the display 201, and can superimpose the information output to the user according to the processing result of the output control unit 111 on the actual background. can. Alternatively, the display 201 may be a retinal projection type display.

As a result, for example, the image of the virtual cut wig is superimposed and displayed in the real background, so that the user of the virtual cut wig system actually cuts the cut wig in the real space where he / she is. You can practice haircuts repeatedly while getting a sense of reality.

In this case, since the actual background is transparent to the user through the display 201, the output control unit 111 omits the generation of the virtual background image in the generation of the virtual image.

In this way, by using the display 201 that can transmit the real image and show it to the user, the output control unit 111 can show the user the real background image instead of the virtual background image. This eliminates the need to allocate that processing power to the generation of virtual background video. As a result, the output control unit 111 can generate an image such as a virtual cut wig with a sufficient sense of presence with a small processing capacity.

Alternatively, the output control unit 111 can concentrate its processing power on the generation of a virtual video other than the real video, so that the processing power can be used to generate a video such as a virtual cut wig with a more realistic feeling. It can be used.

Further, in the case of the present embodiment, the output unit sensor 203 includes a mechanism for recognizing the positions and shapes of the user's right and left hands as seen from the user's viewpoint at a predetermined frequency. The output unit sensor 203 causes the virtual cut wig system to recognize information indicating the positions and shapes of the user's right and left hands as seen from the recognized user's viewpoint via the user device communication unit 230.

Then, the output control unit 111 is based on the information indicating the positions and shapes of the user's right and left hands recognized by the output unit sensor 203 in the above-mentioned initial state output process (STEP 10) and image change process (STEP 20). Generates a virtual right-hand and left-handed image of the user so that the virtual right-handed and left-handed images of the user are displayed in the recognized shape and position, and the image, the image of the virtual cut wig, and the image of the virtual cut wig. A virtual image is generated by combining the image of a comb or scissors held by the right or left hand.

That is, for example, when the position of the user's left hand from the user's point of view changes due to the user moving the left hand up / down, front / back, left / right, the output control unit 111 moves the user's left hand up / down, front / back, left / right. The virtual image is changed so that the image of the left hand in the virtual image is moved up and down, back and forth, and left and right according to the operation.

As a result, the virtual right-hand and left-hand images of the user are generated according to the actual positions and shapes of both hands of the user and displayed on the display 201 of the output unit 200. Therefore, the hair is used by using the virtual cut wig system. When practicing cutting, the user does not feel uncomfortable.

Even when the output unit 200 is composed of a non-transmissive head-mounted display, the output unit sensor 203 recognizes the positions and shapes of the user's right and left hands from the user's point of view at a predetermined frequency. The output control unit 111 may be configured to operate as described above.

Although the embodiments of the present invention have been described above, the present invention is not limited thereto. Various changes can be made without departing from the spirit of the present invention.

For example, an embodiment of accepting input of specific information of head model data, hair model data, and design data by a user in STEP 320 has been described. For example, the head model data, hair model data, and design data are stored in the server storage unit 100. When only one is stored in, the output control unit 111 automatically identifies the head model data, hair model data, and design data as these data used when outputting to the output unit 200. It may be configured.

Alternatively, for example, the head model data, hair model data, and design used when the output control unit 111 randomly outputs the head model data, hair model data, and design data stored in the server storage unit 100 to the output unit 200. It may be configured to be specified by selecting data.

Alternatively, for example, the server storage unit 100 stores the user's haircut proficiency level, and the output control unit 111 automatically selects the head model data, hair model data, and design data according to the proficiency level. It may be configured to specify the head model data, the hair model data and the design data used when outputting to the output unit 200.

Alternatively, for example, the server 10 determines the quality of the haircut according to the degree of matching between the virtual hair length at the time when the haircut is completed and the virtual hair length for achieving a predetermined hairstyle and the elapsed time. May be evaluated and the evaluation result may be output to the output unit 200.

Alternatively, for example, the output control unit 111 borders the boundary on the surface portion of the head model image so that the user can recognize the boundary of the hair bundle point when outputting the information regarding the virtual cut wig to the output unit 200. It may be displayed as a line. Further, the output control unit 111 is configured to control whether or not to display the boundary line by receiving input of information specifying whether or not to display the boundary line by the user in advance or at any time. You may.

10 ... server, 20 ... user device, 30 ... communication network, 100 ... server storage unit, 111 ... output control unit, 200 ... output unit, 210 ... operation unit, 211 ... specific unit, 220 ... recognition unit, 230 ... user equipment Communication department.

Claims (5)

In a computer system having an output unit and an operation unit,
Virtual cut wig data showing a virtual cut wig that is a three-dimensional image of a virtual cut wig, and multiple parts of the virtual head of the virtual cut wig to make the virtual cut wig a predetermined hairstyle. A storage unit that stores design data including numerical information indicating the virtual hair length related to each of the above, and a storage unit.
A specific unit that specifies the virtual cut wig data and the design data used when outputting the virtual cut wig to the output unit, and
An output control unit that outputs the virtual cut wig to the output unit,
It has a recognition unit that recognizes the position and orientation of the output unit and the operation unit.
The operation unit is configured to receive input of information indicating the operation content for the virtual cut wig.
The output control unit is the virtual cut wig according to the positions and orientations of the output unit and the operation unit, information indicating the operation content for the virtual cut wig, and the specified virtual cut wig data and design data. It is configured to change the image of the wig and output it to the output unit, and the information indicating the operation content indicates that the user wants to output the support information which is the information for smoothly advancing the haircut. A virtual cut wig system characterized in that it is configured to output support information according to the information indicating the operation content to the output unit when the conditions of the above conditions are satisfied. In the virtual cut wig system according to claim 1,
When the output control unit recognizes that the virtual hair is cut shorter than the length for obtaining a predetermined hairstyle at one or more of the parts, the virtual hair is cut. Includes information urging the user to cut one or more parts other than the portion, depending on the length of the hair, shorter than the length of each of the virtual hairs to achieve the predetermined hairstyle. A virtual cut wig system characterized in that it is configured to output support information to the output unit. In the virtual cut wig system according to claim 1 or 2.
The design data includes order data which is information indicating the cutting order of each part of the virtual cut wig for making the virtual cut wig a predetermined hairstyle.
The output control unit determines the current disconnection order based on the order data when the information indicating the operation content satisfies a predetermined condition indicating that the user wants an output based on the order data. The virtual hair from the site to the site of the cutting order after a predetermined order is configured to be output to the output unit in a manner different from that of the virtual hair of other sites. Cut wig system. In the virtual cut wig system according to any one of claims 1 to 3.
The output control unit is a virtual cut wig system characterized in that the virtual hair is formed into a flat plate shape for each part and output to the output unit. The output unit, the operation unit, the virtual cut wig data showing the virtual cut wig which is a three-dimensional image of the virtual cut wig, and the virtual cut wig for making the virtual cut wig a predetermined hairstyle. A computer system equipped with a storage unit that stores design data including numerical information indicating a virtual hair length related to each of a plurality of parts of a wig.
A step of specifying the virtual cut wig data and the design data used when outputting the virtual cut wig to the output unit, and
A step of outputting the virtual cut wig to the output unit,
A step of recognizing the positions and orientations of the output unit and the operation unit, and
A step for accepting input of information indicating the operation content for the virtual cut wig, and
The image of the virtual cut wig is changed according to the positions and orientations of the output unit and the operation unit, the information indicating the operation content for the virtual cut wig, and the specified virtual cut wig data and design data. The step to output to the output section and
When the information indicating the operation content satisfies a predetermined condition indicating that the user is requesting the output of the support information which is the information for smoothly advancing the haircut, the support according to the information indicating the operation content is satisfied. A virtual cut wig program characterized by executing a step of outputting information to the output unit.

Images