WO2016123769A1 - 虚拟饰品试戴的人机交互方法和系统 - Google Patents
虚拟饰品试戴的人机交互方法和系统 Download PDFInfo
- Publication number
- WO2016123769A1 WO2016123769A1 PCT/CN2015/072277 CN2015072277W WO2016123769A1 WO 2016123769 A1 WO2016123769 A1 WO 2016123769A1 CN 2015072277 W CN2015072277 W CN 2015072277W WO 2016123769 A1 WO2016123769 A1 WO 2016123769A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- hand
- dimensional model
- jewelry
- accessory
- depth information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
Definitions
- the present invention relates to the field of virtual reality technology, and in particular, to a human-computer interaction method and system for virtual jewelry trial wear.
- the object of the present invention is to provide a human-computer interaction method and system for virtual jewelry trials, which realizes the technical effect of improving the purchase experience of customers purchasing jewelry.
- a human-computer interaction method for virtual jewelry fitting comprises: respectively importing and displaying a three-dimensional model of a hand and a three-dimensional model of a jewelry; wearing the three-dimensional model of the accessory on the three-dimensional model of the hand; receiving a depth sensor in its perception Depth information of the hand acquired in the space; and based on the depth information of the hand, the display of the three-dimensional model of the hand and the three-dimensional model of the accessory is adjusted.
- the method further includes: receiving depth information of the hand acquired by the depth sensor in the sensing space; obtaining bone information of the hand based on the acquired depth information of the hand; wherein the bone information includes a wrist, a palm, and a bone of each finger Width information and bone length information; a hand three-dimensional model of the hand is constructed based on the bone information of the hand.
- the method further comprises: constructing a three-dimensional model of the jewelry of the jewelry.
- the method further includes: storing the three-dimensional model of the jewelry in a three-dimensional model library of the jewelry; and the three-dimensional model of the imported jewelry is specifically: selecting a target jewelry from the three-dimensional model library of the jewelry A three-dimensional model and a three-dimensional model of the target ornament is imported.
- the three-dimensional model of the accessory is worn on the three-dimensional model of the hand, specifically: selecting a position on the hand three-dimensional model that needs to wear the three-dimensional model of the accessory; Displayed at the location.
- the hand three-dimensional model includes a three-dimensional model of wearing a hand and a three-dimensional model of an interactive hand; and the display of the three-dimensional model of the hand and the three-dimensional model of the accessory is adjusted based on the depth information of the hand, specifically: Determining whether the state of the three-dimensional model of the wearing hand changes based on the depth information of the hand; if not, determining whether the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand are present based on the depth information of the hand Relative motion; if so, adjust the position of the three-dimensional model of the accessory and display it.
- the determining, according to the depth information of the hand, whether the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand have relative motion specifically: obtaining the wearing hand based on the depth information of the hand Orientation information of a finger or a wrist in the three-dimensional model; determining whether the interactive hand three-dimensional model is translationally moved relative to a direction of a finger or a wrist in the three-dimensional model of the wearing hand; if yes, adjusting the position of the three-dimensional model of the accessory and displaying Specifically, the displacement of the three-dimensional model of the accessory on the finger or the wrist in the three-dimensional model of the wearing hand is adjusted and displayed.
- the determining, according to the depth information of the hand, whether the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand have relative motion specifically: obtaining the wearing hand based on the depth information of the hand Orientation information of a finger or a wrist in the three-dimensional model; determining whether the interactive hand three-dimensional model moves vertically with respect to a direction of a finger or a wrist in the three-dimensional model of the wearing hand; if yes, adjusting the position of the three-dimensional model of the accessory and displaying Specifically, the angle of the three-dimensional model of the accessory on the finger or the wrist in the three-dimensional model of the wearing hand is adjusted and displayed.
- the displaying, according to the depth information of the hand, the display of the three-dimensional model of the hand and the three-dimensional model of the accessory specifically: the synchronizing the hand according to the change of the depth information of the hand
- the three-dimensional model and the display of the three-dimensional model of the ornament specifically: the synchronizing the hand according to the change of the depth information of the hand.
- the displaying, according to the depth information of the hand, the display of the three-dimensional model of the hand and the three-dimensional model of the accessory specifically: determining, according to the depth information of the hand, the three-dimensional model of the interactive hand Whether the state changes; if not, the display of the three-dimensional model of the wearing hand is synchronized according to the change in the depth information of the hand.
- the method includes: receiving depth information of the hand acquired by the depth sensor in the sensing space; and analyzing the depth information based on the hand a gesture corresponding to the movement of the hand; based on the gesture, controlling the flipping, moving or zooming of the three-dimensional model of the accessory.
- a human-computer interaction system for virtual jewelry fitting comprising a depth sensor and a display unit, further comprising an importing unit and a main control unit: the depth sensor for acquiring depth information of the hand in the sensing space thereof;
- the import unit is configured to respectively introduce a three-dimensional model of the hand and a three-dimensional model of the ornament; the main control unit wears the three-dimensional model of the accessory on the three-dimensional model of the hand; and receives the depth sensor acquired in the sensing space thereof Depth information of the hand; and adjusting the display of the three-dimensional model of the hand and the three-dimensional model of the accessory based on the depth information of the hand; the display unit displaying the three-dimensional model of the hand and the three-dimensional model of the accessory.
- the system further includes a building unit; the building unit is configured to construct a three-dimensional model of the jewelry of the jewelry; and the main control unit receives the depth information of the hand acquired by the depth sensor in the sensing space thereof, And obtaining bone information of the hand based on the obtained depth information of the hand, the building unit constructing a three-dimensional model of the hand of the hand based on the bone information of the hand; wherein the bone information includes Bone width information and bone length information for wrists, palms, and fingers.
- system further includes a three-dimensional model library of ornaments; the three-dimensional model of the jewelry of the three-dimensional model storage jewelry of the jewelry.
- the three-dimensional model of the accessory is worn on the three-dimensional model of the hand, specifically: selecting a position on the hand three-dimensional model that needs to wear the three-dimensional model of the accessory; The model is shown at the location.
- the hand three-dimensional model includes a three-dimensional model of wearing a hand and a three-dimensional model of an interactive hand; and the display of the three-dimensional model of the hand and the three-dimensional model of the accessory is adjusted based on the depth information of the hand, specifically: Determining whether the state of the three-dimensional model of the wearing hand changes based on the depth information of the hand; if not, determining whether the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand are present based on the depth information of the hand Relative motion; if so, adjust the position of the three-dimensional model of the accessory and display it.
- the determining, according to the depth information of the hand, whether the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand have relative motion specifically: obtaining the wearing hand based on the depth information of the hand Orientation information of a finger or a wrist in the three-dimensional model; determining whether the interactive hand three-dimensional model is translationally moved relative to a direction of a finger or a wrist in the three-dimensional model of the wearing hand; if yes, adjusting the position of the three-dimensional model of the accessory and displaying Specifically, the displacement of the three-dimensional model of the accessory on the finger or the wrist in the three-dimensional model of the wearing hand is adjusted and displayed.
- the determining, according to the depth information of the hand, whether the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand have relative motion specifically: obtaining the wearing hand based on the depth information of the hand Orientation information of a finger or a wrist in the three-dimensional model; determining whether the interactive hand three-dimensional model moves vertically with respect to a direction of a finger or a wrist in the three-dimensional model of the wearing hand; if yes, adjusting the position of the three-dimensional model of the accessory and displaying Specifically, the angle of the three-dimensional model of the accessory on the finger or the wrist in the three-dimensional model of the wearing hand is adjusted and displayed.
- the displaying, according to the depth information of the hand, the display of the three-dimensional model of the hand and the three-dimensional model of the accessory specifically: the synchronizing the hand according to the change of the hand depth information
- the three-dimensional model and the display of the three-dimensional model of the ornament specifically: the synchronizing the hand according to the change of the hand depth information.
- the displaying, according to the depth information of the hand, the display of the three-dimensional model of the hand and the three-dimensional model of the accessory specifically: determining, according to the depth information of the hand, the three-dimensional model of the interactive hand Whether the state changes; if not, the display of the three-dimensional model of the wearing hand is synchronized according to the change in the depth information of the hand.
- the virtual 3D model of the hand when the customer wants to try on a certain jewelry, introduces and displays the 3D model of the jewelry and the 3D model of the hand of the customer's hand, and controls the wearing of the virtual jewelry on the virtual hand, and then adopts
- the depth sensor acquires the depth information of the hand of the customer, and adjusts the display of the three-dimensional model of the hand and the three-dimensional model of the jewelry based on the depth information of the hand, for example, adjusting the display angle of the virtual hand and the virtual jewelry according to the movement of the hand, so that the customer It is possible to know whether the size of the jewelry and the hand is appropriate, whether the effect of the jewelry worn on the hand is good or not, etc., and the effect of the customer actually wearing the jewelry is generated, and the customer can purchase the jewelry when the customer cannot actually try the jewelry. Experience.
- 1 is a schematic view of a depth sensor sensing space
- FIG. 2 is a flowchart of a method for human-computer interaction of a virtual jewelry try-on according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of relative movement of a wearing hand and an interactive hand according to an embodiment of the present invention
- FIG. 4 is a schematic diagram of relative movement of a wearing hand and an interactive hand according to an embodiment of the present invention
- FIG. 5 is a flowchart of still another method for a human-computer interaction method for virtual jewelry trials according to an embodiment of the present invention
- FIG. 6 is a flowchart of still another method for a human-computer interaction method for virtual jewelry trials according to an embodiment of the present invention
- FIG. 7 is a block diagram of a human-machine interaction system for virtual jewelry trials according to an embodiment of the present invention.
- the present invention constructs a three-dimensional model of a jewelry and a three-dimensional model of a hand by using a virtual try-on method by using a human-computer interaction method and system for virtual jewelry fitting, that is, constructing a virtual jewelry and a virtual hand,
- the virtual hand wears the virtual jewelry, and obtains the depth information of the hand through the depth sensor, and adjusts the display relationship of the virtual hand wearing the virtual jewelry based on the depth information, so as to achieve the same effect as the real hand try to wear the real jewelry.
- the current depth sensor can obtain information such as bone information, spatial three-dimensional coordinates and speed of the hand, including the palm, the wrist and each finger.
- the kinect sensor can acquire the hand at a frequency of several tens of frames per second.
- the information, while the LeapMotion sensor can be acquired at a frequency of more than one hundred frames per second.
- the depth sensor 1 is placed on the front end of the display interface 21 of a device such as a computer, and
- the range of perception forms a perceptual space 4 in front of the display interface that senses the palms, wrists, and fingers.
- the three-dimensional coordinates and velocity information including the rate of the palm, wrist, and fingers of the user. And the velocity direction) and bone information can be sensed by the depth sensor.
- the depth sensor is not necessarily limited to being placed around the device such as a computer, but is placed according to the spatial position of the actual hand operation, and it is not necessary to limit the hand to a fixed position.
- the display interface can be, but is not limited to, a television screen, a projection screen, a computer screen, a head mounted 3D display system, and the like.
- the accessories mentioned in the embodiments of the present invention include, but are not limited to, rings, watches, bracelets, bracelets and the like.
- FIG. 2 is a flowchart of a method for human-computer interaction of a virtual jewelry try-on according to an embodiment of the present invention, where the method includes the following steps:
- Step S21 respectively importing and displaying a three-dimensional model of the hand and a three-dimensional model of the jewelry;
- the construction of the three-dimensional model of the jewelry can be carried out by any existing method for constructing the three-dimensional model; it can be constructed according to the actual existing jewelry, or can be constructed according to the jewelry design concept or drawing; in the Internet e-commerce, Customers can even create and build 3D models of their own jewelry and upload them to suppliers.
- the three-dimensional model of the target jewelry is selected from the three-dimensional model library of the jewelry and imported.
- the target three-dimensional model of the jewelry the customer can use existing methods, such as dragging in the mouse point, or gesture control, to select the three-dimensional model of the Italian jewelry from the three-dimensional model library of the jewelry
- the customer's hand 3D model is constructed in real time.
- the customer's hand information is acquired by the depth sensor, including the hand.
- Bone information (including wrists, palms, and fingers) that includes bone width information and bone length information, ie the width of the wrist bone, the width and length of the palm bone, the width and length of each finger (including the individual knuckles) ) and other information, based on the depth sensor acquired these bones
- the skeleton information can construct the 3D model of the client's hand in real time.
- a hand 3D model library can also be created for the hand 3D model, and the constructed 3D model of the client hand can be stored, when the customer tries to wear the jewelry next time. It is no longer necessary to rebuild the 3D model of the hand, which is especially suitable for old customers and enhance the customer's buying experience.
- Step S22 wearing the three-dimensional model of the ornament on the three-dimensional model of the hand;
- the situation of the hand wearing the jewelry is simulated, and the three-dimensional model of the ornament is worn on the three-dimensional model of the hand.
- a specific implementation manner is to select a position on the hand three-dimensional model that needs to be worn, and display the three-dimensional model of the jewelry at this position. For example, selecting one of the fingers of the hand three-dimensional model displays the three-dimensional model of the ring on the finger portion; or, after selecting the wrist portion in the three-dimensional model of the hand, displaying a three-dimensional model of the jewelry such as a bracelet or a watch on the wrist On the part.
- the depth sensor can obtain the bone information of the wrist, the palm and each finger. In addition to the information such as the width and length of the bone, including the position information of the wrist, the palm and each finger, the three-dimensional model of the wearing hand is selected to wear the three-dimensional jewelry.
- the specific three-dimensional coordinates of the wearing position are determined, and the three-dimensional model of the jewelry can be displayed at this position; the specific ring, bracelet, watch and other accessories can adopt the center point position of the three-dimensional model and The way the wrist bones or the center of the finger bones coincide with each other to achieve the effect of attaching the ring and bracelet to the finger or wrist.
- Step S23 receiving depth information of the hand acquired by the depth sensor in the sensing space thereof;
- the depth sensor acquires the depth information of the hand in real time, including the three-dimensional coordinates and speed of the hand, and the client's hand is in In the sensing space of the depth sensor, the angle of the hand is adjusted like a real wearing jewelry to realize the effect of simulating the real wearing test in the virtual system.
- Step S24 Adjust the display of the three-dimensional model of the hand and the three-dimensional model of the ornament based on the depth information of the hand.
- the depth sensor acquires the depth information of the hand in its perceptual space, including the bone information of the palm, the wrist and each finger, and the bone information can reflect the characteristic information of the hand; the depth information also includes the three-dimensional coordinates of the palm, the wrist and each finger and Velocity information, which can accurately capture the position, posture and motion of the hand; in the sensing space of the depth sensor, acquire the depth information generated by the movement, flipping, etc. of the hand at a certain frequency, based on the depth information and the above characteristic information
- the reaction to the display interface is the virtual simulation of the hand and the jewelry to perform the corresponding action.
- the hand 3D model is constructed according to the bone information, and then the motion information of the hand is acquired at a certain frequency, thereby controlling the movement of the hand 3D model or the 3D model of the jewelry in the display interface, which can make
- the hand feature information and the motion information in the perceptual space are in one-to-one correspondence with the hand three-dimensional model in the display interface and the feature information and the motion information of the three-dimensional model of the ornament, thereby simulating the effect of the real hand-trimmed jewelry.
- the display angle of the three-dimensional model of the hand and the three-dimensional model of the ornament is adjusted, so that the customer can understand whether the effect of the jewelry worn on the hand is good or not, and the effect of the customer actually wearing the jewelry is generated, and the customer cannot be true.
- you try on accessories you can improve the purchasing experience of customers trying on jewelry.
- the customer can set whether the jewelry is displayed on the left or right hand, or on the finger or on the wrist, as shown in Figure 1.
- the customer can select the three-dimensional model of the jewelry from the three-dimensional model library of the jewelry, or replace the three-dimensional model of the jewelry during the virtual fitting process.
- the corresponding hand 3D model can be distinguished as the wearing hand 3D model and the interactive hand 3D model, as shown in FIG. 3 and FIG. 4, the left hand is Wear your hands and your right hand is an interactive hand.
- the following is a simulation of the actual situation in which the hand wears the jewelry: the left hand wears the jewelry, and the right hand adjusts the position or angle of the jewelry.
- the following specific method is proposed in the embodiment of the present invention.
- the display of the three-dimensional model of the hand and the three-dimensional model of the ornament is adjusted, which may be the steps as shown in FIG. 5:
- Step S51 determining whether the state of wearing the three-dimensional model of the hand changes based on the depth information of the hand;
- the wearing hand In the case of real wear, the wearing hand is usually kept still, and the position and angle of the jewelry are adjusted by the other hand. Correspondingly, it is designed to be in the virtual system, if the state of wearing the hand 3D model remains unchanged, That is, the depth information of the hand wearing the hand does not change, reflecting the state in which the customer's wearing hand remains stationary, indicating that the customer is about to adjust the position or angle of the jewelry. then
- Step S52 determining, according to the depth information of the hand, whether there is relative motion between the wearing hand three-dimensional model and the interactive hand three-dimensional model;
- Step S53 Adjust the position of the three-dimensional model of the jewelry and display it.
- the different movements of the interactive hand correspond to different adjustments of the jewelry.
- the position of the three-dimensional model of the accessory needs to be adjusted according to the different state of motion, for example, the position of the three-dimensional model of the moving ornament. , or adjust the angle of the 3D model of the jewelry, etc.
- a specific implementation for determining whether there is relative motion between the wearing hand 3D model and the interactive hand 3D model is as shown in FIG. 3, based on the hand depth information, including the interactive hand (corresponding to the right hand) and the wearing hand ( Corresponding to the depth information of the left hand, the direction information of the finger or the wrist in the three-dimensional model of the wearing hand is obtained, and it is determined whether the three-dimensional model of the interactive hand is translationally moved relative to the direction of the finger or the wrist in the three-dimensional model of the wearing hand, which corresponds to the relative hand of the interactive hand.
- the finger or wrist direction shifts and moves; if it is judged that the interactive hand 3D model is moved relative to the direction of the finger or wrist in the 3D model of the wearing hand, the action is correspondingly adjusted to adjust the jewelry 3D model in the wearing hand 3D model finger Or the displacement on the wrist, and display; corresponding to the actual wearing situation, to adjust the position of the ring on the finger, adjust the position of the watch on the wrist, etc.; translational movement includes the translation of the entire hand, and only the translation of the finger.
- FIG. 4 Based on the depth information of the hand, another specific implementation for determining whether there is relative motion between the wearing hand 3D model and the interactive hand 3D model is as shown in FIG. 4, based on the hand depth information, including the interactive hand (corresponding to the right hand) 3D model.
- Wearing the depth information of the hand (corresponding to the left hand), obtaining the direction information of the finger or the wrist in the three-dimensional model of the wearing hand, and determining whether the three-dimensional model of the interactive hand moves vertically with respect to the direction of the finger or the wrist in the three-dimensional model of the wearing hand, which corresponds to the interaction hand
- Vertical movement relative to the wearing hand including vertical movement on the same plane and vertical movement on different planes; if it is judged that the interactive hand three-dimensional model is vertically moved relative to the direction of the finger or wrist in the three-dimensional model of the wearing hand, the action is corresponding To adjust the decoration
- the angle of the 3D model on the finger or wrist in the 3D model of the hand is displayed and displayed; corresponding to the actual wearing situation, the angle of the ring on the finger is adjusted, the angle of the watch on the wrist is adjusted, and the vertical movement includes the entire hand.
- the magnitude of the movement and rotation of the three-dimensional model of the ornament is determined by the distance and amplitude of the movement of the interactive hand within the depth sensor's perceived space.
- the customer When actually wearing the jewelry, the customer sometimes uses the interactive hand to fix the jewelry, and changes the position of the wearing hand to adjust the angle and position relationship between the jewelry and the wearing hand, and accordingly, the interactive hand does not move, and then the virtual try-on system is reacted.
- the display of the 3D model of the wearing hand can be adjusted by determining whether the state of the interactive hand 3D model changes, that is, when it is determined that the state of the interactive hand 3D model has not changed. According to the change of the depth information of the hand, the display of the three-dimensional model of the hand is synchronously worn, and the position and angle of the three-dimensional model of the fixed ornament are unchanged.
- the customer can also place the wearing hand only in the sensing space of the depth sensor.
- the most direct way is to synchronize the display of the hand (wearing hand) 3D model according to the change of the depth information of the hand, and to make the 3D jewelry.
- the display of the model is synchronized with the display of the three-dimensional model of the hand.
- the effect of the reaction is that when the customer adjusts the position and angle of the wearing hand, the accessory moves following the movement of the wearing hand to realize the wearing effect of observing the jewelry and the hand at different angles. .
- the customer Before the virtual wear jewelry, the customer can only choose to import the three-dimensional model of the jewelry, and adjust the display of the three-dimensional model of the jewelry through operations of the input device such as a mouse or a keyboard, such as flipping, zooming, and the like.
- the input device such as a mouse or a keyboard, such as flipping, zooming, and the like.
- the customer can also control the flipping or zooming of the 3D model of the jewelry based on the depth sensor based on the gesture, as shown in Figure 6:
- Step S61 receiving depth information of the hand acquired by the depth sensor in the sensing space thereof;
- Step S62 analyzing, according to the depth information of the hand, a gesture corresponding to the motion of the hand;
- Step S63 Control the flipping, moving or zooming of the three-dimensional model of the ornament based on the gesture.
- the three-dimensional coordinates and velocity information of the hand are obtained; and the displacement of the hand is analyzed according to the three-dimensional coordinates of the hand, and the moving direction of the hand is analyzed according to the speed information of the hand.
- the depth sensor collects the depth information of the hand change in the sensing space. Therefore, the three-dimensional coordinates in the acquired depth information form the motion displacement of the hand on the time axis, and the speed direction and the velocity in the velocity information are in the space. The direction of movement and speed of movement of the hand are constructed.
- the gesture corresponding to the hand movement can be calculated; specifically, combined with the movement displacement of the hand and the movement direction and the movement speed, a gesture model of the hand occurring in the space can be constructed, and different gesture models correspond to different gestures.
- the human-computer interaction instruction for example, flips the three-dimensional model of the jewelry, enlarges or reduces the three-dimensional model of the jewelry, and the corresponding relationship between the specific gesture and the human-computer interaction instruction can be determined according to the actual situation of the game, and the solution is not limited.
- the size of the three-dimensional model of the jewelry can also be adjusted by the above method, for example, by using a mouse or a keyboard to input parameters to change the size of the three-dimensional model of the jewelry, and for example, based on the relative movement of the two fingers of the interactive hand.
- the change in the size of the distance to adjust the size of the three-dimensional model of the jewelry, etc.; the advantage of this is that the customer can customize the size of the jewelry suitable for his hand according to the size of the hand, and is not limited to the size of the existing jewelry, thereby improving Customer's buying experience.
- the user can complete the selection and purchase process of the jewelry by himself, thereby reducing the labor cost of the jewelry merchant.
- the embodiment of the present invention further provides a human-computer interaction system for virtual jewelry trial, as shown in FIG. 7, including a depth sensor 1, a display unit 2, an import unit 3, and a main The control unit 4; the depth sensor is used to acquire the depth information of the hand in the sensing space; the importing unit is used to respectively introduce the hand three-dimensional model and the three-dimensional model of the ornament; the main control unit wears the three-dimensional model of the ornament on the three-dimensional model of the hand, And receiving the depth information of the hand acquired by the depth sensor in the sensing space thereof, and adjusting the display of the hand three-dimensional model and the three-dimensional model of the ornament based on the depth information of the hand; the display unit displays the three-dimensional model of the hand and the three-dimensional model of the accessory.
- a human-computer interaction system for virtual jewelry trial as shown in FIG. 7, including a depth sensor 1, a display unit 2, an import unit 3, and a main The control unit 4; the depth sensor is used to acquire the depth information of the hand in the sensing space; the
- the above system also includes a building unit 5; the building unit is used to construct a three-dimensional model of the jewelry of the jewelry and a three-dimensional model of the hand of the client.
- the three-dimensional model of the jewelry is constructed according to the measurement parameter of the jewelry, and the bone information of the hand obtained after the depth information of the hand acquired by the depth sensor received by the main control unit in the sensing space is constructed, and the three-dimensional shape of the hand is constructed.
- the model in this case, the bone information includes bone width information and bone length information of the wrist, the palm, and each finger.
- the above system further comprises a three-dimensional model library 6 for storing the three-dimensional model of the jewelry for the customer, for the customer to select the three-dimensional model of the jewelry from the three-dimensional model library of the jewelry for virtual trial wear.
- the main control unit wears the 3D model of the ornament on the 3D model of the hand, specifically: selecting the position of the 3D model of the hand to be worn on the 3D model of the hand; And display the 3D model of the jewelry at this position.
- the three-dimensional model of the hand is constructed to include the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand.
- the left hand wears the jewelry, and the right hand adjusts the position or angle of the jewelry, which can correspond to the wearing hand remaining, and the state of the interactive hand relative to the wearing hand changes; specifically, judging the wearing hand Whether the state of the three-dimensional model changes; if not, it is judged whether there is relative motion between the wearing hand three-dimensional model and the interactive hand three-dimensional model; if so, the position of the three-dimensional model of the jewelry is adjusted and displayed.
- the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand have relative motion, and can be a translational movement of the finger or wrist of the three-dimensional model of the interactive hand with the three-dimensional model of the hand, wearing the hand or the wrist of the three-dimensional model of the hand.
- the direction information is obtained based on the depth information of the hand, including the interactive hand (corresponding to the right hand) and the wearing hand (corresponding to the left hand); if it is judged that the interactive hand three-dimensional model is moved relative to the direction of the finger or the wrist in the three-dimensional model of the wearing hand Then, the action is correspondingly adjusted to adjust the displacement of the three-dimensional model of the jewelry on the finger or the wrist in the three-dimensional model of the hand, and is displayed; corresponding to the actual wearing situation, the position of the ring on the finger is adjusted, and the position of the watch on the wrist is adjusted.
- the translational movement includes the translation of the entire hand and the translation of only the finger; corresponding to the angle of the adjustment of the jewelry by the interactive hand, the three-dimensional model of the wearing hand and the three-dimensional model of the interactive hand have relative motion, and the three-dimensional model of the interactive hand can be relatively worn.
- the direction of the finger or wrist moves vertically in the 3D model.
- the interactive three-dimensional model is moved relative to the direction of the finger or the wrist in the three-dimensional model of the wearing hand, and the action is correspondingly adjusted to adjust the angle of the three-dimensional model of the accessory on the finger or the wrist in the three-dimensional model of the wearing hand, and is displayed;
- the angle of the ring on the finger is adjusted, the angle of the watch on the wrist, and the like are adjusted;
- the vertical movement includes the vertical movement of the entire hand and the vertical movement of only the finger portion.
- the customer When the customer only places the wearing hand in the sensing space of the depth sensor, the customer can view the fitting effect from different angles by flipping or moving the wearing hand.
- the most direct way is that according to the change of the hand depth information, Synchronizing the hand 3D model and the display of the 3D model of the ornament; that is, synchronizing the display of the 3D model of the ornament with the display of the 3D model of the hand, the effect of the reaction is that the customer follows the wearer's hand when adjusting the position and angle of the wearer's hand. Exercise and exercise to achieve the effect of observing the jewelry and the hand at different angles.
- the customer When actually wearing the jewelry, the customer sometimes uses the interactive hand to fix the jewelry, and moves the position of the wearing hand to adjust the angle and position relationship between the jewelry and the wearing hand, and accordingly, the interactive hand does not move, and then the virtual try-on system is reacted.
- the display of the 3D model of the wearing hand can be adjusted by determining whether the state of the interactive hand 3D model changes, that is, when it is determined that the state of the interactive hand 3D model has not changed. According to the change of the depth information of the hand, the display of the three-dimensional model of the hand is synchronously worn, and the position and angle of the three-dimensional model of the fixed ornament are unchanged.
- the human-computer interaction method and system for virtual jewelry trials proposed in the embodiments of the present invention construct a three-dimensional model of the jewelry and a three-dimensional model of the hand of the client, and wear the three-dimensional model of the jewelry on the three-dimensional model of the hand, and adopt the jewelry.
- the virtual try-on method of the hand realizes the effect of the real try-on jewelry; and realizes the change of the position or angle of the virtual control jewelry three-dimensional model by wearing the relative motion of the hand and the interactive hand, and simulates the real hand-adjusting adjustment of the hand And the position and angle of the jewelry, when the customer can not really try on the jewelry, improve the customer's purchase experience of wearing jewelry.
- the customer can try on the virtual jewelry at home instead of going to the jewelry storefront.
- the application store on the network select the jewelry style and try the virtual jewelry. After the trial wear is satisfied, you can pass Online trading orders satisfactory accessories, and you can customize the accessories that suit you through online trading, so that customers can purchase satisfactory accessories without leaving home.
- the three-dimensional model of the jewelry can be displayed on the real hand in the holographic display environment space in a holographic display manner, realizing the combination of virtual and reality, and the depth sensor obtains the depth information of the hand in real time (including wearing the hand).
- the main control unit adjusts the display state of the three-dimensional model of the holographic display in real time according to the depth information of the hand according to the manner of the above embodiment, and realizes the effect of the virtual try-on jewelry.
- the three-dimensional model of the jewelry is put into the human eye through the light, and the depth sensor is placed on the eyeglass frame to form a sensing space in the front of the human body, and the motion of the customer's hand is perceived by the depth sensor, and The perceived depth information is transmitted to the main control unit, and the main control unit superimposes the virtual jewelry with the hand of the real world according to the depth information, and realizes the effect that the jewelry is worn on the hand in the human eye, and real-time according to the manner of the above embodiment. Adjusting the display of the three-dimensional model of the ornament in the human eye, Realize the combination of virtual and reality and the effect of virtual try-on jewelry.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
Landscapes
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Finance (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
一种虚拟饰品试戴的人机交互方法和系统，实现的是提高客户购买饰品的购买体验的技术效果。方法包括：分别导入并显示手部三维模型和饰品三维模型（S21），并将饰品三维模型佩戴于手部三维模型上（S22）；接收深度传感器在其感知空间内获取的手部的深度信息（S23），并基于手部的深度信息，调整手部三维模型与饰品三维模型的显示（S24）。构建饰品的饰品三维模型以及客户手部的手部三维模型，将饰品三维模型佩戴于手部三维模型上，并通过佩戴手和交互手的相对运动来实现虚拟控制饰品三维模型的位置或角度的变化，模拟真实试戴中调整手部和饰品的位置和角度，在客户不能真实试戴饰品时，采用这种饰品与手部虚拟的试戴的方式，实现真实试戴饰品的效果。
Description
本发明涉及虚拟现实技术领域，尤其涉及一种虚拟饰品试戴的人机交互方法和系统。
购买饰品时，客户需要试戴饰品，以确定饰品的大小是否合适，以及佩戴的效果是否满意。
对于贵重的饰品，出于安全性的考虑，在客户没有确定要购买的情况下，通常不允许将饰品拿出柜台供客户试戴；或者饰品并不存放于柜台，而是出示饰品的图片或者视频供客户观看，在客户有意购买时，需要带领客户去饰品的存储地，通常是具有保险柜的安防较严格的地方专门试戴。即使不是贵重的饰品，由于商家的饰品款式众多，不可能全部摆在柜台上，也只能用图片或者视频的方式。这都降低了客户的购买体验。
而且传统的饰品试戴过程中，需要商家服务人员的全程陪同，商家需要承担高额的人力成本。
问题的解决方案
本发明的目的是提供一种虚拟饰品试戴的人机交互方法和系统，实现的是提高客户购买饰品的购买体验的技术效果。
本发明的目的是通过以下技术方案实现的：
提出一种虚拟饰品试戴的人机交互方法，包括：分别导入并显示手部三维模型和饰品三维模型；将所述饰品三维模型佩戴于所述手部三维模型上；接收深度传感器在其感知空间内获取的手部的深度信息；基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示。
进一步的，所述分别导入并显示手部三维模型和饰品三维模型之前，所述方法
还包括：接收深度传感器在其感知空间内获取的手部的深度信息；基于获取的手部的深度信息，得到手部的骨骼信息；其中，所述骨骼信息包括手腕、手掌和各手指的骨骼宽度信息和骨骼长度信息；基于所述手部的骨骼信息，构建所述手部的手部三维模型。
进一步的，所述分别导入并显示手部三维模型和饰品三维模型之前，所述方法还包括：构建饰品的饰品三维模型。
进一步的，在构建饰品三维模型之后，所述方法还包括：将所述饰品三维模型存放于饰品三维模型库中；所述导入饰品三维模型具体为：从所述饰品三维模型库中选择目标饰品三维模型，并导入所述目标饰品三维模型。
进一步的，所述将所述饰品三维模型佩戴于所述手部三维模型上，具体为：在所述手部三维模型上选定需要佩戴所述饰品三维模型的位置；将所述饰品三维模型显示于所述位置上。
进一步的，所述手部三维模型包括佩戴手三维模型和交互手三维模型；所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述佩戴手三维模型的状态是否发生变化；若否，基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动；若是，调整所述饰品三维模型的位置并显示。
进一步的，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向平移移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的位移并显示。
进一步的，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向垂直移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手
三维模型中手指或手腕上的角度并显示。
进一步的，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：所述根据所述手部的深度信息的变化，同步所述手部三维模型和所述饰品三维模型的显示。
进一步的，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述交互手三维模型的状态是否发生变化；若否，根据所述手部的深度信息的变化，同步所述佩戴手三维模型的显示。
进一步的，若只导入并显示所述饰品三维模型，则所述方法包括：接收所述深度传感器在其感知空间内获取的手部的深度信息；基于所述手部的深度信息，分析得到所述手部的运动对应的手势；基于所述手势，控制所述饰品三维模型的翻转、移动或者缩放。
提出一种虚拟饰品试戴的人机交互系统，包括深度传感器和显示单元，还包括导入单元和主控单元：所述深度传感器，用于在其感知空间内获取手部的深度信息；所述导入单元，用于分别导入手部三维模型和饰品三维模型；所述主控单元，将所述饰品三维模型佩戴于所述手部三维模型上；接收所述深度传感器在其感知空间内获取的手部的深度信息；并基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示；所述显示单元，显示所述手部三维模型和饰品三维模型。
进一步的，所述系统还包括构建单元；所述构建单元，用于构建饰品的饰品三维模型；以及，所述主控单元接收所述深度传感器在其感知空间内获取的手部的深度信息，并基于获取的手部的深度信息，得到所述手部的骨骼信息，所述构建单元基于所述手部的骨骼信息，构建所述手部的手部三维模型；其中，所述骨骼信息包括手腕、手掌和个手指的骨骼宽度信息和骨骼长度信息。
进一步的，所述系统还包括饰品三维模型库；所述饰品三维模型库存储饰品的饰品三维模型。
进一步的，所述将所述饰品三维模型佩戴于所述手部三维模型上，具体为：在所述手部三维模型上选定需要佩戴所述饰品三维模型的位置；将所述饰品三维
模型显示于所述位置上。
进一步的，所述手部三维模型包括佩戴手三维模型和交互手三维模型；所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述佩戴手三维模型的状态是否发生变化；若否，基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动；若是，调整所述饰品三维模型的位置并显示。
进一步的，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向平移移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的位移并显示。
进一步的，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向垂直移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的角度并显示。
进一步的，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：所述根据所述的手部深度信息的变化，同步所述手部三维模型和所述饰品三维模型的显示。
进一步的，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述交互手三维模型的状态是否发生变化；若否，根据所述手部的深度信息的变化，同步所述佩戴手三维模型的显示。
发明的有益效果
采用虚拟饰品试戴的方式，在诸如电脑等智能主控设备中，构建饰品以及客户
手部的虚拟三维模型，在客户想要试戴某个饰品时，导入并显示饰品的饰品三维模型以及客户手部的手部三维模型，并控制将虚拟饰品佩戴于虚拟手部上，随后采用深度传感器获取客户的手部的深度信息，基于手部的深度信息，调整手部三维模型和饰品三维模型的显示，例如，根据手部的动作调整虚拟手部和虚拟饰品的显示角度，使客户能够了解饰品与自身手部的大小是否合适，饰品佩戴于自身的手部的效果是否好看等，产生客户真实试戴饰品的效果，在客户不能真实试戴饰品时，提高客户试戴饰品的购买体验感。
对附图的简要说明
图1为深度传感器感知空间示意图；
图2为本发明实施例提出的虚拟饰品试戴的人机交互方法的方法流程图；
图3为本发明实施例中佩戴手与交互手相对运动示意图；
图4为本发明实施例中佩戴手与交互手相对运动示意图；
图5为本发明实施例提出的虚拟饰品试戴的人机交互方法的又一方法流程图；
图6为本发明实施例提出的虚拟饰品试戴的人机交互方法的又一方法流程图；
图7为本发明实施例提出的虚拟饰品试戴的人机交互系统框图。
发明实施例
本发明通过提供一种虚拟饰品试戴的人机交互方法和系统，采用虚拟试戴的方式，在系统中构建饰品三维模型和手部三维模型，也即构建了虚拟饰品和虚拟手部，采用虚拟手部佩戴虚拟饰品，并通过深度传感器获取手部的深度信息，基于该深度信息来调整虚拟手部佩戴虚拟饰品的显示关系，达到与真实手部试戴真实饰品相同的效果。
目前的深度传感器，可以获取到手部，包括手掌、手腕和各手指等部位的骨骼信息、空间三维坐标和速度等信息，以kinect传感器为例，其可以以每秒几十帧的频率获取手部的信息，而LeapMotion传感器更可以以超过每秒一百帧的频率获取。
如图1中所示，以深度传感器1放置于电脑等装置的显示界面21前端为例，其能
感知的范围在显示界面前方形成一个能感知手掌、手腕和各手指的感知空间4，客户在此感知空间内进行手部操作时，其手掌、手腕和各手指的三维坐标、速度信息(包括速率和速度方向)以及骨骼信息都能被该深度传感器感知。当然，在深度传感器与电脑等装置实现无线连接的情况下，深度传感器不必限于放置在电脑等装置的周围，而是使其根据实际手部操作的空间位置放置，不必使手部局限于固定位置进行手势操作。显示界面可以是但不受限于电视屏幕、投影屏幕、电脑屏幕、头戴式3D显示系统等。
本发明实施例中提到的饰品，包括但不受限于戒指、手表、手镯和手环等。
下面将结合附图，对本发明实施例提供的技术方案进行详细描述。
如图2所示，为本发明实施例提出的虚拟饰品试戴的人机交互方法的方法流程图，该方法包括以下步骤：
步骤S21：分别导入并显示手部三维模型和饰品三维模型；
在导入和显示手部三维模型和饰品三维模型之前，首先要构建手部的三维模型和饰品的三维模型。
饰品三维模型的构建，可以采用现有的任一种构建三维模型的方法进行；其可以按照实际存在的饰品去构建，也可以是按照饰品设计构思或图纸去构建的；在互联网电子商务中，客户甚至可以自己创意和构建饰品三维模型然后上传给供应商。
多个饰品，需要构建多个饰品三维模型，将所有构建的饰品三维模型存放于一个饰品三维模型库中，在导入饰品三维模型时，从该饰品三维模型库中选取目标饰品三维模型，并导入该目标饰品三维模型；客户可以采用现有的方法，例如鼠标点中拖动，或者手势控制等方式，从饰品三维模型库中选取中意饰品的三维模型
由于客户是不断更换的，因此客户的手部三维模型是实时构建的，如图1所示，在深度传感器1的感知空间4中，客户的手部信息由深度传感器获取，这其中包括手部(包括手腕、手掌和各个手指)的骨骼信息，该骨骼信息包括骨骼宽度信息和骨骼长度信息，也即手腕骨骼的宽度、手掌骨骼的宽度和长度、各个手指的宽度和长度(包括各个指关节)等信息，基于深度传感器获取的这些骨
骼信息，可以实时构建客户手部的三维模型，当然，也可以为手部三维模型创建一个手部三维模型库，将构建的客户手部三维模型存储起来，当客户下次来试戴饰品时，不必再重新构建手部三维模型，这尤其适用于老客户，提高客户的购买体验。
导入手部三维模型和饰品三维模型后，将他们在显示界面上显示出来。
步骤S22：将饰品三维模型佩戴于手部三维模型上；
为模拟真实情况中手部试戴饰品的情况，在导入饰品三维模型和手部三维模型并显示后，模拟手部试戴饰品的情况，使饰品三维模型佩戴于手部三维模型上。
具体的一种实施方式是，在手部三维模型上选定需要佩戴饰品的位置，将饰品三维模型显示于这个位置上。例如，选定手部三维模型的其中一个手指，则将戒指的三维模型显示在手指部位；或者，选定手部三维模型中的手腕部位后，将手镯、手表等饰品的三维模型显示在手腕部位上。深度传感器能获取手腕、手掌和各个手指的骨骼信息，这其中除了骨骼的宽度和长度等信息，也包括手腕、手掌和各个手指的位置信息，则在佩戴手三维模型上选定了佩戴饰品三维模型的具体位置后，也即确定了佩戴位置的具体三维坐标，将饰品三维模型显示在这个位置上即可；具体的戒指、手镯、手表等饰品，可以采用将其三维模型的中心点位置与手腕骨骼或手指骨骼中心点位置重合的方式，实现将戒指和手镯套接在手指或手腕上的效果。
通过这种虚拟试戴的方式，可以直观的了解到饰品的款式与手部是否合适。
步骤S23：接收深度传感器在其感知空间内获取的手部的深度信息；
客户在试戴饰品时，不仅仅是为了试看饰品是否合适，更需要试看饰品与手部搭配是否具有美感，在真实试戴时，会调整手部或者饰品的角度，从各个角度观看饰品的佩戴效果。
针对于此，在导入并显示了手部三维模型与饰品三维模型的虚拟佩戴后，深度传感器实时获取手部的深度信息，这其中包括手部的三维坐标和速度等信息，客户的手部在深度传感器的感知空间内，像真实佩戴饰品一样调整手部的角度，以实现虚拟系统中模拟真实佩戴试看的效果。
步骤S24：基于手部的深度信息，调整手部三维模型与饰品三维模型的显示。
深度传感器在其感知空间内获取手部的深度信息，包括手掌、手腕和各个手指的骨骼信息，这些骨骼信息能反应手部的特征信息；深度信息还包括手掌、手腕和各个手指的三维坐标以及速度信息，这可以精确捕获手部的位置、姿态和动作等；在深度传感器的感知空间内，以一定频率获取手部的移动、翻转等产生的深度信息，基于这些深度信息和上述的特征信息，反应到显示界面上即为虚拟仿真的手部和饰品进行相应的动作。
基于深度传感器获取的深度信息，根据骨骼信息构建手部三维模型，之后，以一定频率获取手部的运动信息，以此来控制显示界面中手部三维模型或者饰品三维模型的运动，这样可以使得在感知空间内的手部特征信息、运动信息与显示界面中的手部三维模型和饰品三维模型的特征信息、运动信息一一对应，以此来模拟真实手部试戴饰品的效果。
例如，根据手部的动作调整手部三维模型和饰品三维模型的显示角度，使客户能够了解饰品佩戴于自身的手部的效果是否好看等，产生客户真实试戴饰品的效果，在客户不能真实试戴饰品时，提高客户试戴饰品的购买体验感。
客户可以通过设定来实现饰品是显示在左手还是右手上，亦或是手指上还是手腕上等，如图1所示。客户可以从饰品三维模型库中选择饰品三维模型，也可以在虚拟试戴过程中更换饰品三维模型。
具体的，客户的两只手都在深度传感器的感知空间内时，对应构建的手部三维模型，可以区别为佩戴手三维模型和交互手三维模型，如图3和图4所示，左手为佩戴手，右手为交互手。
则模拟真实手部佩戴饰品的以下情况：左手佩戴饰品，而右手调整饰品的位置或者角度，本发明实施例提出以下具体的方法。
基于手部的深度信息，调整手部三维模型和饰品三维模型的显示，具体可以是如图5所示的步骤：
步骤S51：基于手部的深度信息，判断佩戴手三维模型的状态是否发生变化；
真实佩戴情况下，佩戴手通常保持不动，由另一只手来调整饰品的位置和角度。则相应的，设计为在虚拟系统中，若佩戴手三维模型的状态保持不变化，也
即佩戴手的手部的深度信息没有发生变化，反应了客户的佩戴手保持不动的状态，说明客户即将调整饰品的位置或者角度。则
步骤S52：基于手部的深度信息，判断佩戴手三维模型与交互手三维模型是否存在相对运动；
当佩戴手三维模型与交互手三维模型存在相对运动时，也即反映了佩戴手与交互手存在相对的运动；而在佩戴手保持不动的状态下，若佩戴手与交互手发生相对运动，则必然是交互手发生了运动，也即交互手的手部的深度信息发生了变化；而交互手发生的运动对应为对饰品位置或者角度的调整，则
步骤S53：调整饰品三维模型的位置并显示。
真实佩戴时，交互手的不同运动对应对饰品不同的调整，则交互手三维模型发生运动时，对应需要根据运动状态的不同来调整饰品三维模型的位置并显示，例如，移动饰品三维模型的位置，或者调整饰品三维模型的角度等。
基于手部的深度信息，判断佩戴手三维模型与交互手三维模型是否存在相对运动的一种具体实施例如图3所示，基于手部的深度信息，包括交互手(对应右手)和佩戴手(对应左手)的深度信息，得到佩戴手三维模型中手指或者手腕的方向信息，并判断交互手三维模型是否相对于佩戴手三维模型中手指或手腕的方向平移移动，这对应为交互手相对佩戴手的手指或手腕方向平移移动；若判断得出交互手三维模型是相对于佩戴手三维模型中手指或手腕的方向平移移动的，则将该动作对应为调整饰品三维模型在佩戴手三维模型中手指或手腕上的位移，并显示出来；对应实际佩戴情况，则为调整戒指在手指上的位置，调整手表在手腕上的位置等；平移移动包括整个手部的平移，以及仅手指的平移。
基于手部的深度信息，判断佩戴手三维模型与交互手三维模型是否存在相对运动的又一种具体实施例如图4所示，基于手部的深度信息，包括交互手(对应右手)三维模型相对佩戴手(对应左手)的深度信息，得到佩戴手三维模型中手指或者手腕的方向信息，并判断交互手三维模型是否相对于佩戴手三维模型中手指或手腕的方向垂直移动，这对应为交互手相对佩戴手垂直移动，包括同一平面上的垂直移动和不同平面上垂直移动；若判断得出交互手三维模型是相对于佩戴手三维模型中手指或手腕的方向垂直移动的，则将该动作对应为调整饰
品三维模型在佩戴手三维模型中手指或手腕上的角度，并显示出来；对应实际佩戴情况，则为调整戒指在手指上的角度，调整手表在手腕上的角度等；垂直移动包括整个手部的垂直移动，以及仅手指部位的垂直移动。
饰品三维模型的移动和旋转幅度由交互手在深度传感器感知空间内的移动的距离和幅度决定。
实际试戴饰品时，客户有时会用交互手固定住饰品，而改变佩戴手的位置来调整饰品与佩戴手的角度和位置关系，相应的是保持交互手不动，则反应到虚拟试戴系统中，表现为交互手三维模型的状态不变化，则可以通过判断交互手三维模型的状态是否发生变化来调整佩戴手三维模型的显示，即，在判断出交互手三维模型的状态没有发生变化时，根据手部的深度信息的变化，同步佩戴手三维模型的显示，而固定饰品三维模型的位置和角度不变。
客户也可以只将佩戴手置于深度传感器的感知空间内，则最直接的一种方式是，根据手部的深度信息的变化，同步手部(佩戴手)三维模型的显示，并将饰品三维模型的显示与手部三维模型的显示同步起来，反应的效果是，客户调整佩戴手的位置和角度时，饰品跟随佩戴手的运动而运动，以实现观察饰品与手部在不同角度的佩戴效果。
客户在虚拟佩戴饰品之前，还可以只选择导入饰品三维模型，并通过鼠标、键盘等输入设备的操作来调节饰品三维模型的显示，例如翻转、缩放等。
客户也可以基于深度传感器，通过手势来实现控制饰品三维模型的翻转或者缩放，具体的如图6所示：
步骤S61：接收深度传感器在其感知空间内获取的手部的深度信息；
步骤S62：基于手部的深度信息，分析得到手部的运动对应的手势；
步骤S63：基于手势，控制饰品三维模型的翻转、移动或者缩放。
基于手部的深度信息，得到手部的三维坐标和速度信息；并根据手部的三维坐标，分析手部的位移，以及根据手部的速度信息，分析手部的运动方向。
深度传感器采集其感知空间内手部变化的深度信息，因此，获取到的深度信息中的三维坐标在时间轴上形成了手部的运动位移，而速度信息中的速度方向和速率则在空间中构建出了手部的运动方向和运动速度。
基于手部的运动，可以推算得到手部运动对应的手势；具体的，结合手部的运动位移以及运动方向和运动速度，可以构建出手部在空间发生的手势模型，不同的手势模型对应不同的人机交互指令，例如，翻转饰品三维模型、放大或者缩小饰品三维模型等，而具体的手势与人机交互指令的对应关系可以依据游戏实际情况确定，本方案不予限制。
客户在虚拟试戴饰品时，也可以通过上述方式来调整饰品三维模型的大小，例如用鼠标或键盘输入参数的方式来改变饰品三维模型的大小，又例如，基于交互手的两指相对运动产生的距离的大小变化来调整饰品三维模型大小的变化等；这样做的好处是，客户可以根据手部的大小，定制适合自身手部的饰品尺寸，而不局限于现有饰品的大小，进而提高客户的购买体验。而且用户可以自行完成饰品的选择购买过程，降低了饰品商家的人力成本。
基于上述虚拟饰品试戴的人机交互方法，本发明实施例还提出一种虚拟饰品试戴的人机交互系统，如图7所示，包括深度传感器1、显示单元2、导入单元3和主控单元4；深度传感器用于在其感知空间内获取手部的深度信息；导入单元用于分别导入手部三维模型和饰品三维模型；主控单元将饰品三维模型佩戴于手部三维模型上，并接收深度传感器在其感知空间内获取的手部的深度信息，基于手部的深度信息，调整手部三维模型和饰品三维模型的显示；显示单元显示手部三维模型和饰品三维模型。
上述系统还包括构建单元5；构建单元用于构建饰品的饰品三维模型和客户的手部三维模型。具体的，根据饰品的测量参数构建饰品的三维模型，以及基于主控单元接收到的深度传感器在其感知空间内获取的手部的深度信息后得到的手部的骨骼信息，构建手部的三维模型；这其中，骨骼信息包括手腕、手掌和各个手指的骨骼宽度信息和骨骼长度信息。
相应于饰品三维模型，上述系统还包括饰品三维模型库6，用于存储饰品的饰品三维模型，以供客户从饰品三维模型库中选择中意的饰品三维模型进行虚拟试戴。
主控单元在导入手部三维模型和饰品三维模型后，将饰品三维模型佩戴于手部三维模型上，具体为：在手部三维模型上选定需要佩戴饰品三维模型的位置；
并将饰品三维模型显示于该位置上。
模拟真实试戴饰品的场景中区分的佩戴饰品的佩戴手和调整饰品位置和角度的交互手，则构建手部三维模型相应的包括佩戴手三维模型和交互手三维模型。
则模拟真实手部佩戴饰品的以下情况：左手佩戴饰品，而右手调整饰品的位置或者角度，可以对应为佩戴手保持不动，而交互手相对佩戴手的状态发生变化；具体的，判断佩戴手三维模型的状态是否发生变化；若否，判断佩戴手三维模型与交互手三维模型是否存在相对运动；若是，调整饰品三维模型的位置并显示。
相应于交互手调整饰品的位置，佩戴手三维模型与交互手三维模型存在相对运动，可以为交互手三维模型相对佩戴手三维模型的手指或手腕的平移移动，佩戴手三维模型中手指或者手腕的方向信息是基于手部的深度信息得到，包括交互手(对应右手)和佩戴手(对应左手)；若判断得出交互手三维模型是相对于佩戴手三维模型中手指或手腕的方向平移移动的，则将该动作对应为调整饰品三维模型在佩戴手三维模型中手指或手腕上的位移，并显示出来；对应实际佩戴情况，则为调整戒指在手指上的位置，调整手表在手腕上的位置等；平移移动包括整个手部的平移，以及仅手指的平移；相应于交互手调整饰品的角度，佩戴手三维模型与所述交互手三维模型存在相对运动，可以为交互手三维模型相对佩戴手三维模型中手指或手腕的方向垂直移动，若判断得出交互手三维模型是相对于佩戴手三维模型中手指或手腕的方向平移移动的，则将该动作对应为调整饰品三维模型在佩戴手三维模型中手指或手腕上的角度，并显示出来；对应实际佩戴情况，则为调整戒指在手指上的角度，调整手表在手腕上的角度等；垂直移动包括整个手部的垂直移动，以及仅手指部位的垂直移动。
在客户只将佩戴手置于深度传感器的感知空间内时，客户通过翻转或者移动佩戴手来实现从不同角度观看试戴效果，则最直接的一种方式是，根据手部深度信息的变化，同步手部三维模型和饰品三维模型的显示；也即，将饰品三维模型的显示与手部三维模型的显示同步起来，反应的效果是，客户调整佩戴手的位置和角度时，饰品跟随佩戴手的运动而运动，以实现观察饰品与手部在不同角度的佩戴效果。
实际试戴饰品时，客户有时会用交互手固定住饰品，而移动佩戴手的位置来调整饰品与佩戴手的角度和位置关系，相应的是保持交互手不动，则反应到虚拟试戴系统中，表现为交互手三维模型的状态不变化，则可以通过判断交互手三维模型的状态是否发生变化来调整佩戴手三维模型的显示，即，在判断出交互手三维模型的状态没有发生变化时，根据手部的深度信息的变化，同步佩戴手三维模型的显示，而固定饰品三维模型的位置和角度不变。
具体虚拟饰品试戴的人机交互系统的工作方法，已经在上述虚拟饰品试戴的人机交互方法中详述，此处不予赘述。
本发明实施例提出的虚拟饰品试戴的人机交互方法和系统，构建饰品的饰品三维模型以及客户手部的手部三维模型，将饰品三维模型佩戴于手部三维模型上，采用这种饰品与手部虚拟的试戴的方式，实现真实试戴饰品的效果；并通过佩戴手和交互手的相对运动来实现虚拟控制饰品三维模型的位置或角度的变化，模拟真实试戴中调整手部和饰品的位置和角度，在客户不能真实试戴饰品时，提高客户试戴饰品的购买体验感。
当深度传感器普及到客户家里时，客户可以在家里进行虚拟饰品的试戴而不用去饰品店面，在网络上的应用商店里选择饰品款式并进行虚拟饰品试戴，在试戴满意后，可以通过网上交易订购满意的饰品，更可以通过网上交易定制适合自身的饰品，这样客户在足不出户的情况下即可以购买满意的饰品。
在全息技术中，可以以全息显示的方式将饰品三维模型显示在处于全息显示环境空间内的真实手部上，实现虚拟与现实的结合，深度传感器实时获取手部的深度信息后(包括佩戴手和交互手)，主控单元根据手部的深度信息按照上述实施例的方式实时调整全息显示的饰品三维模型的显示状态，实现虚拟试戴饰品的效果。
在最新的微软hololens全息眼镜技术中，饰品三维模型通过光线被投入人眼中，而深度传感器置于眼镜框体上，在人体前部形成感知空间，客户手部的动作被深度传感器感知，并将感知的深度信息传递给主控单元，主控单元根据深度信息，将虚拟饰品与现实世界的手部叠加在一起，在人眼中实现饰品佩戴于手部的效果，并按照上述实施例的方式实时调整饰品三维模型在人眼中的显示，
实现虚拟与现实的结合和虚拟试戴饰品的效果。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本发明的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。
显然，本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样，倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内，则本发明也意图包含这些改动和变型在内。
Claims (20)
- 虚拟饰品试戴的人机交互方法，其特征在于，包括：分别导入并显示手部三维模型和饰品三维模型；将所述饰品三维模型佩戴于所述手部三维模型上；接收深度传感器在其感知空间内获取的手部的深度信息；基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示。
- 根据权利要求1所述的虚拟饰品试戴的人机交互方法，其特征在于，所述分别导入并显示手部三维模型和饰品三维模型之前，所述方法还包括：接收深度传感器在其感知空间内获取的手部的深度信息；基于获取的手部的深度信息，得到手部的骨骼信息；其中，所述骨骼信息包括手腕、手掌和各手指的骨骼宽度信息和骨骼长度信息；基于所述手部的骨骼信息，构建所述手部的手部三维模型。
- 根据权利要求1所述的虚拟饰品试戴的人机交互方法，其特征在于，所述分别导入并显示手部三维模型和饰品三维模型之前，所述方法还包括：构建饰品的饰品三维模型。
- 根据权利要求3所述的虚拟饰品试戴的人机交互方法，其特征在于，在构建饰品的饰品三维模型之后，所述方法还包括：将所述饰品三维模型存放于饰品三维模型库中；所述导入饰品三维模型具体为：从所述饰品三维模型库中选择目标饰品三维模型，并导入所述目标饰品三维模型。
- 根据权利要求1所述的虚拟饰品试戴的人机交互方法，其特征在于，所述将所述饰品三维模型佩戴于所述手部三维模型上，具体为：在所述手部三维模型上选定需要佩戴所述饰品三维模型的位置；将所述饰品三维模型显示于所述位置上。
- 根据权利要求2所述的虚拟饰品试戴的人机交互方法，其特征在于，所述手部三维模型包括佩戴手三维模型和交互手三维模型；所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述佩戴手三维模型的状态是否发生变化；若否，基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动；若是，调整所述饰品三维模型的位置并显示。
- 根据权利要求6所述的虚拟饰品试戴的人机交互方法，其特征在于，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向平移移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的位移并显示。
- 根据权利要求6所述的虚拟饰品试戴的人机交互方法，其特征在于，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向垂直移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的角度并显示。
- 根据权利要求1所述的虚拟饰品试戴的人机交互方法，其特征在于，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：根据所述手部的深度信息的变化，同步所述手部三维模型和所述饰品三维模型的显示。
- 根据权利要求6所述的虚拟饰品试戴的人机交互方法，其特征在于，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述交互手三维模型的状态是否发生变化；若否，根据所述手部的深度信息的变化，同步所述佩戴手三维模型的显示。
- 根据权利要求1所述的虚拟饰品试戴的人机交互方法，其特征在于，若只导入并显示所述饰品三维模型，则所述方法包括：接收所述深度传感器在其感知空间内获取的手部的深度信息；基于所述手部的深度信息，分析得到所述手部的运动对应的手势；基于所述手势，控制所述饰品三维模型的翻转、移动或者缩放。
- 虚拟饰品试戴的人机交互系统，包括深度传感器和显示单元，其特征在于，还包括导入单元和主控单元：所述深度传感器，用于在其感知空间内获取手部的深度信息；所述导入单元，用于分别导入手部三维模型和饰品三维模型；所述主控单元，将所述饰品三维模型佩戴于所述手部三维模型上；接收所述深度传感器在其感知空间内获取的手部的深度信息；并 基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示；所述显示单元，显示所述手部三维模型和饰品三维模型。
- 根据权利要求12所述的虚拟饰品试戴的人机交互系统，其特征在于，所述系统还包括构建单元；所述构建单元，用于构建饰品的饰品三维模型；以及，所述主控单元接收所述深度传感器在其感知空间内获取的手部的深度信息，并基于获取的手部的深度信息，得到所述手部的骨骼信息，所述构建单元基于所述手部的骨骼信息，构建所述手部的手部三维模型；其中，所述骨骼信息包括手腕、手掌和各手指的骨骼宽度信息和骨骼长度信息。
- 根据权利要求13所述的虚拟饰品试戴的人机交互系统，其特征在于，所述系统还包括饰品三维模型库；所述饰品三维模型库存储饰品的饰品三维模型。
- 根据权利要求12所述的虚拟饰品试戴的人机交互系统，其特征在于，所述将所述饰品三维模型佩戴于所述手部三维模型上，具体为：在所述手部三维模型上选定需要佩戴所述饰品三维模型的位置；将所述饰品三维模型显示于所述位置上。
- 根据权利要求13所述的虚拟饰品试戴的人机交互系统，其特征在于，所述手部三维模型包括佩戴手三维模型和交互手三维模型；所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述佩戴手三维模型的状态是否发生变化；若否，基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动；若是，调整所述饰品三维模型的位置并显示。
- 根据权利要求16所述的虚拟饰品试戴的人机交互系统，其特征在于，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向平移移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的位移并显示。
- 根据权利要求16所述的虚拟饰品试戴的人机交互系统，其特征在于，所述基于所述手部的深度信息，判断所述佩戴手三维模型与所述交互手三维模型是否存在相对运动，具体为：基于所述手部的深度信息，得到所述佩戴手三维模型中手指或手腕的方向信息；判断所述交互手三维模型是否相对于所述佩戴手三维模型中手指或手腕的方向垂直移动；若是，则所述调整所述饰品三维模型的位置并显示，具体为：调整所述饰品三维模型在所述佩戴手三维模型中手指或手腕上的角度并显示。
- 根据权利要求12所述的虚拟饰品试戴的人机交互系统，其特征在于，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：根据所述手部的深度信息的变化，同步所述手部三维模型和所述饰品三维模型的显示。
- 根据权利要求16所述的虚拟饰品试戴的人机交互系统，其特征在于，所述基于所述手部的深度信息，调整所述手部三维模型和所述饰品三维模型的显示，具体为：基于所述手部的深度信息，判断所述交互手三维模型的状态是否发生变化；若否，根据所述手部的深度信息的变化，同步所述佩戴手三维模型的显示。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2015/072277 WO2016123769A1 (zh) | 2015-02-05 | 2015-02-05 | 虚拟饰品试戴的人机交互方法和系统 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2015/072277 WO2016123769A1 (zh) | 2015-02-05 | 2015-02-05 | 虚拟饰品试戴的人机交互方法和系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016123769A1 true WO2016123769A1 (zh) | 2016-08-11 |
Family
ID=56563317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2015/072277 WO2016123769A1 (zh) | 2015-02-05 | 2015-02-05 | 虚拟饰品试戴的人机交互方法和系统 |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2016123769A1 (zh) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3068812A1 (fr) * | 2017-07-09 | 2019-01-11 | Guillaume Chican | Procede pour l’essayage virtuel de bracelets, bagues et montres |
| US20200371472A1 (en) * | 2019-05-21 | 2020-11-26 | Light Field Lab, Inc. | Light Field Display System Based Commercial System |
| CN116524088A (zh) * | 2023-07-03 | 2023-08-01 | 深圳星坊科技有限公司 | 珠宝虚拟试戴方法、装置、计算机设备和存储介质 |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156810A (zh) * | 2011-03-30 | 2011-08-17 | 北京触角科技有限公司 | 增强现实实时虚拟试衣系统及方法 |
| CN102298797A (zh) * | 2011-08-31 | 2011-12-28 | 深圳市美丽同盟科技有限公司 | 三维虚拟试衣的方法、装置及系统 |
| US20120306918A1 (en) * | 2011-06-01 | 2012-12-06 | Seiji Suzuki | Image processing apparatus, image processing method, and program |
| CN102930447A (zh) * | 2012-10-22 | 2013-02-13 | 广州新节奏数码科技有限公司 | 一种虚拟穿戴的实现方法及设备 |
| CN103049852A (zh) * | 2012-12-19 | 2013-04-17 | 武汉世纪炎龙网络科技有限公司 | 虚拟试衣系统 |
| CN202904582U (zh) * | 2012-07-18 | 2013-04-24 | 浙江国自机器人技术有限公司 | 一种基于体感识别装置的虚拟试衣系统 |
| CN103106604A (zh) * | 2013-01-23 | 2013-05-15 | 东华大学 | 基于体感技术的3d虚拟试衣方法 |
| CN203070360U (zh) * | 2012-10-22 | 2013-07-17 | 广州新节奏数码科技有限公司 | 一种虚拟穿戴设备 |
| CN103530903A (zh) * | 2013-10-28 | 2014-01-22 | 智慧城市系统服务（中国）有限公司 | 一种虚拟试衣间的实现方法及实现系统 |
| CN103533449A (zh) * | 2012-12-20 | 2014-01-22 | Tcl集团股份有限公司 | 一种基于智能3d电视的3d试衣的实现方法及系统 |
| CN103678836A (zh) * | 2012-08-30 | 2014-03-26 | 北京三星通信技术研究有限公司 | 虚拟试衣系统及方法 |
| CN104091269A (zh) * | 2014-06-30 | 2014-10-08 | 京东方科技集团股份有限公司 | 一种虚拟试衣方法及虚拟试衣系统 |
-
2015
- 2015-02-05 WO PCT/CN2015/072277 patent/WO2016123769A1/zh active Application Filing
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156810A (zh) * | 2011-03-30 | 2011-08-17 | 北京触角科技有限公司 | 增强现实实时虚拟试衣系统及方法 |
| US20120306918A1 (en) * | 2011-06-01 | 2012-12-06 | Seiji Suzuki | Image processing apparatus, image processing method, and program |
| CN102298797A (zh) * | 2011-08-31 | 2011-12-28 | 深圳市美丽同盟科技有限公司 | 三维虚拟试衣的方法、装置及系统 |
| CN202904582U (zh) * | 2012-07-18 | 2013-04-24 | 浙江国自机器人技术有限公司 | 一种基于体感识别装置的虚拟试衣系统 |
| CN103678836A (zh) * | 2012-08-30 | 2014-03-26 | 北京三星通信技术研究有限公司 | 虚拟试衣系统及方法 |
| CN102930447A (zh) * | 2012-10-22 | 2013-02-13 | 广州新节奏数码科技有限公司 | 一种虚拟穿戴的实现方法及设备 |
| CN203070360U (zh) * | 2012-10-22 | 2013-07-17 | 广州新节奏数码科技有限公司 | 一种虚拟穿戴设备 |
| CN103049852A (zh) * | 2012-12-19 | 2013-04-17 | 武汉世纪炎龙网络科技有限公司 | 虚拟试衣系统 |
| CN103533449A (zh) * | 2012-12-20 | 2014-01-22 | Tcl集团股份有限公司 | 一种基于智能3d电视的3d试衣的实现方法及系统 |
| CN103106604A (zh) * | 2013-01-23 | 2013-05-15 | 东华大学 | 基于体感技术的3d虚拟试衣方法 |
| CN103530903A (zh) * | 2013-10-28 | 2014-01-22 | 智慧城市系统服务（中国）有限公司 | 一种虚拟试衣间的实现方法及实现系统 |
| CN104091269A (zh) * | 2014-06-30 | 2014-10-08 | 京东方科技集团股份有限公司 | 一种虚拟试衣方法及虚拟试衣系统 |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3068812A1 (fr) * | 2017-07-09 | 2019-01-11 | Guillaume Chican | Procede pour l’essayage virtuel de bracelets, bagues et montres |
| US20200371472A1 (en) * | 2019-05-21 | 2020-11-26 | Light Field Lab, Inc. | Light Field Display System Based Commercial System |
| CN116524088A (zh) * | 2023-07-03 | 2023-08-01 | 深圳星坊科技有限公司 | 珠宝虚拟试戴方法、装置、计算机设备和存储介质 |
| CN116524088B (zh) * | 2023-07-03 | 2023-09-19 | 深圳星坊科技有限公司 | 珠宝虚拟试戴方法、装置、计算机设备和存储介质 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104820498B (zh) | 手部虚拟饰品试戴的人机交互方法和系统 | |
| US11164381B2 (en) | Clothing model generation and display system | |
| US8599194B2 (en) | System and method for the interactive display of data in a motion capture environment | |
| EP3564788B1 (en) | Three-dimensional user input | |
| CN107577045B (zh) | 用于头戴式显示器的预测跟踪的方法、装置及存储介质 | |
| EP2942693B1 (en) | Systems and methods for viewport-based augmented reality haptic effects | |
| CN111696213B (zh) | 图像生成装置、图像生成方法以及计算机可读介质 | |
| CN103365416B (zh) | 用于虚拟工程的系统和方法 | |
| EP4080465A1 (en) | Interactive cubicle and method for determining a body shape | |
| CN108292449A (zh) | 使用手势修改三维服装 | |
| WO2016112017A2 (en) | System and method for controlling immersiveness of head-worn displays | |
| TW202101172A (zh) | 用於人工實境系統的手臂視線驅動的使用者介面元件閘控 | |
| CN110456626A (zh) | 全息键盘显示 | |
| US9716842B1 (en) | Augmented reality presentation | |
| CN109690447A (zh) | 信息处理方法、用于使计算机执行该信息处理方法的程序、以及计算机 | |
| JP2012181688A (ja) | 情報処理装置、情報処理方法、情報処理システムおよびプログラム | |
| WO2019020608A1 (en) | METHOD AND SYSTEM FOR PROVIDING A VIRTUAL REALITY EXPERIENCE BASED ON ULTRASONIC DATA | |
| TW202101170A (zh) | 用於人工實境系統的角點識別手勢驅動的使用者介面元件閘控 | |
| WO2016123769A1 (zh) | 虚拟饰品试戴的人机交互方法和系统 | |
| KR20130061538A (ko) | 가상현실 기반 콘텐츠 제공장치 및 그 방법 | |
| US20110080273A1 (en) | Sensation Presenting System and Sensation Presenting Device | |
| CA2830094C (en) | Lifting motion evaluation | |
| JP2022025461A (ja) | アニメーション制作システム | |
| KR101638550B1 (ko) | 혼합현실을 이용한 가상현실 시스템 및 그 구현방법 | |
| Mazuryk et al. | History, applications, technology and future |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15880725 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15880725 Country of ref document: EP Kind code of ref document: A1 |