JP4981109B2 - Virtual try-on device and program - Google Patents

Description

  The present invention relates to a virtual fitting device and a program.

  2. Description of the Related Art Conventionally, a retail store that sells clothing has been provided with a fitting room so that customers can try on clothing that the customer desires. However, this method may be troublesome for customers because it takes time to try on. In addition, a space for providing a fitting room is also required on the store side, and it is also necessary to put away the clothing that has been tried on in a predetermined position, so a more efficient method is desired.

  On the other hand, an image composition technique for superimposing a CG image or the like on an object in actual view has been put into practical use. For example, Patent Document 1 discloses a technique for displaying and observing a costume image superimposed on an object in real field of view.

  However, in the technique of Patent Document 1, since the object on which the costume image is superimposed exists in the observer's own real field of view, it is not assumed that the observer himself or an image related to the observer himself is the object to be superimposed. . In addition, since it is necessary to select the image you want to wear from the costume image database, when applying to virtual try-on such as clothing, you will select the desired product image from many product images, There is a problem of lack of convenience.

  This invention is made in view of the above, Comprising: It aims at providing the virtual try-on device and program which can improve the convenience which concerns on the virtual try-on of the clothing items sold in a shop .

In order to solve the above-described problems and achieve the object, the present invention is a head-mounted display that is mounted on a customer's head and is provided with a light-transmissive display unit at a position corresponding to the customer's eyes, An image pickup unit provided in the head mounted display and having an image pickup range set in the line-of-sight direction of the customer wearing the head mounted display, and data attached to a product from image data picked up by the image pickup unit The decryption means for identifying the code and decrypting the product code included in the data code, and the decryption means from the product image storage means for storing the product code of each product and the product image imitating each product in association with each other. Reading means for reading the product image corresponding to the product code decrypted by the means, and the product image read by the reading means is a key imitating the appearance of the customer. Image processing means for superimposing a predetermined site Rakuta image, wherein the emphasizing weighted image data codes, said and said character image in which the product image is superimposed portion in said image data decoding means has identified And display control means for displaying each of them .

The present invention also provides a head-mounted display that is mounted on a customer's head and is provided with a light-transmissive display unit at a position corresponding to the customer's eyes, and the head-mounted display. A virtual try-on device computer comprising: an imaging unit whose imaging range is set in the line-of-sight direction of the customer wearing the device, and identifying a data code attached to a product from the image data captured by the imaging unit The decryption means decrypts the product code included in the data code, and the product image storage means that stores the product code of each product and the product image imitating each product in association with each other. character reading means for reading a commodity image corresponding to the commodity code, the commodity image read by the reading means, which simulates the appearance of the customer was Image processing means for superimposing a predetermined portion of the data image, wherein the emphasizing weighted image data codes, said and said character image in which the product image is superimposed portion in said image data decoding means has identified Function as display control means for displaying each of them.

  ADVANTAGE OF THE INVENTION According to this invention, the virtual try-on device and program which can improve the convenience which concerns on the virtual try-on of the clothing articles sold in a shop can be provided.

FIG. 1 is a diagram illustrating an example of a POS system according to the present embodiment. FIG. 2 is a block diagram illustrating a configuration example of the electrical system of the store server illustrated in FIG. FIG. 3 is a diagram illustrating an example of data items constituting the product master table shown in FIG. FIG. 4 is a diagram illustrating an example of data items constituting the product image management table illustrated in FIG. FIG. 5 is a diagram showing an example of data items constituting the member management table shown in FIG. FIG. 6 is a diagram illustrating an example of data items constituting the sales management table illustrated in FIG. FIG. 7 is a diagram illustrating an example of the head mounted display illustrated in FIG. 1. FIG. 8 is a block diagram showing a configuration example of the interface box shown in FIG. FIG. 9 is a flowchart showing the procedure of the virtual try-on process. FIG. 10 is a diagram showing a display example of the monitor display unit shown in FIG. FIG. 11 is a diagram illustrating a display example of the monitor display unit illustrated in FIG. 7. 12 is a diagram showing a display example of the monitor display unit shown in FIG.

  Exemplary embodiments of a virtual fitting device and a program according to the present invention will be described below in detail with reference to the accompanying drawings. Hereinafter, an example in which the virtual try-on device and the program according to the present invention are applied to a POS system in a store that sells clothing will be described, but the present invention is not limited to this embodiment.

  FIG. 1 is a block diagram schematically showing an example of a POS system according to the present embodiment. As shown in FIG. 1, the POS system 1 includes one or a plurality of POS terminals 2, a store server 3 functioning as a host device thereof, a wearable terminal device 4 which is a user interface worn and used by the wearer C, and data A transmission / reception apparatus 5 for performing transmission / reception is connected via a network N. Here, the network N is a LAN (Local Area Network), an intranet, or the like.

  Data transmission / reception between the transmission / reception device 5 and the wearable terminal device 4 may be radio waves, light, infrared rays, ultrasonic waves, and the like. In this embodiment, close proximity wireless communication (for example, Bluetooth (for example, Bluetooth ( Registered trademark) etc.). In addition, the transmission / reception apparatus 5 shall be installed in each area | region in stores, such as the area | region near a payment counter, the area | region where the display shelf was provided, and a backyard.

  The POS terminal 2 is provided with a drawer, a card reader, a code scanner, a display, a receipt / journal printer, etc. (all not shown), and performs business transactions using cash or a credit card. It is done.

  In a store where such a POS system is constructed, a bar code indicating various information relating to the product is given to each product for each product to be sold. The store server 3 stores a product master table 371 (to be described later) in which prices and the like are preset corresponding to the product codes of various products. The POS terminal 2 extracts the product code from the barcode data read through a code scanner (not shown), inquires the store server 3 for the price set in correspondence with the product code, and purchases based on the acquired price. The sales data is registered in a sales registration table 374, which will be described later, by adjusting the merchandise and generating sales data indicating the sales record of the purchased merchandise and notifying the store server 3 of the sales data.

  The store server 3 is a server device that manages information on products sold in the store, sales of products sold in the store, and information on customers, and provides various information to the POS terminal 2 and the wearable terminal device 4.

  FIG. 2 is a block diagram illustrating a configuration example of the electrical system of the store server 3. As shown in the figure, the store server 3 has a control unit 31 including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. (not shown), and is connected to the bus 32. The communication interface 33 is configured to be able to communicate with the POS terminal 2 and the wearable terminal device 4 (transmission / reception device 5).

  The control unit 31 includes an input unit 35 configured by an input device such as a keyboard and a mouse, a display unit 36 configured by a display device such as a liquid crystal display, and the like via a bus 32 and an I / O device control unit 34. Storage units 37 each including a storage device such as an HDD (Hard Disk Drive) or an SDD (Solid State Drive) are connected to each other.

  The storage unit 37 stores a product master table 371, a product image management table 372, a member management table 373, a sales registration table 374, and the like in addition to various control programs executed by the CPU of the control unit 31.

  The product master table 371 is a table for managing information related to products sold in the store. FIG. 3 is a diagram illustrating an example of data items constituting the product master table 371. As shown in the figure, the product master table 371 includes “product code”, “manufacturer”, and records composed of data items such as “product type” and “price” indicating product types such as jackets and suits. Has been. Here, the “product code” stores a unique code preset for each product in order to identify various product items sold in the store. In addition, information on a product specified by the same product code is stored in “manufacturer”, “product type”, and “price”.

  The product image management table 372 is a table for managing two-dimensional or three-dimensional image data (hereinafter referred to as a product image) imitating each product sold in the store. FIG. 4 is a diagram illustrating an example of data items constituting the product image management table 372. As shown in the figure, the product image management table 372 is composed of records including data items such as “product code”, “product image”, and “superimposition position”. Here, “product code” corresponds to “product code” in the product master table 371. In “product image”, a product image simulating a product corresponding to the product code is stored. Further, in the “superimposition position”, a part where the product image is superimposed on a character image to be described later is stored. For example, when the product specified by the product code is a hat, the head or the coordinates indicating the head, which is the part wearing the hat, is stored in the “superimposition position”. In this way, the product image and the superimposed position of the product image are stored in association with the product code.

  The member management table 373 is a table for managing information related to registered customers. FIG. 5 is a diagram illustrating an example of data items constituting the member management table 373. As shown in the figure, the member management table 373 is composed of records composed of data items such as “member management number”, “member information”, “body type”, “face image”, and the like. Here, the “member management number” stores an identifier such as a member number uniquely assigned to identify each member. The “member information” stores personal information such as the name, sex, and address of the customer registered as a member. The “body shape” stores body shape data characterizing the body shape of the customer registered as a member. Examples of the body shape data include measured values of predetermined parts such as height, chest circumference, abdominal circumference, and waist circumference. The “face image” stores the face image data of the customer registered as a member.

  The sales registration table 374 is a table for managing sales data transmitted from the POS terminal 2 in the store. FIG. 6 is a diagram illustrating an example of data items constituting the sales registration table 374. Every time sales data is notified from the POS terminal 2, the control unit 31 associates the sales data with today's date and registers them in the sales registration table 374 as one record.

  The control unit 31 provides various information related to sales support to the POS terminal 2 and the wearable terminal device 4 in cooperation with the program stored in the storage unit 37.

  Specifically, when receiving a product code inquiry from the POS terminal 2, the control unit 31 reads a record corresponding to the product code from the product master table 371 and transmits it to the POS terminal 2.

  Further, when the member management number is notified from the wearable terminal device 4, the control unit 31 reads a record corresponding to the member management number from the member management table 373 and transmits it to the POS terminal 2 as member information. Further, when the product code is notified from the wearable terminal device 4, the control unit 31 reads a record corresponding to the product code from the product image management table 372 and transmits it to the POS terminal 2.

  As shown in FIGS. 1 and 7, the wearable terminal device 4 includes a head mounted display 41, a digital camera 42 as an imaging device, and an interface box 43, and is a terminal device worn by a wearer C. . The head mounted display 41 includes a frame main body 44 as a holding member formed in the shape of a frame of eyeglasses, and mounting arms 45 provided respectively on the left and right sides of the frame main body 44. The head mounted display 41 can be mounted on the head H of the wearer C by mounting arms 45 provided on both the left and right sides.

  The frame main body 44 is formed in a frame shape having a size suitable for both eyes of the wearer C. A digital camera 42 is provided in the upper center outside the frame of the frame body 44 via an imaging direction variable mechanism 46. Further, on the upper left side of the frame main body 44, a line-of-sight recognition camera 47 is provided for capturing the eyes of the wearer C and detecting the line of sight E. Further, in the frame of the frame body 44, for example, a plate-like light transmissive member 48 formed in accordance with the shape of the frame is held. When the head-mounted display 41 is mounted on the head H of the wearer C, the light transmissive member 48 can observe the surrounding environment with the eyes of the wearer C. The light transmissive member 48 may be, for example, colorless and transparent or have a predetermined color.

  A monitor display portion 481 is formed in a part of the light transmissive member 48. The monitor display unit 481 monitors and displays moving image data and the like acquired by the imaging of the digital camera 42 in real time. The monitor display unit 481 is formed on the left side of the head mounted display 41, for example. That is, the monitor display unit 481 is formed in a portion corresponding to, for example, the left eye of the wearer C when the head mounted display 41 is worn on the head H of the wearer C. The monitor display unit 481 may be formed in a part corresponding to the right eye of the wearer C, or may be formed in each part corresponding to both eyes of the wearer C. The monitor display unit 481 performs monitor display in a light transmissive state. However, the monitor display unit 481 can observe the surrounding environment even in a state where, for example, image data acquired by imaging by the digital camera 42, various information, and the like are displayed on the monitor in real time.

  The digital camera 42 performs an imaging operation and outputs moving image data. The digital camera 42 is mounted on the frame main body 44 of the head mounted display 41 in a state where an imaging range is set so as to be focused in the direction of the line of sight E of the wearer C through the light transmissive member 48. The imaging direction variable mechanism 46 supports, for example, the digital camera 42 so as to be able to swing, and the imaging direction of the digital camera 42 is set to an arbitrary direction, here, the imaging range of the digital camera 42 is set in the direction of the line of sight E of the wearer C as described above. Set to focus.

  The interface box 43 transmits / receives data to / from the transmission / reception device 5 and performs various processes related to the head mounted display 41. Specifically, as shown in FIG. 8, the interface box 43 includes a control unit 431, a transmission / reception unit 432, an information display unit 433, and an image processing unit 434, and is a box that can be carried by the wearer C of the head mounted display 41. It is. Here, FIG. 8 is a block diagram illustrating a configuration example of the interface box 43.

  The control unit 431 is a computer having a CPU, a ROM, a RAM, and the like, and controls the operation of the wearable terminal device 4. The ROM stores in advance various programs and various setting information referred to when the programs are executed.

  The CPU centrally controls the operation of the wearable terminal device 4 by developing the program stored in the ROM in the RAM work area and sequentially executing the program.

  Specifically, the control unit 431 outputs the image data acquired by the imaging of the digital camera 42 to the information display unit 433 and displays it on the monitor display unit 481 of the head mounted display 41 in real time. Further, by outputting the image data acquired by the imaging of the digital camera 42 to the image processing unit 434, the barcode is identified from the image data, and then the barcode is held by decoding the barcode. Information obtained.

  Here, examples of the barcode that the image processing unit 434 decodes include a barcode attached to a membership card and a barcode attached to a product sold in a store. It is assumed that the membership card is distributed in advance to the customer who has registered the membership, and the barcode attached to the membership card holds the membership management number for identifying each member in a coded state. It is assumed that In addition, it is assumed that the product code corresponding to the product is held in the barcode attached to the product.

  The control unit 431 notifies the store server 3 of the record corresponding to the member management number by notifying the store server 3 via the transmission / reception unit 432 and the transmission / reception device 5 of the member management number acquired by the image processing unit 434. Read from the management table 373. Then, the control unit 431 outputs the body image data and the face image data included in the record read from the member management table 373 to the image processing unit 434, thereby generating a character image to be described later.

  Further, the control unit 431 notifies the store server 3 of the record corresponding to the product code by notifying the store server 3 via the transmission / reception unit 432 and the transmission / reception device 5 of the product code acquired by the image processing unit 434. Read from the image management table 372. Then, the control unit 431 outputs the product image and the superimposed position included in the record read from the product image management table 372 to the image processing unit 434. That is, the control unit 431 specifies the product image and the superimposed position by the product code.

  The image processing unit 434 superimposes the product image at the superimposition position output by the control unit 431 on the character image. Furthermore, the control unit 431 outputs the character image on which the product image is superimposed to the information display unit 433, thereby causing the monitor display unit 481 to display the character image.

  The information display unit 433 displays the image data input from the control unit 431 or the like on the monitor display unit 481 of the head mounted display 41. Specifically, the information display unit 433 displays image data acquired by imaging with the digital camera 42 on the monitor display unit 481. Further, the information display unit 433 displays the character image generated by the image processing unit 434 on the monitor display unit 481. In addition, when the information display unit 433 receives information such as various icon images from the control unit 431 and the like, the information display unit 433 combines the received information with the input image data and displays it on the monitor display unit 481 of the head mounted display 41. When the display position of the received information is designated by coordinates or the like, the input image data is synthesized so that the information is displayed at the designated display position.

  The image processing unit 434 detects the line of sight E of the wearer C by performing image processing on the image data acquired by the digital camera 42 and analyzing the image data captured by the line-of-sight recognition camera 47. Specifically, the image processing unit 434 detects the eye of the wearer C from the image data captured by the line-of-sight recognition camera 47, and detects the line of sight E according to the position of the detected pupil. In addition, the image processing unit 434 captures one frame from the image data acquired by the imaging of the digital camera 42, identifies the barcode in the captured image, and decodes the identified barcode. Perform image processing such as obtaining a member management number and product code.

  In addition, when the image processing unit 434 receives the body shape data and the face image data from the control unit 431, the image processing unit 434 uses the measurement values of each part represented by the body shape data as parameters for characterizing the body shape, and the body shape according to the measurement values. Generate a human body model. Then, the image processing unit 434 generates a character image imitating the customer who is the owner of the face image by superimposing face image data on the face of the generated human body model. The generated human body model may be either two-dimensional or three-dimensional, and may be configured to perform deformation or the like. It should be noted that the human body model generation method and the face image data superimposition method use a known technique relating to CG (computer graphics).

  In addition, when the image processing unit 434 receives the product image and the superimposition position from the control unit 431, the character image is displayed on the product corresponding to the product image by superimposing the product image on the portion of the character image corresponding to the superposition position. Apply the effect of wearing clothes. Note that a known technique related to CG is used as a method for superimposing a product image on a character image.

  Note that the transmission / reception unit 432, the information display unit 433, the image processing unit 434, and the like in the interface box 43 may be realized by the control unit 431 executing a program stored in advance in the ROM.

  Hereinafter, processing performed in the wearable terminal device 4 will be described with reference to FIGS. Here, FIG. 9 is a flowchart showing the procedure of the virtual try-on process. As a premise of this process, it is assumed that a member (customer) registered in the member management table 373 comes to the store, and the wearable terminal device 4 is lent to this customer.

  First, the control unit 431 outputs the image data acquired by the imaging of the digital camera 42 to the image processing unit 434, thereby performing barcode identification processing (step S11). The image processing unit 434 determines whether or not a barcode exists in the image data. If it is determined that the barcode does not exist (step S12; No), the process returns to step S11 again. If the image processing unit 434 determines that a barcode is present in the image data (step S12; Yes), the image processing unit 434 decodes the barcode to obtain information held in the barcode (step S13). ).

  Next, the control unit 431 determines whether or not the information acquired in step S13 is a product code (step S14). Here, when it is determined that the acquired information is the member management number (step S14; No), the member management number is notified to the store server 3 so that the record corresponding to the member management number is stored in the member of the store server 3. Read from the management table 373 (step S15). Subsequently, the control unit 431 outputs the body shape data and the face image data included in the record read out in step S15 to the image processing unit 434. The image processing unit 434 generates a character image (step S16), and the process returns to step S11 again.

  On the other hand, when it is determined in step S14 that the acquired information is a product code (step S14; Yes), the control unit 431 determines whether a character image has been generated (step S17). If it is determined that no character image has been generated (step S17; No), the process returns to step S11 again. When it is determined that the character image has been generated (step S17; Yes), the control unit 431 displays a screen for confirming whether or not to try on the monitor display unit 481 via the information display unit 433 (step S41). S18).

  Here, FIG. 10 is a diagram illustrating an example of the confirmation image displayed on the monitor display unit 481. In the figure, a line-of-sight marker M is a marker indicating the line of sight E detected by the image processing unit 434 based on the image of the line-of-sight recognition camera 47. Further, in order to clearly indicate the barcode B identified by the image processing unit 434, an image recognition frame G11 is displayed around the barcode B.

  The icon images G <b> 12 and G <b> 13 are icons for accepting an operation instruction for the wearable terminal device 4 by the line-of-sight marker M. Note that processing when an input instruction for each icon image is given will be described later.

  Returning to FIG. 9, when the control unit 431 determines that the instruction “do not try on” is input because the line-of-sight marker M overlaps the icon image G12 of FIG. 10 (step S19; No), the control unit 431 returns to step S11 again. . If the control unit 431 determines that the instruction to “try on” is input with the line-of-sight marker M overlapping the icon image G13 in FIG. 10 (step S19; Yes), the product code acquired in step S13 Is read from the product image management table 372 of the store server 3 (step S20).

  Subsequently, the control unit 431 outputs the product image and the superimposed position included in the record read out in step S20 to the image processing unit 434. The product image is superimposed on the character image in the image processing unit 434 (step S21). And the control part 431 displays on the monitor display part 481 by outputting the character image on which the product image was superimposed to the information display part 433 (step S22).

  Here, FIG. 11 is a diagram illustrating an example of a character image displayed on the monitor display unit 481. As shown in the figure, the display area G21 is an area for displaying a character image on which a product image is superimposed. The customer wearing the wearable terminal device 4 can check his / her appearance of trying on the product via the character image by checking the monitor display unit 481. Further, even after the bar code attached to the product is imaged, even if the product is disengaged from the arrangement position of the product, it is possible to provide a character image virtually trying on the product in front of the customer's eyes.

  The icon images G22 and G23 are icons for accepting an operation instruction for the wearable terminal device 4 by the line-of-sight marker M. Note that processing when an input instruction for each icon image is given will be described later.

  Returning to FIG. 9, when the control unit 431 determines that the “product clear” instruction is input with the line-of-sight marker M overlapped with the icon image G22 of FIG. 11 (step S23; Yes), the character image is input to the image processing unit 434. The product image superimposed on is removed (step S24).

  In addition, when the control unit 431 determines that the instruction of “end fitting” has been input because the line-of-sight marker M overlaps with the icon image G23 of FIG. 11 (step S23; No → step S25; Yes), the control unit 431 enters the RAM work area. Each retained record is deleted, and this process ends.

  Moreover, when a line of sight is directed to the barcode of a new product by the customer (step S25; No), the process returns to step S11 again. Thus, each time a new product code is acquired, a character image in which a product image imitating the product is superimposed is displayed on the monitor display unit 481. In particular, when “product clear” of the icon image G22 is not instructed, a plurality of product images can be superimposed on the character image, so that a combination of a plurality of products can be virtually performed. In addition, when the superimposition position of the product image superimposed previously overlaps with the superimposition position of the product image superimposed later, the product image superimposed later is preferentially superimposed.

  As described above, according to the present embodiment, a product image imitating the product is obtained using the product code input by gazing at the barcode attached to the product desired to be tried on, and the customer's appearance Is superimposed on a predetermined part of the character image imitating the image, and then displayed on a monitor display unit 481 provided in front of the customer's eyes. Thereby, after acquiring the product code, it is possible to observe the character image subjected to the virtual try-on at an arbitrary position in the store. Further, by acquiring product codes from a plurality of types of products, it is possible to provide a character image that is a result of virtual try-on of these products, so that a customer can coordinate a combination of a plurality of products. In addition, the barcode included in the image data acquired by the imaging of the digital camera 42 is decoded to acquire the product code, and the product image associated with the barcode is specified. Only by visually recognizing, a try-on image of the product image can be easily obtained. Furthermore, since the superimposed position of the product image is associated with the product code, it is possible to obtain a try-on image in which the product image is accurately superimposed only by visually recognizing the barcode of the product to be tried on. Therefore, it is possible to improve the convenience related to virtual try-on of clothing items sold in the store.

  In the present embodiment, the character image is generated using the body shape data and the face image data registered in the member management table 373. However, the present invention is not limited to this, and at the time of lending the wearable terminal device 4 to a customer, The character image generated in advance for the customer may be stored in the RAM or the like of the control unit 431. Further, when the wearable terminal device 4 is lent, the customer may directly input the body shape data using the line-of-sight marker M. In the case of this form, for example, it can be realized by displaying a body type data input screen as shown in FIG. 12 on the monitor display unit 481.

  Here, FIG. 12 is a diagram illustrating an example of a body shape data input screen displayed on the monitor display unit 481. As shown in the figure, the display area G31 is an area for inputting height. The display areas G32, G33, and G34 are areas for inputting chest circumference, abdominal circumference, and waist circumference, respectively. It should be noted that the input of numerical values in each display area is performed by icon images G35 and G36 representing the vertical direction arranged on the right part of each display area. For example, when the line-of-sight marker M overlaps with the icon image G35, the control unit 431 sequentially increases the numerical value. Further, when the line-of-sight marker M overlaps the icon image G36, the control unit 431 sequentially decreases the numerical value.

  In addition, when the control unit 431 determines that the “decision” instruction is input because the line-of-sight marker M overlaps the icon image G37, the numerical values input in the display areas G31 to G34 are received as body data, and the RAM work Remember in the area. The face image data may be input by the digital camera 42, or may be selected as a face image data by selecting an illustration desired by the customer from a plurality of types of face illustrations.

  In this embodiment, the barcode is input via the image data captured by the digital camera 42. However, the present invention is not limited to this. For example, the barcode may be input by separately providing a code reader capable of reading the barcode. In this embodiment, a bar code is used as an example of a data code. However, the present invention is not limited to this, and a two-dimensional code such as a QR code may be used.

  Moreover, although this embodiment demonstrated the form which a customer wears the wearable terminal device 4, not only this but the salesclerk in a store may wear the wearable terminal device 4. In this case, the customer can make the store clerk confirm the customer's character image by showing the bar code attached to the membership card to the store clerk. It becomes possible.

  The program executed by the control unit 431 according to the present embodiment may be configured to be provided by being incorporated in advance in a ROM or the like. The program may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD in an installable or executable format file. Good.

  Further, the program may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Further, the program may be provided or distributed via a network such as the Internet.

  Further, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment.

DESCRIPTION OF SYMBOLS 1 POS system 2 POS terminal 3 Store server 31 Control part 32 Bus 33 Communication interface 34 I / O apparatus control part 35 Input part 36 Display part 37 Storage part 371 Goods master table 372 Goods image management table 373 Member management table 374 Sales registration table DESCRIPTION OF SYMBOLS 4 Wearable terminal device 41 Head mounted display 42 Digital camera 43 Interface box 431 Control part 432 Transmission / reception part 433 Information display part 434 Image processing part 44 Frame main body 45 Arm for mounting 46 Imaging direction variable mechanism 47 Camera for line-of-sight recognition 48 Light transmissive member 481 Monitor display unit 5 Transmitter / receiver

JP 2006-148618 A

Claims (5)

A head mounted display mounted on the customer's head and provided with a light transmissive display at a position corresponding to the customer's eyes;
An imaging unit provided in the head-mounted display and having an imaging range set in the line-of-sight direction of the customer wearing the head-mounted display;
Decoding means for identifying the data code attached to the product from the image data captured by the imaging unit and decoding the product code included in the data code;
Reading means for reading out the product image corresponding to the product code decoded by the decoding means from the product image storage means storing the product code of each product and the product image imitating each product,
Image processing means for superimposing the product image read by the reading means on a predetermined part of the character image imitating the appearance of the customer;
Display control means for displaying an emphasized image for emphasizing the data code in the image data identified by the decoding means and the character image on which the product image is superimposed, respectively, on the display unit;
A virtual try-on device characterized by comprising: Further comprising image generation means for generating the character image based on body shape data characterizing the customer's body shape;
The virtual try-on device according to claim 1, wherein the image processing unit superimposes the product image on the character image generated by the image generation unit. The decryption means decrypts the data code attached to the customer's membership card to obtain a unique member identifier for the customer,
The reading means obtains body shape data corresponding to the member identifier acquired by the decryption means from a member information storage means storing the member identifier of each customer who has registered as a member and the body shape data of each customer. reading,
The virtual try-on device according to claim 2, wherein the image generation unit generates the character image based on the body shape data read by the reading unit. The product image storage means stores the product image of each product in association with the superimposed position of the product image ,
The reading means reads the superimposed position of the product image corresponding to the product code from the product image storage means,
The virtual try-on device according to claim 1, wherein the image processing unit superimposes the product image on the character image in accordance with the superposition position read by the reading unit. A head mounted display mounted on the customer's head and provided with a light transmissive display at a position corresponding to the customer's eyes, and a customer's line of sight provided on the head mounted display and mounted with the head mounted display A virtual try-on device computer comprising: an imaging unit having an imaging range set in a direction;
Decoding means for identifying the data code attached to the product from the image data captured by the imaging unit and decoding the product code included in the data code;
Reading means for reading out the product image corresponding to the product code decoded by the decoding means from the product image storage means storing the product code of each product and the product image imitating each product,
Image processing means for the product image that has been read, superimposes a figure of the customer in a predetermined portion of the character image simulating by said reading means,
Display control means for displaying an emphasized image for emphasizing the data code in the image data identified by the decoding means and the character image on which the product image is superimposed, respectively, on the display unit;
A program characterized by making it function.

Images