KR20210014860A - Automated sales support system with consulting - Google Patents

Abstract

The present invention relates to an automated sales support system capable of consulting and, specifically, to an automated sales support system capable of consulting capable of providing images of clothing, shoes, and hats worn through augmented reality to a visitor who visits a clothing store, a shoe store, and a hat store; photographing, storing, and managing a photograph including a character of a movie and the like; and allowing to keep the photographed image in a form of a photograph. In addition, according to the present invention, the system comprises: a display for displaying the image; a plurality of cameras photographing a customer; and a management server which extracts a movement path of the customer from the images photographed by the plurality of cameras, checks the clothing of interest from the extracted movement path, extracts the whole body image of the customer from the photographed image, synthesizes the image of the clothing of interest with the extracted whole body image, and outputs the synthesized image to the display.

Description

Automated sales support system with consulting}

The present invention relates to an automatic sales support system capable of consulting, and in particular, provides an image on which clothes, shoes, hats, etc. are worn through augmented reality to visitors who visit a clothing store, a shoe store, a hat store, etc. It relates to an automatic sales support system that enables consulting to take and store and manage a picture including a character, and to have the captured image in the form of a picture.

In general, a company that manufactures and sells clothing has developed and used various display systems for displaying the state of customers wearing predetermined clothing using a computer system.

In other words, a plurality of clothing images are stored in the computer system in advance, an image of a customer who wants to purchase clothing is captured, and the image of the clothing selected by the customer is synthesized with the captured customer's image, and then displayed on a monitor. It allows you to check whether the color and design of the clothing suits you without having to try on the clothing you are going to purchase.

An example of a technology for synthesizing and displaying clothes by photographing a customer as described above is disclosed in [Republic of Korea Patent Publication 10-2004-0090791 (published on October 27, 2004), "Clothing Coordination Method and Device"] (hereinafter, prior art 1). Has been.

The prior art 1 relates to a technology for directly coordinating selected clothing by modeling the customer himself, and includes a clothing information storage unit for extracting and storing clothing information from images of an electronic catalog; A model information storage unit for receiving and storing image information on a customer input through a camera; A control unit that outputs various types of clothing, outputs clothing information when one of the various types of clothing is selected, and controls to output selected clothing information and the model image according to a request for image synthesis from a customer; An image synthesizing unit for synthesizing the model information and the selected clothing information to output a composite image that is a customer image coordinated with the selected clothing; And a display unit that displays clothing type and clothing information, and a composite image.

In addition, another example of a technology for synthesizing and displaying clothing by photographing a customer is [Korea Patent Laid-Open Patent 10-2004-0093576 (published on November 6, 2004), "Customer-customized clothing image display system and method"] (hereinafter, prior art 2) ).

The prior art 2 relates to a technology for synthesizing and displaying a customer's image after adjusting the size and angle of each part of the clothing image according to the size and posture of the body, and photographing a customer with a camera and storing a plurality of clothing images in advance. In addition, a technology for synthesizing clothing images stored in an output image and displaying them on a display panel is disclosed. In particular, the prior art 2 extracts only the customer's image excluding the background image from the output image, divides the extracted customer image according to each part of the body, and determines the size and posture of the customer according to the divided image of each part of the body. In addition, starting a technology for reading the clothing image selected according to the clothing selection command, editing the read clothing image according to the size and posture of the determined customer, and synthesizing the edited clothing image to the output image and outputting it. Are doing.

Such a conventional technique provides an image for clothing selected by the user, and it is difficult to capture the user's attention because information on clothing that the user is interested in is not provided.

Republic of Korea Patent Publication 10-2004-0090791 (published on October 27, 2004) Republic of Korea Patent Publication 10-2004-0093576 (published on November 6, 2004)

The present invention is to solve the above problems, and provides an image wearing clothes, shoes, hats, etc. through augmented reality to visitors visiting a clothing store, a shoe store, and a hat store, and includes characters such as movies. The goal is to provide an automated sales support system that enables consulting to take and store and manage photos, and to hold the captured images in the form of photos.

According to the present invention, a display for displaying an image; Multiple cameras for photographing customers; And extracting the customer's moving path from the images captured by the plurality of cameras, checking the clothing of interest from the extracted moving path, extracting the customer's full body image from the captured image, and using the extracted body image to the clothing image of interest. An automatic sales support system capable of consulting is provided including a management server that synthesizes and outputs it to the display.

According to the present invention, an image on which clothes, shoes, hats, etc. are worn through augmented reality are provided to visitors visiting a clothing store, a shoe store, and a hat store, and a picture including a character such as a movie is taken and stored and managed, Make it possible to carry the captured video in the form of a photo.

1 is a block diagram showing the configuration of an embodiment of an automatic sales support system capable of consulting according to the present invention.
2 is a block diagram showing the configuration of an image processing unit according to an embodiment of the present invention.
3 is a diagram illustrating a reference line of an image displayed according to an embodiment of the present invention.
4 is a diagram illustrating an arrangement of input buttons of an input device according to an embodiment of the present invention.
5 is a diagram illustrating a screen for synthesizing by adjusting a clothing image according to an embodiment of the present invention.
6 is a block diagram showing the configuration of an automatic sales support system capable of consulting according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail so that those skilled in the art can easily understand and reproduce the present invention through preferred embodiments described with reference to the accompanying drawings.

In describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the embodiments of the present invention, the detailed description will be omitted.

Terms used throughout the specification of the present invention are terms defined in consideration of functions in the embodiments of the present invention, and can be sufficiently modified according to the intention and custom of the user or operator. It should be made based on the contents of

1 is a block diagram showing the configuration of an embodiment of an automatic sales support system capable of consulting according to the present invention.

Referring to FIG. 1, the automatic sales support system capable of consulting according to the present invention includes a display 20 displaying an image, a plurality of cameras 30 and 30a photographing a customer, and the plurality of cameras 30 and 30a. Extract the customer's movement path from the captured image, check the clothing of interest from the extracted movement path, extract the customer's full body image from the captured image, and synthesize the clothing image of interest with the extracted whole body image to display the display ( It is configured to include a management server 40 to output to 20). In addition, it may be configured to further include a database 50 for storing data.

The management server 40 may provide an image in which an image of a clothing of interest is synthesized with a full body image of the customer to the customer's mobile terminal so that the customer can check it in real time.

At this time, when the customer wants to check whether the worn clothing suits the customer by transmitting an image in which the clothing image of interest is combined with the full-body image to acquaintances, the management server 40 sends a message to the corresponding inquiry group. B. It can be sent to KakaoTalk and received a "recommended" and "not recommended" message, calculated the total, and displayed on the customer's portable terminal to help the customer make a selection when purchasing.

Meanwhile, the display 20 is a device for outputting an image and includes a display panel 21 such as a liquid crystal display (LCD) and a plasma display panel (PDP). In addition, all devices capable of outputting an image correspond to the display 20.

Preferably, the display 20 has a support 22 installed at a lower portion thereof, and the support 22 is provided with a plurality of wheels (not shown) to facilitate movement. As another embodiment, the display 20 may be installed on a wall. In this case, the display 20 may not include the support 22.

Meanwhile, the display 20 may be provided with input buttons 23 for accepting an input in a frame on the right or left of the display panel 21.

Preferably, the display panel 21 may be configured as a touch screen panel. In this case, the display 20 receives selection commands in a touch screen manner. For example, input buttons 23 are displayed on the display panel 21, and an input is accepted by a customer touching the input buttons 23 displayed on the display panel 21.

A plurality of cameras 30 are installed in various areas of the store to photograph customers and provide the captured images to the management server 40.

Then, the management server 40 identifies a customer by recognizing a face using facial recognition technology, and tracks the movement path of the identified customer.

The management server 40 determines that clothing of interest (or shoes of interest, hats of interest) is determined as the photographed when the customer grasps clothing (same shoes or hats) and puts them in close contact with the body while tracking the movement path of the customer. A full-body image of the customer is extracted from the image, and a clothing image of interest is synthesized with the extracted full-body image and output to the display 20.

At this time, in the case of a shoe store, it operates in the same way even in the case of shoes rather than clothing, and in the case of a hat shop, it operates in the same manner in the case of hats and not clothes.

At this time, the management server 40 may grasp the clothing of interest using various image techniques.

In addition, a clothing image of interest (a shoe image of interest in the case of shoes, an image of a hat of interest in case of a hat) is stored in the database 50, and the stored clothing image of interest (or a shoe image of interest, a hat image of interest) is stored. ) To the management server 40.

Here, the management server 40 may extract the customer's whole body image from the customer images measured by the plurality of cameras 30.

In this case, in order to accurately obtain a full-body image of the customer, any one camera 30a may be attached to the display 20 and the lens portion of the camera 30a may be installed to face the front of the display 20. Accordingly, the camera 30a can take an image of the front of the display 20.

Preferably, the camera 30a is attached to the top center of the display 20. This is because the image of the customer located in front can be photographed in a symmetrical way.

Preferably, a location line may be displayed on the floor at a certain distance away from the front of the display 20. The location line is a line indicating a location to be located when the customer is photographed. Since the location of the customer 10 is known, the size of the customer 10, such as height, width, etc., can be known from the captured image of the customer.

The management server 40 is a device equipped with a computer operation function and controls the display 20 and a plurality of cameras 30 and 30a. To this end, the management server 40 is connected to the display 20 and the cameras 30 and 30a, respectively.

Preferably, the management server 40 may be implemented by a program running on a computer terminal such as a personal computer (PC) or a notebook computer. In addition, it may be implemented as a dedicated terminal. More preferably, the management server 40 may be implemented by being built into the display 20. For example, it may be manufactured in the form of a chip or a PCB board and embedded in the display 20.

Meanwhile, the database 50 includes a clothing information DB 51 that stores information on clothing of interest and a customer information DB 52 that stores information about customers. However, the configuration of the database 50 is only a preferred embodiment, and may be configured in a different structure according to the database construction theory in consideration of the ease and efficiency of access and search in developing a specific device.

Next, a specific configuration of the management server 40 according to an embodiment of the present invention will be described with reference to FIG. 2.

As shown in FIG. 2, a captured image input unit 41, a customer image extraction unit 42, an image reference display unit 43, a clothing image display unit 44, a clothing image adjustment unit 45, an image synthesis unit 46 Consists of including.

The captured image input unit 41 captures an image of the customer 10 located in front of the display 20 by controlling the camera 30a.

As described above, a location line where the customer should stand at a certain distance from the front of the display 20 is drawn on the floor. Therefore, it is preferable that the focusing (focusing) of the camera 30a is also adjusted to the distance of the position line. Further, the camera 30a has an automatic focusing function to focus on the object when an object is caught near the position line point.

In addition, the captured image input unit 41 controls a plurality of cameras 30 to capture an image of the customer 10 to receive the captured image of the customer.

In this way, the captured image input unit 41 causes the cameras 30 and 30a to capture an image of the customer 10, receives the captured image, and converts it into digital image data in a form that can be processed and stores it. When the cameras 30 and 30a themselves pre-process a digital image, the image data value may be stored as it is.

The customer image extraction unit 42 extracts an image of the customer 10 from the captured image, recognizes a face, and obtains a full body image.

To this end, the customer image extracting unit 42 may include a texture feature map extracting unit (not shown), a face detection unit (not shown), a face recognition unit (not shown), and the like.

First, the texture feature map extraction unit extracts a local texture feature map from an image input through the captured image input unit 41.

When there is an image input through the captured image input unit 41, the texture feature map extraction unit extracts a texture feature value based on the local block texture feature pattern in order to extract the texture feature of the image.

At this time, as an example of a representative local block texture pattern, there is a local binary pattern. In order to generate a texture feature map using these local binary pattern values, a binary code is obtained through size comparison between the center and neighboring pixel values for each local area in the input image, and the feature is characterized by decimating the binary code. The value is calculated. In this case, the texture feature map refers to an image having a texture feature value obtained from an input image. After calculating the texture feature values, an image having texture feature values is obtained for pixel values of all input images, and a texture feature map made of these texture feature values is input to the face detection unit and the face recognition unit.

The face detection unit detects a face area in the input image based on the texture feature map. That is, the face detection unit calculates a local block texture feature vector for a window of a predetermined size to be scanned for face detection in the input image based on the texture feature map, and uses the local block texture feature vector as a preset reference feature vector. Matching with, detects a face area in the input image.

In addition, the face detection unit generates a binary map from the texture feature map, integrates the generated binary map to extract the integral feature map, and local block texture features for all local blocks of the input image from the extracted integral feature map. Yields a vector.

At this time, the face detection unit scans a window of a certain size for each input image based on the integrated feature map, counts the frequency of the local block texture feature values for n predefined local blocks within each window, A corresponding histogram vector is generated, and a local block texture feature vector corresponding to the window is calculated by concatenating the histogram vectors for each local block.

Meanwhile, the face recognition unit receives a texture feature map from the texture feature map extraction unit for an input image to be subjected to face recognition, and receives a texture feature vector for the input image from the face detection unit.

Subsequently, the face recognition unit performs face recognition by reusing the texture feature map and the texture feature vector calculated for detection of the face region by the face detection unit.

That is, the face recognition unit performs face recognition through matching between a feature vector and a face database (data base) prepared in advance, and outputs a face recognition result corresponding to the nearest identity information according to the matching result.

At this time, in the database 50, for example, template feature vectors of target faces to be recognized may be stored, and the Euclidean distance between the texture feature vector and the template feature vector is compared with a predefined threshold value similarly when face is detected. A face can be recognized in the face area.

On the other hand, the customer image extracting unit 42 implements a plurality of cameras 30 as depth cameras, photographs the posture of the customer 10, determines the balance of the body, and generates a 3D model applying this to a clothing image display unit. Output as (44).

In the created 3D model, when sliced into a plane that passes through the area of interest (for example, waist) orthogonal to each other, the size of the area of interest can be measured by measuring the perimeter of the area where the plane and the 3D model intersect.

At this time, errors occur due to external factors (for example, errors due to thick clothes or lighting), and the error range between the actual circumference and the circumference measured on the 3D model can be measured to be about 0.6 to 0.7 inches.

Meanwhile, the image reference display unit 43 divides the extracted image of the customer 10 by a plurality of reference lines 61 and 62 and displays it on the display 20. The reference line is divided into a horizontal reference line 61 and a vertical reference line 62.

For example, as shown in FIG. 3, the image reference display unit 43 includes a horizontal reference line 61 centered on the neck, waist, and shoes (or ankle) and a vertical reference line 62 based on the center of the customer. Distinguish the image of the customer 10.

Other baselines may be further subdivided. For example, the upper body may be further subdivided around the armpits, and the lower body may be further subdivided around the hips (hips) between the pants.

The reason for classification by the baseline is that it is one of the best ways for customers who do not have expertise in clothing to intuitively select the characteristics of their clothing. In addition, when the clothing image is overlapped with the customer image, the reference lines 61 and 62 become a criterion for overlapping.

Initially, the customer stands against this baseline (61,62). However, for portions that are less than or larger than the reference lines 61 and 62, the reference lines 61 and 62 can be increased or decreased by pressing the input button 71. For example, when the reference lines 61 and 62 displayed on the display 20 are compared to the waist of the customer. When the customer's waist is higher, pressing the input button 71 can match the waist reference line to the customer's waist.

After matching the reference lines 61 and 62 with the customer image, the clothing image of interest of the clothing of interest to the customer may be called.

That is, the clothing image display unit 44 displays the clothing image of interest on the display 20 so as to fit in the area divided by the reference lines 61 and 62. At this time, the clothing image display unit 44 overlaps the clothing image of interest by the reference lines 61 and 62.

For example, as shown in FIG. 3, the top is marked to fit within the baseline of the neck and the waist, and the bottom is marked to fit within the baseline between the waist and the shoe. Alternatively, a clothing image is displayed so that the belt portion of the trousers coincides with the waist reference line.

On the other hand, the clothing image display unit 44 retrieves the clothing image of interest that the customer is interested in among the clothing information stored in the database 50 and displays the imported clothing image of interest on the display 20. The clothing information of interest is stored in the database 50 together with the classification or search word, so that the customer can easily find the desired clothing by classification or search word. For example, clothing information for a top is divided into gender, size, long/short arm, heating/shirt (type), jeans/cotton pants (material), and stored.

Meanwhile, when the size of the clothing of interest is adjusted, the clothing image display unit 44 displays the clothing image to be semi-transparently overlapped with the image of the customer 10. As shown in FIG. 5A, since the image of the clothing of interest is displayed as translucent, the image of the customer displayed behind is projected and shown.

Accordingly, the customer 10 can view not only the image of the clothing of interest, but also the image of the customer located behind it at once. As described above, when the customer 10 reduces or increases the clothing image of interest, it is possible to check how much the customer 10 decreases or increases compared to his/her body.

The clothing image adjustment unit 45 adjusts the size of the displayed clothing image of interest by receiving a customer's input for each of the divided regions. In particular, the clothing image adjustment unit 45 adjusts the left and right length or the vertical length of the clothing of interest by receiving an input of left and right or up and down for each area divided by the reference lines 61 and 62.

Preferably, as shown in FIG. 4, input devices 70 for controlling a clothing image are displayed on the screen of the display 20 by a touch screen method. The input device 70 displayed on the touch screen includes an input button that increases or decreases vertically, left and right, and an input button that moves a clothing image up and down, left and right.

The input devices 70 are arranged by dividing input buttons so as to be adjusted for each divided area. Preferably, when an area of the displayed customer image or clothing image is selected, input buttons related to clothing in the selected area may be displayed.

The buttons displayed in FIG. 4 will be described as follows.

"Neckline UP", "Neckline Down", etc. are buttons for adjusting the reference line up and down, and the neckline, waistline, and ankle line up button or down button respectively. In addition, the buttons under the "shirt" button are buttons that move left or right or up and down, or stretch left or right or up and down when the upper garment image does not fit. The buttons under the "Pants" button are buttons for adjusting the image of the clothing under the clothing.

When receiving a completion input, the image synthesizing unit 46 synthesizes the clothing image with the clothing image.

As shown in FIG. 5B, the image synthesizing unit 46 converts the translucent state displayed when adjusting the clothing image to an opaque state. In addition, in the case where the top is covered with the lower end of the bottom inward or outward, the top or bottom part entering the inside is displayed invisible. By doing this, you can get the feeling the customer is actually wearing.

In addition, the image synthesizing unit 46 combines the clothing image and the synthesized customer image with the background image and displays it on the display 20. Accordingly, the display 20 can be illuminated like a mirror.

On the other hand, if the customer 10 can have a portable terminal, an App for supporting a mirror service system using augmented reality is installed in the equipped portable terminal.

Then, the customer 10 photographs a face when installing the app and transmits the photographed face image to the management server 40.

If the customer 10 provides the photographed face image as described above, the management server 40 can check the identity of the customer when the customer 10 enters a clothing store.

Meanwhile, an NFC tag is provided on the clothing of the clothing store, and the mobile terminal possessed by the customer 10 reads the NFC tag provided on the clothing and transmits the tag information.

At this time, the mobile terminal possessed by the customer 10 reads and transmits tag information of NFC tags attached to the clothes accessed by the customer 10, and the management server 40 takes the tag information and the camera 30 Clothing of interest can be identified by using the generated image information.

In general, an RF device using NFC technology has a location in which the reception sensitivity of an RF signal is maximum exists, and as the distance from the maximum location increases, the reception sensitivity decreases. In the present invention, the distance between the mobile terminal and the NFC tag can be measured by measuring the reception sensitivity of the received NFC signal using this feature. In addition, NFC signals are continuously exchanged between the mobile terminal and the NFC tag until the NFC tag is removed. In this case, the mobile terminal may measure the sensitivity of the signal received from the NFC tag, and may measure the distance to the NFC tag in real time. Through this, when the customer 10 grips and moves the clothing, the mobile terminal measures the change in distance of the NFC tag in real time, and the image processing unit 40 is based on this, and the customer 10 holds the interest in close contact with the body. You can also determine whether it is clothing.

6 is a block diagram showing the configuration of an automatic sales support system capable of consulting according to another embodiment of the present invention.

As shown in Fig. 6, the automatic sales support system 100 capable of consulting according to an embodiment of the present invention includes a photo taking unit 110, an object storage unit 120, an image recognition unit 130, and An object identification unit 140, an object reading unit 150, an object synthesis unit 160, a photo storage unit 170, a display unit 180, a printing unit 190, a ticket machine 200, an inquiry unit It consists of including (210) and a management server (40).

Here, the photo taking unit 110, the object storage unit 120, the image recognition unit 130, the object identification unit 140, the object reading unit 150, the object synthesis unit 160, and , The photo storage unit 170 may be included in the mobile terminal of the customer 10 implemented as a smart phone and implemented in the form of an application.

The photo taking unit 110 takes a picture of a photo zone. For example, the photo taking unit 110 may be implemented to take a picture of a photo zone through a CCD camera.

In this case, the customer 10 reads the NFC tag information by selecting the clothing of interest that he wants to be synthesized in the body using the mobile terminal and transmits the information to the management server 40.

In this case, the photographing area is an area set to take an augmented reality photo including virtual 2D and 3D objects, and a background image for object identification is disposed.

For example, the background image may be implemented in the form of being reproduced on a large screen display.

The object storage unit 120 stores objects corresponding to a background image. For example, the object storage unit 120 may be implemented in the form of a nonvolatile memory such as a flash memory. Meanwhile, the object may be a stationary or moving object.

The image recognition unit 130 recognizes a background image from the picture taken by the photo taking unit 110 and transmits it to the management server 40 to receive and store the corresponding object from the management server 40. Can be managed.

The image recognition unit 130 recognizes a background image and a customer from a picture taken by the photo taking unit 110. In this case, there may be a plurality of 2D and 3D objects corresponding to the background image recognized by the image recognition unit 130.

For example, the image recognition unit 130 may be implemented to recognize a background image by recognizing a background image itself reproduced by a large screen display included in a photo or by recognizing a unique tag attached to a specific position of the background image. .

Meanwhile, the image recognition unit 130 may be implemented to recognize a customer from a photo through object recognition based on Feature Point Extraction.

For example, the image recognition unit 130 may be implemented to recognize a customer from a photo by extracting a feature point for a body.

The object identification unit 140 identifies an object corresponding to the background image recognized by the image recognition unit 130. For example, if the background image recognized by the image recognition unit 130 is a movie'Titanic image', the object identification unit 140 may use'DiCaprio','Winslet', and'Jane' corresponding to the'Titanic image'. The same actors can be identified as 2D and 3D objects.

The object reading unit 150 reads the object identified by the object identification unit 140 from the object storage unit 120. At this time, when there are a plurality of objects corresponding to the background image, the object reading unit 150 displays a list of a plurality of objects corresponding to the background image, at least one object is selected from the user, and the selected object May be implemented to read from the object storage unit 120.

The object synthesis unit 160 synthesizes the object read by the object reading unit 150 around the customer recognized by the image recognition unit 130.

At this time, when the object combining unit 160 reads a plurality of 2D and 3D objects by the object reading unit 150, a picture of a plurality of 2D and 3D objects taken by the photo taking unit 110 It can be implemented to synthesize around the customer in the shooting area.

In addition, the object synthesis unit 160 transmits a photo in which the object is synthesized to the management server 40, and the management server 40 converts a photo including a customer wearing the clothing of interest selected by the customer 10 to the object synthesis unit. Send to 160.

The photo storage unit 170 stores a photo in which clothing of interest is worn by the object combining unit 170 and an object is synthesized around the customer.

In this case, the photo storage unit 170 may be implemented in the form of a nonvolatile memory such as a flash memory, and may be the same as or different from the object storage unit 120.

The display unit 180 displays a photo in which clothes of interest are worn and objects are synthesized around the customer.

Meanwhile, the printing unit 190 provides a screen with a print menu through the display unit 180.

The customer selects a picture to be printed from the stored pictures, and when the customer clicks a print execution button on the portable terminal, the vending machine 200 prints and provides the picture.

On the other hand, the inquiry unit 210, if the customer wants to check whether the clothes worn by the acquaintances suit the customer well, transmits the photo to the selected group by message or KakaoTalk, and sends a "recommended" or "not recommended" message. It receives and calculates the sum and displays it to the customer to help the customer make a choice at the time of purchase.

Here, the description is mainly made of clothing as an example, but the same can be applied to shoes or hats.

On the other hand, the management server 40 receives photos stored in the customer's mobile terminal and identifies the customer's style, and then recommends and provides clothing suitable to the customer at the clothing store visited by the customer according to the identified style. In this case, an image of a state in which the recommended clothing is worn may be provided to the customer.

Although the present invention has been described based on a preferred embodiment referenced by the accompanying drawings, it is apparent that various modifications are possible without departing from the scope of the present invention within the scope covered by the claims to be described later from this description. .

10: customer
20: display
30: camera
40: management server
100: Automatic sales support system with consulting
110: photo shooter
120: object storage unit
130: image recognition unit
140: object identification unit
150: object reading unit
160: object composition unit
170: photo storage unit
180: display
190: printing unit
200: display
210: Inquiry

Claims (15)

A display for displaying an image;
Multiple cameras for photographing customers; And
Extracting the customer's moving path from the images taken by the multiple cameras, checking the clothing of interest from the extracted moving path, extracting the customer's full body image from the captured image, and adding the clothing image of interest to the extracted full body image An automatic sales support system capable of consulting including a management server that synthesizes and outputs the display to the display. The method of claim 1,
The management server is an automatic sales support system that enables consulting to provide real-time confirmation by the customer by providing an image in which the customer's full body image and the clothing image of interest are synthesized to the customer's mobile terminal. The method of claim 1,
When the customer wants to check whether the worn clothing suits the customer by transmitting an image in which the clothing image of interest is combined with the full-body image to acquaintances, the management server sends a message to the corresponding inquiry group or Kakao Talk. Automatic sales support system that allows consulting to be sent to the customer's mobile terminal by calculating the total by receiving the message "recommended" and "not recommended". The method of claim 1,
The management server divides the clothing image and the synthesized customer's image into a plurality of reference lines, and adjusts the size of the clothing image overlapped according to the reference line. The method of claim 1,
The management server is an automatic sales support system capable of consulting, characterized in that the image of the customer is divided into a horizontal reference line centered on the neck, waist, and shoes and a vertical reference line based on the center of the customer. The method of claim 1,
The management server is an automatic sales support system capable of consulting, characterized in that receiving input of left and right or up and down for each area divided by the reference line and adjusting the left and right length or top and bottom length of the clothing. The method of claim 6,
The management server is an automatic sales support system capable of consulting, characterized in that receiving the input of the left and right or up and down on the display in a touch screen method. The method of claim 1,
When the size of the clothing is adjusted, the management server displays the clothing image to be semi-transparently overlapped with the customer's image. The method of claim 1,
The plurality of cameras are installed in various areas of the store to photograph customers and provide images taken by the management server,
The management server identifies a customer by recognizing a face using facial recognition technology, and an automatic sales support system that enables consulting to track the movement path of the identified customer. The method of claim 1,
The management server determines that the clothing is of interest when the customer grasps the clothing and puts it in close contact with the body while tracking the movement path of the customer, extracts a full body image of the customer from the captured image, and extracts the clothing image of interest from the captured image. An automatic sales support system that enables consulting to synthesize and output to the display. The method of claim 1,
An automatic sales support system that enables consulting to implement the plurality of cameras as depth cameras to photograph the customer's posture, and the management server to determine the balance of the body and generate a 3D model applying the same. The method of claim 1,
If the customer can have a mobile terminal, an app is installed on the provided mobile terminal to support a mirror service system using augmented reality, and the customer photographs a face when installing the app. An automatic sales support system that enables consulting to verify the identity of the customer when the image is transmitted to the management server, and when the customer provides the image of the face taken by the customer, the management server when the customer enters the store. The method of claim 12,
The clothing of the store is equipped with an NFC tag, and when the mobile terminal held by the customer reads the NFC tag provided on the clothing and transmits tag information, the mobile terminal held by the customer is The tag information of attached NFC tags is read and transmitted, and the management server is an automatic sales support system that enables consulting to identify clothing of interest using tag information and image information captured by the plurality of cameras. The method of claim 1,
Take a picture of a customer located in the photo shooting area, recognize the background image and the customer from the picture taken, synthesize a 3D object corresponding to the recognized background image around the customer, and transmit the synthesized picture to the management server, and the Transmitting the NFC tag information of the clothing of interest to the management server, and a mobile terminal for receiving a picture of the clothing of interest is worn by the customer from the management server to display to the customer,
When the management server receives the NFC tag information and the composite photo of the clothing of interest from the mobile terminal, an automated sales support system capable of consulting that synthesizes the image of the clothing of interest with the composite photo and transmits the synthesized photo to the mobile terminal. The method of claim 14,
Consulting available automatic sales support system further comprising a vending machine that prints photos according to the photo print request of the mobile terminal.

Images