JP7506956B1 - Mirror device and program - Google Patents

Abstract

A mirror device and the like capable of further improving user satisfaction is provided.
The computer 140 of the mirror device 100 has a storage unit that stores multiple pieces of product information for fashion items handled by a store, and receives, from a user positioned in front of the half mirror,
The system includes a first acquisition unit that acquires basic mind information necessary for judging the psychological state, a mind diagnosis unit that judges the user's psychological state based on the basic mind information, a first selection unit that selects product information of fashion items recommended to the user at that time from a plurality of product information based on the judgment result of the user's psychological state, and a display control unit that displays the product information of the fashion items recommended to the user on a display panel.
[Selected figure] Figure 2

Description

The present invention relates to a mirror device and a program suitable for use in various facilities that use mirrors, such as apparel-related facilities.

A mirror device is known that includes a half mirror that reflects a mirror image of a user such as a customer, and a display panel provided behind the half mirror (see, for example, Patent Document 1). The mirror device displays images of fashion-related items (hereinafter collectively referred to as "fashion items"), such as clothing and accessories, desired by the user on the display panel in accordance with the user's mirror image reflected in the half mirror, allowing the user to virtually try on the items.

JP 2010-70889 A

The mirror device described above allows users to find fashion items that suit them without actually trying them on. However, there are no services that can be provided other than virtual try-on, and there is a need to further improve user satisfaction.

The present invention has been made in consideration of the above-described circumstances, and has as its object to provide a mirror device etc. that can further improve user satisfaction.

The mirror device of one embodiment of the present invention is a mirror device comprising a half mirror having a semi-transparent reflective surface, and a display panel having a display screen, arranged behind the half mirror, and is equipped with a memory unit that stores multiple pieces of product information for fashion items handled by a store, a first acquisition unit that acquires basic mind information necessary for judging the psychological state of a user positioned in front of the half mirror, a mind diagnosis unit that judges the user's psychological state based on the basic mind information, a first selection unit that selects product information for fashion items recommended to the user at that time from the multiple pieces of product information based on the judgment result of the user's psychological state, and a display control unit that displays product information of the fashion items recommended to the user on the display panel.

According to the present invention, it is possible to provide a mirror device etc. that can further improve user satisfaction.

1 is a diagram showing a schematic configuration of a mirror signage system according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration of a mirror device. FIG. 4 is a diagram illustrating an example of registered contents of a user management database. FIG. 2 is a diagram illustrating an example of registered contents of a product management database. 13 is a flowchart showing a mind diagnosis process. 11A and 11B are diagrams illustrating examples of display contents on a display panel. 13 is a flowchart showing a camera recommendation process. 11A and 11B are diagrams illustrating examples of display contents on a display panel. 13 is a flowchart showing a fashion type diagnosis process. 11A and 11B are diagrams illustrating examples of display contents on a display panel. 11A and 11B are diagrams illustrating examples of display contents on a display panel.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the same elements are given the same reference numerals and duplicated explanations will be omitted.

A. This embodiment A-1. Configuration FIG. 1 is a diagram showing a schematic configuration of a mirror signage system 1000 according to this embodiment. The mirror signage system 1000 includes a user terminal 10 carried by each user, and a mirror device 100 installed in a store that handles fashion items, etc. The user terminal 10 and the mirror device 100 are connected to each other so as to be able to communicate with each other via a communication network N. The communication network N may be, for example, the Internet, a LAN, a dedicated line, a telephone line, an in-house network, a mobile communication network, Bluetooth (registered trademark), Wi-Fi (
The communication line may be either a wired or wireless communication line, such as wireless fidelity (Wireless Fidelity), other communication lines, or a combination thereof.

The mirror device 100 is assumed to be installed in each store, but is not limited to this. In the case of a shopping mall or the like housing many stores, the mirror device 100 may be installed on each floor.
Alternatively, one mirror device 1000 may be installed in each store and shared among multiple stores. The number of user terminals 10 and mirror devices may be set arbitrarily depending on the number of stores and users that use the system 1000.

<User Terminal 10>
The user terminal 10 is a terminal used by each user, and is configured by a tablet terminal, a handheld computer device, a wearable terminal, a mobile phone, a smartphone, or the like. The user terminal 10 is also equipped with software, a browser, and the like necessary for using the present system 1000. The user enjoys various services provided by the present system 1000 by operating the software, the browser, and the like. The software may be configured to be installed in the user terminal 10, or may be configured such that some or all of the functions of the software are provided from a management server (not shown) or the like via a communication network N (so-called SaaS (Software as a Service), etc.).

<Mirror device 100>
FIG. 2 is a diagram showing the configuration of the mirror device 100 according to the present embodiment.
1, the mirror device 100 includes a half mirror 101, a display panel 102, a camera 110, a reading device 120, a printer 130, and a computer 140. In addition, the mirror device 100 includes various sound systems including a speaker.

A display panel 102 is disposed behind the half mirror 101.
The half mirror 101 is formed by forming a metal film of, for example, silver or aluminum as a reflective material on a flat transparent substrate of, for example, plastic or glass by sputtering, etc. A semi-transmissive reflective surface 101f that allows a portion of light to pass through is formed on the front side of the half mirror 101.

For example, the half mirror 101 functions as a normal mirror when there is strong external light from the front side, whereas when display light is emitted from a display panel 102 disposed behind the half mirror 101, it functions as a display that projects various images through the half mirror 101. A user can select whether the half mirror 101 functions as a normal mirror or as a display by tapping the half mirror 101.

Therefore, a user positioned in front of the half mirror 101 can use the half mirror 101 as a mirror to check his/her own appearance (i.e., a mirror image).
By using the half mirror 101 as a display, for example, a user image captured of the user or images of recommended fashion items can be viewed.

The display panel 102 is a touch panel display that can be touched via the half mirror 101, and has a display screen 103. The display panel 102 is configured of a self-luminous display panel such as an organic EL display panel. Instead of the self-luminous display panel, a backlight type or a reflective type display panel may be used.

The camera (imaging unit) 110 is, for example, a camera using a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor, and is embedded somewhere in (for example, above) the half mirror 101. The camera 110 captures an image of a user positioned in front of the half mirror 101. The captured image of the user (user image) is output to the computer 140.

The reading device 120 is a reader device that reads information (membership information) contained in a barcode of a user's membership ID and information (product information) stored in an IC tag attached to a product, and is provided, for example, on the outer frame of the mirror device 100. The user's membership information, product information, etc. read by the reading device 120 are output to the computer 140.

The printer 130 is a device that prints various diagnostic results obtained by the mirror device 100, product information read by the reading device 120, and the like, and is built into the mirror device 100, for example.

The computer 140 comprises a control unit 141 equipped with a CPU etc., a storage device 142 consisting of an optical disk device, a semiconductor memory, a hard disk device etc., an input unit 143 consisting of a touch panel etc., and a communication unit 144 consisting of an ISDN modem, an ADSL modem, a cable modem, an optical modem, a soft modem etc. The control unit 141 centrally controls each unit of the computer 140 by executing various programs stored in the storage device 142.

The storage device 142 stores user images of each user captured by the camera 110, an application for making various fashion suggestions (hereinafter, fashion application AP), and various video contents (advertisements, etc.).

The fashion app AP is capable of diagnosing the user's psychological state (mind) by using the mirror device 100, diagnosing the user's fashion type, and proposing recommended fashion items in accordance with the items the user is wearing (worn items). However, these are merely examples, and it is also possible to diagnose, for example, the user's face type and colors that suit the user (so-called personal colors).

<User Management Database DB1>
FIG. 3 is a diagram showing an example of the registered contents of the user management database DB1 stored in the storage device 142. As shown in FIG.
In the user management database DB1, an identification ID and personal information are registered for each user in association with each other. The basic personal information includes the user's name, age, sex, date of birth, address, telephone number, email address, SNS account name, etc., as well as the store ID of the store that the user uses.
Contact information such as your ID, email address, and phone number, and historical information showing your past usage history (
For example, the information includes details of the purchased product and the purchase date, and a user image (a full-body image of the items worn and a face image, etc.) The control unit 141 newly registers and updates (including corrections and deletions) personal information in the user management database DB1.

<Product Management Database DB2>
FIG. 4 is a diagram showing an example of registered contents of the product management database DB2 stored in the storage device 142. As shown in FIG.
In the product management database (storage unit) DB2, an identification ID and product information are registered in association with each other for each fashion item handled by the store.
In addition to the type of product (e.g., tops, pants, shoes, accessories, etc.), color, pattern, size, material, price, etc., the information includes inventory information (e.g., availability at physical stores or online stores, inventory quantity, etc.), trend information (e.g., sales figures to date, user reviews, number of reviews, etc.), shelf position information for products in stock at physical stores (e.g., the shelf position where the product is displayed), type identification information indicating the fashion type (e.g., "denim outfit" if the item is recommended for denim coordination), snapshot images of various people wearing the product, etc. The control unit 141 performs new registration and update (including modification and deletion) of product information in the product management database DB2.
In the above example, all information registered in each database DB1, DB2 is stored in the storage device 142, but the present invention is not limited to this. For example, among the information registered in each database DB1, DB2, personal information of each user (e.g., basic personal information and history information) can be stored in the company's CDP (Customer Data Platform).
) may be used to collect and analyze data from multiple external sources.
The results of the user analysis by P may be used to deliver appropriate information suited to each user (for example, sales information on the user's favorite products).
In addition, the person in charge of maintaining and managing the mirror device 100 may monitor the user's operation status (e.g., whether or not an error has occurred) by using a maintenance function for logs related to personal information and product information installed in a computer. If an error is detected, it is possible to identify and resolve the cause of the error by remote access. In addition, customer attributes and purchasing contributions may be analyzed by tracking (log analysis) logs related to the usage status of each user.

A-2. Various Functions Below, we will explain various functions that are realized by the control unit 141 executing the fashion application AP. As a premise, it is assumed that the user stands in front of the mirror device 100 and touches the display panel 102 through the half mirror 101.

<Mind diagnostic function>
The mind diagnosis function is a function that diagnoses the user's current psychological state (including fortune, etc.), selects fashion items recommended to the user at that time based on the diagnosis results, and presents product information for the selected fashion items.

FIG. 5 is a flowchart showing the mind diagnosis process executed by the control unit 141.
When the user operates the display panel 102 to select the mind diagnosis function, the control unit 1
41 prompts the user to input basic mind information necessary for diagnosing the psychological state (in this case, the user's zodiac sign and the color that the user likes depending on the mood at the time, etc.) (step S101
After acquiring the basic mind information, the control unit (first acquisition unit, mind diagnosis unit) utilizes the installed AI (Artificial Intelligence) to diagnose the user's psychological state at that time (step S102).

As an example, the control unit 141 gives a diagnosis result such as "Today is a day when your intuition will be sharp. Let's be active and energetic!" based on the input basic mind information. The control unit (first selection unit) 141 selects fashion items recommended to the user from among multiple products registered in the product management database DB2 based on such psychological state diagnosis results. More specifically, the control unit 141 first selects fashion items recommended to the user (hereinafter, lucky items) based on the psychological state diagnosis results, and also selects recommended item colors (hereinafter, lucky colors) (step S1
03).

As an example, the control unit 141 selects a "tote bag" as the lucky item and selects "charcoal gray" as the lucky color. The control unit 141 selects product information of a fashion item recommended for the user that matches the selected lucky item and lucky color from the product management database DB2 (step S10).
4). Then, the control unit (display control unit) 141 displays product information IF1 of fashion items recommended for the selected user together with the psychological state diagnosis result on the display panel 102 as shown in Fig. 6 (step S105), and ends the process.

The mind diagnosis function described above not only makes it possible to present each user's psychological state (fortune, etc.), but also makes it possible to suggest recommended fashion items that reflect each user's current psychological state.

(Application example)
Here, when there are multiple pieces of product information of fashion items recommended to the user, the control unit 141 may preferentially display products that are in stock. As described above, each piece of product information includes inventory information (e.g., availability and quantity at a physical store or online store). When selecting product information of fashion items recommended to the user, the control unit (first selection unit) 141 may extract a predetermined number of products (e.g., 10 items) in order from the products that are in stock, and display them on the display panel 102. In this case, the control unit 141 may display the products in order of the number of items in stock, or may display only the products that are in stock.
By removing out-of-stock fashion items from the display, it is possible to eliminate the concern that even if a customer finds a fashion item they like, they may lose interest in purchasing it, along with other fashion items, because it is out of stock and they are unable to purchase it.

In addition, the user using the mind diagnosis function may be able to select as appropriate whether to display only items that are in stock or to display items that are out of stock as well as product information for recommended fashion items.

Furthermore, for products that are in stock at a physical store, the control unit (display control unit) 141 may use shelf position information included in the product information to display where the product is located in the store on a shelf position map. Here, if the mirror device 100 is installed in a shopping mall or the like, the location of the store that handles the product may be displayed on a floor map. In this case, the product information may include floor map information indicating the location of the store that handles the product in stock.

The control unit (first selection unit) 141 may also use not only the inventory information but also trend information to select product information of fashion items recommended to the user. Based on the inventory information and trend information, the control unit 141 may extract a predetermined number of items that are in stock and have high sales (or a large number of user reviews) in descending order, and display them on the display panel 102.
The mirror device 100 is equipped with a so-called favorite registration function. When a user likes a proposed fashion item, the user registers it as a favorite by tapping. If the favorite fashion item is available in a physical store, the user can purchase it on the spot. Even if the physical store does not have the item in stock, the user can purchase it later from an EC (El
You can purchase the fashion items through the Electronic Commerce website.
You can enjoy a new shopping experience like never before.
The application examples described above can be applied not only to the mind diagnosis function, but also to the camera recommendation function and fashion diagnosis function described below.

<Camera recommendation function>
The camera recommendation function is a function that analyzes fashion items (worn items) worn by a user that are photographed by the camera 110, selects matching items or similar items that go well with the worn items based on the analysis results, and presents product information for the selected fashion items.

FIG. 7 is a flowchart showing the camera recommendation process executed by the control unit 141.
When the user selects the camera recommendation function by operating the display panel 102, the control unit 141 uses the camera 110 to capture an image of the entire body of the user standing in front of the half mirror 101 (step S201), and acquires a worn item image representing the items worn by the user (step S202). After acquiring the worn item image, the control unit 141 uses the built-in image recognition AI to analyze the items worn by the user.

More specifically, the control unit 141 first classifies the worn items by type (e.g., pants, jackets, bags, shoes, hats, etc.) based on the images of the worn items of the user (step S203). Then, the control unit (second selection unit) 141 refers to the product management database DB2 and selects matching items and similar items for each classified worn item (step S204). As an example, for the worn item "pants", the control unit 1
The control unit 141 selects "T-shirts" and "tank tops" as matching items and "denim pants" and "trekking pants" of similar materials and colors as similar items. When such a selection is made, the control unit 141 extracts the matching items and similar items selected for each worn item from multiple pieces of product information registered in the product management database DB2.

Then, the control unit (display control unit) 141 displays on the display panel 102, as shown in FIG. 8, product information IF2 of the extracted matching items and similar items for each worn item, together with worn item images representing the items worn by the user (step S205), and ends the processing.

In addition, the user may be able to select which worn item is to have product information of matching items or similar items displayed. For example, when the user selects the mirror device 10
When the user touches 0 to select “pants,” the control unit 141 displays on the display panel 102 product information about matching items and similar items that go well with the item of clothing selected by the user (here, “pants”).

The camera recommendation function described above makes it possible to suggest other coordinations for the items worn by each user when they visited the store, as well as to suggest a wide range of coordinations using products handled by the store.

<Fashion type diagnosis function>
The fashion type diagnosis function is a function that diagnoses a user's preferred fashion type, selects recommended fashion items that match the user's preferred fashion type at that time based on the diagnosis results, and presents product information for the selected fashion items.

FIG. 9 is a flowchart showing the fashion type diagnosis process executed by the control unit 141.
When the user operates the display panel 102 to select the fashion type diagnosis function, the control unit 141 prompts the user to input preference information necessary for determining a preferred fashion type (step S301).

Specifically, the control unit 141 displays on the display panel 102 two coordinated images IF3 of other people (i.e., images of people wearing various fashion items) as shown in FIG.
The control unit (second acquisition unit) 141 repeats the operation of selecting a preferred coordinated image IF3 from two options multiple times (e.g., 10 times) to acquire preference information required to determine the user's preferred fashion type. Note that the multiple coordinated images IF3 are sequentially uploaded from, for example, an external server and stored in the storage device 142.

When the user inputs the preference information, the control unit (fashion diagnosis unit) 141 uses the installed AI to diagnose the user's preferred fashion type at that time (step S302).

For example, the control unit 141 may diagnose that the user's preferred fashion types are "logo T-shirts,""denimoutfits," and "one-tone outfits" based on the input preference information. The types and number of fashion types that can be diagnosed may be preset on the system side.

Based on the result of the fashion type diagnosis, the control unit (third selection unit) 141 selects
From among a plurality of products registered in the product management database DB2, products that match the user's preferred fashion type are selected (step S303). For example, if the user's preferred fashion types are "logo T-shirts,""denimoutfits," and "one-tone outfits," the control unit 141 identifies fashion items from the product management database DB2 that are given type identification information of "logo T-shirts,""denimoutfits," and "one-tone outfits."

Then, the control unit 141 selects the product information of the fashion item to which the specified type identification information is assigned as the product information of the fashion item that matches the user's preferred fashion type (step S304).
As shown in FIG. 1, product information (specifically, a snapshot image) IF4 of the selected fashion item is displayed on the display panel 102 together with the fashion diagnosis result (step S
305) and the process ends.

The above-described fashion diagnostic function allows each user to learn about preferred fashion types that the user himself/herself may not have realized, thereby enabling the user to broaden the scope of his/her own coordination.

The user can use the printer 130 to print out an original diagnostic chart on which his or her own diagnostic results are printed. The diagnostic chart can also be downloaded by reading the QR code (registered trademark) displayed on the display panel 102 with the user terminal 10.

B. Others The present invention is not limited to the above-mentioned embodiment, and can be implemented in various other forms without departing from the scope of the present invention. Therefore, the above-mentioned embodiment is merely an example in every respect, and should not be interpreted as being limited. For example, the above-mentioned processing steps can be arbitrarily changed in order or executed in parallel as long as there is no contradiction in the processing contents. In addition, in the above-mentioned mind diagnosis processing, both the fashion item and the item color recommended to the user are selected, but either one may be selected. Similarly, in the above-mentioned camera recommendation processing, both the matching item and the similar item are selected, but either one may be selected.
In addition, when each user downloads the diagnostic chart data, the mirror device 100
Information on fashion items handled by the store may be distributed using various functions (e.g., ID linking, message sending/receiving function, etc.) installed in the SNS (Social Networking Service). The mirror device 100 may also create an avatar (an alter ego of the user in a virtual space) based on the user image of each user, and make it available for use in a virtual store in the metaverse (virtual space).
In addition, an AR (Augmented Reality) function may be used to create and output a composite image of a user wearing virtual fashion items, etc.
Also, a bone structure diagnosis may be performed based on the user image, and fashion items and coordination methods that suit the user's body line (bones, muscle tone, joint size, etc.) may be suggested. Furthermore, a scent diagnosis may be performed based on the user's psychological state at the time, and a perfume recommended for the user may be suggested, or a scent may be used to create a spatial presentation.
In addition, images or videos of the user trying on clothes captured by the mirror device 100 may be transmitted to the user terminal 10 in response to a request from the user.
In addition, some kind of benefit may be given to a user who has performed each diagnosis using the mirror device 100, such as a coupon that can be used at the store for a limited time (for example, for the same day only). The benefit given to the user may be set or changed depending on the number or type of diagnoses used by the user.

1000...mirror signage system, 10...user terminal, 100...mirror device, 101
. . . Half mirror, 102: display panel, 103: display screen, 110: camera, 120: reading device, 130: printer, 140: computer, 141: control unit, 142: storage device, 143: input unit, 144: communication unit, DB1: user management database, DB2: product management database

Claims (3)

A half mirror having a semi-transmissive reflective surface;
a display panel having a display screen, the display panel being disposed behind the half mirror,
a storage unit that stores a plurality of pieces of product information of fashion items handled by a store , the product information including type identification information representing a fashion type ;
an acquisition unit that acquires preference information necessary for diagnosing a preferred fashion type from a user positioned in front of the half mirror;
A fashion diagnosis unit that uses AI to diagnose the user's preferred fashion type based on the preference information;
a selection unit that selects, based on a diagnosis result of the user's preferred fashion type, from among a plurality of pieces of product information, product information of a fashion item that matches the user's preferred fashion type at the time;
a display control unit that displays product information of fashion items that match the user's preferred fashion type on the display panel;
A mirror device comprising: The storage unit stores a plurality of coordinated images,
The acquisition unit is
The mirror device according to claim 1, wherein the preference information is acquired by presenting two of the coordination images extracted from the plurality of coordination images to the user and repeating an operation of selecting a preferred coordination image by alternative at least a plurality of times. A computer of a mirror device including a half mirror having a semi-transmissive reflective surface and a display panel having a display screen, the display panel being disposed behind the half mirror, the computer including a storage unit for storing a plurality of pieces of product information of fashion item products handled by a store , the product information including type identification information representing a fashion type ;
The computer,
an acquisition unit that acquires preference information necessary for diagnosing a preferred fashion type from a user positioned in front of the half mirror;
A fashion diagnosis unit that uses AI to diagnose the user's preferred fashion type based on the preference information;
a selection unit that selects, based on a diagnosis result of the user's preferred fashion type, from among a plurality of pieces of product information, product information of a fashion item that matches the user's preferred fashion type at the time;
A program for causing the display control unit to function as a display control unit that displays, on the display panel, product information of fashion items that match the user's preferred fashion type .

Images