JP7513578B2 - Information processing device, information processing method, and information processing program - Google Patents

Description

Patent Act Article 30, Paragraph 2 applies https://about. yahoo. co. jp/info/blog/20210913/internalhackday18. html Reference 1. pdf Published on September 13, 2021

The present invention relates to an information processing device, an information processing method, and an information processing program.

Previously, technology has been disclosed that appropriately updates the expected selling price of items owned by users and manages these items as assets. In recent years, as efforts toward a sustainable society into the future have been attracting attention, online services that enable individuals to buy and sell items have become widely used as a way to dispose of personal possessions that are no longer needed.

JP 2020-129225 A

However, with the above-mentioned technology, it is difficult to suggest to a user the appropriate timing to dispose of their possessions. For example, the above-mentioned technology manages the user's possessions as assets by updating the expected selling price of the items owned by the user. However, if the user's possessions are consumables used in daily life, such as fashion items such as clothing, the expected selling price alone is not necessarily the most appropriate information for deciding to dispose of the possessions.

The present application has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can provide a user with information that encourages the user to choose to dispose of their possessions.

The information processing device according to the present application includes an identification unit, a recording unit, and a providing unit. The identification unit identifies used possessions among the possessions based on a captured image of the possessions of the user and information related to the possessions that is registered in advance. The recording unit records the frequency of use of the possessions identified by the identification unit. The providing unit provides suggested information regarding the disposal of the possessions based on the frequency of use of the possessions.

According to one aspect of the embodiment, information can be provided to users to encourage them to choose to dispose of their possessions.

FIG. 1 is a diagram illustrating an example of an information processing system according to an embodiment. FIG. 2 is a diagram for explaining an overview of information processing according to the embodiment. FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. FIG. 4 is a diagram conceptually illustrating an overview of user information stored in the storage information DB according to the embodiment. FIG. 5 is a diagram conceptually illustrating an outline of information stored in the wearing history DB according to the embodiment. FIG. 6 is a diagram conceptually showing an outline of information managed in the image information DB according to the embodiment. FIG. 7 is a flowchart illustrating an example of a processing procedure performed by the information processing device according to the embodiment. FIG. 8 is a diagram showing an example of information processing (part 1) according to the modified example. FIG. 9 is a diagram showing an example of information processing (part 2) according to the modified example. FIG. 10 is a diagram showing an example of information processing according to a third modified example. FIG. 11 is a diagram showing an example of information processing according to a fourth modified example. FIG. 12 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device according to the embodiment.

Below, the information processing device, information processing method, and information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, information processing method, and information processing program according to the present application are not limited to the embodiments described below. Furthermore, the embodiments described below can be appropriately combined as long as they do not cause inconsistencies in the processing content. Furthermore, the same parts in the embodiments described below will be given the same reference numerals, and duplicated explanations will be omitted.

In the following embodiment, an example of information processing will be described in which the information processing device 100 provides an electronic commerce service that allows users to buy and sell fashion items such as clothing online. Note that the information processing described below is not limited to platforms for buying and selling fashion items, but can be similarly applied to various platforms for buying and selling items that users use on a daily basis, such as cosmetics. In addition, in the following description, the terminal device 10 may be referred to as the service user U1. In other words, the service user U1 can be read as the terminal device 10.

[1. Information Processing System]
Fig. 1 is a diagram illustrating an example of an information processing system according to an embodiment. As shown in Fig. 1, the information processing system SYS according to the embodiment includes a terminal device 10 and an information processing device 100. Note that the information processing system SYS is not limited to the example shown in Fig. 1, and may include a plurality of terminal devices 10 and a plurality of information processing devices 100.

The terminal device 10 and the information processing device 100 are each connected to a network N (for example, see FIG. 3) by wire or wirelessly. The network N is a communication network such as a LAN (Local Area Network), a WAN (Wide Area Network), a telephone network (mobile phone network, landline telephone network, etc.), a regional IP (Internet Protocol) network, or the Internet. The network N may include a wired network or a wireless network. The terminal device 10 and the information processing device 100 can communicate with each other through the network N.

The terminal device 10 shown in FIG. 1 is an information processing device used by a service user U1 who uses an e-commerce service for fashion items. For example, the terminal device 10 is realized by a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a PDA (Personal Digital Assistant), etc.

The terminal device 10 can also display information for using e-commerce services for fashion items using a web browser or application. When the terminal device 10 receives control information for implementing information display processing from the information processing device 100 or the like, the terminal device 10 implements the display processing in accordance with the control information.

The information processing device 100 shown in FIG. 1 is an information processing device that executes information processing according to an embodiment in an e-commerce service for fashion items. The information processing device 100 is typically a server device. When the information processing device 100 is realized as a server device, it may be realized by a single server, or may be realized by a cloud system in which multiple server devices and multiple storage devices operate in cooperation with each other. The information processing device 100 may function as a distribution device that distributes control information to a terminal device 10 used by a service user U1. Here, the control information is described in, for example, a script language such as JavaScript (registered trademark) or a style sheet language such as CSS (Cascading Style Sheets). The application itself distributed from the information processing device 100 may be considered as control information.

2. Information Processing
(2-1. Overall processing flow)
An example of information processing in the information processing system SYS will be described below. Note that the information processing device 100 included in the information processing system SYS is not limited to the example described below, and can execute the information processing described below in parallel for any number of terminal devices 10.

As shown in FIG. 1, the information processing device 100 collects user information, such as images of fashion items (an example of "possessions") and purchasing history of fashion items, for each service user U, such as service user U1 and service user U2.

In addition, the information processing device 100 registers information on fashion items owned by each service user U in the storage information DB and image information DB based on the collected user information. For example, the information processing device 100 can extract various information from captured images and purchase history. In addition, the information processing device 100 registers information on fashion items worn by each service user U in the wearing history DB.

The storage information DB stores information such as the category, type, brand, purchase date and time, and image path of the fashion items owned by the service user U for each service user U (an example of "information related to pre-registered possessions"). The image information DB also stores image files of photographed images of the fashion items owned by the service user U for each service user U. The image information DB also stores image files of photographed images (so-called selfies) of the service user U wearing the fashion items for each service user U. The image files stored in the image information DB are registered in association with the image paths stored in the storage information DB and the wearing information DB. The reference images registered in the image information DB may be automatically extracted from the purchase history of the service user U.

In the information processing system SYS shown in FIG. 1, for example, a service user U1 who uses an electronic commerce service for fashion items looks at himself/herself wearing the fashion item in a mirror each time he/she wears the fashion item, and transmits a selfie image (a so-called selfie) taken using the terminal device 10 to the information processing device 100 (step S1).

When the information processing device 100 receives the captured image from the service user U1, it identifies the worn fashion items (an example of "used possessions") that are being used among the fashion items owned by the service user U1 based on the received captured image and the information registered in the storage information DB (step S2).

For example, the information processing device 100 identifies the worn items based on the degree of similarity between reference images of fashion items registered in advance in the image information DB and the selfie image received from the service user U1. Specifically, the information processing device 100 detects the fashion items (e.g., tops, bottoms, shoes, and accessories) shown in the captured image and trims the areas corresponding to the detected fashion items. Next, the information processing device 100 extracts features for each area in which the fashion items are shown in the captured image. The information processing device 100 then uses the extracted features to perform a neighborhood search of the reference images registered in the image information DB, thereby estimating the worn items. In other words, the information processing device 100 searches for the fashion items registered in the image information DB that are most similar to the fashion items detected from the captured image.

In addition, when the information processing device 100 identifies the worn item, it records the number of times the worn item has been worn (an example of "frequency of use") in the wearing history DB (step S3).

For example, the information processing device 100 acquires information such as an item ID linked to the identified worn item from the storage information DB. Next, the information processing device 100 refers to the wearing history DB and acquires the number of times worn that is associated with the item ID acquired from the storage information DB. The information processing device 100 then sets the acquired number of times worn to "+1" as the number of times the worn item has been worn, associates it with the item ID acquired from the storage information DB that is the source of the selfie image, and records it in the wearing history DB. The information processing device 100 also associates the captured image received from the service user U with the service user U and registers it in the image information DB together with the item ID. In this way, the information processing device 100 manages the daily history of worn items for each service user U.

The information processing device 100 also provides suggested information regarding the disposal of the worn item based on the number of times the identified worn item has been worn (step S4).

For example, the information processing device 100 can provide proposal information proposing the sale of a worn item on the condition that the number of times the item has been worn satisfies a predefined condition. Specifically, the information processing device 100 may provide proposal information proposing the sale of a worn item if the number of times the item has been worn exceeds a predefined threshold. Note that the number of times the item has been worn may be the number of times the item has been worn within a specified period, such as the most recent specified period or the same period last year.

The information processing device 100 may also suggest selling the worn item based on conditions that take into account indicators other than the number of times it has been worn. Specifically, the information processing device 100 assesses the remaining value of the worn item based on the time that has elapsed since the purchase of the worn item and the frequency of use. The information processing device 100 may then provide proposal information that suggests selling the worn item based on a comparison result between the assessed value and the estimated selling price of the worn item.

More specifically, the information processing device 100 calculates the value per wearing of the worn item by subtracting the depreciation cost based on the time elapsed since the purchase of the worn item from the purchase price of the worn item, and then dividing the result by the frequency of use. The information processing device 100 then compares the value per wearing of the worn item with the estimated selling price of the worn item, and if the value per wearing of the worn item is lower than the estimated selling price of the worn item, provides proposal information proposing the sale of the worn item.

The information processing device 100 can obtain information on the estimated selling price of the worn item from a linked buying and selling service not shown in FIG. 1. For example, the buying and selling service linked to the information processing device 100 includes a buying and selling service that allows individuals to buy and sell unwanted items online. The estimated selling price of the worn item may be estimated based on the selling price of an item similar to the worn item.

In addition, when providing the service user U with proposal information proposing the sale of a wearable item, the information processing device 100 may obtain the secondhand market price of an item similar to the wearable item, and provide information on the estimated selling price of the wearable item based on the secondhand market price along with the proposal information proposing the sale of the wearable item. The information processing device 100 can obtain information on the secondhand market price of an item similar to the wearable item through a linked buying and selling service, etc.

In addition, when providing information regarding the estimated selling price of a wearable item, the information processing device 100 may provide information regarding the estimated selling price for each buying and selling service through which the wearable item can be sold.

In addition, the information processing device 100 may estimate the expiration date by which the worn item can be used without problems based on information such as the purchase date and time of the worn item, the frequency of use, and the general useful life of the worn item, and provide this to the service user U.

(2-2. Display example of proposed information)
A display example of suggested information provided to the service user U from the information processing device 100 will be described below. Fig. 2 is a diagram showing a display example of suggested information according to an embodiment. The suggested information shown in Fig. 2 is displayed by an application program that provides various functions for the service user U to use an e-commerce service for fashion items. Fig. 2 illustrates an example in which suggested information is displayed on a terminal device 10 used by a service user U1.

As shown in FIG. 2, the terminal device 10 displays on the display 11 a closet window G-1 configured to allow the service user U1 to select fashion items registered in advance by category in response to an operation by the service user U1 (step S11). In the example shown in FIG. 2, content (icons) G11 to G14 are provided for selecting fashion item categories such as "tops," "bottoms," "shoes," and "accessories." FIG. 2 shows an example of a user interface configured to allow the selection of fashion items by category, and the layout and design of the content may be different from the example shown in FIG. 2.

For example, when the service user U1 selects the "Tops" category in the closet window G-1, the terminal device 10 displays on the display 11 an item list window G-2 configured to allow selection of each item stored in the selected "Tops" (step S12). In the item list window G-2, reduced images (thumbnails) G-21 of each item are displayed arranged in predetermined positions that do not overlap with each other. Note that, similar to the example shown in FIG. 2, if the service user U1 selects a category other than "Tops" in the closet window G-1, a list of multiple thumbnails corresponding to each item stored in the selected category is displayed.

For example, when the service user U1 selects one of the thumbnail images G-21 in the item list window G-2, the terminal device 10 displays on the display 11 an item window G-3 that displays detailed information about the item corresponding to the selected thumbnail image G-21 (step S13).

The item window G-3 shown in FIG. 2 includes an item image G-31, the type of item (for example, "Parka (top)") G-32, detailed information G-33 regarding the time of purchase and wearing of the item, forecast information G-34 regarding the item, suggested information G-35 regarding the item, price list information G-36 showing the estimated selling price for each linked buying and selling service, and buttons G-37.

The item image G-31 is displayed based on information preregistered in the image information DB. The item type G-32 is displayed based on information preregistered in the storage information DB. The detailed information G-33 is displayed based on information preregistered in the storage information DB and information recorded in the wearing history DB.

The forecast information G-34 is displayed based on the results of the information processing by the information processing device 100 described above. The proposal information G-35 is displayed based on the results of the information processing by the information processing device 100 described above. The price list information G-36 is displayed, for example, based on the secondhand market price of the wearable item obtained from the linked buying and selling service. In the example shown in FIG. 2, service SA, service SB, and service SC are displayed as linked buying and selling services. Also, in the example shown in FIG. 2, radio buttons are provided in association with each buying and selling service for selecting one of the multiple buying and selling services. The button G-37 is a GUI (Graphical User Interface) component that the service user U selects and automatically accesses the website of the linked buying and selling service in response to the operation of the service user U.

The terminal device 10 executes an application program provided by the information processing device 100 to switch between windows in response to the operation of the service user U and obtain information to be displayed in each window. By displaying the item window G-3, the service user U can check the suggested information displayed in the item window G-3 and obtain useful information for considering the timing of disposing of the worn item. For example, in the example shown in FIG. 2, the deadline by which the fashion item can be worn without problems: "2021/7/26" is provided to the service user U1 as predicted information G-34 as a prediction of when it can be worn, and the suggested information G-35 of "It's about time to let it go" is provided to the service user U1. In addition, in the example shown in FIG. 2, information on the estimated selling price for each linked buying and selling service is provided to the service user U1. This allows the information processing device 100 to encourage the service user U1 to make a decision.

The proposed information provided to the service user U from the information processing device 100 does not need to be particularly limited as long as it is displayed in the item window G-3 after going through the window transitions shown in FIG. 2. For example, when the information processing device 100 receives a captured image from the service user U, it may directly display the item window G-3 reflecting the proposed information on the display 11 of the terminal device 10.

In addition, when displaying the item list window G-2, the information processing device 100 may change the display mode of items (thinned images) for which suggested information has been issued to a display mode different from that of items (thinned images) for which suggested information has not been issued. For example, the information processing device 100 can differentiate an item for which suggested information has been issued from other items by thickening the frame of the item, enlarging the display size, overlaying an arbitrary mark, or the like. In this way, the service user U can recognize items for which suggested information has been issued and easily select them as necessary, without having to display the item windows G-3 in sequence.

3. Configuration of information processing device
The configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device according to the embodiment.

As shown in FIG. 3, the information processing device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. Note that FIG. 3 shows an example of the configuration of the information processing device 100, and is not limited to the form shown in FIG. 3, and may include other functional units than those shown in FIG. 3.

(Communication unit 110)
The communication unit 110 is connected to a network N, for example, by wire or wirelessly, and transmits and receives information to and from other devices, such as the terminal device 10, via the network N. The communication unit 110 is realized by, for example, a network interface card (NIC) or an antenna. The network N is a communication network, such as a local area network (LAN), a wide area network (WAN), a telephone network (such as a mobile phone network or a landline telephone network), a regional Internet Protocol (IP) network, or the Internet. The network N may include a wired network or a wireless network.

The communication unit 110 receives information such as captured images from the terminal device 10. The communication unit 110 also transmits proposal information to the terminal device 10.

(Memory unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 stores programs and data for realizing information processing executed by each part of the control unit 130.

As shown in FIG. 3, the memory unit 120 has a storage information DB 121, a wearing history DB 122, and an image information DB 123.

(Storage information DB121)
The storage information DB 121 stores, in an arbitrary format, information on fashion items owned by the service user U for each service user U. The information on fashion items stored in the storage information DB 121 is stored by the service user U through an initial registration operation at the time of starting to use the service, for example.

In addition, the information on fashion items stored in the storage information DB 121 may be registered in an external storage server that is provided separately from the information processing device 100. Figure 4 is a conceptual diagram showing an overview of user information stored in the storage information DB according to the embodiment.

As shown in FIG. 4, the information about fashion items stored in storage information DB121 includes multiple items such as "user ID," "item ID," "category," "type," "brand," "purchase date and time," "purchase price," and "image path." These items included in the information about fashion items stored in storage information DB121 are associated with each other.

The "User ID" field stores identification information that is individually assigned to each service user U in order to identify the service user U. In addition, the "Item ID" field stores identification information that is individually assigned to each fashion item in order to identify the fashion items owned by the service user U.

The "Category" field stores information for grouping fashion items, such as "tops" and "bottoms." The "Type" field stores information for specifying in detail the fashion items grouped into each category, such as parkas, shirts, trousers, and shorts.

The "Brand" section stores information such as symbols, names, and trademarks that identify fashion items, such as designer brands, corporate brands, factory brands, and original brands.

In addition, the "Purchase Date and Time" field stores information indicating the date and time when the corresponding fashion item was purchased. In addition, the "Purchase Price" field stores information indicating the purchase price of the corresponding fashion item.

The "Image Path" field also stores path information indicating the storage location in image information DB 123 where the image file of the corresponding fashion item is stored.

In this way, the storage information DB 121 manages information about each fashion item owned by each service user U. The information processing device 100 can display the item list window G-2 on the terminal device 10 based on the information preregistered in the storage information DB 121.

(Wearing history DB122)
The wearing history DB 122 stores information (wearing history) on daily worn items in any format for each service user U. The information stored in the wearing history DB 122 may be registered in an external storage server provided separately from the information processing device 100. Fig. 5 is a diagram conceptually illustrating an overview of information stored in the wearing history DB according to the embodiment.

As shown in FIG. 5, the information stored in the wearing history DB 122 has multiple items such as "user ID," "item ID," "number of times worn," "wearing date and time," and "image path." These items of the information stored in the wearing history DB 122 are associated with each other.

The "User ID" field corresponds to the "User ID" field shown in FIG. 4. That is, the "User ID" field stores identification information that is individually assigned to each service user U. For example, the identification information stored in the "User ID" field is acquired together with a selfie image taken by the service user U1 using the terminal device 10 while looking in a mirror after wearing the fashion item.

The "item ID" field corresponds to the "item ID" field shown in FIG. 4. That is, the "item ID" field stores identification information that is individually assigned to each fashion item in order to identify the fashion item owned by the service user U. For example, the identification information stored in the "item ID" field is obtained from the storage information DB 121 in conjunction with the identification of the worn item.

In addition, the "number of times worn" field stores information on the number of times worn, which indicates how often the fashion item is used. The information on the number of times worn stored in the "number of times worn" field is updated based on the item ID associated with the worn item identified from the selfie image of the service user U.

In addition, the "Date and time of wearing" field stores information about the last date and time the fashion item was worn. For example, the date and time of receiving a selfie image of the service user U is used as the last date and time information stored in the "Date and time of wearing" field.

The "image path" item corresponds to the "image path" item shown in FIG. 4. That is, the "image path" item stores path information indicating the storage location in image information DB 123 where the image file of the selfie image of service user U is stored.

(Image information DB 123)
The image information DB 123 stores image information on the fashion items of the service user U in an arbitrary format for each service user U. Note that the image information stored in the image information DB 123 may be registered in an external storage server provided separately from the information processing device 100. Fig. 6 is a diagram conceptually illustrating an overview of information managed in the image information DB according to the embodiment.

As shown in FIG. 6, the information managed in the image information DB 123 has a "user ID" field and an "image path" field that are associated with each other. In addition, although not shown in FIG. 6, the image information DB 123 stores image files of images acquired from the service user U.

The "User ID" item corresponds to the "User ID" item shown in Figures 4 and 5. That is, the "User ID" item stores identification information that is individually assigned to each service user U.

The "Image Path" item corresponds to the "Image Path" item shown in Figures 4 and 5. That is, the "Image Path" item stores path information indicating the storage location of the image file of the fashion item image sent by the service user U upon the initial registration operation, and path information indicating the storage location of the image file of the service user U's selfie image. The image information DB123 is linked to the storage information DB121 and the wearing history DB122 through the identification information stored in the "User ID" item and the path information stored in the "Image Path" item.

(Control unit 130)
The control unit 130 is a controller that controls the information processing device 100. The control unit 130 is realized by executing various programs (e.g., information processing programs) stored in a storage device inside the information processing device 100 using a RAM as a working area by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), or the like. The control unit 130 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 3, the control unit 130 has an identification unit 131, a recording unit 132, and a provision unit 133. The control unit 130 realizes or executes the information processing functions and actions described below using each of these units. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 3, and may be other configurations that perform the information processing described below. Also, the connection relationships between the units of the control unit 130 are not limited to the connection relationships shown in FIG. 3, and may be other connection relationships.

(Identification unit 131)
The identification unit 131 identifies the used belongings among the belongings based on the captured image of the user's belongings and the information on the belongings registered in advance. For example, the identification unit 131 identifies the worn item based on the similarity between the reference image of the fashion item registered in advance in the image information DB 123 and the captured selfie image received from the service user U.

Specifically, the identification unit 131 detects fashion items (e.g., tops, bottoms, shoes, and accessories) that appear in the captured image, and trims the areas that correspond to the detected fashion items. Next, the identification unit 131 extracts features for each area in which the fashion items appear in the captured image. The features may be low-level features that learn colors and textures, category features that learn categories, area aspect ratios, etc., or may be integrated features that integrate these features.

Then, the identification unit 131 uses the extracted feature amount to estimate the worn items by performing a neighborhood search of the reference image registered in the image information DB 123. That is, the identification unit 131 identifies the worn items of the service user U by searching for the item most similar to the fashion item detected from the captured image from among the fashion items registered in the image information DB 123.

The identification unit 131 may identify the possessions to be used based on the similarity between the captured image and a reference image of the possessions that is automatically registered from the user's purchasing history. For example, a reference image of a fashion item that is pre-registered in the image information DB 123 may be automatically registered from the purchasing history of the service user U.

The identification unit 131 acquires information on the identified worn item from the storage information DB 121 and passes the acquired information to the recording unit 132. For example, the identification unit 131 acquires an item ID linked to the identified worn item from the storage information DB 121. The identification unit 131 then passes the user ID of the service user U who sent the selfie image to the recording unit 132, together with the item ID acquired from the storage information DB 121.

(Recording Unit 132)
The recording unit 132 records the frequency of use of the used possession identified by the identification unit 131. For example, the recording unit 132 records in the wearing history DB 122 the item ID acquired from the identification unit 131 and the number of times the worn item has been worn, in association with the user ID acquired from the identification unit 131.

Specifically, the recording unit 132 refers to the wearing history DB 122 and obtains the number of times the item has been worn that is associated with the item ID obtained from the identification unit 131. Next, the recording unit 132 increments the obtained number of times the item has been worn by "+1". Next, the recording unit 132 records the item ID and the number of times the item has been worn in the wearing history DB 122 in association with the user ID obtained from the identification unit 131. The recording unit 132 also registers the selfie image and item ID received from the service user U in the image information DB 123 in association with the user ID.

(Providing Unit 133)
The providing unit 133 provides proposal information regarding the disposal of the used possessions based on the frequency of use of the used possessions. For example, the providing unit 133 can provide proposal information proposing the sale of the worn item on the condition that the number of times of wearing satisfies a predetermined condition. Specifically, the providing unit 133 may provide proposal information proposing the sale of the worn item when the number of times of wearing exceeds a predetermined threshold. Note that the number of times of wearing may be the number of times of wearing within a predetermined period, such as the most recent predetermined period or the same period last year.

The providing unit 133 may also suggest selling the worn item based on conditions that take into account indicators other than the number of times the item has been worn. Specifically, the providing unit 133 assesses the remaining value of the worn item based on the time that has elapsed since the purchase of the worn item and the frequency of use. The providing unit 133 may then provide proposal information that suggests selling the worn item based on the results of comparing the assessed value with the estimated selling price of the worn item.

More specifically, the providing unit 133 calculates the value of each time the worn item is worn by subtracting the depreciation cost based on the time elapsed since the purchase of the worn item from the purchase price of the worn item, and then dividing the result by the frequency of use. Note that the depreciation cost based on the time elapsed of the worn item can be calculated by any method using, for example, ministerial ordinances regarding the useful life of depreciable assets.

The providing unit 133 then compares the value of the worn item per wear with the estimated selling price of the worn item, and if the value of the worn item per wear is lower than the estimated selling price of the worn item, provides proposal information proposing the sale of the worn item. Note that information on the estimated selling price of the worn item can be acquired, for example, from a buying and selling service with which the information processing device 100 is linked. The buying and selling service with which the information processing device 100 is linked includes a buying and selling service that enables the buying and selling of unwanted items between individuals online. The estimated selling price of the worn item may be estimated based on the selling price of an item similar to the worn item.

Furthermore, when providing the service user U with proposal information proposing the sale of the wearable item, the providing unit 133 may obtain the secondhand market price of an item similar to the wearable item, and provide information on the estimated selling price of the wearable item based on the secondhand market price along with the proposal information proposing the sale of the wearable item. For example, the providing unit 133 may obtain information on the secondhand market price of an item similar to the wearable item through a linked buying and selling service, and adopt the median of the obtained secondhand market prices as the estimated selling price. Furthermore, when the providing unit 133 obtains information on the secondhand market price of an item similar to the wearable item from multiple buying and selling services, it may adopt the median of the secondhand market price in each buying and selling service as the estimated selling price.

When providing information regarding the estimated selling price of a wearable item, the providing unit 133 may provide information regarding the estimated selling price for each buying and selling service through which the wearable item can be sold. In this case, the median secondhand market price for each buying and selling service may be calculated and used as the estimated selling price for each buying and selling service, or the minimum and maximum prices for each buying and selling service may be provided as they are.

In addition, the providing unit 133 may estimate the expiration date until which the worn item can be used without problems based on information such as the purchase date and time of the worn item, frequency of use, and general useful life of the worn item (for example, ministerial ordinance regarding the useful life of depreciable assets, etc.), and provide this to the service user U.

4. Processing Procedure
Hereinafter, a processing procedure by the information processing device 100 according to the embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of a processing procedure by the information processing device according to the embodiment. The processing procedure shown in Fig. 7 is executed by the control unit 130 of the information processing device 100. The processing procedure shown in Fig. 7 is repeatedly executed while the information processing device 100 is in operation.

As shown in FIG. 7, the identification unit 131 acquires a selfie image of the user wearing the fashion item (step S101).

Next, the identification unit 131 identifies the worn item based on the acquired captured image (step S102).

Next, the recording unit 132 records the number of times the worn item has been worn in the wearing history DB 122 (step S103).

Then, the providing unit 133 provides suggested information regarding the disposal of the worn item based on the number of times the identified worn item has been worn (step S104), and ends the processing procedure shown in FIG. 7.

5. Modifications
The above-described information processing device 100 may be implemented in various different forms other than the above-described embodiment. Therefore, modifications of the embodiment will be described below.

(5-1. Providing suggested information based on appearance characteristics)
In the above-described embodiment, the information processing device 100 may provide suggested information regarding the disposal of fashion items based on the appearance characteristics of the service user U. Fig. 8 is a diagram showing an example of information processing (part 1) according to a modified example.

As shown in FIG. 8, the identification unit 131 identifies the external characteristics of the service user U1 from the photographed image acquired from the service user U (step S21). The external characteristics include skin color, eye color, hair color, bone structure, etc. Next, the provision unit 133 provides the service user U1 with suggested information regarding the disposal of fashion items based on the external characteristics of the service user U1 identified by the identification unit 131 (step S22).

For example, the providing unit 133 acquires image files of self-portrait images stored in the image information DB 123, and scores the degree of harmony with the external features of the service user U1 for each fashion item. Specifically, the providing unit 133 can score the degree of harmony with the fashion items using the results of a personal color diagnosis or bone structure diagnosis of the service user U1. The providing unit 133 then extracts fashion items whose scored harmony degree is less than a predetermined threshold value, and provides proposal information proposing the sale of the extracted fashion items. In addition, the providing unit 133 can provide information on the reference selling price of the items proposed for sale together with the proposal information, as shown in FIG. 8.

(5-2. Providing information proposing alternative products)
Furthermore, the information processing device 100 may also suggest alternative items when providing suggestion information for suggesting the disposal of a fashion item. Fig. 9 is a diagram showing an example of information processing (part 2) according to a modified example. Fig. 9 shows an example in which the content is partially different from the information processing (part 1) shown in Fig. 8.

As shown in FIG. 9, the identification unit 131 identifies the external characteristics of the service user U1 from the captured image acquired from the service user U1, similar to step S21 shown in FIG. 8 (step S31). Next, when providing the service user U1 with suggested information regarding the disposal of a fashion item based on the external characteristics of the service user U1 identified by the identification unit 131, the provision unit 133 also provides the service user U1 with substitute information regarding a substitute (step S32). The substitute information is, for example, information that suggests a fashion item that matches the external characteristics of the service user U1 instead of the fashion item proposed to be disposed of. Although not shown in FIG. 9, the information processing device 100 may also provide information on a reference selling price of the item proposed to be sold, similar to the example shown in FIG. 8.

(5-3. Providing suggested information based on service user trends)
The information processing device 100 may provide suggested information regarding the disposal of fashion items based on the tendency of the service user U. For example, the tendency of the service user U may be a tendency to wear fashion items. Fig. 10 is a diagram showing an example of information processing according to a modified example (part 3).

The identification unit 131 identifies the tendency of the service user U1 based on the information stored in the wearing history DB 122 and the image file (an example of a "use history related to the use of possessions") stored in the image information DB 123 (step S41). For example, the identification unit 131 identifies the wearing tendency of the service user U1 by analyzing the item types that are frequently worn and the item types that are not often worn for each fashion item category.

Next, the providing unit 133 provides the service user U1 with suggested information based on the tendency of the service user U1 identified by the identifying unit 131 (step S42). For example, the providing unit 133 provides suggested information proposing the sale of a fashion item that does not match the wearing tendency of the service user U1 (that is, is worn relatively infrequently).

In addition, the information processing device 100 may, for example, identify trends in coordinating fashion items and provide suggested information that suggests modifying coordination that does not match the external characteristics of the service user U1.

In addition, the information processing device 100 may, for example, periodically update the wearing trends of fashion items, and when a significant change in the wearing trends is detected, provide suggested information according to the new wearing trends of the service user U1.

(5-4. Providing suggested information according to the genre set by the service user)
Furthermore, the information processing device 100 may provide suggested information according to a genre setting of a fashion style received from the service user U1. Fig. 11 is a diagram showing an example of information processing according to a fourth modified example.

For example, as shown in FIG. 11, the terminal device 10 accepts a fashion style genre setting (e.g., "smart casual") from the service user U1 and transmits the accepted genre information to the information processing device 100 (step S51).

Meanwhile, the information processing device 100 provides the service user U1 with suggested information according to the genre set by the service user U1 (step S52). For example, as shown in FIG. 11, the information processing device 100 can provide the service user U1 with suggested information based on the genre set by the service user U1, including information on recommended items for sale that suggest the sale of fashion items that do not match the set genre, as well as information on recommended items for purchase that recommend the purchase of fashion items that match the set genre.

In addition, as shown in FIG. 11, when providing proposal information, the information processing device 100 can also provide information on the reference selling price of the recommended selling item, information on the reference purchasing price of the recommended purchasing item, and information on the actual cost of selling the recommended selling item and purchasing the recommended purchasing item.

6. Hardware Configuration
The information processing device 100 according to the embodiment is realized, for example, by a computer 1000 having a configuration as shown in Fig. 12. Fig. 12 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device according to the embodiment.

The computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which a calculation device 1030, a primary storage device 1040, a secondary storage device 1050, an output IF (Interface) 1060, an input IF 1070, and a network IF 1080 are connected by a bus 1090.

The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and the secondary storage device 1050, and programs read from the input device 1020, and executes various processes. The primary storage device 1040 is a memory device, such as a RAM, that primarily stores data used by the arithmetic device 1030 for various calculations. The secondary storage device 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), HDD, flash memory, etc.

The output IF 1060 is an interface for transmitting information to be output to an output device 1010 such as a monitor or printer, which outputs various types of information, and is realized, for example, by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (registered trademark) (High Definition Multimedia Interface). The input IF 1070 is an interface for receiving information from various input devices 1020 such as a mouse, keyboard, scanner, etc., and is realized, for example, by a USB.

The input device 1020 may be a device that reads information from, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. The input device 1020 may also be an external storage medium such as a USB memory.

The network IF 1080 receives data from other devices via the network N and sends it to the computing device 1030, and also transmits data generated by the computing device 1030 to other devices via the network N.

The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

For example, when the computer 1000 functions as the information processing device 100, the arithmetic device 1030 of the computer 1000 executes a program (e.g., an information processing program) loaded onto the primary storage device 1040, thereby realizing functions similar to those of the control unit 130. That is, the arithmetic device 1030 cooperates with the program (e.g., an information processing program) loaded onto the primary storage device 1040 to realize the processing by the information processing device 100 according to the embodiment.

[7. Other]
Of the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the process procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

In the above-described embodiment, in order to realize the information processing method (for example, see FIG. 7) by the information processing device 100, the processing functions corresponding to each part (identification unit 131, recording unit 132, and provision unit 133) of the control unit 130 possessed by the information processing device 100 may be realized as an add-on to an information processing program pre-installed in the information processing device 100, or may be realized by flexibly writing it as a dedicated information processing program using a lightweight programming language, etc.

The information processing device 100 may also collect, as information on the service users U, the history of search queries entered by each service user U, the purchase history of each user, the history of transaction objects viewed in the online shopping mall, the purchase history which is the history of transaction objects purchased, the browsing history which is the history of content such as news viewed, the posting history which is the history of texts and images posted on SNS (Social Networking Service), the location history, and the like. In addition, the information processing device 100 may also collect, for example, the usage history of a payment service realized by reading a QR code (registered trademark) installed in a store using a smartphone owned by the service user U and using the reading result, or the usage history of a payment service realized by displaying a QR code on the smartphone owned by the service user U and reading the QR code with a store terminal (for example, the purchase date and time, purchased products, purchase amount, etc.). In addition, the information processing device 100 may also collect the usage history of a credit card and bank account owned by the service user U.

The information processing device 100 may also use information estimated based on the collected information as information about the service user U. For example, if the average total monthly purchase amount for groceries is 100,000 yen or more from the purchase history, the information processing device 100 may estimate, for example, the monthly household income or monthly individual income of 300,000 yen or more, the family structure such as a family of three, or the composition of cohabitants, and use this information as information about the service user U. The information processing device 100 may also use, for example, location history and purchase history to estimate the items owned by the service user U, the place of residence and workplace of the service user U, and use the estimated information as information about the service user U.

In addition, the information processing device 100 may acquire, for example, a service usage history from a server device that provides various services as information about the service user U. Furthermore, the information processing device 100 may collect, as information about the service user U, various pieces of information that a server device that provides such services or a single server device estimates from the service usage history. Furthermore, the information processing device 100 may collect, as information about the service user U, information indicating various geographic attributes and psychographic attributes such as hobbies and preferences that have been registered by the service user U or estimated about the service user U.

In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution/integration of each device is not limited to that shown in the figure, and all or part of it can be functionally or physically distributed/integrated in any unit depending on various loads, usage conditions, etc. For example, the identification unit 131 and recording unit 132 of the control unit 130 may be functionally integrated.

The above-mentioned embodiments and variations can be combined as appropriate to the extent that they do not cause inconsistencies in the processing content.

[8. Effects]
The information processing device 100 according to the embodiment described above includes an identification unit 131, a recording unit 132, and a providing unit 133. The identification unit 131 identifies a used possession that has been used among the possessions, based on a captured image of the possessions of the user and information related to the possessions that is registered in advance. The recording unit 132 records the frequency of use of the used possession identified by the identification unit 131. The providing unit 133 provides suggested information regarding the disposal of the used possession, based on the frequency of use of the used possession.

For this reason, the information processing device 100 according to the embodiment can suggest to the user the appropriate timing for disposing of possessions by providing various useful information for considering the timing of disposing of the possessions.

In addition, in the information processing device 100 according to the embodiment, the captured image is a selfie image taken by the user wearing a fashion item that the user owns. This allows the information processing device 100 to obtain a captured image from which the category or type of the fashion item can be easily identified.

In addition, in the information processing device 100 according to the embodiment, the identification unit 131 identifies the possession to be used based on the similarity between a reference image of the possession registered in advance and the captured image.

In addition, in the information processing device 100 according to the embodiment, the identification unit 131 identifies the possessions being used based on the similarity between the captured image and a reference image of the possessions that is automatically registered from the user's purchasing history.

As a result, the information processing device 100 can identify the possessions being used using captured images that can be easily obtained by the user, lowering the psychological barrier for users to using the service.

In addition, in the information processing device 100 according to the embodiment, the providing unit 133 provides proposal information proposing the sale of a used possession, on the condition that the frequency of use satisfies a predefined condition. This allows the information processing device 100 to propose the sale of a used possession based on a simple indicator showing the deterioration of the possession.

In addition, in the information processing device 100 according to the embodiment, the providing unit 133 obtains the second-hand market price of a similar item to the used possession, and provides information on the estimated selling price of the used possession based on the second-hand market price together with the proposal information proposing the sale of the used possession.

In addition, in the information processing device 100 according to the embodiment, the providing unit 133 provides information regarding the estimated selling price for each buying and selling service through which the used possessions can be sold.

In this way, the information processing device 100 can provide information that may motivate users to dispose of their possessions.

In addition, in the information processing device 100 according to the embodiment, the providing unit 133 assesses the remaining value of the used possession based on the time elapsed since the purchase of the used possession and the frequency of use, and provides proposal information proposing the sale of the used possession based on the comparison result between the assessed value and the estimated selling price of the used possession. This allows the information processing device 100 to propose the sale of the used possession based on the objective value.

In addition, in the information processing device 100 according to the embodiment, the identification unit 131 identifies the external characteristics of the user from the captured image, and the provision unit 133 provides suggested information based on the external characteristics.

In addition, in the information processing device 100 according to the embodiment, the identification unit 131 identifies the user's tendencies based on the usage history of the usage of the possessions, and the provision unit 133 provides suggested information based on the user's tendencies.

This allows the information processing device 100 to suggest the sale of used possessions according to the context, such as the user's personality and potential preferences.

In addition, in the information processing device 100 according to the embodiment, the providing unit 133 provides information regarding suggestions for substitutes for used possessions. This allows the information processing device 100 to realize a sustainable service that circulates items through a series of steps, such as purchase, use, review, and sale.

The above describes the embodiments of the present application in detail with reference to several drawings, but these are merely examples, and the present invention can be embodied in other forms with various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the disclosure section of the invention.

The above-mentioned "section, module, unit" can be read as "means" or "circuit." For example, a control unit can be read as a control means or a control circuit.

REFERENCE SIGNS LIST 10 Terminal device 100 Information processing device 110 Communication unit 120 Storage unit 121 Storage information DB
122 Wearing history DB
123 Image Information DB
130 Control unit 131 Identification unit 132 Recording unit 133 Provision unit

Claims (10)

an identification unit that identifies a worn item, which is a fashion item worn by the user, based on a similarity between a photographed image, which is a selfie image taken by the user wearing a fashion item owned by the user, and a reference image of the fashion item that is registered in advance;
a recording unit that records the number of times the wear item is identified by the identification unit as the number of times the wear item is worn;
a providing unit that provides the user with suggested information regarding the disposal of the worn item on condition that the number of times the worn item has been worn satisfies a predetermined condition. The identification unit is
The information processing apparatus according to claim 1 , wherein the worn item is identified based on a similarity between a reference image of the fashion item that is automatically registered from the purchase history of the user and the photographed image. The providing unit is
The information processing device according to claim 1 or 2, further comprising: providing the user with the proposal information proposing the sale of the worn item on condition that the number of times the item has been worn satisfies a predetermined condition. The providing unit is
The information processing device according to claim 3, further comprising: obtaining second-hand market prices of items similar to the worn item; and providing the user with information regarding an estimated selling price of the worn item based on the second-hand market prices, along with the proposal information proposing the sale of the worn item. The providing unit is
The information processing device according to claim 4 , further comprising: providing the user with information regarding the estimated selling price for each buying and selling service in which the wear item can be sold. The providing unit is
The information processing device according to any one of claims 3 to 5, characterized in that the remaining value of the worn item is assessed based on the time elapsed since the purchase of the worn item and the number of times the worn item has been worn, and the proposal information proposing the sale of the worn item is provided to the user based on a comparison result between the assessed value and an estimated selling price of the worn item. The identification unit is
Using the captured image, a degree of harmony between the appearance features of the user and the worn item is scored;
The providing unit is
The information processing device according to any one of claims 1 to 6, characterized in that the suggestion information proposing disposal of the wearing item for which the harmony degree scored by the identification unit is less than a predetermined threshold is provided to the user. The identification unit is
Identifying a wearing trend indicating a tendency of the type of the wearing item worn by the user based on information about the wearing item stored daily for the user;
The providing unit is
The information processing device according to any one of claims 1 to 6, characterized in that the suggestion information proposing disposal of the wear items of the type that do not match the wear trends based on the wear trends is provided to the user. 1. A computer-implemented information processing method, comprising:
an identification step of identifying a worn item, which is a fashion item worn by the user, based on a similarity between a photographed image, which is a selfie image taken by the user wearing the fashion item owned by the user, and a reference image of the fashion item registered in advance;
a recording step of recording the number of times the worn item is identified by the identification step as the number of times the fashion item is worn;
and a providing step of providing the user with suggested information regarding the disposal of the fashion item, on condition that the number of times the fashion item has been worn satisfies a predetermined condition. On the computer,
an identification step of identifying a worn item, which is a fashion item worn by the user, based on a similarity between a photographed image, which is a selfie image taken by the user wearing a fashion item owned by the user, and a reference image of the fashion item registered in advance;
a recording step of recording the number of times the worn item is identified by the identification step as the number of times the fashion item is worn;
and a provision step of providing the user with suggested information regarding the disposal of the fashion item on condition that the number of times the fashion item has been worn satisfies a predetermined condition.

Images