JP2023060906A - Information processing device, information processing method and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To recommend art based on fashion.

SOLUTION: An information providing device includes a collection part for collecting fashion information of a user, a calculation part for calculating a combination of fashion of the user and art work based on the user's fashion information, and a provision part for providing art work according to the fashion of the user based on the combination of the fashion of the user and the art work. Alternatively, the collection part collects the user's fashion information and space information relating to a space where the user wears a fashion item. The calculation part calculates a combination of the fashion of the user according to spaces and art work based on the user's fashion information and space information.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

A technique is known for providing a user with an art work that is suitable for the location and purpose of installation, and the mood and taste of the user.

Japanese Patent No. 6799342

However, the prior art described above focuses on providing an art piece for viewing. In other words, the above-described prior art is a means of providing when the art work itself is the leading role (center). Art works are sometimes used as backgrounds and accessories when taking pictures of people. In addition, in the living environment, etc., art works may be selected based on a common theme with the user's fashion. In this way, when the art work itself is not the leading role, and the art work is used together with the fashion items worn by the user, it is necessary to consider the harmony with the fashion items and coordination, the balance as a whole, and the like.

The present application has been made in view of the above, and aims to recommend art based on fashion.

An information processing apparatus according to the present application includes a collection unit that collects user's fashion information, a calculation unit that calculates a combination of the user's fashion and art work based on the user's fashion information, and a user's fashion and art. and a providing unit that proposes an art work according to the user's fashion based on the combination with the work.

According to one aspect of an embodiment, fashion-based art can be recommended.

FIG. 1 is an explanatory diagram showing an outline of an information processing method according to an embodiment. FIG. 2 is a diagram illustrating a configuration example of an information processing system according to the embodiment; FIG. 3 is a diagram illustrating a configuration example of a terminal device according to the embodiment; FIG. 4 is a diagram illustrating a configuration example of an information providing apparatus according to the embodiment; FIG. 5 is a diagram showing an example of a user information database. FIG. 6 is a diagram showing an example of the history information database. FIG. 7 is a diagram showing an example of a recommendation information database. FIG. 8 is a flow chart showing a processing procedure according to the embodiment. FIG. 9 is a diagram illustrating an example of a hardware configuration;

Embodiments for implementing an information processing apparatus, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail below with reference to the drawings. The information processing apparatus, information processing method, and information processing program according to the present application are not limited to this embodiment. Also, in the following embodiments, the same parts are denoted by the same reference numerals, and overlapping descriptions are omitted.

[1. Outline of information processing method]
First, an outline of an information processing method performed by an information processing apparatus according to an embodiment will be described with reference to FIG. FIG. 1 is an explanatory diagram showing an outline of an information processing method according to an embodiment. Note that in FIG. 1, a case where art (real art, digital art) is recommended based on the user's fashion information will be described as an example.

As shown in FIG. 1 , the information processing system 1 includes a terminal device 10 and an information providing device 100 . The terminal device 10 and the information providing device 100 are communicably connected to each other by wire or wirelessly via a network N (see FIG. 2). In this embodiment, the terminal device 10 cooperates with the information providing device 100 .

The terminal device 10 is a smart device such as a smartphone or tablet used by a user U (user), and communicates with an arbitrary server device via a wireless communication network such as 4G (Generation) or LTE (Long Term Evolution). It is a portable terminal device capable of performing The terminal device 10 has a screen such as a liquid crystal display and has a touch panel function. Accepts various operations for . An operation performed on an area where content is displayed on the screen may be an operation on the content. In addition, the terminal device 10 may be an information processing device such as a desktop PC (Personal Computer) or a notebook PC as well as a smart device.

The information providing device 100 cooperates with the terminal device 10 of each user U, and provides the terminal device 10 of each user U with API (Application Programming Interface) services for various applications (hereinafter referred to as apps) and various It is an information processing device that provides data, and is realized by a server device, a cloud system, or the like.

Also, the information providing device 100 may be an information processing device that provides some web service online to the terminal device 10 of each user U. FIG. For example, the information providing apparatus 100 provides, as Web services, Internet connection, search service, SNS (Social Networking Service), electronic commerce (EC), fashion coordination (pictures (still images) and videos of wearing fashion items). Posting sites, electronic payments, online games, online banking, online trading, accommodation/ticket reservations, video/music distribution, news, maps, route searches, route guidance, route information, operation information, weather forecasts, etc. may be provided. In practice, the information providing apparatus 100 may cooperate with various servers that provide web services as described above, mediate web services, or take charge of web service processing.

Note that the information providing device 100 can acquire user information about the user U. FIG. For example, the information providing device 100 acquires information about attributes of the user U, such as the user's U gender, age, and area of residence. The information providing apparatus 100 stores and manages identification information indicating the user U (user ID, etc.) and information related to the attributes of the user U. FIG.

Further, the information providing apparatus 100 acquires various types of history information (log data) indicating actions of the user U from the terminal apparatus 10 of the user U or from various servers based on the user ID or the like. For example, the information providing device 100 acquires a location history, which is a history of the user U's location and date and time, from the terminal device 10 . The information providing apparatus 100 also acquires a search history, which is a history of search queries input by the user U, from a search server (search engine), an electronic commerce server, or a posting server. In addition, the information providing apparatus 100 acquires a browsing history, which is a history of content and products (including fashion items) browsed by the user U, from the content server, the electronic commerce server, and the posting server. The information providing apparatus 100 also acquires a purchase history (payment history), which is a history of content and products (including fashion items and artworks) purchased or paid for by the user U, from an electronic commerce server or a payment processing server. Further, the information providing apparatus 100 may acquire the exhibition history and sales history, which are the history of the user U's exhibition in the marketplace, from the electronic commerce server or the payment processing server. The information providing apparatus 100 also posts a posting history, which is a history of fashion coordination (fashion items) posted by the user U, and a support history, which is a history of fashion coordination (fashion items) supported (liked) by the viewer. Acquire from a server or SNS server.

As shown in FIG. 1, the information providing apparatus 100 directly or indirectly retrieves, browses, and distributes fashion items from the terminal device 10 of the user U, various servers, etc., via the network N (see FIG. 2). Information on purchase (purchase), possession, posting, etc. is acquired (step S1). At this time, the information providing apparatus 100 may acquire information on searching, viewing, purchasing, owning, posting, etc. of fashion items based on the user U's attribute information and/or history information.

Subsequently, the information providing device 100 collects the fashion information of the user U based on the information on searching, viewing, purchasing, owning, posting, etc. of fashion items (step S2). At this time, the information providing apparatus 100 may extract information about the fashion of the user U from the history information of the user U and collect the information as fashion information.

Subsequently, based on the user U's fashion information, the information providing apparatus 100 combines (dresses) the user U's fashion (clothes, accessories, bags, shoes, hats) and artworks (real art, digital art). combination) is calculated (step S3). At this time, the information providing apparatus 100 performs machine learning based on big data of an unspecified number of users to combine fashion and artwork (for example, combinations of fashion and artwork supported by viewers on posting sites and SNS). and combinations of fashion and art works published in magazines and fashion information sites), and infer the recommended combination of fashion and art works. That is, the user's fashion information is used as input information, and an art work corresponding to the user's fashion (for example, a recommended art work corresponding to the user's fashion, an art work that is compatible with the user's fashion) is estimated. It should be noted that information related to time and date, such as season and time zone, may also be combined for learning. This is because both fashion and works of art are easily influenced by trends.

Subsequently, the information providing device 100 identifies the art work most suitable for the user U's fashion from the combination of the user U's fashion and the art work (step S4). For example, when the information providing device 100 calculates a combination of user U's fashion and art work and also calculates a score indicating the degree of compatibility between the fashion and the art work, the art work included in the combination with the high score is calculated. , as the art work most suitable for user U's fashion. Alternatively, the information providing apparatus 100 selects an art work most suitable for the fashion of the user U from among the art works corresponding to the fashion of the user U based on information (attributes, preferences, etc.) other than the fashion information of the user U. Identify. Incidentally, in practice, the information providing apparatus 100 may calculate the art work most suitable for the fashion of the user U when calculating the combination of the fashion and the art work in step S3.

Subsequently, the information providing device 100 creates recommendation information regarding art works that are most suitable for the fashion of the user U (step S5).

Subsequently, based on the recommendation information, the information providing device 100 recommends an artwork that is most suitable for the fashion of the user U to the terminal device 10 of the user U via the network N (see FIG. 2) (step S6 ). In other words, the information providing device 100 proposes recommended artworks that match the user U's fashion. As a result, it is possible to promote the purchase of art works according to fashion.

As described above, in the present embodiment, the information providing apparatus 100 combines fashion (clothes, accessories, bags, shoes, hats) and artworks (real art, digital art) based on the user's fashion preferences. Dressing) is recommended by AI (Artificial Intelligence). That is, the information providing apparatus 100 according to this embodiment recommends art works (real art, digital art) based on the user's fashion information. For example, the information providing apparatus 100 recommends an artwork that looks good in the background when photographed with a user wearing fashion items as a photo or video for posting to a posting site or SNS. For example, it recommends an art work that is highly compatible with fashion items in terms of the color wheel (for example, it does not give a dark impression and gives a trendy impression (impression supported by viewers)). Alternatively, an art work that is estimated to have a high approval rate (like rate) by viewers on a posting site or SNS is recommended. Alternatively, it recommends an art work that is estimated to increase the purchase rate of fashion items by viewers. As a result, it is possible to promote the purchase of fashion-appropriate art works, and the purchase of fashion items by the viewer.

Fashion information can be acquired from each user U's attribute information, history information, and the like. The fashion information also includes information on fashion items worn by the user U (fashion item information). In this embodiment, fashion information is behavior information (search, selection , viewed, purchased, posted). The fashion information includes information (fashion item information) related to fashion items searched, browsed, purchased, owned, posted, etc. by the user U.

In this embodiment, the user's fashion preferences are stored in various historical information such as e-commerce sites such as fashion mail-order sites and fashion coordination posting sites that connect accounts with this system (or are part of this system). It is determined by logic that calculates/estimates based on (log data). For example, from the clothes purchased by the user on a fashion mail-order site (defined as clothes that match the user's information) and the clothes that the user has browsed, it calculates/estimates "a combination of clothes and artwork that looks good", Recommend the best art work to match with clothes. In addition, it calculates/estimates “a combination of clothes and art work that looks good” from the clothes browsed by the user on the fashion coordination posting site, and recommends the best art work for the combination with the clothes.

In addition to the fashion information, the information providing apparatus 100 may recommend art works (real art, digital art) based on information such as lifestyle behavior/habits and mood of the user.

Furthermore, the information providing apparatus 100 may recommend art works (real art, digital art) based on both fashion information and spatial information. For example, the information providing device 100 may propose a combination of the user U's fashion and art works that match the space based on the user U's fashion information and space information. In other words, it is possible to recommend an art work that is most suitable for the fashion of the user U according to the space. The fashion information may be an image of the user U wearing a fashion item. Also, the image may be a photograph (still image) or a video (moving image). In this case, the information providing apparatus 100 can acquire spatial information about articles included in backgrounds and images as well as fashion information.

Spatial information is information about the space where the user wears fashion items. The spatial information may be three-dimensional data (3D data) indicating the interior of the space. Spatial information also includes information about articles (interior/furniture, miscellaneous goods, foliage plants, lighting, etc.) present in the space. Spaces are, for example, rooms in a building, warehouses, corridors, and the like. Note that the entrance, entrance, lobby, corridor, bath, toilet, garage, etc. may be included. A building has, for example, spaces partitioned by walls, partitions, floors, ceilings, and the like. That is, a space is a place where people stay, enter, exit or pass through. A space may be a place where a person lives or works, or a place where items used by a person are stored. Moreover, in a building, the number of spaces may be one or plural.

The building is, for example, a collective housing such as a condominium/apartment, a detached house, or the like. In reality, buildings include office buildings such as companies, commercial facilities such as stores, accommodation facilities such as hotels, educational institutions such as schools, medical institutions such as hospitals, research institutes such as laboratories, and industrial facilities such as factories. It may be a physical distribution base such as a plant or distribution center. In addition, large-scale commercial facilities (shopping centers/outlet malls/underground malls), entertainment facilities (theme parks/amusement parks/playgrounds/zoo/aquariums/pools/bathing facilities), cultural facilities (halls/theaters/libraries/art galleries/museums) , complex facilities, sports facilities, shrines and temples, service areas (SA) and parking areas (PA), railway stations, roadside stations, airports, harbors (boarding piers), and the like.

Further, the space is not limited to a room in a building, but may be a passenger room (cabin) of a vehicle, a ship, an aircraft, or the like. That is, the space is not limited to a space where people live indoors such as a house, but may be a space where crew members and passengers spend time in automobiles, highway buses, railways, large passenger ships, airplanes, and the like. In other words, the space may be a living space inside a building or a mobile object. Moreover, the space is not limited to the inside of the building, and may be outdoors. For example, it may be a site of a predetermined size such as a garden or an open space. Artworks such as ornaments/objects, AR (Augmented Reality), and projection mapping can be combined even outdoors.

For example, based on fashion information and spatial information, the information providing apparatus 100 recommends presentation of artworks on walls, floors, and in the air using AR.

Further, the information providing apparatus 100 may recommend space decorations (space decorations, non-wearing goods) from fashion such as clothes (wearing goods, owned goods). In addition, the information providing apparatus 100 recommends space decorations (space decorations, non-wearing goods) based on fashion such as clothes (wearing goods, belongings) and space features (rooms, furniture, interiors, etc.). good too.

Also, the recommendation of the art work may include the recommendation of the artist who creates the art work. Digital art may also include digital art content (NFT art) using NFTs (Non-Fungible Tokens).

[2. Configuration example of information processing system]
Next, the configuration of the information processing system 1 including the information providing device 100 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the information processing system 1 according to the embodiment. As shown in FIG. 2, the information processing system 1 according to the embodiment includes a terminal device 10 and an information providing device 100. As shown in FIG. These various devices are communicatively connected via a network N by wire or wirelessly. The network N is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network) such as the Internet.

Also, the number of devices included in the information processing system 1 shown in FIG. 2 is not limited to the illustrated one. For example, only one terminal device 10 is shown in FIG. 2 for simplification of illustration, but this is only an example and is not limited, and two or more devices may be provided.

The terminal device 10 is an information processing device used by the user U. FIG. For example, the terminal device 10 includes smart devices such as smartphones and tablet terminals, feature phones, PCs (Personal Computers), PDAs (Personal Digital Assistants), game machines and AV equipment with communication functions, car navigation systems, smart watches, Wearable devices such as head-mounted displays, smart glasses, and the like.

In addition, the terminal device 10 is compatible with wireless communication networks such as LTE (Long Term Evolution), 4G (4th Generation), 5G (5th Generation: fifth generation mobile communication system), Bluetooth (registered trademark), wireless LAN (Local It is possible to communicate with the information providing apparatus 100 by connecting to the network N via short-range wireless communication such as Area Network).

The information providing device 100 is, for example, a PC, a server device, a mainframe, a workstation, or the like. Note that the information providing apparatus 100 may be realized by cloud computing.

[3. Configuration example of terminal device]
Next, the configuration of the terminal device 10 will be described using FIG. FIG. 3 is a diagram showing a configuration example of the terminal device 10. As shown in FIG. As shown in FIG. 3, the terminal device 10 includes a communication unit 11, a display unit 12, an input unit 13, a positioning unit 14, a sensor unit 20, a control unit 30 (controller), and a storage unit 40. Prepare.

(Communication unit 11)
The communication unit 11 is connected to the network N (see FIG. 2) by wire or wirelessly, and transmits and receives information to and from the information providing apparatus 100 via the network N. FIG. For example, the communication unit 11 is implemented by a NIC (Network Interface Card), an antenna, or the like.

(Display unit 12)
The display unit 12 is a display device that displays various information such as position information. For example, the display unit 12 is a liquid crystal display (LCD) or an organic EL display (Organic Electro-Luminescent Display). Also, the display unit 12 is a touch panel display, but is not limited to this.

(Input unit 13)
The input unit 13 is an input device that receives various operations from the user U. For example, the input unit 13 has buttons and the like for inputting characters, numbers, and the like. The input unit 13 may be an input/output port (I/O port), a USB (Universal Serial Bus) port, or the like. Moreover, when the display unit 12 is a touch panel display, a part of the display unit 12 functions as the input unit 13 . Also, the input unit 13 may be a microphone or the like that receives voice input from the user U. FIG. The microphone may be wireless.

(Positioning unit 14)
The positioning unit 14 receives signals (radio waves) transmitted from GPS (Global Positioning System) satellites, and based on the received signals, position information (for example, latitude and longitude). That is, the positioning unit 14 positions the position of the terminal device 10 . GPS is merely an example of GNSS (Global Navigation Satellite System).

Also, the positioning unit 14 can measure the position by various methods other than GPS. For example, the positioning unit 14 may measure the position using various communication functions of the terminal device 10 as described below as auxiliary positioning means for position correction and the like.

(Wi-Fi positioning)
For example, the positioning unit 14 measures the position of the terminal device 10 using the Wi-Fi (registered trademark) communication function of the terminal device 10 or the communication network provided by each communication company. Specifically, the positioning unit 14 performs Wi-Fi communication or the like and measures the position of the terminal device 10 by measuring the distance to a nearby base station or access point.

(beacon positioning)
The positioning unit 14 may also use the Bluetooth (registered trademark) function of the terminal device 10 to measure the position. For example, the positioning unit 14 measures the position of the terminal device 10 by connecting with a beacon transmitter connected by the Bluetooth (registered trademark) function.

(geomagnetic positioning)
Further, the positioning unit 14 positions the position of the terminal device 10 based on the geomagnetism pattern of the structure measured in advance and the geomagnetic sensor provided in the terminal device 10 .

(RFID positioning)
Further, for example, if the terminal device 10 has an RFID (Radio Frequency Identification) tag function equivalent to a contactless IC card used at station ticket gates, stores, etc., or has a function of reading an RFID tag In this case, the location used is recorded together with the information that the payment was made by the terminal device 10 . The positioning unit 14 may measure the position of the terminal device 10 by acquiring such information. Also, the position may be measured by an optical sensor provided in the terminal device 10, an infrared sensor, or the like.

The positioning unit 14 may measure the position of the terminal device 10 using one or a combination of the positioning means described above, if necessary.

(Sensor unit 20)
The sensor unit 20 includes various sensors mounted on or connected to the terminal device 10 . The connection may be wired connection or wireless connection. For example, the sensors may be detection devices other than the terminal device 10, such as wearable devices and wireless devices. In the example shown in FIG. 3, the sensor unit 20 includes an acceleration sensor 21, a gyro sensor 22, an atmospheric pressure sensor 23, an air temperature sensor 24, a sound sensor 25, an optical sensor 26, a magnetic sensor 27, and an image sensor ( camera) 28.

The sensors 21 to 28 described above are only examples and are not limited. That is, the sensor unit 20 may be configured to include a part of the sensors 21 to 28, or may include other sensors such as a humidity sensor in addition to or instead of the sensors 21 to 28. .

The acceleration sensor 21 is, for example, a three-axis acceleration sensor, and detects physical movements of the terminal device 10 such as movement direction, speed, and acceleration of the terminal device 10 . The gyro sensor 22 detects physical movements of the terminal device 10 such as inclination in three axial directions based on the angular velocity of the terminal device 10 and the like. The atmospheric pressure sensor 23 detects the atmospheric pressure around the terminal device 10, for example.

Since the terminal device 10 includes the above-described acceleration sensor 21, gyro sensor 22, barometric pressure sensor 23, etc., techniques such as pedestrian dead-reckoning (PDR: Pedestrian Dead-Reckoning) using these sensors 21 to 23, etc. , the position of the terminal device 10 can be determined. This makes it possible to acquire indoor position information that is difficult to acquire with a positioning system such as GPS.

For example, a pedometer using the acceleration sensor 21 can calculate the number of steps, walking speed, and distance walked. Further, by using the gyro sensor 22, it is possible to know the traveling direction, the direction of the line of sight, and the inclination of the body of the user U. Also, from the atmospheric pressure detected by the atmospheric pressure sensor 23, the altitude at which the terminal device 10 of the user U is present and the number of floors can be known.

The temperature sensor 24 detects the temperature around the terminal device 10, for example. The sound sensor 25 detects sounds around the terminal device 10, for example. The optical sensor 26 detects the illuminance around the terminal device 10 . The magnetic sensor 27 detects, for example, geomagnetism around the terminal device 10 . The image sensor 28 captures an image around the terminal device 10 .

The atmospheric pressure sensor 23, the temperature sensor 24, the sound sensor 25, the optical sensor 26, and the image sensor 28 described above detect the atmospheric pressure, temperature, sound, and illuminance, respectively, or capture an image of the surroundings to detect the terminal device 10. It is possible to detect the surrounding environment and situations. In addition, it is possible to improve the accuracy of the location information of the terminal device 10 based on the surrounding environment and situation of the terminal device 10 .

(control unit 30)
The control unit 30 includes, for example, a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, an input/output port, and various circuits. Also, the control unit 30 may be configured by hardware such as an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 30 includes a transmission unit 31 , a reception unit 32 and a processing unit 33 .

(Sending unit 31)
The transmission unit 31 receives, for example, various information input by the user U using the input unit 13, various information detected by the sensors 21 to 28 mounted on or connected to the terminal device 10, and information measured by the positioning unit 14. The position information of the terminal device 10 and the like can be transmitted to the information providing device 100 via the communication unit 11 .

(Receiver 32)
The receiving unit 32 can receive various information provided by the information providing apparatus 100 and requests for various information from the information providing apparatus 100 via the communication unit 11 .

(Processing unit 33)
The processing unit 33 controls the entire terminal device 10 including the display unit 12 and the like. For example, the processing unit 33 can output various types of information transmitted by the transmitting unit 31 and various types of information received by the receiving unit 32 from the information providing apparatus 100 to the display unit 12 for display.

(storage unit 40)
The storage unit 40 is realized by, for example, a semiconductor memory device such as RAM (Random Access Memory) or flash memory, or a storage device such as HDD (Hard Disk Drive), SSD (Solid State Drive), or optical disk. be. Various programs, various data, and the like are stored in the storage unit 40 .

[4. Configuration example of information providing device]
Next, the configuration of the information providing device 100 according to the embodiment will be described using FIG. FIG. 4 is a diagram showing a configuration example of the information providing device 100 according to the embodiment. As shown in FIG. 4, the information providing device 100 has a communication section 110, a storage section 120, and a control section .

(Communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. Also, the communication unit 110 is connected to the network N (see FIG. 2) by wire or wirelessly.

(storage unit 120)
The storage unit 120 is implemented by, for example, a semiconductor memory device such as RAM (Random Access Memory) or flash memory, or a storage device such as HDD, SSD, or optical disk. As shown in FIG. 4 , the storage unit 120 has a user information database 121 , history information database 122 and recommendation information database 123 .

(User information database 121)
The user information database 121 stores user information about the user U. FIG. For example, the user information database 121 stores various information such as user U attributes. FIG. 5 is a diagram showing an example of the user information database 121. As shown in FIG. In the example shown in FIG. 5, the user information database 121 has items such as "user ID (Identifier)", "age", "gender", "home", "place of work", and "interest".

“User ID” indicates identification information for identifying the user U. The “user ID” may be the user U's contact information (telephone number, e-mail address, etc.), or may be identification information for identifying the user U's terminal device 10 .

"Age" indicates the age of the user U identified by the user ID. Note that the "age" may be information indicating a specific age of the user U (for example, 35 years old) or information indicating the age of the user U (for example, 30's). . Alternatively, the "age" may be information indicating the date of birth of the user U, or information indicating the generation of the user U (for example, born in the 80's). "Gender" indicates the gender of the user U identified by the user ID.

"Home" indicates location information of the home of the user U identified by the user ID. In the example shown in FIG. 5, "home" is represented by an abstract code such as "LC11", but may be latitude/longitude information or the like. Also, for example, "home" may be an area name or an address.

"Place of work" indicates location information of the place of work (school in the case of a student) of the user U identified by the user ID. In the example shown in FIG. 5, the "place of work" is illustrated as an abstract code such as "LC12", but may be latitude/longitude information or the like. Also, for example, the "place of work" may be an area name or an address.

"Interest" indicates the interest of the user U identified by the user ID. That is, "interest" indicates an object in which the user U identified by the user ID is highly interested. For example, the "interest" may be a search query (keyword) that the user U has entered into a search engine and searched for. In the example shown in FIG. 5, one "interest" is shown for each user U, but a plurality of "interests" may be shown.

For example, in the example shown in FIG. 5, the age of the user U identified by the user ID "U1" is "twenties" and the gender is "male". Also, for example, the user U identified by the user ID "U1" indicates that the home is "LC11". Also, for example, the user U identified by the user ID "U1" indicates that the place of work is "LC12". Also, for example, the user U identified by the user ID "U1" indicates that he is interested in "sports".

Here, in the example shown in FIG. 5 , abstract values such as “U1”, “LC11” and “LC12” are used, but “U1”, “LC11” and “LC12” have specific values. It is assumed that information such as character strings and numerical values is stored. Hereinafter, abstract values may also be illustrated in diagrams relating to other information.

The user information database 121 is not limited to the above, and may store various types of information depending on the purpose. For example, the user information database 121 may store various types of information regarding the user U's terminal device 10 . In addition, the user information database 121 stores user U's demographics (demographic attributes), psychographics (psychological attributes), geographics (geographical attributes), behavioral attributes (behavioral attributes), etc. Information about attributes may be stored. For example, the user information database 121 includes name, family structure, hometown (local), occupation, position, income, qualification, residence type (detached house, condominium, etc.), presence or absence of car, commuting time, commuting time, commuting time. Information such as routes, commuter pass sections (stations, lines, etc.), frequently used stations (other than the nearest station to your home or place of work), lessons (places, time zones, etc.), hobbies, interests, lifestyle, etc. may

(History information database 122)
The history information database 122 stores various types of information related to history information (log data) indicating user U's actions. FIG. 6 is a diagram showing an example of the history information database 122. As shown in FIG. In the example shown in FIG. 6, the history information database 122 has items such as "user ID", "location history", "search history", "browsing history", "purchase history", and "posting history".

“User ID” indicates identification information for identifying the user U. "Position history" indicates a position history, which is a history of the user's U position and movement. Also, "search history" indicates a search history that is a history of search queries input by the user U. FIG. Also, the "browsing history" indicates the browsing history, which is the history of contents and products (including fashion items) that the user U has browsed. "Purchase history" indicates the purchase history of contents and products (including fashion items and artworks) purchased by the user U. "Posting history" indicates the posting history, which is the history of fashion coordination (fashion items) posted by the user U. In addition, an ownership history that is a history of products (including fashion items and artworks) owned by the user U may be included.

For example, in the example shown in FIG. 6, the user U identified by the user ID "U1" moves along the "location history #1", searches along the "search history #1", It indicates that the content or product was browsed according to the “history #1”, the content or product was purchased at an electronic commerce transaction or a physical store according to the “purchase history #1”, and posted according to the “posting history”.

Here, in the example shown in FIG. 6, abstract history such as "U1", "location history #1", "search history #1", "browsing history #1", "purchase history #1" and "posting history #1" "U1", "location history #1", "search history #1", "browsing history #1", "purchase history #1" and "posting history #1" , information such as specific character strings and numerical values are stored.

Note that the history information database 122 may store various types of information, not limited to the above, depending on the purpose. For example, the history information database 122 may store the user U's usage history of a predetermined service. In addition, the history information database 122 may store the user U's store visit history, facility visit history, and the like. In addition, the history information database 122 may store a history of payment (electronic payment) using the terminal device 10 of the user U, and the like.

(Recommendation information database 123)
The recommendation information database 123 stores recommendation information related to recommendations for art works. FIG. 7 is a diagram showing an example of the recommendation information database 123. As shown in FIG. In the example shown in FIG. 7, the recommendation information database 123 has items such as "user ID", "fashion", "space", "artwork", and "recommendation".

“User ID” indicates identification information for identifying the user U. "Fashion" indicates user U's fashion information. The fashion information includes information on fashion items worn by the user U (fashion item information). The fashion information includes information (fashion item information) on fashion items searched, browsed, purchased, owned, posted, etc. for the user U to wear.

"Space" indicates information (spatial information) about the space where the user U wears fashion items. That is, the spatial information includes information about the space around the user U wearing the fashion item. Furthermore, the spatial information also includes information about articles (interior/furniture, miscellaneous goods, foliage plants, lighting, etc.) present in the space.

In addition, "art work" means art work that can be combined with user U's fashion (recommended art work according to user U's fashion, art work that goes well with user U's fashion items) (real art, digital art). In addition, the art work which can be combined with the fashion of the user U may be plural. "Recommended" indicates an art work most suitable for the user U's fashion among the art works that can be combined with the user U's fashion.

For example, in the example shown in FIG. 7, a user U identified by a user ID “U1” wears “fashion #1”, is present in “space #1”, and wears “fashion #1” and “space #1”. #1”, the “recommended #1” is the most suitable.

Here, in the example shown in FIG. 7, abstract values such as "U1", "fashion #1", "space #1", "art work #1", and "recommended #1" are used, "U1", "fashion #1", "space #1", "art work #1" and "recommendation #1" store information such as specific character strings and numerical values.

It should be noted that the recommendation information database 123 may store various types of information, not limited to the above, depending on the purpose. For example, the recommendation information database 123 may store the date and time when the fashion item was obtained, the date and time when the user stayed in the space, and the date and time when the photograph was taken. This is because the combination may differ depending on the season and time zone. In addition, the recommendation information database 123 may store information regarding fashion items and artworks and popularity.

(control unit 130)
Returning to FIG. 4, the description is continued. The control unit 130 is a controller, and for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like controls the information providing apparatus 100. Various programs (corresponding to an example of an information processing program) stored in the internal storage device are executed by using a storage area such as a RAM as a work area. In the example shown in FIG. 4 , the control unit 130 has a collection unit 131 , a calculation unit 132 , a specification unit 133 , a creation unit 134 and a provision unit 135 .

(Collection unit 131)
The collection unit 131 collects search queries input by the user U. FIG. For example, the collection unit 131 collects the search queries via the communication unit 110 when the user U inputs a search query into a search engine or the like and performs a keyword search. That is, the collection unit 131 collects keywords input by the user U to search windows of search engines, various sites (including fashion shopping sites and posting sites), or various applications via the communication unit 110 .

Also, the collection unit 131 collects user information about the user U via the communication unit 110 . For example, the collection unit 131 collects, from the terminal device 10 of the user U, identification information (user ID, etc.) indicating the user U, location information of the user U, attribute information of the user U, and the like. Further, the collection unit 131 may collect identification information indicating the user U, attribute information of the user U, and the like when the user U is registered as a user. The collection unit 131 then registers the user information in the user information database 121 of the storage unit 120 .

The collection unit 131 also collects various types of history information (log data) indicating the behavior of the user U via the communication unit 110 . For example, the collection unit 131 collects various types of history information indicating actions of the user U from the terminal device 10 of the user U or from various servers based on the user ID or the like. The collection unit 131 then registers various types of history information in the history information database 122 of the storage unit 120 .

In this embodiment, the collecting unit 131 collects fashion information about the user U's fashion (clothes, accessories, bags, shoes, hats) from user information and history information about the user U. FIG. The fashion information may include fashion item information related to fashion items worn by the user U at the time of photographing. In this embodiment, fashion information is behavior information (search, selection , viewed, purchased, posted). For example, the collection unit 131 collects the fashion information of the user U from behavior information on a fashion mail-order site or a fashion coordination posting site with which the account of the user U is linked.

Also, the collection unit 131 collects various types of information about art works (real art, digital art) via the communication unit 110 . For example, the collection unit 131 may collect various pieces of information about artworks existing on the network N (see FIG. 2) via the communication unit 110 and register them in a database or the like. The collecting unit 131 may also collect various pieces of information about artworks that can be purchased on e-commerce sites such as fashion mail-order sites via the communication unit 110 and register the information in a database or the like. Alternatively, the collection unit 131 may collect various pieces of information about the artwork from the network N (see FIG. 2) via the communication unit 110 each time information about the artwork is needed. In addition, the collection unit 131 collects various types of information on artworks that can be purchased on e-commerce sites such as fashion mail-order sites through the communication unit 110 each time information on artworks is required, It may be registered in a database or the like.

The collection unit 131 also collects information (spatial information) about the space where the user wears fashion items via the communication unit 110 . Spatial information also includes information about articles (interior/furniture, miscellaneous goods, foliage plants, lighting, etc.) present in the space. For example, the collection unit 131 may collect information about the space where the user U wears fashion items from the terminal device 10 of the user U, and register the information in a database or the like. Also, the collection unit 131 may collect various types of information about the space existing on the network N (see FIG. 2) via the communication unit 110 and register the information in a database or the like. Alternatively, the collecting unit 131 collects information about the space where the user U wears fashion items from the terminal device 10 of the user U each time information about the space is required, and registers the information in a database or the like. You may The collection unit 131 may also collect various types of space-related information from the network N (see FIG. 2) via the communication unit 110 each time the space-related information is required.

For example, the collection unit 131 collects user U's fashion information and spatial information about the space where the user U wears fashion items.

(Calculation unit 132)
Based on the user U's fashion information, the calculation unit 132 calculates a combination (combination) of the user U's fashion (clothes, accessories, bag, shoes, hat) and artwork (real art, digital art). do. For example, the calculation unit 132 calculates a combination of the user U's fashion and art works that match the space based on the user U's fashion information and space information.

For example, the calculation unit 132 learns combinations of fashion and works of art by machine learning based on big data of an unspecified number of users, and infers recommended combinations of fashion and works of art. That is, the calculation unit 132 uses the user's fashion information as input information to estimate an art work according to the user's fashion.

(Specifying unit 133)
The specifying unit 133 specifies the art work most suitable for the user U's fashion from the combination of the user U's fashion and the art work. For example, when the calculating unit 132 of the information providing device 100 calculates the combination of the user U's fashion and art work and also calculates the score indicating the degree of compatibility between the fashion and the art work, The art work that is displayed is specified as the art work that is most suitable for the user U's fashion. Alternatively, the information providing apparatus 100 selects an art work most suitable for the fashion of the user U from among the art works corresponding to the fashion of the user U based on information (attributes, preferences, etc.) other than the fashion information of the user U. Identify. Incidentally, in practice, the calculation unit 132 may calculate the best art work for the user U's fashion when calculating the combination of fashion and art work. That is, the identification unit 133 may be the same as the calculation unit 132 .

(Creating unit 134)
The preparation unit 134 prepares recommendation information regarding art works that are most suitable for user U's fashion.

(Providing unit 135)
Based on the recommendation information, the provision unit 135 proposes art works that are most suitable for the fashion of the user U to the terminal device 10 of the user U via the communication unit 110 . In other words, the providing unit 135 proposes artworks that match the fashion of the user U based on the combination of the fashion of the user U and the artworks.

For example, the providing unit 135 proposes a space decoration as an art work that matches the user U's fashion. Alternatively, the providing unit 135 proposes digital art as an art work that matches the user U's fashion.

In addition, the providing unit 135 proposes an art work that looks good in the background when photographed together with the user U wearing fashion items. In addition, when photographed together with the user U wearing the fashion item, the art work is compatible with the fashion item in terms of the color wheel (for example, it does not give a dark impression and gives a trendy impression (an impression supported by the viewer)). Suggest. In addition, the provision unit 135 proposes an art work that is estimated to have a high approval rate among viewers on posting sites and SNSs when photographed together with the user U wearing fashion items. Further, the provision unit 135 proposes an art work that is estimated to increase the purchase rate of the fashion item by the viewer when photographed together with the user U wearing the fashion item.

[5. Processing procedure]
Next, a processing procedure performed by the information providing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 8 is a flow chart showing a processing procedure according to the embodiment. Note that the processing procedure described below is repeatedly executed by the control unit 130 of the information providing apparatus 100 .

As shown in FIG. 8, the collection unit 131 of the information providing device 100 collects fashion information of the user U via the communication unit 110 (step S101).

Subsequently, the collection unit 131 of the information providing device 100 collects spatial information of the user U via the communication unit 110 (step S102).

Subsequently, the calculation unit 132 of the information providing device 100 calculates a combination of the fashion of the user U and the artwork based on the fashion information and the space information of the user U (step S103).

Subsequently, the identifying unit 133 of the information providing device 100 identifies the artwork most suitable for the fashion of the user U from the combination of the fashion of the user U and the artwork (step S104).

Subsequently, the creation unit 134 of the information providing device 100 creates recommendation information regarding art works that are most suitable for the fashion of the user U (step S105).

Subsequently, based on the recommendation information, the collection unit 131 of the information providing device 100 recommends to the terminal device 10 of the user U via the communication unit 110 an art work that is most suitable for the fashion of the user U (step S6 ). For example, the information providing device 100 proposes to the terminal device 10 of the user U a fashion item that the user U is interested in (or plans to purchase) and a recommended artwork corresponding to the fashion item. Alternatively, the information providing device 100 proposes to the terminal device 10 of the user U, a fashion item purchased (or owned) by the user U and a recommended artwork corresponding to the fashion item. Alternatively, the information providing device 100 proposes to the terminal device 10 of the user U, a fashion item that the user U intends to wear at the time of photographing, and a recommended artwork corresponding to the fashion item.

[6. Modification]
The terminal device 10 and the information providing device 100 described above may be implemented in various different forms other than the above embodiments. So, below, the modification of embodiment is demonstrated.

In the above embodiment, part or all of the processing executed by the information providing device 100 may actually be executed by the terminal device 10 . For example, the processing may be completed stand-alone (by the terminal device 10 alone). In this case, it is assumed that the terminal device 10 has the functions of the information providing device 100 in the above embodiment. In addition, in the above-described embodiment, the terminal device 10 cooperates with the information providing device 100, so from the user U's point of view, it appears that the terminal device 10 is executing the processing of the information providing device 100 as well. That is, from another point of view, it can be said that the terminal device 10 includes the information providing device 100 .

Moreover, in the above embodiment, the fashion information is not limited to fashion item information, and may include information related to makeup, atmosphere, height, body shape, user's image, etc. of the user who is the wearer. It is speculated that these factors also change the combination of fashion and artwork.

In the above embodiment, fashion information includes fashion item codes, brands and categories, product names, prices, sizes/dimensions, weights, standards, product targets (attributes of users expected as target/purchasing demographics). It may also contain information about such as.

Also, in the above embodiment, the fashion information may include information on seasons, days of the week, and time zones. The seasons are not limited to the four seasons such as spring, summer, autumn, and winter, but also include Golden Week, rainy season, mountain/sea opening, Obon, New Year, entrance/graduation season, and the like. Moreover, the day of the week is not limited to seven days, and may be divided into weekdays/Saturdays, Sundays, and holidays (holidays). In addition, the time period is not limited to between a certain time and a certain time (for example, 8 o'clock, 8: 00-9: 00, etc.), morning / afternoon / night (or morning / noon / evening / night) It may be a division such as.

Also, in the above embodiments, the work of art may include a handmade craft work. In addition, the information providing apparatus 100 may recommend antiques, vintages, and the like as works of art, as well as good-looking/valuable goods other than these. etc. may be recommended.

Further, in the above embodiment, the information providing apparatus 100 may acquire fashion information from the user U's location history, payment history, or the like. For example, the information providing apparatus 100 detects that the user U entered a specific brand shop, stopped in front of a product shelf of a specific product, and picked up a specific product based on the position history by GPS, PDR, or the like. You may estimate and acquire the information regarding the specific goods as fashion information. Further, the information providing apparatus 100 presumes that the user U picked up a specific product and put it in the cart by means of a tag reader or the like mounted on the product shelf or cart, and sends information about the specific product to the fashion store. You may acquire it as information. Further, the information providing apparatus 100 may extract fashion items purchased by the user U from the payment history of electronic money or the like, and acquire information about the fashion items as fashion information.

[7. effect〕
As described above, the information processing device (the terminal device 10 and the information providing device 100) according to the present application includes a collection unit that collects user's fashion information, and a user's fashion and artwork based on the user's fashion information. A calculation unit that calculates a combination, and a provision unit that proposes an art work according to the user's fashion based on the combination of the user's fashion and the art work.

For example, the collection unit collects fashion information of the user and spatial information about the space where the user wears fashion items. The calculation unit calculates a combination of the user's fashion and the art work in accordance with the space based on the user's fashion information and the space information.

At this time, the providing unit proposes a spatial decoration as an art work according to the fashion of the user.

Alternatively, the providing unit proposes digital art as an art work that matches the user's fashion.

In addition, the provision unit proposes an art work that looks good as a background when photographed together with the user wearing the fashion item.

In addition, the provision unit proposes an art work that is highly compatible with the fashion item in terms of the color wheel when photographed together with the user wearing the fashion item.

In addition, the provision unit proposes an art work that is estimated to have a high approval rate among viewing users on the fashion coordination posting site or SNS when photographed together with the user wearing the fashion item.

Also, the provision unit proposes an art work that is estimated to increase the purchase rate of the fashion item by the viewing user when photographed together with the user wearing the fashion item.

Also, the collection unit collects the user's fashion information from the user's behavior information on the electronic commerce site or the fashion coordination posting site.

The information processing apparatus according to the present application can recommend fashion-based art by any one or a combination of the processes described above.

[8. Hardware configuration]
Also, the terminal device 10 and the information providing device 100 according to the above-described embodiments are implemented by a computer 1000 configured as shown in FIG. 9, for example. The information providing apparatus 100 will be described below as an example. FIG. 9 is a diagram illustrating an example of a hardware configuration; The computer 1000 is connected to an output device 1010 and an input device 1020, and an arithmetic device 1030, a primary storage device 1040, a secondary storage device 1050, an output I/F (Interface) 1060, an input I/F 1070, and a network I/F 1080 are buses. It has a form connected by 1090.

The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and the secondary storage device 1050, programs read from the input device 1020, and the like, and executes various processes. The arithmetic unit 1030 is implemented by, for example, a CPU (Central Processing Unit), MPU (Micro Processing Unit), ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or the like.

The primary storage device 1040 is a memory device such as a RAM (random access memory) that temporarily stores data used for various calculations by the arithmetic device 1030 . The secondary storage device 1050 is a storage device in which data used for various calculations by the arithmetic device 1030 and various databases are registered. State Drive), flash memory, or the like. The secondary storage device 1050 may be an internal storage or an external storage. Also, the secondary storage device 1050 may be a removable storage medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) memory card. Also, the secondary storage device 1050 may be a cloud storage (online storage), a NAS (Network Attached Storage), a file server, or the like.

The output I/F 1060 is an interface for transmitting information to be output to the output device 1010 that outputs various information such as a display, a projector, and a printer. (Digital Visual Interface), HDMI (registered trademark) (High Definition Multimedia Interface), and other standardized connectors. Also, the input I/F 1070 is an interface for receiving information from various input devices 1020 such as a mouse, keyboard, keypad, buttons, scanner, etc., and is realized by, for example, USB.

Also, the output I/F 1060 and the input I/F 1070 may be wirelessly connected to the output device 1010 and the input device 1020, respectively. That is, the output device 1010 and the input device 1020 may be wireless devices.

Also, the output device 1010 and the input device 1020 may be integrated like a touch panel. In this case, the output I/F 1060 and the input I/F 1070 may also be integrated as an input/output I/F.

Note that the input device 1020 includes, for example, optical recording media such as CDs (Compact Discs), DVDs (Digital Versatile Discs), PDs (Phase change rewritable discs), magneto-optical recording media such as MOs (Magneto-Optical discs), and tapes. It may be a device that reads information from a medium, a magnetic recording medium, a semiconductor memory, or the like.

Network I/F 1080 receives data from other devices via network N and sends the data to arithmetic device 1030, and also transmits data generated by arithmetic device 1030 via network N to other devices.

Arithmetic device 1030 controls output device 1010 and input device 1020 via output I/F 1060 and input I/F 1070 . For example, arithmetic device 1030 loads a program from input device 1020 or secondary storage device 1050 onto primary storage device 1040 and executes the loaded program.

For example, when the computer 1000 functions as the information providing device 100 , the arithmetic device 1030 of the computer 1000 implements the functions of the control unit 130 by executing a program loaded on the primary storage device 1040 . Further, arithmetic device 1030 of computer 1000 may load a program acquired from another device via network I/F 1080 onto primary storage device 1040 and execute the loaded program. Further, the arithmetic unit 1030 of the computer 1000 may cooperate with another device via the network I/F 1080, and call functions, data, etc. of the program from another program of the other device for use.

[9. others〕
Although the embodiments of the present application have been described above, the present invention is not limited by the contents of these embodiments. In addition, the components described above include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those within the so-called equivalent range. Furthermore, the components described above can be combined as appropriate. Furthermore, various omissions, replacements, or modifications of components can be made without departing from the gist of the above-described embodiments.

Further, among the processes described in the above embodiments, all or part of the processes described as being automatically performed can be manually performed, or the processes described as being performed manually can be performed manually. All or part of this can also be done automatically by known methods. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

Also, each component of each device illustrated is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the illustrated one, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

For example, the information providing apparatus 100 described above may be implemented by a plurality of server computers, and depending on the function, may be implemented by calling an external platform or the like using an API (Application Programming Interface), network computing, or the like. can be changed flexibly.

Also, the above-described embodiments and modifications can be appropriately combined within a range that does not contradict the processing contents.

Also, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the collecting unit can be read as collecting means or a collecting circuit.

1 information processing system 10 terminal device 100 information providing device 110 communication unit 120 storage unit 121 user information database 122 history information database 123 recommendation information database 130 control unit 131 collection unit 132 calculation unit 133 identification unit 134 creation unit 135 provision unit

Claims (11)

a collection unit that collects user fashion information;
a calculation unit that calculates a combination of the user's fashion and artwork based on the user's fashion information;
a providing unit that proposes an art work according to the user's fashion based on the combination of the user's fashion and the art work;
An information processing device comprising: The collection unit collects fashion information of the user and spatial information about a space where the user wears fashion items,
2. The information processing apparatus according to claim 1, wherein the calculation unit calculates a combination of the user's fashion and art works that match the space based on the user's fashion information and the space information. . The information processing apparatus according to claim 1 or 2, wherein the providing unit proposes a space decoration as an art work according to fashion of the user. 4. The information processing apparatus according to any one of claims 1 to 3, wherein said providing unit proposes digital art as an art work according to said user's fashion. The information processing apparatus according to any one of claims 1 to 4, wherein the providing unit proposes an artwork that looks good as a background when photographed together with the user wearing fashion items. 6. The providing unit, when photographed together with the user wearing the fashion item, proposes an art work that is highly compatible with the fashion item in terms of the color wheel. 1. The information processing device according to 1. 1. The provision unit proposes an art work that is estimated to have a high degree of support among viewing users on a fashion coordination posting site or SNS when photographed together with the user wearing fashion items. 7. The information processing apparatus according to any one of 6. 8. The provision unit proposes an art work that is estimated to increase the purchase rate of the fashion item by the viewing user when photographed together with the user wearing the fashion item. The information processing device according to claim 1. The information according to any one of claims 1 to 8, wherein the collecting unit collects the user's fashion information from the user's behavior information on an electronic commerce site or a fashion coordination posting site. processing equipment. An information processing method executed by an information processing device,
a collection step of collecting user fashion information;
a calculation step of calculating a combination of the user's fashion and artwork based on the user's fashion information;
a providing step of proposing an art work according to the user's fashion based on the combination of the user's fashion and the art work;
An information processing method comprising: a collection procedure for collecting user's fashion information;
a calculation procedure for calculating a combination of the user's fashion and artwork based on the user's fashion information;
a providing procedure for proposing an art work according to the user's fashion based on the combination of the user's fashion and the art work;
An information processing program for executing a computer.

Images