KR102093328B1 - Method and system for recommending clothing using clothing and environmental information of user pictures - Google Patents

Abstract

An embodiment of the present invention is a method for recommending clothing based on clothing and environment information of a user picture using a terminal, the method comprising: extracting a plurality of user pictures from a plurality of pictures stored in a memory; Generating first environment information based on shooting information of each of the plurality of user pictures; Generating current second environmental information; Extracting matching user pictures from the plurality of user pictures based on the first environment information and the second environment information; Generating clothing information for each of the matching user pictures based on image analysis of each of the matching user pictures; And providing customized clothing information to a user based on the clothing information. A method of recommending clothing may be provided using clothing and environment information of a user picture.

Description

Method and system for recommending clothing using clothing and environmental information of user pictures}

The present invention relates to a method and system for recommending clothing using clothing and environmental information of a user picture.

The area where fashion meets AI is diversifying. As in the success story of the US online shopping mall 'Stitch Fix', members instead of choosing clothes themselves, such as 'Do you like fine clothes or like clogged clothes' or 'Is it a trend or stick to your own style'? Simply answering the question will provide the user with appropriate fashion information. Afterwards, the human stylist and the AI send clothes together to suit the budget and taste. AI runs hundreds of algorithms by assembling various related information from customers. In addition, we check the image sharing search site of customers and find out the tastes that have not been answered directly, and then incorporate them into the selection of clothes. Also, recently, AI is predicting trends using image identification and automatic classification technology. Just take a photo of the T-shirt you saw on the street and you can easily see what brand it is and where it is sold. In addition, by analyzing millions of social network service (SNS) fashion photos, it is possible to predict not only real-time trends, but also what style will be popular in the future. However, the existing research results or products are focused on providing new clothing product information, not clothing owned by the user, and there are limitations in considering various external environmental conditions by staying in the technology mainly analyzing the user's clothing taste.

Republic of Korea Patent Publication No. 10-2017-0003046

An object of the present invention is to provide clothing coordination information to a user based on environmental information.

An embodiment of the present invention provides a method of recommending clothing based on clothing and environment information of a user picture using a terminal, comprising: extracting a plurality of user pictures from a plurality of pictures stored in a memory; Generating first environment information based on shooting information of each of the plurality of user pictures; Generating current second environmental information; Extracting matching user pictures from the plurality of user pictures based on the first environment information and the second environment information; Generating clothing information for each of the matching user pictures based on image analysis of each of the matching user pictures; And providing customized clothing information to a user based on the clothing information. A method of recommending clothing may be provided using clothing and environment information of a user picture.

In another aspect, extracting a plurality of user pictures from a plurality of pictures stored in the memory includes: classifying the plurality of pictures by different people based on image analysis of each of the plurality of pictures; And extracting the plurality of user pictures based on information on the number of pictures classified for each different person. Also, a method of recommending clothes using clothing and environment information of the user picture may be provided.

In another aspect, generating the first environment information based on the shooting information of each of the plurality of user pictures includes: detecting shooting date information of each of the plurality of user pictures; Detecting photographing position information of each of the plurality of user pictures; And generating the first environmental information including the photographing date information, the photographing location information, and the photographing weather information by detecting photographing weather information corresponding to the photographing date information. Information can be used to provide a way to recommend clothing.

In another aspect, in the step of generating the current second environmental information, the second environmental information including current date information and current location information corresponding to the location of the terminal and current weather information corresponding to the current location information. It is also possible to provide a method of recommending clothing by using clothing and environment information of a user picture generating.

In another aspect, in the step of extracting matching user pictures among the plurality of user pictures based on the first environment information and the second environment information, the current date information is matched within a first preset range Matching user among the plurality of user pictures based on date information, shooting location information matching within the second preset range with the current location information, and shooting weather information matching within the preset range with the current weather information It is also possible to provide a method of recommending clothing by using clothing and environment information of a user photo extracting pictures.

In another aspect, reading the calendar information stored in the memory; Detecting schedule information corresponding to the current date information from the calendar information; And classifying the generated clothing information based on the schedule information; further comprising, based on the classified clothing information, using the clothing and environment information of the user picture providing the customized clothing information to the user. You can also provide recommendations.

In another aspect, transmitting customized clothing information to each of the plurality of clothing storage devices having a recognizer for recognizing identification information attached to the clothing; Receiving storage information of each of a plurality of customized clothes in the customized clothing information from each of the plurality of clothing storage devices; And displaying location information of each of the plurality of customized clothes based on the storage information. A method of recommending clothes using clothing and environment information of a user picture may be provided.

In another aspect, detecting proximity information with a first clothing storage device for storing at least one of the tailored clothing; Determining whether the first clothing storage device is detected within a preset range from the terminal; And when the first clothing storage device is detected, transmitting a signal for opening the clothing storage device door to the first clothing storage device; further comprising a method of recommending clothing using clothing and environment information of a user picture. It might be.

In another aspect, displaying all of the images of each of a plurality of customized clothing in the customized clothing information; Displaying location information of an indoor space map and a plurality of clothing storage devices in the indoor space map; And displaying location information of each of the plurality of customized clothing as location information of each of the plurality of customized clothing, based on a clothing storage database in the plurality of clothing storage devices registered in advance. It is also possible to provide a method of recommending clothing by using clothing and environment information of a user photo that further includes.

In another aspect, determining whether the clothing storage device is detected within a preset range from the terminal; And updating the clothing storage database in response to the selection of the image of the customized clothing corresponding to the customized clothing stored in the detected clothing storage device, wherein the clothing storage device is detected. It is also possible to provide a method of recommending clothing using environmental information.

In another aspect, in response to the selection of the image of the custom clothing, the shooting date information of the first matching user photo including the selected custom clothing image among the matching user pictures is the current date information, and the shooting location information is the current location. Generating additional matching user pictures by correcting the weather information taken with the information as current weather information; And storing the additional matching user picture and the first matching user picture together. Also, a method of recommending clothes using clothing and environment information of the user picture may be provided.

In another aspect, it is also possible to provide a non-transitory computer-readable medium storing instructions for performing the steps described above.

According to an embodiment of the present invention, appropriate clothing coordination information may be provided in consideration of environmental conditions.

In addition, the embodiment provides the clothes coordination information by using the clothes owned by the user, so that the user can immediately wear the clothes.

In addition, the embodiment may provide information that more accurately reflects the user's taste by providing clothing coordination information based on clothing worn by a user mainly at a specific location or weather.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood from the following description.

1 is an exemplary view of a system according to an embodiment of the present invention.
2 provides a description of an exemplary terminal.
3 is an exemplary diagram for a terminal.
4 is a flowchart illustrating a method of recommending clothing using clothing and environment information of a user picture according to an embodiment of the present invention.
5 is an exemplary view of a plurality of pictures stored in a terminal.
6 is a conceptual diagram illustrating a method of extracting a user picture from a plurality of pictures.
7 is an exemplary view displaying a plurality of user pictures and first and second environment information.
8 is an exemplary view of a terminal displaying matching user pictures and various information.

The present invention can be applied to various transformations and can have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the detailed description. Effects and features of the present invention and methods for achieving them will be clarified with reference to embodiments described below in detail with reference to the drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. In the following examples, terms such as first and second are not used in a limiting sense, but for the purpose of distinguishing one component from other components. In addition, a singular expression includes a plural expression unless the context clearly indicates otherwise. In addition, terms such as include or have means that a feature or component described in the specification exists, and does not preclude the possibility of adding one or more other features or components in advance. In addition, in the drawings, the size of components may be exaggerated or reduced for convenience of description. For example, since the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of description, the present invention is not necessarily limited to what is shown.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals when describing with reference to the drawings, and redundant description thereof will be omitted. .

1 is an exemplary view of a system according to an embodiment of the present invention.

Referring to FIG. 1, a system 10 for recommending clothes using clothing and environment information of a user picture according to an embodiment of the present invention includes a terminal 100, a server 200, a clothing storage device 300, and a network It may be composed of 400.

The clothing storage device 300 according to the embodiment may include a plurality of clothing storage devices 300. The plurality of clothing storage devices 300 are located in the user's home and are devices for separating and storing at least some of the clothes owned by the user according to the storage space. In addition, each of the plurality of clothing storage devices 300 may be installed with a recognizer 310, and each door 320 of each of the clothing storage devices 300 may be configured in an automatic opening and closing method.

The recognizer 310 may read identification information, which means unique information of clothing that is pre-attached to each clothing by the user. The method of reading the identification information is read by the user manually using a touch pad or a keyboard device provided in the recognizer 310 or by scanning the identification information using the serial number input device of the recognizer 310. We can, but are not limited to this.

In addition, when the identification information of the specific clothing is first recognized by the recognizer 310, the clothing storage device 300 stores information that the specific clothing is stored on the clothing storage device 300 in which the recognizer 310 is installed. In addition, when the identification information of the specific clothing is recognized again by the recognizer 310, the clothing storage device 300 stores an existing clothing to store that the specific clothing is not stored on the clothing storage device 300 in which the recognizer 310 is installed. Update storage information.

In addition, the clothing storage device 300 is configured to automatically open the door 320 when a predetermined signal is received from the terminal 100 through communication with the terminal 100.

In addition, the clothing storage device 300 may be provided with a plurality of storage spaces, each of these storage spaces can be automatically opened and closed doors and recognizers 310 may be installed. Accordingly, even if only one clothing storage device 300 exists, if one clothing storage device 300 has a plurality of storage spaces, each of these plurality of storage spaces, their doors, and their recognizers may be It can be defined as a clothing storage device.

Embodiments of terminals, user interfaces for such terminals, and associated processes for using such terminals are described.

In the following discussion, a terminal comprising a display and a touch-sensitive surface is described. However, it should be understood that the terminal optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.

Terminals typically support a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website authoring applications, disk authoring applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email Application, instant messaging application, exercise support application, photo management application, digital camera application, digital video camera application, web browsing application, digital music player application, and / or digital video player application.

Various applications running on the terminal, optionally, use at least one universal physical user interface device, such as a touch-sensitive surface. The one or more functions of the touch-sensitive surface as well as the corresponding information displayed on the device are, optionally, adjusted and / or changed from one application to the next and / or within each application. In this way, the device's universal physical architecture (such as a touch-sensitive surface) optionally supports a variety of applications using user interfaces that are intuitive and clear to the user.

Attention is now directed to embodiments of portable terminals with touch-sensitive displays. 2 is a block diagram illustrating a portable terminal 100 with touch-sensitive displays 110 in accordance with some embodiments. The touch-sensitive display 110 is sometimes referred to as a “touch screen” for convenience, and is sometimes known or referred to as a touch-sensitive display system. The terminal 100 includes a memory 190 (optionally including one or more computer-readable storage media), a memory controller 191, one or more processing units (CPUs) 180, a peripheral interface 120, and an RF circuit 170, input / output (I / O) subsystem 130, other input or control devices 140, and camera system 150. The terminal 100 is, optionally, touch sensitive, such as one or more intensity sensors 160 (eg, the touch sensitive display system 110 of the terminal 100) for detecting the intensity of contacts on the terminal 100. Mold surface). The terminal 100 is, optionally, on a touch-sensitive surface such as a touch-sensitive display system 110 or a touchpad of the terminal 100 to generate tactile outputs on the terminal 100. And one or more tactile output generators (for generating tactile outputs). These components optionally communicate over one or more communication buses or signal lines.

The terminal 100 is only an example, and the terminal 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has different configurations or arrangements of components. Should be recognized. The various components shown in FIG. 2 are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits.

The memory 190 optionally includes high-speed random access memory, and, optionally, non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to memory 190 by other components of terminal 100, such as CPU 180 and peripherals interface 120, is optionally controlled by memory controller 191.

The peripheral interface 120 may be used to connect input and output peripherals of the device to the CPU 180 and the memory 190. The one or more processors 180 drive or execute various sets of software programs and / or instructions stored in the memory 190 to perform various functions for the terminal 100 and process data.

In some embodiments, peripheral interface 120, CPU 180, and memory controller 191 are, optionally, implemented on a single chip, such as a chip. In some other embodiments, they are optionally implemented on separate chips.

The radio frequency (RF) circuit 170 receives and transmits RF signals, also called electromagnetic signals. The RF circuit 170 converts electrical signals to / from electromagnetic signals and communicates with the communication networks and other communication devices via electromagnetic signals. The RF circuit 170 optionally includes, but is not limited to, an antenna system, RF transceiver, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, subscriber identity module (SIM) cards, memory, etc. It includes, but is not limited to, well-known circuits for performing these functions. RF circuit 107 may optionally be networks, such as the Internet, intranet, and / or wireless networks, also referred to as the World Wide Web (WWW), such as cellular telephone networks, wireless local area networks (LANs), and / or It communicates by wireless communication with a metropolitan area network (MAN), and other devices. Wireless communication, optionally, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), evolution (EV-DO), Data-Only, HSPA, HSPA +, DC-HSPDA (Dual-Cell HSPA), long term evolution (LTE), near field communication (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA) ), Time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g. IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and / or IEEE 802.11n), voice over Internet Protocol (VoiP) , Wi-MAX, protocols for e-mail (e.g. Internet message access protocol (IMAP) and / or post office protocol (POP)), instant messaging (e.g., XMPP (extensible messaging and presence protocol), SIMPLE (Session) Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (IMPS), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS), Uses any of a plurality of communication standards, including any other suitable communication protocol, including communication protocols not yet developed the filing date of the present document, but not limited to, protocols and technologies.

The camera system 150 provides a camera interface between the user and the terminal 100. The camera system 150 converts the photographed image into an electric signal, processes the electric signal, and transmits the image to the display 110 or the memory 190. The camera system 150 converts the electrical signal into image data and transmits it to the peripheral interface 120 for processing. The image data is selectively fetched from the memory 190 by the peripheral interface 120 and / or transmitted to the memory 190.

The I / O subsystem 130 connects input / output peripherals on the terminal 100, such as the touch screen 110 and other input control devices 140, to the peripheral interface 120. I / O subsystem 130 optionally includes display controller 111, one or more input controllers 112. The one or more input controllers 112 receive / transmit electrical signals to / from other input or control devices 140. Other input control devices 140 optionally include physical buttons (eg, push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and the like. In some alternative embodiments, input controller (s) 160 is optionally connected to (or not connected to) any of the pointer device, such as a keyboard, infrared port, USB port, and mouse.

The touch-sensitive display 110 provides an input interface and an output interface between the terminal 100 and the user.

The display controller 111 receives and / or transmits electrical signals to / from the touch screen 110. The touch screen 110 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects.

The touch screen 110 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Touch screen 110 and display controller 111 (and any associated modules and / or sets of instructions in memory 190) contact on touch screen 110 (and any movement or interruption of contact). , And converts the detected contact into interaction with user interface objects (eg, one or more soft keys, icons, web pages or images) displayed on the touch screen 110. In an exemplary embodiment, the point of contact between the touch screen 110 and the user corresponds to the user's finger.

The touch screen 110 optionally uses LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. The touch screen 110 and the display controller 111 may optionally include capacitive, resistive, infrared and surface acoustic wave technologies and other proximity sensor arrays to determine one or more contact points with the touch screen 110 or Contact and any movement or interruption thereof is detected using any of a plurality of touch sensing techniques currently known or to be developed later, including but not limited to other elements.

The touch screen 110 optionally contacts the touch screen 110 using any suitable object or accessory, such as a stylus, finger, or the like. In some embodiments, the user interface is designed to operate primarily using finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, terminal 100 converts the coarse finger-based input into a precise pointer / cursor position or command to perform the actions desired by the user.

In some embodiments, in addition to the touch screen, the terminal 100 optionally includes a touchpad (not shown) for activating or deactivating certain functions. In some embodiments, a touchpad is a touch-sensitive area of a device that does not display visual output unlike a touch screen. The touchpad is, optionally, a touch-sensitive surface separated from the touch screen 110 or an extension of the touch-sensitive surface formed by the touch screen.

Terminal 100 also includes a power system 101 for supplying power to various components. The power system 101 is optionally a power management system, one or more power sources (eg, batteries, alternating current (AC)), recharging systems, power failure detection circuits, power converters or inverters, power status indicators (eg , Light emitting diodes (LEDs), and any other components associated with the generation, management, and distribution of power within portable terminals.

Terminal 100 also optionally includes one or more accelerometers 102. 2 shows the accelerometer 102 connected to the peripheral interface 120. Alternatively, accelerometer 102 is optionally connected to input controller 112 in I / O subsystem 130. In some embodiments, information is displayed in a portrait or landscape view on a touch screen display based on analysis of data received from one or more accelerometers.

The terminal 100 is, optionally, a magnetometer (not shown) in addition to the accelerometer (s) 102, and a GPS for obtaining information regarding the position and orientation (eg, portrait or landscape) of the terminal 100 (Or GLONASS or other global navigation system) receiver 103.

Also, the terminal 100 may use the GPS receiver 103 to detect location information of the terminal 100.

In some embodiments, software components stored in memory 190 include operating system 192, communication module (or set of instructions) 193, contact / motion module (or set of instructions) 194, graphics module ( Or set of instructions) 195, text input module (or set of instructions) 196, satellite positioning system (GPS) module (or set of instructions) 197, and applications (or sets of instructions) (198).

In some embodiments, memory 190 includes an event classifier 199 and an application.

The event classifier 199 receives event information and determines an application that delivers the event information. The event classifier 199 includes an event monitor 199a. In some embodiments, event monitor 199a receives event information from peripherals interface 120. The event information includes information on a specific location of the terminal 100. Therefore, the information that the event monitor 199a receives from the peripheral interface 120 includes information from the GPS receiver 103.

3 is an exemplary diagram for a terminal.

3 illustrates a terminal 100 having a touch screen 110 according to some embodiments. The touch screen 110 optionally displays one or more graphics within the user interface (UI) 20. In this embodiment as well as in other embodiments described below, the user may graphically use, for example, one or more fingers (not shown to scale in the drawing) or one or more stylus (not shown to scale in the drawing). It becomes possible to select one or more of the graphics by making a gesture to. In some embodiments, selection of one or more graphics occurs when the user stops contact with one or more graphics. In some embodiments, the gesture is optionally one or more taps of the finger that have contacted the terminal 100, one or more swipes (from left to right, right to left, up and / or down) and / or (from the right) Left, right to left, up and / or down). In some implementations or situations, unintentional contact with the graphic does not select the graphic. For example, if the gesture corresponding to the selection is a tap, the swipe gesture swiping over the application icon optionally does not select the corresponding application.

The server 200 transmits and receives data through the terminal 100 and the network. More specifically, the server 200 may transmit various data necessary for the execution of the application of the terminal 100. In addition, it is possible to database the information received from the terminal 100. Also, the server 200 may act as a relay for transmitting information received from another terminal to another terminal. In addition, the server 200 may function to provide the application execution file to the terminal 100 in response to the request of the terminal 100. In addition, the server 200 may perform overall management of the application running on the terminal 100 through communication.

In addition, the server 200 may consist of a plurality of servers 200, each of the plurality of servers 200 may exist to provide different functions, and the management subject of each of the plurality of servers 200 may also It will be appreciated that they may be similar, identical or otherwise different personalities.

4 is a flowchart illustrating a method of recommending clothing using clothing and environment information of a user picture according to an embodiment of the present invention. 5 is an exemplary diagram for a plurality of pictures stored in a terminal, and FIG. 6 is a conceptual diagram illustrating a method of extracting a user picture from a plurality of pictures. And FIG. 7 is an exemplary view displaying a plurality of user pictures and first and second environment information, and FIG. 8 is an exemplary view showing a terminal displaying matching user pictures and various information.

Referring to FIG. 4, the method S10 extracts a plurality of user pictures from a plurality of pictures stored in the memory (S100), and generates first environment information based on shooting information of each of the plurality of user pictures. Step (S200), generating the current second environment information (S300), extracting matching user pictures from the plurality of user pictures based on the first environment information and the second environment information (S400) ), Generating clothing information of each of the matching user pictures based on image analysis of each of the matching user pictures (S500) and providing customized clothing information to the user based on the clothing information (S600). Can provide.

In detail, referring to FIGS. 4 to 6, the terminal 100 may extract a plurality of user pictures a2 from a plurality of pictures a stored in the memory 190 (S100). Specifically, the terminal 100 may classify a plurality of photos (a) into different people (P1 to P4) based on image analysis of each of the plurality of photos (a).

A plurality of user pictures a2 may be extracted based on the number information of the pictures a1, a2, a3, and a4 classified as different people (P1 to P4). In this case, since the number of pictures (a2) of the most photographed people (the number of pictures for the P2 people is the highest) among the P1 to P4 people is the largest, the pictures of the P2 people are a plurality of user pictures It becomes field (a2).

A user's picture may be extracted by estimating a person in a picture in which the largest number of pictures appear as the user by using a point in which the number of pictures taken by the user is highest among the portrait pictures in the user's terminal 100. have.

In addition, the step of generating the first environment information based on the shooting information of each of the plurality of user pictures (S200), the terminal 100 detects the shooting date information of each of the plurality of user pictures a2, and the plurality of It detects the shooting location information of each of the user photos (a2), and can detect shooting weather information corresponding to the shooting date information to generate first environment information including shooting date information, shooting location information, and shooting weather information. have.

More specifically, the terminal 100 may read the shooting date information and the shooting location information previously stored in the terminal 100 at the time when each of the plurality of user pictures a2 is taken. In addition, the terminal 100 may generate photographing weather information by receiving weather information on the photographed location at the time of the photographing date from the server 200 by transmitting the photographing date and location information to the server 200. Accordingly, the terminal 100 may generate first environment information including shooting date information, shooting location information, and shooting weather information for each of the plurality of user pictures a2. In addition, the terminal 100 may display a plurality of user pictures a2 as illustrated in FIG. 7 (b), and display (c) first environment information of each user picture a2. .

In addition, the terminal 100 may generate the current second environment information (S300). More specifically, the terminal 100 may generate second environment information including current date information, current location information corresponding to the location of the terminal 100, and current weather information corresponding to the current location information. That is, the terminal 100 identifies the location of the terminal 100 according to GPS information, generates second environmental information by receiving current weather information corresponding to the current location from the server 200, and is illustrated in FIG. 7 As described above, the second environment information may be displayed (d).

Also, the terminal 100 may extract matching user pictures from the plurality of user pictures a2 based on the first environment information and the second environment information (S400).

More specifically, the terminal 100 may generate current date information and shooting date information that matches within a first preset range. For example, if the current date is 2018.06.16, and the first preset range is X years, the shooting date may be 2013.06.16 to 2018.06.16. Here, the X year can be arbitrarily set by the user. The user may set it in consideration of the user's propensity to wear clothing and changes in the user's body, such as wearing only clothing in recent years. In addition, according to the value of X, the terminal 100 filters the photographed picture out of the first preset range among the plurality of user pictures and extracts a matching user picture from the remaining pictures.

Next, the terminal 100 may generate photographing location information matching the current location information and the second preset range. For example, if the second set range is a region range of a unit of east, ward, city, or province, or a country unit, and the current location is Seoul, the Seoul region or Korea may be the location information.

If the second preset range is an area range in units of hours, the terminal 100 filters a picture taken in an area outside the Seoul area among a plurality of user pictures and extracts a matching user picture from the remaining pictures. .

Next, the terminal 100 may generate current weather information and photographed weather information that matches within a third preset range. For example, when the third set range is the temperature of Y degrees and the humidity of Z, the plus and minus Y degrees from the current temperature and the plus and minus Z humidity from the current humidity are photographed weather information.

The terminal 100 filters the picture taken in the weather outside the above range and extracts a matching user picture from the remaining pictures.

Here, the temperature and humidity are given as examples, but the present invention is not limited thereto, and various weather information may be additionally considered.

Next, the terminal 100 may finally select matching user pictures, which are pictures corresponding to a range of the information, based on shooting date information, shooting location information, and shooting weather information among a plurality of user pictures.

In addition, the terminal 100 may display the extracted matching user pictures (e) as illustrated in FIG. 8, and the shooting date information, shooting location information, and shooting weather associated with each of the extracted matching user pictures (e) Information f can be displayed.

Further, the terminal 100 may analyze each of the extracted matching user pictures (e) to generate clothing information worn by the user in the matching user picture (S500). In addition, the terminal 100 may display customized clothing information h to the user based on the generated clothing information as illustrated in FIG. 8. Accordingly, the user may be provided with customized clothing information h automatically recommended by the terminal 100 according to the current location and weather (S600).

According to another embodiment, the terminal 100 may read calendar information previously stored in the memory 190.

The calendar information will be described in detail. A calendar application may be installed in the terminal 100, and a user may input schedule information of his or her specific day using the calendar application. And if there is no special schedule, it can be left blank.

The terminal 100 detects schedule information corresponding to the current date information from the calendar information. The generated clothing information can be classified based on the schedule information. Specifically, the terminal 100 may check whether there is schedule information of the current date in the calendar information, and if there is schedule information, analyze input text information to check a user's schedule at the current date. For example, when the user inputs 000 travel on the current date through the calendar application, the terminal 100 may recognize the word “business trip”. If the user does not enter any information on the current date, the terminal 100 can recognize that it is blank.

Next, the terminal 100 may provide customized clothing information to the user based on the classified clothing information. That is, the terminal 100 may classify the clothing information generated in step S500 according to the characteristics of clothing, classify it into clothing information suitable for a schedule of the current date, and provide customized clothing information based on the classified clothing information. For example, when the user is scheduled to travel based on the current date, among clothing information generated in step S500, casual clothing information excluding formal clothing information and clothing information having a similar personality may be removed. In addition, the terminal 100 may provide customized clothing information based on the suit clothing information.

On the other hand, if the user does not have a special business trip based on the current date (if it is determined to be blank), among the clothing information generated in step S500, formal clothing information excluding casual clothing information and clothing information of a similar nature are removed. You can. In addition, the terminal 100 may provide customized clothing information based on the suit clothing information. This makes it possible to provide more suitable clothing information to the user. That is, by considering not only environmental information such as the current weather, but also a schedule of a scheduled user, it is possible to recommend personalized clothing information of the user.

Meanwhile, the tailored clothing information here is at least one of clothing owned by the user, not new clothing different from the clothing analyzed in the user pictures. In other words, rather than recommending a new clothing product that the user does not currently possess, the result of understanding and grasping the clothing taste in the specific environment of the user by analyzing the clothing information that the user mainly wears in a specific environment such as a specific location, specific weather, etc. According to this, it is to provide costume coordination information within the range of clothing owned by the user himself. Therefore, before the user goes out, the time to worry about clothing coordination through clothing to be worn immediately is minimized, and the clothing information can be quickly obtained based on the clothing coordination of the past without having to acquire accurate information about the outside weather. Be recommended.

According to another embodiment, the terminal 100 may transmit customized clothing information to each of a plurality of clothing storage devices 300 having a recognizer 310 that recognizes identification information attached to the clothing. In addition, the terminal 100 may receive storage information of each of a plurality of custom clothing in the custom clothing information from each of the plurality of clothing storage devices 300. In addition, the terminal 100 may display location information of each of a plurality of customized clothes based on the storage information.

More specifically, the user can store his / her own clothing in the plurality of clothing storage devices 300, and the customized clothing in the above-described customized clothing information is a storage device of any one of the plurality of clothing storage devices 300 Or it may be stored in a plurality of storage devices, or may not be stored in the storage device for reasons such as laundry.

Each of the clothing storage devices 300 receives the customized clothing information from the terminal 100, detects information about the clothes being stored among the customized clothing in the customized clothing information based on its own database, and the detected clothing information and The storage device identification number may be transmitted to the terminal 100. In addition, the terminal 100 may use the identification number of the storage device to generate location information of the customized clothes on which storage device contains at least one of the customized clothes. In addition, the terminal 100 may indirectly display the location information of the customized clothes by displaying the location information of the clothes storage devices 300 in which the customized clothes are stored. In addition, the clothes that are judged not to be stored are displayed separately so that the user can find clothes in a place other than the clothes storage device 300 (for example, a place where a laundry or a laundry hanger is located).

In addition, the terminal 100 may detect proximity information with a first clothing storage device that accommodates at least one of customized clothing. In addition, it is possible to determine whether the first clothing storage device is detected within a preset range from the terminal 100. That is, when the user approaches the clothing storage device in order to take out the customized clothing from the clothing storage device, when the distance between the terminal 100 and the clothing storage device is within a predetermined distance range, the terminal 100 and the clothing storage device By being paired with each other, the terminal 100 can detect the clothing storage device. In addition, when the terminal 100 detects the first clothing storage device, the terminal 100 may transmit a signal for opening the clothing storage device door to the detected first clothing storage device. Then, the clothing storage device automatically opens the door in response to the door open signal. Therefore, the user can quickly check through the physical door opening which storage space is currently included in the clothes storage device composed of a plurality of drawer spaces.

According to another embodiment, the terminal 100 may display all images of each of a plurality of customized clothes in the customized clothing information, and display location information of a plurality of clothing storage devices in an indoor space map and an indoor space map, The location information of each of the plurality of customized clothing may be displayed as the location information of each of the plurality of customized clothing, based on the clothing storage database in the plurality of previously registered clothing storage devices. Therefore, the user can quickly check the indoor space map and the location of the clothing storage device in which the customized clothing is stored.

Meanwhile, the terminal 100 may periodically receive clothing information received from the respective clothing storage devices 300 to generate a clothing storage database.

Next, the terminal 100 determines whether or not a clothing storage device is detected within a predetermined range from the terminal, and the clothing storage device is detected and the image of the customized clothing corresponding to the customized clothing stored in the detected clothing storage device. In response to the selection, the clothing storage database may be updated.

In more detail, when the user checks the indoor space map displayed on the terminal 100 and the location information of the customized clothing to bring the customized clothing out of the clothing storage device, the terminal 100 approaches the clothing storage device. It is possible to recognize that it is close to and finally detect the clothing storage device. In addition, the terminal 100 transmits a command signal for opening and closing the door of the detected clothing storage device. And when the user touches the image of the displayed customized clothing, the touched customized clothing is recognized as being removed from the currently detected clothing storage device, and the clothing storage database is updated. Therefore, the user does not need to separately recognize the identification number of the clothing in the recognizer 310 when taking the clothing out of the clothing storage device.

According to another embodiment, the terminal 100 photographs shooting date information of a first matching user picture including selected custom clothing images among matching user pictures as current date information, and photographing location information as current location information. Can be modified with the current weather information to generate and save additional matching user photos. In this case, it should be noted that the matching user picture before modification is maintained in the memory 190 without being removed. Through this, even if the user does not take a separate picture, a picture of the same image in which the picture was taken, the shooting location, and the shooting weather is changed is generated. In addition, the next time the terminal 100 proceeds with the above-mentioned personalized clothing information providing process, the number of identical pictures with only the shooting date, location, and weather changed becomes larger, so that the possibility of recommending the clothing preferred by the user is automatically increased. It can work.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and can be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, or the like alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and usable by those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device can be changed to one or more software modules to perform the processing according to the present invention, and vice versa.

The specific implementations described in the present invention are examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connecting members of the lines between the components shown in the drawings are illustrative examples of functional connections and / or physical or circuit connections, and in the actual device, alternative or additional various functional connections, physical It can be represented as a connection, or circuit connections. In addition, unless specifically mentioned, such as “essential”, “importantly”, etc., it may not be a necessary component for application of the present invention.

In addition, the detailed description of the present invention has been described with reference to preferred embodiments of the present invention, but those skilled in the art or those of ordinary skill in the art will appreciate the spirit of the present invention as set forth in the claims below. And it will be understood that various modifications and changes can be made to the present invention without departing from the technical scope. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

Claims (11)

In the method of recommending clothing based on the clothing and environmental information of the user picture using the terminal,
Extracting a plurality of user pictures from a plurality of pictures stored in the memory;
Generating first environment information based on shooting information of each of the plurality of user pictures;
Generating current second environmental information;
Extracting matching user pictures from the plurality of user pictures based on the first environment information and the second environment information;
Generating clothing information for each of the matching user pictures based on image analysis of each of the matching user pictures; And
Including the step of providing personalized clothing information to the user based on the clothing information;
Generating the first environment information based on the shooting information of each of the plurality of user pictures,
Detecting shooting date information of each of the plurality of user pictures;
Detecting photographing position information of each of the plurality of user pictures; And
Includes; detecting the shooting weather information corresponding to the shooting date information to generate the first environment information including the shooting date information, the shooting location information and the shooting weather information;
In the step of generating the current second environment information,
Generating the second environment information including current date information, current location information corresponding to the location of the terminal, and current weather information corresponding to the current location information,
In the step of extracting matching user pictures among the plurality of user pictures based on the first environment information and the second environment information,
The current date information and shooting date information matched within the first preset range, the current location information and shooting location information matched within the second preset range, and the current weather information matched within the third preset range Extracting matching user pictures from the plurality of user pictures based on the photographed weather information,
How to recommend clothing using clothing and environmental information from the user's photo. According to claim 1,
Extracting a plurality of user photos from a plurality of photos stored in the memory,
Classifying the plurality of pictures for different people based on image analysis of each of the plurality of pictures; And
And extracting the plurality of user pictures based on the number information of the pictures classified for each different person.
How to recommend clothing using clothing and environmental information from the user's photo. delete delete delete According to claim 1,
Reading calendar information stored in the memory;
Detecting schedule information corresponding to the current date information from the calendar information; And
Further comprising the step of classifying the generated clothing information based on the schedule information;
Providing the customized clothing information to the user based on the classified clothing information
How to recommend clothing using clothing and environmental information from the user's photo. According to claim 1,
Transmitting customized clothing information to each of a plurality of clothing storage devices having a recognizer for recognizing identification information attached to the clothing;
Receiving storage information of each of a plurality of customized clothes in the customized clothing information from each of the plurality of clothing storage devices; And
Displaying location information of each of the plurality of tailored clothes based on the storage information; further comprising
How to recommend clothing using clothing and environmental information from the user's photo. The method of claim 7,
Detecting proximity information with a first clothing storage device storing at least one of the tailored clothing;
Determining whether the first clothing storage device is detected within a preset range from the terminal; And
Further comprising the step of transmitting a door opening signal to the clothing storage device to the first clothing storage device when the first clothing storage device is detected;
How to recommend clothing using clothing and environmental information from the user's photo. According to claim 1,
Displaying all images of each of a plurality of customized clothes in the customized clothes information;
Displaying location information of an indoor space map and a plurality of clothing storage devices in the indoor space map; And
Displaying location information of each of the plurality of customized clothing as location information of each of the plurality of customized clothing, based on a clothing storage database in the plurality of clothing storage devices registered in advance; Containing
How to recommend clothing using clothing and environmental information from the user's photo. The method of claim 9,
Determining whether the clothing storage device is detected within a preset range from the terminal; And
Further comprising; the clothing storage device is detected, and updating the clothing storage database in response to the selection of the image of the customized clothing corresponding to the customized clothing stored in the detected clothing storage device;
How to recommend clothing using clothing and environmental information from the user's photo. A non-transitory computer readable medium storing instructions for performing the steps according to claim 1, 2 and 6.

Images