JP4826139B2 - Dressing system - Google Patents

Description

  The present invention relates to a dressing system for managing information on clothing items.

Conventionally, as a device for managing information on clothing items, clothing items that are stored and managed in the database as electronic images using video cameras, electronic cameras, scanners, etc., one by one. There is provided a clothing data management device having a function of examining the combination of images using images (for example, Patent Document 1).
JP 7-243112 A (paragraph number 0025)

  The apparel data management device disclosed in Patent Document 1 requires that the apparel items be photographed side by side in front of an electronic camera or video camera when the user registers apparel items in the database. In addition to the daily life, the image capturing work is required, and the attribute data of the clothing item is also required to be input by a pointing device using the display screen on the monitor, and thus the registration work is complicated.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a dressing system capable of registering information on clothing items in the flow of action of daily clothing operation. .

In order to achieve the above object, according to the first aspect of the present invention, there is provided an imaging means for photographing a user's figure, a user's standing position and the imaging means, and the user direction from the imaging means. It is possible to take a picture of the user by the imaging means by the light transmittance of the lens, and a mirror body that functions as a mirror from the user side, and clothing worn by the user from the figure image of the user taken by the imaging means Control means for acquiring item information and automatically registering the clothing item information in the storage means, wherein the control means performs area segmentation of each part from the user's figure image, performing area pattern matching between the pattern matching image of the various kinds of clothing items registered in correspondence with the site, and an image input processing unit for extracting an image of each clothing item that is mounted at each site The image for each extracted clothing items registered with the attribute of該服decorative item, the image input processing unit after matching by size during the area pattern matching performs matching processing using the shape-specific pattern matching image, clothing An image for each item is extracted .

  According to the first aspect of the present invention, information on clothing items worn by the user can be obtained by photographing the appearance of the user in the flow of the act of daily clothing movement of standing in front of the mirror. It can be acquired, and there is no need to register for clothing items by taking photos of the clothing items one by one. After imaging, the information on clothing items is automatically registered without taking any effort to the user. Yes.

  According to a second aspect of the invention, in the first aspect of the invention, the control means includes an image processing means for obtaining a histogram of colors included in the photographed clothing item, and the histogram color obtained by the image processing means It registers in the said memory | storage means as an attribute of clothing item information, It is characterized by the above-mentioned.

  According to invention of Claim 2, the histogram contained in a clothing item can be calculated | required automatically, and the color can be automatically registered as an attribute, without manpower.

According to a third aspect of the present invention, in the first aspect of the invention, the control means recognizes a keyword related to a clothing item from the voice acquisition means for acquiring a user's utterance voice and the voice acquired from the voice acquisition means. and a speech recognition means for recognizing the individual user as well as characterized by a voice keywords and individual user recognized by the voice recognition unit for registering in the storage section as an attribute of the clothing item.

  According to the third aspect of the present invention, the user can automatically register the keyword of the clothing item as an attribute without manpower by simply speaking the keyword related to the clothing item.

  In the present invention, it is possible to acquire information on clothing items worn by the user by photographing the appearance of the user in the flow of the act of daily clothing movement of standing in front of the mirror. This eliminates the need for registration of clothing items by shooting clothing items one by one. After imaging, there is an effect that information on clothing items can be automatically registered without troublesome users. .

  The present invention will be described below with reference to an embodiment.

  As shown in FIG. 1, the present embodiment is a system corresponding to a closet 1 that is a storage place for clothing items, and a hanger part that hangs clothing items such as outerwear in the closet 1 as shown in the figure. 2, a drawer 3 for storing accessory items such as handbags and scarves, an imaging camera 4 made of a color digital camera, and a control device 5, which are formed on the wall of the closet 1 facing the indoor side. A mirror liquid crystal 6 is attached to the opening, and a reader device 7 (which may have a reader / writer function) of an RF type ID tag (IC tag) is provided on the indoor side wall surface near the mirror liquid crystal 6. , A microphone MC, a liquid crystal display for inputting various data such as setting / registration, and an operation display panel 8 including a touch panel. It is provided an illumination device 9 comprising a switch source.

  Here, the mirror liquid crystal 6 has a half mirror formed on the display surface of the liquid crystal display device 6a, which will be described later, by metal vapor deposition or the like, and the imaging in the closet 1 is performed via a half mirror portion that does not correspond to the display surface of the liquid crystal display device 6a. The camera 5 can take a picture of the user M standing at the standing position A in front of the mirror liquid crystal 6. Further, the liquid crystal display device 6a has a display surface having a size corresponding to the half mirror part that reflects the appearance of the user M, and will be described later at positions corresponding to each part of the user M reflected on the mirror surface of the half mirror. The image of the corresponding clothing item can be displayed.

  The hanger part 2 in the closet 1 is provided with a light emitting display part 10a by LED at a hanger hanging position, and each drawer part 3 is similarly provided with a light emitting display part 10b by LED, and further each hanger hanging position and each drawer. The unit 3 is provided with ID tag reader devices 7 '(see FIG. 2).

  The control device 5 captures image data obtained by photographing with the imaging camera 4 and performs image processing, and is responsible for signal processing and control processing of the entire system. As shown in FIG. An illumination condition generation unit 50 that generates a predetermined illumination condition by controlling the illumination device 9, and an illumination that creates a predetermined illumination environment by controlling the illumination device 9 according to the illumination condition generated by the illumination condition generation unit 50 A control unit 51, an image input processing unit 52 for extracting clothing items such as clothes and accessories from the whole body image of the user M photographed by the imaging camera 4 by area pattern matching, and an image input processing unit 52 An image H for determining the color of the clothing item by obtaining a histogram of each color (for example, R (red), G (green), B (blue)) in the obtained clothing item image. The image generation unit 53, the reader processing unit 54 for processing the ID information read by the reader devices 7 and 7 'from the ID tag attached to the clothing item, and the liquid crystal display device 6a of the mirror liquid crystal 6 display an image. Image display unit 55 that performs processing for the above, lighting control unit 56 that performs lighting control of light emitting display units 10a and 10b, and server 11a and a weather information provider provided in a manufacturer that manufactures clothing items such as a clothing manufacturer Communication function for communicating with the server 11b for providing weather information installed in the network 11 via the network NT such as the Internet, and acquiring various data of the clothing items and weather information provided by the servers 11a and 11b. The utterance voice of the user M is acquired through the processing unit 57 and the microphone MC, and the keyword is recognized from the acquired utterance voice. Voice recognition unit 58 that performs input processing, information processing of control device 5 as a whole, information processing unit 59 that performs control processing, and various databases (clothing history database D1, A comfort database D3, a clothing item image database D4, a storage location management database D5, a clothing item identification database D6, a voice keyword database D7, and a pattern matching image database D2) in which pattern matching image data is registered. .

  Here, the information processing unit 59 includes an operation display panel 8, a voice recognition unit 58, a communication function processing function unit 57, processing of information acquired from the reader devices 7 and 7 ', display processing of the operation display panel 8, and a lighting control unit. 17, lighting control processing of the light emitting display units 10 a and 10 b, display control on the liquid crystal display device 6 a through the image display unit 55, control of condition generation operation in the illumination condition generation unit 50, processing operation of the image input processing unit 13 And control of the generation operation of the image histogram generation unit 53, and further a function of performing registration (storage) processing of information with respect to each of the databases D1 to D7 and search / read processing of registered (stored) information. Yes.

  Thus, when the present system is activated, the information processing unit 59 of the control device 5 displays the operation buttons for registering the clothing item and searching for the clothing item on the menu screen on the display surface of the operation display panel 8. The operation of each part is controlled to a standby state. FIG. 3 shows a flowchart of this state. In step S1, it is checked whether or not an operation button for registering a clothing item has been pressed. If it has been pressed, the process proceeds to a clothing item registration process (step S2) described later. . When the check in step S1 is not performed or the clothing item registration process is completed, it is checked in the next step S3 whether or not the operation button for searching for the clothing item is pressed. The process proceeds to processing (step S4). When the check in step S3 is not completed or when the clothing item search process is completed, in step S5, the entry / exit of the clothing item is checked in step S6. If there is no entry / exit of the clothing item in the closet 1 or if there is entry / exit and the processing is completed, it is checked in step S7 whether or not the system operation is terminated. Then, the above process is repeated.

  By the way, when the operation button for registering a clothing item is pressed and registration is selected in step S1, the information processing unit 59 of the control device 5 performs the following control and processing shown in the flowchart of FIG. Do.

  That is, in step S10, a registration process of clothing item attributes for new registration is started. In this registration process, the imaging camera 4 images the whole body in front of the user M facing the mirror liquid crystal 6 through the half mirror of the mirror liquid crystal 6 (step S11). Here, the user should know in advance the explanation of the standing position by using an instruction manual or the like so that the user directly faces the mirror liquid crystal 6 and stands at the predetermined position, or by voice or the operation input panel 8. You should be guided by the display.

  The whole body image composed of the captured color still image is input to the image input processing unit 52 under the control of the information processing unit 5. When the whole body image is input to the image input processing unit 52, alignment processing with the image data of the whole body figure for pattern matching read from the pattern matching image database D2 is performed on the basis of the head, for example. As described above, by making the user's standing position at the time of photographing constant, the photographing magnification of the imaging camera 4 becomes constant. Therefore, it is not necessary to perform adjustment corresponding to the photographing magnification in the alignment. After the alignment, the image input processing unit 5 performs area segmentation of each part of the head, neck, upper body and upper limbs, wrist, lower body and lower limbs, and legs. Area / pattern matching is performed with pattern matching image data of various corresponding clothing items (for example, a hat if it is a head), and clothing items attached to each part are extracted (step S12).

  The pattern matching image database D2 includes pattern matching image data such as clothing items worn on each part of the human body and clothing items from the upper body to the lower body, in addition to the image data of the whole body of the person for alignment. The image input processing unit 52 is registered for each type and shape, and the clothing item extracted by performing pattern matching between the pattern matching image data and the imaged area image corresponding to each human body part is, for example, a large size. The type can be detected in detail, such as whether it is a handbag or a second back. In addition, it is easy to extract clothing items such as long long coats and short short coats that are continuous in the upper and lower bodies. Here, for example, in the case of extraction of a clothing item in the case of a wrist part, a matching process is performed using pattern matching images according to the sizes (large, medium, and small) of the back registered corresponding to the wrist part, After matching by size, matching processing is performed using pattern matching images according to shapes such as portrait, landscape, and square, and finally the image is extracted. Similarly, in the case of extracting clothing items of the head part, matching processing is performed using pattern matching images according to the sizes (large, medium, and small) of the hat collars registered corresponding to the head part. Finally, the image is extracted. In the case of the lower body part, it is determined whether the clothing item worn from the branch position of the lower limb is a skirt or trousers (pants). For example, in the case of a skirt, according to the size of the length (long, short, normal) The pattern matching image is used to perform the matching process, and after matching by size, the matching process is performed using the pattern matching image for each shape such that the hem is wide or narrow, and finally the image is extracted. . In this way, only the pattern matching image registered corresponding to each part of the body is used for the matching process at the time of extraction of the clothing item attached to the part, thereby enabling accurate and short-time matching processing. It can be extracted.

  Now, with respect to the image of the clothing item extracted by the image input processing unit 52, the image histogram generation unit 14 performs processing for obtaining a histogram of each color, and determines the color of the clothing item (step S13). FIGS. 5A, 5B, and 5C are examples in which a histogram is obtained with three colors of R (red), B (blue), and G (green). That is, FIGS. 5A, 5B, and 5C show the distribution of density values when an image is represented using 256 gradations of R, G, and B. In the illustrated example, blue clothing items are displayed. Show. Of course, not only R, G, and B but also various color systems may be specified to create a histogram. In addition, the color of the clothing item obtained in the histogram processing is displayed on the operation display panel 8 and presented to the user M, and the user M is asked whether the color is appropriate. The clothing item color may be specified by operating the operation display panel 8. At the same time, it is possible to specify the user M of each clothing item by registering the identification ID of the individual user as an attribute of the clothing item. In this case, for example, an individual user is specified by template matching between face image data of each registered user and a face image extracted from the captured whole body image.

  Further, at the time of photographing for registration, the reader device 7 checks whether or not the ID tag is attached to the clothing item worn by the user M (step S14). If an ID tag is attached to the clothing item, the reader device 7 sends the ID information read from the IC tag to the information processing unit 59 through the reader processing unit 54. The information processing unit 59 performs a process of taking ID information in step S15.

  After performing such processing, the information processing unit 59 ends the extraction of the clothing item, the determination of the color of the clothing item, the identification of the individual user, and the reception processing of the ID information of the ID tag. Processing to store in the clothing item identification base D6 the clothing item identification data shown in Table 1 including the type, color, user, and ID information of the extracted clothing item while automatically attaching the clothing ID to the item Is performed (step S16).

  In addition, while associating the extracted image data for each clothing item with the clothing ID, it is stored and saved in the clothing item image database D4 under the control of the information processing unit 59, and at the same time, whole body image data photographed for registration is stored. Each clothing ID of the clothing item that is dressed is associated with the image ID as shown in Table 2 and registered in the clothing item image database D4 (step S17).

  In addition, the user's personal data written in the identification data of the clothing item may be a name or an identification ID registered in advance for each user.

  Next, the information processing unit 59 asks the user M whether or not to add a voice keyword through the display on the operation display panel 8 (step S18). In response to this, when the user M selects to add a voice keyword through the operation display panel 8, the information processing unit 59 enters a voice keyword acquisition state through the voice recognition unit 58.

  In this voice keyword acquisition state, the user M speaks to the microphone MC the keyword associated with the clothing item used when searching for the clothing item. The utterance voice of the keyword acquired by the microphone MC is recognized by the voice recognition process captured by the voice recognition unit 5, and the information processing unit 59 that has received the recognition data (for example, text data) registers it in the voice keyword database D7. At the same time, the process of adding the clothing item identification database D6 is performed (step S19).

  When this voice keyword addition process is not performed or when the addition process ends, the new registration process of the clothing item is completed (step 20). Table 3 shows an example of registration in the voice keyword database D7.

  In this way, when the user M wears the clothing item, the user M stands in front of the closet 1 and simply instructs the above-mentioned registration for the shooting of the clothing item that the user M is wearing. The image data is automatically registered in the clothing item image database D4, and the identification data of the clothing item is automatically registered together with the attribute data in the clothing item database D6.

  In the case of using the clothing history and the comfort data for the difference in searching for the clothing item, the processing for registering the clothing history and the comfort history in the respective databases D1 and D3 may be performed. .

  That is, the clothing history is a history of the entry / exit date and time from the closet 1 for the clothing item managed by the clothing item identification database D6. In the embodiment, the clothing start date and time and the clothing end date and time are stored in the database D1 as the clothing history. In this case, when the user M selects the input / output process of the clothing item on the operation display panel 8 and stores it in the closet 1 based on the guidance displayed according to the selection, the clothing item is associated with the clothing item ID. Enter the date and time when it is put out, and when it is taken out from the closet 1. Further, the destination at that time and the name of the user M are input together. When these inputs are received, the information processing unit 59 acquires and stores the air of the day and the average temperature from the start of clothes to the end of clothes from the weather information providing server 11b of the weather information providing company via the Internet NT, and stores the clothes. Processing to store in the history database D1 is performed. In this way, it is possible to determine which season the clothing item is worn by continuing to record the clothing start date and time and the clothing end date and time for each clothing item and referring to the past clothing history. is there.

  Table 4 shows an example of clothing history data stored in the clothing history database D1.

  Note that instead of inputting the name of the user M as described above, the user M may be specified using voice recognition. In this case, the name and voice data of the user M who uses the system are registered in advance, and when registering the clothing history data, the user speaks to the microphone MC, and the voice data corresponding to the speech is transmitted to the microphone MC. The voice recognition means 59 may acquire the voice data that matches the acquired voice data from the registered voice data to identify the user M.

On the other hand, the comfort data stored in the comfort database D3 is obtained by quantifying the comfort of the clothing item after the user M wears. The comfort of this body type is difficult to judge by weight and body fat percentage. By using this comfort index as a history index and storing it as a history after wearing, it is possible to read daily body shape changes, suggesting meal menu menus and bathing from body shape change data It is also possible to propose a method to the user M. Here, an operation for storing a history of comfort in the comfort database D3 will be described.
This comfort is registered by operating the operation display panel 8 by the user himself / herself for the comfort of the clothing item that the user M is currently wearing. For example, the size of this clothing item is expressed in a 10-point scale. “The larger the number, the larger the clothing item is than the body shape.” “The smaller the number, the smaller the clothing item than the body shape (tight. ) ”. Moreover, it is supposed that it can be described about the site | part which is the evaluation of the clothing item concretely about remarks. Table 5 shows examples of comfort data stored in the comfort database D3.

  In addition, in the present embodiment, in order to enable the user M to search the storage location of the clothing item by storing the storage location when storing the clothing item in the closet 1, in this embodiment, the IC tag Apparel items with can be automatically registered in the storage location management database D5 under the control of the information processing unit 59.

  That is, when a clothing item is hung on a suitable place on the hanger part 2 by a hanger or stored in the drawer part 3, the reader device 7 'provided at each place is hung or attached to the stored clothing item. The ID information of the IC tag being read is read, and the read ID information is sent to the information processing unit 59 through the reader processing unit 54. The information processing unit 59, based on the acquired ID information, a clothing item ID corresponding to the clothing item to which the IC tag is attached, a storage location ID indicating a storage location associated with the reader device 7 ′, and a built-in clock. The storage date and time obtained from the storage location management database D5 is stored. Table 6 shows a data registration example of the storage location management database D5.

  Thus, when various data are stored and registered in the databases D1 to D7 as described above, the user M wants to display a desired clothing item on the liquid crystal display device 6a of the mirror liquid crystal 6, First, search is selected from the menu displayed on the operation display panel 8. By this selection, the control device 5 starts the clothing item search process according to the flowchart shown in FIG.

  First, the information processing unit 59 asks the user M whether or not to input a clothing item attribute through the operation display panel 8 (step S30). When the user M answers this question and inputs a search condition based on the attribute (step S30). (S31), the information processing unit 59 performs a search condition addition process (step S32). In this case, the search conditions that can be input are search conditions such as the item type and color of the clothing item identification database D6.

  Next, the information processing section 59 asks the user M whether or not to specify a clothing history through the operation display panel 8 (step S33). When the user M answers this question and inputs a clothing history condition (step S34). ), The information processing unit 59 performs processing for adding a search condition (step S35).

  In this case, it is also possible to enter search conditions with priorities set for the three elements of date / time (month / day), weather, and average temperature. It is possible to extract clothing items worn at the time. Also, by searching from the date, it is possible to efficiently extract clothing items suitable for the seasonal pattern. Furthermore, it is possible to extract clothing items suitable for annual events such as spring, summer, autumn, winter, birthday, and new year.

  Furthermore, by searching for clothing items from the weather information, it is possible to extract clothing items suitable for weather such as rain and snow, and also to extract clothing items that should be worn in the case of rain and snow, Furthermore, by searching for clothing items from the average temperature, it is possible to extract clothing items suitable for the temperature from the relationship between the past average temperature and clothing items, and also to extract clothing items suitable for the temperature of the day. You can also. In other words, it is possible to pour out clothing items that are suitable for such temperatures.

  Further, the information processing unit 59 asks the user M whether or not to specify the comfort condition through the operation display panel 8 (step S36). When the user M answers the question and inputs the comfort search condition (step S36). In step S37), the information processing section 59 performs search condition addition processing (step S38).

  Further, the information processing unit 59 asks the user M whether or not to specify a voice keyword through the operation display panel 8 (step S39), and when the user M answers the question and inputs a voice search condition (step S40). The information processing unit 59 performs search condition addition processing (step S41).

  When the search condition is input as described above, the information processing unit 59 starts the clothing item search process (step S42).

  By specifying the user M as the search condition, only the clothing items corresponding to the user M can be narrowed down to the search range. Therefore, the user ID can be identified by the operation display panel 8 before or after inputting the condition. Enter. Of course, the voice recognition unit 58 may be used to identify an individual from the speech of the user M.

  Thus, if all the above search conditions are input, the information processing unit 59 extracts the clothing item that best matches the search conditions from the databases D1, D2, D3, D6, and D7 corresponding to the search conditions. The image data of each clothing item corresponding to the clothing item ID of the extracted clothing item is extracted from the clothing item image database D4, and the extracted clothing item image data is sent to the image display unit 55. The image of the clothing item is displayed on the liquid crystal display device 6a of the mirror liquid crystal 6 (step S43). In this case, the image of each clothing item is displayed on the screen position of the liquid crystal display device 6a corresponding to each part of the figure reflected on the mirror surface of the half mirror of the user M standing in front of the mirror liquid crystal 6.

  If the clothing item extracted here has an IC tag and the location stored in the closet 1 is registered in the storage location management database D5, the storage location is displayed on the liquid crystal display device 6a. Let Further, the information processing unit 59 turns on the light emitting display unit 10 a or 10 b where the clothing item is stored through the lighting control unit 56.

  The clothing item search process by the control apparatus 5 is complete | finished by the above. By viewing the display on the liquid crystal display device 6a, the user M can know the clothing item that matches the input search condition, and also knows the location where the clothing item is stored, particularly the light emitting display unit 10a. Alternatively, since the storage location is intuitively (visually) known by turning on 10b, the user M can take out the clothing item without hesitation when entering the closet 1. In addition, when the clothing item displayed on the liquid crystal screen device 6a cannot be convinced, the user M can perform the search again in the control device 5 by resetting the search conditions until the confident clothing item is displayed.

  In this embodiment, the user M uses the operation display panel 8 for each clothing item to input and operate data input, search conditions, and the like. The input may be captured by recognition at 58.

1 is a schematic overall configuration diagram of a system according to an embodiment. It is a circuit block diagram of the control apparatus used for one Embodiment. It is a flowchart of the whole operation | movement description of one Embodiment. It is a flowchart of the clothing item registration process of one Embodiment. FIG. 4 illustrates an example of generating a histogram according to an embodiment, where (a) is a red histogram example, (b) is a green histogram example, and (c) is a blue histogram example. It is a flowchart of the search process of the clothing item of one Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Closet 2 Hanger part 3 Drawer part 4 Imaging camera 5 Control apparatus 6 Mirror liquid crystal 6a Liquid crystal display device 7 Reader apparatus 8 Operation display panel 9 Illumination apparatus 10a, 10b Light emission display part 11a, 11bb Server M User MC Microphone NT Internet

Claims (3)

It is provided between the imaging means for photographing the user's figure, the user's standing position and the imaging means, and the user can be photographed by the imaging means by the light transmission in the user direction from the imaging means. From the user side, the body functioning as a mirror, and the clothing item information worn by the user is acquired from the user's figure image taken by the imaging means, and the clothing item information is automatically registered in the storage means. Control means for performing area extraction of each part from the user's figure image , and pattern matching images of various clothing items registered corresponding to each part cut out and each part performing area pattern matching with, it has an image input processing unit for extracting an image of each clothing item that is mounted at each site, the extracted image of each clothing item該服decorative items Register with sex, the image input processing unit after matching by size during the area pattern matching performs matching processing using the shape by pattern matching image, and extracts an image for each clothing item Dressing system. The control means includes image processing means for obtaining a histogram of colors included in the photographed clothing item, and the histogram color obtained by the image processing means is registered in the storage means as an attribute of the clothing item information. The dressing system according to claim 1, wherein: The control means includes voice acquisition means for acquiring a user's utterance voice, and voice recognition means for recognizing a keyword related to a clothing item and recognizing an individual user from the voice acquired from the voice acquisition means. 2. The dressing system according to claim 1, wherein a voice keyword and individual user recognized by the voice recognition means are registered in the storage means as attributes of the clothing item.

Images