JP4477383B2 - Product data generator - Google Patents

Description

  The present invention relates to a product data generation device that generates product size data.

  In recent years, with the spread of the Internet and the improvement of image processing technology using computers, three-dimensional model data has been used for product presentations and the like. For example, in a shelf allocation system that checks the appearance and number of items displayed on a shelf in a store such as a convenience store or supermarket by simulation, the direction in which each item is displayed depends on the direction of each item. Since it is assumed that either the front, side, or top surface is displayed on the side visible to the customer, image data corresponding to the front view, side view, and top view for each product, Dimension data is required. In addition, when an advertisement on which a product is posted is generated using a computer such as a personal computer, image data corresponding to an overhead view of the product is required.

  On the other hand, various methods have been proposed as methods for generating three-dimensional model data. For example, a subject object (O) that separates the subject portion and the background, and a background display means (BD) in which one or both of the color and the luminance is changed by an n-value electrical signal (S) or the like, where n is an integer of 2 or more. ), A subject holding means (T) that changes in the same manner as the background display means (BD), and a background display means (BD) or subject holding means (T) by changing an electrical signal (S) or the like. The photographing means (CM) for photographing n images P1 to Pn including the subject object, the background display means and the subject holding means while changing one or both of the color and brightness of the image, and the photographing means (CM) Image processing means (SC) for comparing characteristic values of n images P1 to Pn in which one or both of the color and brightness of the background display means (BD) and subject holding means (T) are changed, and Image processing means (S ) By a large portion of the change in the characteristic value as a background, a method of extracting is proposed less parts as silhouettes of the subject object (O) (see Patent Document 1).

In this way, by using the self-luminous display means as the background display means, the amount of change in the brightness and color of the background is made larger than the amount of change in the subject object (O), and the subject object (O) is close to the background. Even if there is a color or the color of the subject object (O) changes, the background and the subject can be accurately segmented. In other words, it is possible to accurately obtain product dimension data (and image data).
JP 2001-148021 A

  However, it is the same as the background display means (BD) and the background display means (BD), where n is an integer of 2 or more, and one or both of the color and brightness changes according to an n-value electrical signal (S) or the like. In order to produce the subject holding means (T) for changing the object to place the subject object, a large amount of cost is required.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a product data generation apparatus that can accurately obtain product dimension data and can be manufactured at low cost. .

The product data generation device according to claim 1 is a product data generation device that generates size data of a product, wherein the product is arranged in a dark room, the product and the background. Image processing means for generating image data, a black light disposed in the dark room for irradiating the background with ultraviolet light, and image processing means for obtaining product dimension data using the image data generated by the imaging means And a first product illumination means for irradiating the product with visible light, wherein the darkroom is provided with a material that emits fluorescence when irradiated with the black light, at least on the background surface, imaging means is adapted to generate image data when irradiated with the black light, while irradiating the first product illumination means, an image in a case of radiating the black light First image data that is data and second image data that is image data when the black light is not irradiated, and the image processing means includes pixels of the first image data and the second image data. It is characterized in that a pixel whose characteristic value difference for each color is smaller than a predetermined value is extracted as a pixel corresponding to the product .

  According to said structure, goods are arrange | positioned inside a dark room and image data of goods and background are produced | generated by the imaging | photography means arrange | positioned in a dark room. Here, the black light disposed in the dark room irradiates ultraviolet rays to a portion corresponding to the background of the image data, and at least the surface corresponding to the background of the image data in the dark room is irradiated with the black light. A light emitting material is provided. That is, the surface corresponding to the background of the image data is configured to emit fluorescence when irradiated with black light. Then, image data when the black light is irradiated by the imaging means (that is, a state where the surface corresponding to the background of the image data is fluorescently emitted) is generated, and the image data generated by the imaging means by the image processing means Dimension data of the product is obtained using

  Accordingly, since the product dimension data is obtained using the image data in a state where the surface corresponding to the background of the image data is fluorescently emitted, the boundary between the product and the background is clarified, and the product dimension data is accurately obtained. . In addition, since the surface corresponding to the background of the image data is fluorescently emitted by the arrangement in which the black light is provided and the material corresponding to the background of the image data is provided with the fluorescent light emission, the configuration is simple and the product data A production | generation apparatus can be manufactured cheaply. The dark room may be a dark room that is not easily affected by outside light, in addition to the one that completely blocks outside light.

Further , according to the above configuration, the image data when the product is irradiated with visible light by the first product illumination unit and the black light is irradiated by the photographing unit (that is, the surface corresponding to the background emits fluorescence). First image data) and second image data which is image data when no black light is irradiated. Then, the image processing means extracts pixels having a characteristic value difference between the first image data and the second image data, which is smaller than a predetermined value, for each pixel as pixels corresponding to the product.

  Therefore, the characteristics regarding the color for each pixel of the first image data that is image data in which the surface corresponding to the background emits fluorescence and the second image data that is image data in which the surface corresponding to the background does not emit fluorescence. Since pixels whose value difference is smaller than a predetermined value are extracted as pixels corresponding to the product, the dimensional data of the product can be obtained more accurately.

3. The product data generation apparatus according to claim 2 , wherein the image processing unit extracts, as a pixel corresponding to the product, a pixel whose color difference between the first image data and the second image data is smaller than a predetermined value. It is characterized by doing.

  According to said structure, the pixel from which the color difference for every pixel of 1st image data and 2nd image data is smaller than predetermined value is extracted as a pixel corresponding to goods by an image processing means.

  Therefore, the color difference for each pixel between the first image data, which is image data in which the surface corresponding to the background emits fluorescence, and the second image data, which is image data in which the surface corresponding to the background does not emit fluorescence, is predetermined. Since the pixels smaller than the value of the product are extracted as the pixels corresponding to the product, the dimensional data of the product can be obtained easily and accurately.

The product data generation device according to claim 3 , further comprising: a second product illumination unit that irradiates the product with white light so as to have a higher illuminance than when the product is illuminated by the first product illumination unit. Means generates third image data which is image data when the second product illumination unit is not irradiated with the first product illumination unit and the black light, and the image processing unit includes the third product illumination unit. Of image data, pixel data corresponding to the product extracted using the first image data and the second image data is obtained as image data of the product.

  According to said structure, white light is irradiated to a product by the 2nd product illumination means so that it may be set as illuminance higher than the case where a product is irradiated by the 1st product illumination means. And it is the image data when not irradiating the first product illumination means and the black light in a state where the second product illumination means is irradiated by the photographing means (that is, image data when the product is irradiated with white light). Third image data is generated, and pixel data corresponding to the product extracted using the first image data and the second image data is obtained as image data of the product by the image processing means. It is done.

  Therefore, since pixel data corresponding to the product extracted using the first image data and the second image data is obtained as product image data, the pixel corresponding to the product is accurately obtained, and the product has white light. Since pixel data corresponding to the product of the third image data, which is image data when the light is irradiated, is obtained as product image data, appropriate image data is obtained.

  Therefore, among the third image data that is image data when the product is irradiated with white light, pixel data corresponding to the product extracted using the first image data and the second image data is the product image. Since it is calculated | required as data, the appropriate image data which has the exact outline of goods is calculated | required.

The product data generation device according to claim 4 , wherein the product data generation device is disposed in the darkroom, and rotatably mounts the product, and a turntable having a material that emits fluorescence when irradiated with the black light on an upper surface. And a control means for controlling the rotation angle of the turntable.

  According to the above configuration, the product is rotatably placed by the turntable that is disposed in the dark room and has a fluorescent light emitting material on the upper surface when irradiated with black light, and the turntable is rotated by the control means. The corner is controlled.

  Accordingly, since the rotation angle of the turntable on which the product is placed is controlled, the direction of the product can be freely changed. The turntable has a material on the top surface that emits fluorescence when irradiated with black light. Therefore, the turntable is irradiated with black light in the same manner as other surfaces (dark room walls, floors, etc.) that correspond to the background of image data. Then, it emits fluorescent light and is recognized as a pixel constituting the background.

The product data generation device according to claim 5 is provided in the darkroom, and includes a moving unit that changes a position of the photographing unit, and the control unit controls the position of the photographing unit by the moving unit. It is characterized by that.

  According to the above configuration, the position of the photographing unit is changed by the moving unit disposed in the darkroom, and the position of the photographing unit by the moving unit is controlled by the control unit. Accordingly, since the position of the photographing unit is controlled, the position of the photographing unit can be freely changed. That is, it is possible to generate image data viewed from an arbitrary position. For example, image data from a desired position is obtained according to the form of the product.

The product data generation apparatus according to claim 6 , wherein the control unit performs on / off control of the black light, the first product illumination unit, and the second product illumination unit, and imaging control by the imaging unit. It is a feature.

  According to said structure, on-off control of a blacklight, a 1st product illumination means, and a 2nd product illumination means and control of imaging | photography by an imaging | photography means are performed by a control means.

  Therefore, since the on / off control of the black light, the first product illumination unit, and the second product illumination unit and the imaging control by the imaging unit are performed, the image data for obtaining the product dimension data and image data (described above) First to third image data) can be easily generated.

The product data generation apparatus according to claim 7 , wherein the control unit obtains the first image data, the second image data, and the third image data when the product is viewed from the front, side, and top surface by the photographing unit. In order to generate each, the on / off control of the black light, the first product illumination unit and the second product illumination unit, the shooting control by the shooting unit, the control of the rotation angle of the turntable, and the movement unit by the moving unit The position of the photographing means is controlled, and the image processing means uses the first image data, the second image data, and the third image data when the product is viewed from the front, the side, and the top. Dimension data and image data when viewed from the front, side, and top are generated.

  According to the above configuration, the black light, the second image data, and the third image data are generated by the control means so as to generate the first image data, the second image data, and the third image data when the product is viewed from the front, the side, and the upper surface, respectively. The on-off control of the 1 product illumination means and the second product illumination means, the imaging control by the imaging means, the control of the rotation angle of the turntable, and the control of the position of the imaging means by the moving means are performed, and the image processing means By using the first image data, the second image data, and the third image data when the product is viewed from the front, the side, and the top surface, the dimension data and the image data when the product is viewed from the front, the side, and the top surface are obtained. Each is generated.

  Accordingly, the first image data, the second image data, and the third image data are generated when the product is viewed from the front, side, and top, and the product is viewed from the front, side, and top using these image data. Since the dimension data and the image data are generated in each case, the dimension data and the image data when the product is viewed from the front, the side, and the top are easily generated.

The product data generation device according to claim 8 , wherein the control unit generates the first image data, the second image data, and the third image data when the product is viewed obliquely from above by the photographing unit. The image processing is performed by controlling on / off of the black light, the first product illumination unit, and the second product illumination unit, the rotation angle of the turntable, and the position of the photographing unit by the moving unit. The means generates image data when the product is viewed obliquely from above using the first image data, the second image data, and the third image data when the product is viewed from diagonally above. It is said.

  According to said structure, in order to produce | generate the 1st image data, 2nd image data, and 3rd image data at the time of seeing goods from diagonally upward by a photography means by a control means, a black light, a 1st goods illumination means The second product lighting means is turned on / off, the rotation angle of the turntable is controlled, and the position of the photographing means is controlled by the moving means. When the product is viewed obliquely from above by the image processing means, Image data when the product is viewed obliquely from above is generated using the one image data, the second image data, and the third image data.

  Accordingly, the first image data, the second image data, and the third image data are generated when the product is viewed obliquely from above, and the image data when the product is viewed obliquely from above is generated using these image data. Therefore, image data when the product is viewed obliquely from above is easily generated.

The product data generation device according to claim 9 , wherein a barcode reader that reads a barcode attached to the product, and dimension data and image data of the product generated by the image processing unit are attached to the product. Product data storage means for storing in association with barcode data; and determination means for determining whether or not barcode data corresponding to the barcode read by the barcode reader is stored in the product data storage means; And the control means generates the first image data, the second image data, and the third image data when the determination means determines that the barcode data is not stored in the product data storage means. And the image processing means uses the first image data, the second image data, and the third image data. Is characterized in the storing in association with the bar code data into said product data storage means to generate the dimensional data and the image data of the product.

  According to the above configuration, the product data storage means stores the dimension data and image data of the product generated by the image processing means in association with the barcode data attached to the product, and the barcode reader The barcode attached to the product is read, and the determination unit determines whether or not the barcode data corresponding to the barcode read by the barcode reader is stored in the product data storage unit. Then, when the determination unit determines that the barcode data is not stored in the product data storage unit, the control unit performs control to generate the first image data, the second image data, and the third image data. The product size data and image data are generated by the image processing means using the first image data, the second image data, and the third image data, and stored in the product data storage means in association with the barcode data. The

  Therefore, when it is determined that the barcode data is not stored in the product data storage means, the product dimension data and the image data are generated and stored in association with the barcode data in the product data storage means. Product dimension data and image data can be efficiently generated.

  According to the invention described in claim 1, since the dimension data of the product is obtained using the image data in a state where the surface corresponding to the background of the image data is fluorescently emitted, the boundary between the product and the background becomes clear, The product dimension data can be obtained accurately. In addition, since the surface corresponding to the background of the image data is fluorescently emitted by the arrangement in which the black light is provided and the material corresponding to the background of the image data is provided with the fluorescent light emission, the configuration is simple and the product data A production | generation apparatus can be manufactured cheaply.

Further, according to the invention described in claim 1, first a first image data surface corresponding to the background is the image data that fluoresce, is a surface corresponding to the background is the image data which is not fluoresce Since pixels having a characteristic value difference with respect to the color of each pixel from the two image data are smaller than a predetermined value are extracted as pixels corresponding to the product, the size data of the product can be obtained more accurately.

According to the second aspect of the present invention, the first image data that is image data in which the surface corresponding to the background emits fluorescence and the second image that is image data in which the surface corresponding to the background does not emit fluorescence. Since a pixel having a color difference with respect to each pixel smaller than a predetermined value is extracted as a pixel corresponding to the product, the dimensional data of the product can be obtained easily and accurately.

According to the invention of claim 3 , it corresponds to the product extracted using the first image data and the second image data among the third image data which is the image data when the product is irradiated with white light. Since the pixel data to be obtained is obtained as image data of the product, appropriate image data having an accurate contour of the product can be obtained.

According to the invention described in claim 4 , since the rotation angle of the turntable on which the product is placed is controlled, the direction of the product can be freely changed. The turntable has a material on the top surface that emits fluorescence when irradiated with black light. Therefore, the turntable is irradiated with black light in the same manner as other surfaces (dark room walls, floors, etc.) that correspond to the background of image data. Then, it emits fluorescent light and can be recognized as a pixel constituting the background.

According to the fifth aspect of the present invention, since the position of the photographing means is controlled, the position of the photographing means can be freely changed. That is, image data viewed from an arbitrary position can be generated.

According to the sixth aspect of the invention, since the on / off control of the black light, the first product illumination unit and the second product illumination unit and the imaging control by the imaging unit are performed, the product dimension data and the image data The image data for obtaining the image (the first to third image data described above) can be easily generated.

According to the seventh aspect of the present invention, the first image data, the second image data, and the third image data when the product is viewed from the front, the side, and the top are generated. Since the dimension data and the image data when the product is viewed from the front, the side, and the top surface are respectively generated, the dimension data and the image data when the product is viewed from the front, the side, and the top surface can be easily generated.

According to the invention described in claim 8 , the first image data, the second image data, and the third image data when the product is viewed obliquely from above are generated, and the product is obliquely upward using these image data. Since the image data of the case is generated, the image data when the product is viewed obliquely from above can be easily generated.

According to the ninth aspect of the present invention, when it is determined that the barcode data is not stored in the product data storage means, product dimension data and image data are generated, and the barcode data is stored in the product data storage means. Therefore, product dimension data and image data can be efficiently generated.

  FIG. 1 is an example of a plan view of a product data generation apparatus of the present invention. The product data generating apparatus includes a dark room 1, a digital camera 2 (corresponding to an imaging unit) capable of color image generation for generating product and background image data, and black lights (Black Light) 31 to 35 (hereinafter referred to as "ultraviolet rays"). , Generically referred to as black light 3), ceiling light 4 (corresponding to the first product illumination means) for irradiating the product with visible light, and illumination lamps 51-58 (hereinafter, generically) for irradiating the product with white light. The lighting lamp 5 is equivalent to the second product lighting means), the turntable 6 on which the product is rotatably mounted, and the support arm 7 that changes the position of the digital camera 2 (corresponding to the moving means). And a control device 8 composed of a personal computer or the like for performing various controls.

  The dark room 1 has a structure that substantially prevents intrusion of light from the outside, and a digital camera 2, a black light 3, a ceiling light 4, an illumination light 5, a turntable 6, and a support arm 7 are arranged therein. It is installed. In addition, a paint containing a material that emits fluorescence when irradiated with the black light 3 (hereinafter referred to as a fluorescent paint) is applied to an appropriate inner surface (floor surface, wall surface, etc.) of the dark room 1.

  The digital camera 2 is a CCD camera with a so-called RGB color filter, and the number of pixels is, for example, 1600 × 2400 pixels for each color. The digital camera 2 has an AF (Auto Focus) function, an AE (Automatic Exposure) function, and the like, and the use of a strobe is prohibited. The digital camera 2 stores captured image data for each color.

  The black light 3 cuts visible light and efficiently generates ultraviolet rays having a strong fluorescent action (wavelength 352 nm). In the dark room 1, there are a total of five black lights 3, one for the support arm 7 in the vicinity of the digital camera 2 (black light 31: see FIG. 2) and four for the side wall (black lights 32 to 35). A book is arranged.

  Both the ceiling lamp 4 and the illuminating lamp 5 are so-called fluorescent lamps that irradiate white light. In the dark room 1, the ceiling lamp 4 is a single fluorescent lamp disposed on the ceiling, and the illuminating lamp 5 Are eight fluorescent lamps 51 to 58 arranged on the side wall.

  The turntable 6 is configured such that a product can be placed on the horizontal upper surface thereof, and is configured to be rotatable around a vertical axis by a motor (not shown) or the like. It can be moved up and down. The drive amount control of each motor is performed by counting the number of drive pulses to the motor or by counting drive pulses from an encoder (rotary encoder in the rotating shaft) provided in the driven part.

  FIG. 2 is an example of a configuration diagram of the support arm 7. (A) is a top view, (b) is a side view. The support arm 7 has a substantially L-shaped movable part 72 with a digital camera 2 and a black light 31 fixed to the distal end thereof, and a base end bolted to the floor 11 of the dark room 1. And a fixed portion 71 that is supported by a rotary shaft 73 and a drive unit (not shown) that includes a motor that rotates the movable portion 72 around the rotary shaft 73. The height of the center of the upper surface of the turntable 6 and the rotation shaft 73 are substantially the same, and the tip of the movable portion 72 is swiveled on a vertical plane passing through the center of the turntable 6.

  The movable portion 72 is configured to be able to rotate approximately 90 ° with respect to the horizontal position, and the product can be viewed from the front and side by the digital camera 2 in a state where the rotation angle θ with respect to the horizontal position is approximately 0 °. Image data is generated. In addition, in the state where the rotation angle θ is approximately 90 °, the digital camera 2 generates image data in which the product is viewed from above. Furthermore, when generating image data obtained by viewing the product from obliquely above, the rotation angle θ is set to 15 to 60 ° depending on the form of the product.

  FIG. 3 is an example of a hardware configuration diagram of the control device 8. The control unit 86 controls the overall operation of the control device 8. An information processing unit (CPU) 861, a RAM 862 for temporarily storing information during processing, an operating system (OS), and the like are stored in advance. ROM 863.

  The external input / output control unit 871 detects between the control unit 86 and the external devices including the digital camera 2, the black light 3, the ceiling light 4, the illumination light 5, the turntable 6, the support arm 7, and the barcode reader 9. The signal is converted into a digital signal for processing, and the command information is converted into a control signal for output to each external device, and the signal processing and input / output processing are performed, for example, in a time-sharing manner. . The external device control unit 872 performs a control signal output operation to each external device and a detection signal input operation from each external device within each time division period.

  The barcode reader 9 reads a barcode printed on a product or a product packaging. The drawing processing unit 811 displays a required image on the monitor 81 in accordance with an image display instruction from the control unit 86, and includes a video RAM and the like. The audio reproducing unit 821 outputs a predetermined message or the like to the speaker 82 in accordance with an instruction from the control unit 86. The I / F unit 831 writes information such as image data generated by the digital camera 2 to the HDD 83 (or reads from the HDD 83) in accordance with a writing (or reading) instruction from the control unit 86.

  The CPU 861 reads out the image, sound, and control program data from the ROM 863 based on an operating system (OS) recorded in the ROM 863 that is built-in or externally attached / detached. Some or all of the read image, sound, control program data, and the like are held on the RAM 862. Thereafter, the CPU 861 proceeds with processing based on a control program stored in the RAM 862, various data (image data, audio data), detection signals from external devices, and the like.

  Of various data stored in the ROM 863, data that can be stored in a removable recording medium can be read by a driver such as a hard disk drive, an optical disk drive, a flexible disk drive, a silicon disk drive, or a cassette medium reader. In this case, the recording medium is, for example, a hard disk, an optical disk, a flexible disk, a CD, a DVD, or a semiconductor memory.

  FIG. 4 is an example of a functional configuration diagram of the control device 8. The CPU 861 of the control device 8 determines whether or not barcode data corresponding to the barcode read by the barcode reader 9 is stored in a product data storage unit 83a described later (corresponding to a determination unit). ), A control unit 861b (corresponding to control means) for outputting control commands to the digital camera 2, the black light 3, the ceiling light 4, the illumination light 5, the turntable 6 and the support arm 7, and the digital camera 2 An image processing unit 861c (corresponding to an image processing unit) that obtains product dimension data and image data from the generated image data is provided.

  The HDD 83 of the control device 8 stores product size data and image data obtained by the image processing unit 861c in association with barcode data corresponding to the barcode read by the barcode reader 9. 83a (corresponding to product data storage means). The RAM 862 of the control device 8 includes an image data storage unit 862a that temporarily stores product image data (first to third image data described later) generated by the digital camera 2 in accordance with an instruction from the control unit 861b. ing.

  FIG. 5 is an example of a chart showing a configuration of the product data storage unit 83a of the HDD 83. The product data storage unit 83a stores product size data SD and image data PD obtained by the image processing unit 861c in association with the barcode data BD corresponding to the barcode read by the barcode reader 9. Yes.

  The bar code data BD is, for example, data corresponding to a so-called JAN code, which is a 2-digit country code data BD1 for identifying a country, a 7-digit manufacturer code data BD2 for identifying a manufacturer, and a product. 3 item merchandise item code data BD3.

  The dimension data SD is composed of, for example, a maximum height SD1 and a maximum width SD2 obtained from image data viewed from the front, and a maximum depth SD3 obtained from image data viewed from the side. Image data PD includes product image data PD1 viewed from the front, product image data PD2 viewed from the side, product image data PD3 viewed from the top, and product image data PD4 viewed from the top. It is configured.

  The functional configuration diagram shown in FIG. 4 will be described again. The determination unit 861a determines whether or not barcode data corresponding to the barcode read by the barcode reader 9 is stored in the product data storage unit 83a.

  Specifically, the determination unit 861a firstly displays the country code data of the barcode data BD corresponding to the barcode read by the barcode reader 9 among the barcode data BD stored in the product data storage unit 83a. The data corresponding to the barcode read by the barcode reader 9 is extracted from the product item code data BD3 of the extracted barcode data BD. It is determined whether or not there is a product that matches the product item code data BD3.

  The controller 861b adjusts the height of the turntable 6 and the viewing angle (zoom) of the digital camera 2 (hereinafter referred to as initial setting) in accordance with the size of the product. In addition, the control unit 861b generates the first image data, the second image data, and the third image data when the product is viewed from the front, the side, the top, and the diagonally upper side, respectively. Control of on / off of the illumination lamp 5, control of photographing by the digital camera 2, control of the rotation angle of the turntable 6, and control of the position of the digital camera 2 by the support arm 7 are performed. A specific initial setting method will be described later with reference to the flowchart shown in FIG.

  Here, the first image data is image data generated by the digital camera 2 when the black light 3, the ceiling light 4, and the illumination light 5 are respectively ON, ON, and OFF, and the second image data is The black light 3, the ceiling light 4, and the illumination light 5 are image data generated by the digital camera 2 when the light is OFF, ON, and OFF, respectively. The third image data is the black light 3, the ceiling light 4, and the illumination. The lamp 5 is image data generated by the digital camera 2 when the lamp 5 is OFF, OFF, and ON, respectively.

  In other words, the first image data is image data that is different from the second image data in that the background portion is fluorescently emitted by the black light 3, and the third image data is most suitable for the product. This is image data in an illuminated state.

  The image processing unit 861c uses the first image data, the second image data, and the third image data when the product is viewed from the front, the side, the upper surface, and the diagonally upper side generated by the control unit 861b to display the product in front. Dimension data and image data when viewed from the side surface and top surface, and image data when the product is viewed obliquely from above are generated.

  More specifically, the image processing unit 861c first uses the first image data and the second image data when the product is viewed from the front, the side, the top, and the diagonally upper side, using the first image data and the second image data. By extracting pixels with a color difference smaller than a predetermined value from the image data as pixels corresponding to the product, the product outline data when the product is viewed from the front, side, top, and diagonally upward is obtained. is there.

  Then, the image processing unit 861c is a pixel corresponding to the product extracted using the first image data and the second image data in the third image data when the product is viewed from the front, side, top, and diagonally upward directions. Is obtained as image data of a product when the product is viewed from the front, side, upper surface, and diagonally upward. Further, the image processing unit 861c uses the outer shape data of the product when the product is viewed from the front, side, and upper surface, and the product dimension data (here, maximum height, maximum width, and maximum depth: see FIG. 5). It is what you want.

  FIG. 6 is an example of a flowchart showing an outline of the operation of the product data generation apparatus of the present invention. First, the determination unit 861a determines whether or not a barcode is read from the barcode reader 9 (whether or not barcode data is input from the barcode reader 9) (step S101). If it is determined that the barcode data has not been input (NO in step S101), the process enters a standby state. If it is determined that the barcode data is input (YES in step S101), whether or not the same barcode data as the input barcode data is stored in the product data storage unit 83a by the determination unit 861a. Is determined (step S103).

  If it is determined that the item is stored in the product data storage unit 83a (YES in step S103), the process ends. When it is determined that the product is not stored in the product data storage unit 83a (NO in step S103), the control unit 861b determines whether or not the product is placed on the turntable 6 (step S105). ). This determination is performed, for example, by the control unit 861b receiving an input from the outside (for example, receiving an input from a mouse). More specifically, a message “Place product on the turntable” and an “OK” button are displayed on the monitor 81, and the product is placed on the turntable 6 when the “OK” button is clicked. It is determined that it is placed.

  If it is determined that the product is not placed on the turntable 6 (NO in step S105), the process is set in a standby state. If it is determined that the product is placed on the turntable 6 (YES in step S105), the control unit 861b adjusts the height of the turntable 6 and the viewing angle (zoom) of the digital camera 2 (initial stage). Setting) is performed (step S107).

  Then, the control unit 861b generates first image data, second image data, and third image data when the product is viewed from the front, and the image processing unit 861c generates the first image data, the second image data, and the second image data. Dimension data and image data when the product is viewed from the front using the three image data are obtained (step S109). Here, a series of processes in which the control unit 861b generates the first image data, the second image data, and the third image data and the image processing unit 861c obtains the dimension data and the image data is referred to as a main photographing process.

  Next, the turntable 6 is rotated by 90 ° by the controller 861b (step S111). The control unit 861b and the image processing unit 861c perform the main photographing process when the product is viewed from the side (step S113). Next, the control unit 861b rotates the turntable 6 by a predetermined angle θ1 (θ1 = −90 ° to 0 °), and the support arm 7 rotates by a predetermined angle φ1 (φ1 = 0 ° to 90 °) (step). S115). For example, the predetermined angle θ1 is −45 °, and the predetermined angle φ1 is 45 °.

  The control unit 861b and the image processing unit 861c perform a main photographing process when the product is viewed obliquely from above (step S117). Next, the turntable 6 is rotated by a predetermined angle θ2 (θ2 = −90 ° −θ1) and the support arm 7 is rotated by a predetermined angle φ2 (φ2 = 90 ° −φ1) by the controller 861b (step S119). ). That is, the turntable 6 is returned to the initial position, and the support arm 7 is set to a position rotated by 90 ° from the initial position (position where the digital camera 2 is directly above the turntable 6). The control unit 861b and the image processing unit 861c perform a main photographing process when the product is viewed from above (step S117). Next, the dimensional data and the image data generated in step S109, step S113, step S117, and step S121 are associated with the barcode data read in step S101 by the image processing unit 861c in the product data storage unit 83a. Stored (step S123), and the process ends.

  FIG. 7 is an example of a detailed flowchart of the initial setting process performed in step S107 of the flowchart shown in FIG. First, the turntable 6 and the support arm 7 are moved to the initial positions by the controller 861b (step S201). Here, the initial position of the turntable 6 is an initial position in the vertical direction. Next, the black light 3, the ceiling light 4, and the illuminating lamp 5 are all set to “OFF” by the control unit 861b (step S203). Then, the black light 3 and the ceiling light 4 are set to “ON” by the control unit 861b (step S205).

  Next, the product is photographed by the digital camera 2 by the control unit 861b, and first image data is generated and stored in the image data storage unit 862a (step S207). Then, the black light 3 is set to “OFF” by the controller 861b (step S209). Next, the control unit 861b shoots the product with the digital camera 2, generates second image data, and stores it in the image data storage unit 862a (step S211). Then, using the first image data generated in step S207 and the second image data generated in step S211 (read out from the image data storage unit 862a), the image processing unit 861c obtains the outline data of the product. (Step S213).

  Next, the turntable 6 is lowered by a predetermined amount (here, 100 mm) by the controller 861b (step S215). Then, the black light 3 is set to “ON” by the controller 861b (step S217). Next, the product is photographed by the digital camera 2 by the control unit 861b, and first image data is generated and stored in the image data storage unit 862a (step S219).

  Then, the black light 3 is set to “OFF” by the controller 861b (step S221). Next, the control unit 861b shoots the product with the digital camera 2, generates second image data, and stores it in the image data storage unit 862a (step S223). Then, using the first image data generated in step S219 and the second image data generated in step S223 (read out from the image data storage unit 862a), the image processing unit 861c obtains the product outline data. (Step S225).

  Next, the control unit 861b obtains a later-described lift amount ΔT of the turntable 6 using the outer shape data obtained in Step S13 and Step S225 (Step S227). Then, the control unit 861b raises / lowers the turntable 6 by the raising / lowering amount ΔT (step S229). Next, the control unit 861b obtains a zoom magnification α, which will be described later, of the digital camera 2 using the outline data obtained in step S13 and step S225 (step S231). Then, the control unit 861a sets the digital camera 2 to the zoom magnification α (step S233), and the process is returned.

  FIG. 8 is an example of an explanatory diagram of the lift ΔT of the turntable 6 and the zoom magnification α of the digital camera 2. (A) is explanatory drawing which shows an example of the external shape data of the goods calculated | required by step S213 and step S225 of the flowchart shown in FIG. 7, (b) is step S229 and step S233 of the flowchart shown in FIG. It is explanatory drawing which shows an example of the external shape data of goods when the raising / lowering amount (DELTA) T of the turntable 6 and the zoom magnification (alpha) of the digital camera 2 are set.

  An area G0 in (a) and (b) indicates the entire area of an image taken by the digital camera 2, and has a height H0 and a width W0. Further, the center line CL1 in the height direction and the center line CL2 in the width direction of the region G0 are indicated by alternate long and short dash lines. In (a), the outline G1 is the outline of the product obtained in step S213 of the flowchart shown in FIG. 7, and the outline G2 is the outline of the product obtained in step S225 of the flowchart shown in FIG. It is.

In (a), the center line in the height direction of the outline G2 is at a position higher than the center line CL1 in the height direction of the region G0 by a distance ΔTG. On the other hand, in (a), the outline G2 is at a position lower than the outline G1 by the distance ΔH because the turntable 6 is lowered by 100 mm in step S215 of the flowchart shown in FIG. That is, the distance ΔH in (a) corresponds to the actual distance of 100 mm. Therefore, in order to make the center position of the product in the height direction coincide with the center line CL1 in the height direction of the region G0, the turntable 6 may be lowered by the lift amount ΔT obtained by the following equation (1). .
ΔT = ΔTG × 100 / ΔH (1)

In (a), the ratio R1 (= W1 / H1) of the width W1 to the height H1 of the outline G1 (and the outline G2) and the ratio R0 (= W0 / W0) of the width W0 to the height H0 of the region G0. In this case, it is assumed that the ratio R1 is larger than the ratio R0 (that is, the outline G1 is longer than the region G0). In this case, the zoom magnification α of the digital camera 2 is obtained by the following equation (2) so that the width W1 of the outline G1 is a predetermined ratio (0.8 times here) of the width W0 of the region G0. Is set to
α = 0.8 × W0 / W1 (2)

  Thus, when the zoom magnification α is set, the width W3 of the product outline G3 shown in (b) becomes a predetermined ratio (here, 0.8 times) of the width W0 of the region G0. As described above, the elevation amount ΔT of the turntable 6 and the zoom magnification α of the digital camera 2 are obtained using the equations (1) and (2), respectively.

  FIG. 9 is an example of a detailed flowchart of the main photographing process performed in step S109, step S113, step S117, and step S121 of the flowchart shown in FIG. First, the control unit 861b sets all of the black light 3, the ceiling lamp 4, and the illuminating lamp 5 in the initial state to “OFF” (step S401). Then, the black light 3 and the ceiling light 4 are set to “ON” by the controller 861b (step S403).

  Next, the product is photographed by the digital camera 2 by the control unit 861b, and first image data is generated and stored in the image data storage unit 862a (step S405). Then, the black light 3 is set to “OFF” by the controller 861b (step S407). Next, the control unit 861b shoots the product with the digital camera 2, generates second image data, and stores it in the image data storage unit 862a (step S409). Then, using the first image data generated in step S405 and the second image data generated in step S409 (read out from the image data storage unit 862a), a pixel corresponding to the product is extracted by the image processing unit 861c. In addition, dimension data (here, maximum height, maximum width, and maximum depth: see FIG. 5) is obtained (step S411).

  Then, the illumination lamp 5 is set to “ON” by the controller 861b (step S4013). Next, the product is photographed by the digital camera 2 by the control unit 861b, and third image data is generated and stored in the image data storage unit 862a (step S415). Next, pixel data corresponding to the product extracted in step S411 is obtained as image data of the product among the third image data generated in step S415 by the image processing unit 861c (step S417). Returned.

  FIG. 10 is an example of an explanatory diagram for explaining the outline of the product outer shape calculation process performed in step S213 and step S225 of the flowchart shown in FIG. 7 and step S411 of the flowchart shown in FIG. An example of the first image P1 is shown in the upper left part of the figure, and an example of the second image P2 is shown in the upper right part of the figure. In the first image P1 and the second image P2, the product images P11 and P21 are displayed at approximately the center, respectively, and the areas excluding the product images P11 and P21 are the background images P12 and P22.

  As described above, the first image P1 is an image generated by the digital camera 2 when the black light 3, the ceiling light 4, and the illumination light 5 are ON, ON, and OFF, respectively, and the second image P2 is , Black light 3, ceiling lamp 4 and illumination lamp 5 are images generated by digital camera 2 when OFF, ON and OFF, respectively. Accordingly, the product images P11 and P21 of the first image P1 and the second image P2 have the same level of brightness, but the second image P2 is an image in a state in which the black light 3 is lit, and thus the background image P22. The image is significantly brighter than the background image P12.

  Therefore, the first image P1 and the second image P2 are compared for each pixel, pixels at positions with significantly different brightness are used as pixels corresponding to the background image P32, and pixels included in an area other than the background image P32 are used. A product outline calculation process is performed by extracting pixels corresponding to the product image P31.

  FIG. 11 is an example of a detailed flowchart of the product outline calculation process performed in steps S213 and S225 of the flowchart shown in FIG. 7 and step S411 of the flowchart shown in FIG. Here, it is assumed that the CCD of the digital camera 2 has a horizontal pixel count M (for example, M = 2400 pixels) and a vertical pixel count N (for example, N = 1600 pixels). The following processing is all performed by the image processing unit 861c.

First, the value of the counter i for counting the pixels in the vertical direction is initially set to 1 (step S301). Next, the value of the counter j that counts the pixels in the horizontal direction is initialized to 1 (step S303). In the first image data, the pixel value of the i-th pixel in the vertical direction and the j-th pixel in the horizontal direction is read from the image data storage unit 862a (step S305). Here, the pixel value is assumed to be composed of RGB data, and the read pixel value is represented as (R1, G1, B1). Next, the pixel value (RGB data) read in step S305 is converted into the L ^* a ^* b ^* color system (step S307). Here, the pixel value after the conversion in step S307 is expressed as (L1 ^* , a1 ^* , b1 ^* ).

Then, the pixel value of the i-th pixel in the vertical direction and the j-th pixel in the horizontal direction in the second image data is read from the image data storage unit 862a (step S309). Here, the pixel value is assumed to be composed of RGB data, and the read pixel value is represented as (R2, G2, B2). Next, the pixel value (RGB data) read in step S309 is converted into the L ^* a ^* b ^* color system (step S311). Here, the pixel value converted in step S311 is expressed as (L2 ^* , a2 ^* , b2 ^* ).

Then, the L ^* a ^* b ^* color difference ΔE between the pixel value obtained in step S307 and the pixel value obtained in step S311 is obtained using the following equation (3) (step S313).
Delta] E = SQRT ^{[(L1 * -L2 *) 2 +} (a1 * -a2 *) 2 + (b1 * -b2 *) 2 ] (3)
However, SQRT (X) is a function for obtaining the square root of X. That is, the L ^* a ^* b ^* color difference ΔE is the distance between the pixel value obtained in step S307 and the pixel value obtained in step S311 in the L ^* a ^* b ^* color space. In the equation (3), a coefficient (weight) may be given to the difference between the components of L ^* a ^* b ^* .

Next, it is determined whether or not L ^* a ^* b ^* color difference ΔE is equal to or larger than a predetermined value β set in advance (step S315). If it is determined that the value is equal to or greater than the predetermined value β, the i-th pixel in the vertical direction and the j-th pixel in the horizontal direction are set as pixels corresponding to the background (step S317). If it is determined that it is not greater than or equal to the predetermined value β (that is, less than the predetermined value β), the i-th pixel in the vertical direction and the j-th pixel in the horizontal direction are set as pixels corresponding to the product (step S319). ).

  When the process of step S317 or step S319 is completed, it is determined whether or not the value of the counter j is equal to or greater than the number of pixels M (step S321). When it is determined that the number of pixels is not equal to or greater than M (that is, less than the number of pixels M) (NO in step S321), the value of the counter j is incremented by 1 (step S323), and the process proceeds to step S305. The process from step S305 to step S319 is repeatedly executed.

  If it is determined that the number of pixels is greater than or equal to M (YES in step S321), it is determined whether or not the value of the counter i is greater than or equal to the number of pixels N (step S325). If it is determined that the number of pixels is not equal to or greater than N (that is, less than the number of pixels N) (NO in step S325), the value of the counter i is incremented by 1 (step S327), and the process proceeds to step S303. The process from step S303 to step S321 is repeatedly executed. If it is determined that the number of pixels is equal to or greater than N (YES in step S325), the process is returned.

  12 to 14 are examples of first to third images generated by the digital camera 2, respectively. In the first to third images PIC1 to PIC3 shown in FIGS. 12 to 14, product images PIC11 to PIC31 having a substantially rectangular parallelepiped shape are displayed at a substantially central portion, and background images PIC12 to PIC32 are displayed in other regions. The product image PIC11 of the first image PIC1 shown in FIG. 12 and the product image PIC21 of the second image PIC2 shown in FIG. 13 are photographed with the same brightness, whereas the first image PIC1 shown in FIG. The background image PIC12 is photographed brighter than the background image PIC22 of the second image PIC2 shown in FIG. 13 because the background portion corresponding to the background image PIC12 emits fluorescence by the black light 3.

  Further, the product image PIC31 of the third image PIC3 shown in FIG. 14 is an image taken with the illumination lamp 5 turned on, and thus is an appropriate image with sufficient brightness. Therefore, using the first image PIC1 shown in FIG. 12 and the second image PIC2 shown in FIG. 13, the pixels corresponding to the product are extracted as described above in FIGS. 10 and 11, and the pixels corresponding to the product are extracted. A product image PIC31 which is the third image PIC3 is obtained as product image data.

  As described above, for each pixel, the first image data that is image data in which the surface corresponding to the background emits fluorescence and the second image data that is image data in which the surface corresponding to the background does not emit fluorescence. Since the pixel having a color difference smaller than the predetermined value β is extracted as a pixel corresponding to the product, the dimensional data of the product can be obtained more accurately. .

  In addition, since the surface corresponding to the background of the image data is made fluorescent by the configuration in which the black light 3 is provided and the surface corresponding to the background of the image data is coated with fluorescent paint, the configuration is simple, The data generation device can be manufactured at low cost.

  Furthermore, among the third image data that is image data when the product is irradiated with white light, pixel data corresponding to the product extracted using the first image data and the second image data is the product image. Since it is calculated | required as data, the appropriate image data which has the exact outline of goods can be calculated | required.

  In addition, since the rotation angle of the turntable 6 on which the product is placed is controlled, the direction of the product can be freely changed. Further, since the turntable 6 is coated with a paint that emits fluorescence when irradiated with the black light 3, the black light is applied in the same manner as other surfaces (dark room wall surface, floor surface, etc.) corresponding to the background of the image data. When 3 is irradiated, it emits fluorescent light and can be recognized as a pixel constituting the background. Further, since the position of the digital camera 2 is controlled, the position of the digital camera 2 can be freely changed. That is, image data viewed from an arbitrary position can be generated.

  Furthermore, the first image data, the second image data, and the third image data when the product is viewed from the front, side, and top are generated, and the product is viewed from the front, side, and top using these image data. Since the dimension data and the image data in the case are respectively generated, the dimension data and the image data when the product is viewed from the front, the side, and the upper surface can be easily generated. In addition, the first image data, the second image data, and the third image data are generated when the product is viewed obliquely from above, and the image data when the product is viewed obliquely from above is generated using these image data. Therefore, it is possible to easily generate image data when the product is viewed obliquely from above.

  When it is determined that the barcode data is not stored in the product data storage unit 83a, product dimension data and image data are generated and stored in the product data storage unit 83a in association with the barcode data. Therefore, product dimension data and image data can be generated efficiently.

  In addition, this invention is applicable also to the following aspects.

  (A) In the present embodiment, the case where the image processing unit 861c extracts the pixels corresponding to the product by comparing the first image data and the second image data has been described, but the image processing unit 861c performs the first image data. The pixel whose brightness is not more than a predetermined value may be extracted as a pixel corresponding to a product. In this case, the processing is simplified, the image data generated by the digital camera 2 can be reduced, and the time required to generate desired dimension data and image data is also reduced.

(B) In the present embodiment, the case has been described in which the image processing unit 861c extracts pixels corresponding to a product based on L ^* a ^* b ^* color differences of pixels corresponding to the first image data and the second image data. The pixel corresponding to the product may be extracted based on the difference in the characteristic values regarding the colors. For example, the form which extracts the pixel corresponding to goods by the difference of a brightness | luminance, brightness, etc. may be sufficient. In this case, the process is simplified. Further, a form using a color difference other than L ^* a ^* b ^* color difference (for example, L ^* u ^* v ^* color difference) may be used. Furthermore, the form using each difference of RGB may be sufficient.

  (C) In the present embodiment, the case where the image processing unit 861c obtains the maximum height, the maximum width, and the maximum depth as the product dimension data has been described. However, the product external data (contour data) may be obtained.

  (D) In the present embodiment, when the product is viewed from the front, side, upper surface, and diagonally upward by rotating the product using the turntable 6 and changing the position of the digital camera 2 using the support arm 7. Although the case where image data is generated has been described, the product and the digital camera 2 may be moved relatively. For example, one of the product and the digital camera 2 may be fixed and the other may move.

It is an example of the top view of the goods data generation apparatus of this invention. It is an example of the block diagram of a support arm. It is an example of the hardware block diagram of a control apparatus. It is an example of a functional block diagram of a control apparatus. It is an example of the figure which shows the structure of the goods data storage part of HDD. It is an example of the flowchart showing the outline | summary of operation | movement of the goods data generation apparatus of this invention. 7 is an example of a detailed flowchart of an initial setting process performed in step S107 of the flowchart shown in FIG. 6. It is an example of explanatory drawing of the raising / lowering amount of a turntable, and the zoom magnification of a digital camera. FIG. 7 is an example of a detailed flowchart of a main photographing process performed in step S109, step S113, step S117, and step S121 of the flowchart shown in FIG. 6; FIG. 10 is an example of an explanatory diagram for explaining an outline of a product outer shape calculation process performed in step S213 and step S225 of the flowchart shown in FIG. FIG. 10 is an example of a detailed flowchart of a product outer shape calculation process performed in step S213 and step S225 of the flowchart shown in FIG. 7 and step S411 of the flowchart shown in FIG. It is an example of the 1st image produced | generated by a digital camera. It is an example of the 2nd picture generated with a digital camera. It is an example of the 3rd image produced | generated by a digital camera.

Explanation of symbols

1 Darkroom 2 Digital camera (photographing means)
3 Black light 4 Ceiling light (1st product lighting means)
5 Illumination lights (second product illumination means)
6 Turntable 7 Support arm (moving means)
8 Control device 83 HDD
83a Product data storage unit (product data storage means)
861 CPU
861a determination unit (determination means)
861b Control unit (control means)
861c Image processing unit (image processing means)
862 RAM
862a Image data storage unit 9 Bar code reader

Claims (9)

A product data generation device for generating product dimension data,
A darkroom in which the product is disposed;
A photographing unit disposed in the dark room and generating image data of the product and background;
A black light disposed in the dark room and irradiating the background with ultraviolet rays;
Image processing means for obtaining product dimension data using the image data generated by the imaging means ;
First product illumination means for irradiating the product with visible light,
In the dark room, a material that emits fluorescence when irradiated with the black light is provided on at least the background surface,
The imaging means generates image data when the black light is irradiated, and the first image data is image data when the black light is irradiated in a state where the first product illumination means is irradiated. And second image data that is image data when not irradiating the black light,
The product is characterized in that the image processing means extracts, as a pixel corresponding to the product, a pixel having a characteristic value difference between the first image data and the second image data that is smaller than a predetermined value regarding a color for each pixel. Data generator. Wherein the image processing means, according to claim 1, characterized in that the color difference for each pixel of the first image data and the second image data to extract the smaller pixels than a predetermined value as a pixel corresponding to the product Product data generation device. Second product illumination means for irradiating the product with white light so as to have a higher illuminance than when the product is illuminated by the first product illumination means;
The photographing unit generates third image data that is image data when the first product illumination unit and the black light are not irradiated in a state where the second product illumination unit is irradiated.
The image processing means obtains, as image data of the product, pixel data corresponding to the product extracted using the first image data and the second image data in the third image data. The product data generation apparatus according to claim 1 or 2 . A turntable that is disposed in the darkroom and rotatably mounts the product, and has a top surface with a material that emits fluorescence when irradiated with the black light;
The product data generation apparatus according to claim 3, further comprising a control unit that controls a rotation angle of the turntable. A moving means disposed in the darkroom and changing the position of the photographing means;
The product data generation apparatus according to claim 4 , wherein the control unit controls the position of the photographing unit by the moving unit. 6. The product data generation according to claim 5 , wherein the control unit performs on / off control of the black light, the first product illumination unit, and the second product illumination unit, and imaging control by the imaging unit. apparatus. The control means generates the first image data, the second image data, and the third image data when the product is viewed from the front, the side, and the top by the photographing unit, respectively. Performing on / off control of the illumination means and the second product illumination means, control of photographing by the photographing means, control of the rotation angle of the turntable, and control of the position of the photographing means by the moving means,
The image processing means uses the first image data, the second image data, and the third image data when the product is viewed from the front, side, and top, and when the product is viewed from the front, side, and top. The product data generation apparatus according to claim 6 , wherein the size data and the image data are respectively generated. The control unit is configured to generate the first image data, the second image data, and the third image data when the product is viewed obliquely from above by the photographing unit. (2) On / off control of the product illumination means, control of the rotation angle of the turntable, and control of the position of the photographing means by the moving means,
The image processing means generates image data when the product is viewed obliquely from above using the first image data, the second image data, and the third image data when the product is viewed obliquely from above. The product data generation apparatus according to claim 6 or 7 , wherein A barcode reader for reading the barcode attached to the product;
Product data storage means for storing the product dimension data and image data generated by the image processing means in association with the barcode data attached to the product;
Determining means for determining whether or not barcode data corresponding to the barcode read by the barcode reader is stored in the product data storage means;
When it is determined by the determination means that barcode data is not stored in the product data storage means,
The control means performs control to generate the first image data, the second image data, and the third image data,
The image processing means generates the product dimension data and image data using the first image data, the second image data, and the third image data, and associates the barcode data with the product data storage means. The product data generation device according to claim 7 or 8 , wherein the product data generation device according to claim 7 or 8 is stored.

Images