JP2012221033A - Electronic instrument and selection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire number values showing objects themselves simply which enables simple comparison between the objects.SOLUTION: An electronic instrument 1 includes: an imaging unit 10; and an extracting unit 20 which extracts rhythm information showing a pattern of color change of an object within a moving image picked up by the imaging unit 10. The extracting unit 20 includes: a first storage unit 22 which stores the rhythm information in association with a pattern of color change of a unit region constituting the object; a calculation unit 24 which calculates a pattern of color change of a unit region in the moving image; and a selection unit 26 which selects the rhythm information corresponding to the pattern of color change of the unit region calculated by the calculating unit 24 from the first storage unit 22.

Description

  The present invention relates to an electronic device and a selection method.

  Conventionally, a technique for extracting a predetermined object (for example, a human face) from a moving image by pattern matching has been disclosed (for example, see Patent Document 1). According to Patent Document 1, an imaging area of a predetermined object can be shown on the display screen.

JP 2009-31469 A

However, the technique disclosed in Patent Document 1 has a problem that the objects themselves cannot be compared because the objects themselves are not digitized (indexed). Furthermore, since the objects cannot be compared with each other, various application processes (for example, object grouping based on the object similarity, imaging devices based on the object similarity based on each image capturing device) And the extraction of objects similar to the reference object) cannot be realized.
The present invention has been made in view of the above problems, and provides an electronic apparatus that can easily acquire a numerical value (index) indicating an object itself that can easily compare objects.

  In order to solve the above problem, an electronic apparatus according to an aspect of the present invention includes an imaging unit and an extraction unit that extracts rhythm information representing a color change pattern of an object in a moving image captured by the imaging unit It is characterized by providing.

  The electronic apparatus further includes a correction unit that corrects the moving image to a color when imaged under a predetermined reference light, and the extraction unit extracts the rhythm from the moving image corrected by the correction unit. Information may be extracted.

  In the electronic device, the extraction unit stores the rhythm information in association with a color change pattern of the unit area constituting the object, and a color change pattern of the unit area in the moving image. And a selection unit that selects from the storage unit the rhythm information corresponding to the color change pattern of the unit area calculated by the calculation unit.

  In the electronic apparatus, the unit area is a pixel group including a predetermined number of adjacent pixels, and the color change pattern of the unit area includes an average pixel value, a maximum pixel value, and a minimum pixel value for each pixel group. Alternatively, it may be information indicating a temporal change in the median value of the pixel values.

  In the electronic apparatus, the unit region is a pixel group including adjacent pixels having a pixel value difference equal to or less than a predetermined value, and the color change pattern of the unit region has an average pixel value for each pixel group, It may be information indicating a temporal change in the maximum pixel value, the minimum pixel value, or the median value of the pixel values.

  In the electronic apparatus, the unit region is a pixel group including adjacent pixels having a pixel value difference equal to or less than a predetermined value, and the color change pattern of the unit region is temporal in the distribution of the pixel group. It may be information indicating a change.

  In the electronic device, the color change may be any one of hue, saturation, brightness, chromaticity, and contrast ratio, or a change including two or more.

  In order to solve the above problem, a selection method according to another aspect of the present invention is a method of changing the color of an object in a moving image in association with a pattern of changing the color of a unit area constituting the object in the moving image. In an electronic device including a storage unit that stores rhythm information representing a pattern, the selection method selects the rhythm information of a moving image captured by an imaging unit, and the calculation unit of the electronic device includes the calculation unit in the moving image. Calculating a color change pattern of the unit region, and the selection unit of the electronic device selects the rhythm information corresponding to the color change pattern of the unit region calculated by the calculation unit from the storage unit; It is characterized by.

  According to the present invention, a numerical value (rhythm information) indicating an object itself can be easily acquired from the object. Moreover, objects can be easily compared using the numerical values. Furthermore, the comparison results between objects can be applied to various application processes (for example, object grouping based on object similarity, imaging device grouping based on object similarity by each imaging device, object similar to a reference object) Extraction).

It is a lineblock diagram showing an example of electronic equipment 1 by one embodiment of the present invention. FIG. 6 is an explanatory diagram for explaining processing of an extraction unit 20. FIG. 6 is an explanatory diagram for explaining processing of an extraction unit 20. FIG. 6 is an explanatory diagram for explaining processing of an extraction unit 20. 3 is a flowchart illustrating an example of an operation of the electronic device 1. FIG. 10 is an explanatory diagram for explaining another process of the extraction unit 20. FIG. 10 is an explanatory diagram for explaining another process of the extraction unit 20.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram illustrating an example of an electronic apparatus 1 according to an embodiment of the present invention.

  The electronic device 1 is, for example, a digital camera, and includes an imaging unit 10, an extraction unit 20, and a second storage unit 40 as illustrated in FIG. The extraction unit 20 includes a first storage unit 22, a calculation unit 24, and a selection unit 26.

  The imaging unit 10 is a camera that captures still images and moving images. The extraction unit 20 extracts an object from the moving image captured by the imaging unit 10, and extracts rhythm information representing a pattern of color change of the object extracted from the moving image. The second storage unit 40 stores the rhythm information extracted by the extraction unit 20. Hereinafter, the process performed by the extraction unit 20 will be described in detail with reference to FIGS. 2 to 4 are explanatory diagrams for explaining the processing of the extraction unit 20.

FIG. 2 schematically shows the traffic light object (O ₁ ) extracted from the moving images (P ₁ , P ₂ , P ₃ ). 2A shows the object when the traffic light is blue, FIG. 2B shows the object when the traffic light is yellow, and FIG. 2C shows the object when the traffic light is red. 2A to 2C, r1 is an imaging area of the traffic signal body, and r2 is an imaging area of a support portion that supports the traffic signal body. r1-1 is an area within r1, which is an imaging area of a holding section that holds a blue lamp, r1-2 is an area within r1, and is an imaging area of a holding section that holds a yellow lamp, and r1-3 is within r1 This is an imaging region of a holding unit that holds a red lamp. r1-1-1 is an area within r1-1 and is an imaging area of a blue lamp, r1-2-1 is an area within r1-2 and is an imaging area of a yellow lamp, and r1-3-1 is r1- 3 is a red lamp area.

For convenience of explanation, it is assumed that when the traffic light is blue, the color of the blue lamp being turned on is blue-green, and the colors of the yellow lamp and red lamp being turned off are black. That is, in FIG. 2A, the color of the blue lamp region r1-1-1 is blue-green, the color of the yellow lamp region r1-2-1 is black, and the color of the red lamp region r1-3-1 is It shall be black.
When the traffic light is yellow, the color of the yellow lamp that is lit is yellow, and the color of the blue and red lamps that are not lit is black. That is, in FIG. 2B, the color of the blue lamp region r1-1-1 is black, the color of the yellow lamp region r1-2-1 is yellow, and the color of the red lamp region r1-3-1 is black. Suppose that
When the traffic light is red, the color of the red lamp being turned on is red, and the color of the blue lamp and the yellow lamp being turned off is black. That is, in FIG. 2C, the color of the blue lamp region r1-1-1 is black, the color of the yellow lamp region r1-2-1 is black, and the color of the red lamp region r1-3-1 is red. Suppose that
In addition, when the traffic light is any of blue, yellow, and red, all the areas other than the lamp are gray.

FIG. 3A schematically shows unit areas constituting the object (O ₁ ) of the traffic light shown in FIG. The unit area is composed of a predetermined number of adjacent pixels and is also referred to as a pixel group.

FIG. 3B shows rhythm information “a color change pattern for each pixel group (that is, for each pixel group shown in FIG. 3A) constituting the traffic light object (O ₁ ) shown in FIG. R0001 ". The pattern of the color change of the pixel group is information indicating a temporal change in the average pixel value (average value of the pixel values of a plurality of pixels in the pixel group) for each pixel group.

The pixel group ID (a-4, a-5,...) Shown in FIG. 3B is a pixel group (that is, the pixel shown in FIG. 3A) constituting the traffic light object (O ₁ ) shown in FIG. Identification information for identifying a group. For example, the pixel group ID “a-4” shown in FIG. 3B is defined by the pixel group (G in the horizontal direction “4” and the index “a” in the vertical direction) shown in FIG. Pixel group).

Each time (t1, t2,...) Shown in FIG. 3B is an imaging timing of the traffic light shown in FIG. t1 to t3 are imaging timings when the signal is blue as shown in FIG. t4 is an imaging timing when the signal is yellow as shown in FIG. t5 to t7 are imaging timings when the signal is red as shown in FIG. That is, t1 to t7 is one cycle of the color change of the traffic light object (O ₁ ) shown in FIG. Note that the time shown in FIG. 3B is a time for convenience of explanation (in the case of an actual traffic light, the blue (and red) time is usually longer than the yellow time.

Each value (D1 to D7) shown in FIG. 3B represents each pixel constituting the traffic light object (O ₁ ) shown in FIG. 2 at each imaging timing (t1, t2,...) Of the traffic light shown in FIG. It is an average pixel value of a group (that is, each pixel group shown in FIG. 3A). D1 is a pixel value indicating gray, D2 is a pixel value indicating blue-green, D3 is a pixel value indicating black, D4 is a pixel value indicating black, D5 is a pixel value indicating yellow, and D6 is a pixel value indicating black , D7 are pixel values representing red.

That is, FIG. 3B is rhythm information representing a color change pattern for each pixel group constituting the traffic light object (O ₁ ) shown in FIG. 2, as described above. Specifically, for example, the following features 1 to 10 are shown as the color change of the object (O ₁ ).

Feature 1: Of the main part region (region r1 shown in FIG. 2) of the object (O ₁ ), a region (shown in FIG. 2) located on the left side of the central region (region r1-2-1 shown in FIG. 2) In the region r1-1-1), the color periodically changes between blue-green (D2) and black (D3).
Feature 2: The color of the central area of the main area of the object (O ₁ ) changes periodically between black (D4) and yellow (D5).
Feature 3: Of the main part region of the object (O ₁ ), the region located on the right side of the central region (region r1-3-1 shown in FIG. 2) is black (D6) and red (D7). ) And change periodically.
Feature 4: Of the main area of the object (O ₁ ), the central area, the area located on the left side of the central area, and the area excluding the area located on the right side of the central area (area r1 shown in FIG. 2) (Region excluding region r1-1-1, region r1-2-1 and region r1-3-1) is always gray (D1) and has no color change.
Feature 5: An area other than the main part of the object (O ₁ ) (area r2 shown in FIG. 2) is always gray (D1) and has no color change.
Feature 6: After the region located on the left side of the central region (region r1-1-1) changes from blue-green (D2) to black (D3), the central region (region r1-2-1) is black ( The color changes from D4) to yellow (D5).
Feature 7: After the central region (region r1-2-1) has changed from yellow (D5) to black (D4), the region (region r1-3-1) located on the right side of the central region is black (D6 ) To red (D7).
Feature 8: After the area located on the right side of the central area (area r1-3-1) changes from red (D7) to black (D6), the area located on the left side of the central area (area r1-1-) 1) changes from black (D3) to blue-green (D2).
Feature 9: a region (region r1-1-1) located on the left side of the central region that changes to blue-green (D2), a central region (region r1-2-1) that changes to yellow (D5), The region (region r1-3-1) located on the right side of the central region that changes to red (D7) has substantially the same size.
Feature 10: The time when the region (region r1-1-1) located on the left side of the central region is blue-green (D2), and the region located on the right side of the central region (region r1-3-1) is red The time for (D7) is equal and is approximately three times the time for the center (region r1-2-1) region to be yellow (D5).

As illustrated in FIG. 4, the first storage unit 22 stores a color change pattern of a pixel group constituting each object in association with rhythm information. For example, the first storage unit 22 associates the rhythm information “R0001” of the traffic light object (O ₁ ) shown in FIG. 2 with the pixel group constituting the object (O ₁ ) shown in FIG. A color change pattern (information indicating temporal change in average pixel value for each pixel group) is stored.

  The information stored in the first storage unit 22 (color change pattern for each pixel group constituting the object) may be created by the electronic device 1 or acquired by the electronic device 1 from the outside. It may be the one input by the user of the electronic device 1. In addition, as an aspect created by the electronic device 1, the calculation unit 24 preliminarily selects the color of the pixel group that constitutes the object based on a moving image as a sample (which may be a moving image captured by the imaging unit 10). A change pattern is calculated and stored in the first storage unit 22.

  As shown in FIG. 4, in the state where the first memory unit 22 stores the color change patterns of the pixel groups constituting each object in association with the rhythm information, the calculation unit 24 includes the imaging unit 10. Then, an object (for example, an object imaged in the central area) is extracted from the moving images (each frame) sequentially imaged by.

  The calculation unit 24 that has extracted an object at each imaging timing calculates an average pixel value for each pixel group constituting the object at each imaging timing. That is, the calculation unit 24 calculates a color change pattern of a pixel group constituting the object. The calculation unit 24 that has calculated the color change pattern of the pixel group that constitutes the object supplies the calculated color change pattern to the selection unit 26.

  The selection unit 26 that has acquired the change pattern from the calculation unit 24 selects the rhythm information corresponding to the change pattern from the first storage unit 22. More specifically, the selection unit 26 compares one cycle of the change pattern acquired from the calculation unit 24 with one cycle of the change pattern for each rhythm information stored in the first storage unit 22. Then, one change pattern that matches or most similar to the change pattern acquired from the calculation unit 24 is selected, and rhythm information corresponding to the selected change pattern is acquired. The selection unit 26 stores the acquired rhythm information in the second storage unit 40. The rhythm information stored in the second storage unit 40 is used for comparison between objects.

  Hereinafter, the operation of the electronic apparatus 1 will be described using a flowchart. FIG. 5 is a flowchart illustrating an example of the operation of the electronic device 1. Note that at the time of disclosure of this flowchart, it is assumed that the first storage unit 22 stores a pattern of color change of the pixel group constituting each object in association with the rhythm information.

  The calculation unit 24 extracts an object from the moving image (step S10). The calculation unit 24 calculates an average pixel value for each pixel group constituting the extracted object (step S12), and temporarily stores it in association with the imaging timing (time).

  The calculation unit 24 determines whether or not an object for one period of color change has been extracted (step S14). In other words, the calculation unit 24 determines whether or not periodicity is found in the color change pattern of the pixel group constituting the object. If the calculation unit 24 determines that an object for one period of color change has not yet been extracted (step S14: No), the calculation unit 24 returns to step S10. That is, the calculation unit 24 repeats steps S10 and S12 until it finds periodicity in the color change.

  On the other hand, when it is determined that the object for one period of the color change is extracted (step S14: Yes), the calculation unit 24 temporarily stores the average pixel value for each pixel group constituting the object at each imaging timing. (A pattern of color change of the pixel group constituting the object) is supplied to the selection unit 26.

  The selection unit 26 that has acquired the change pattern from the calculation unit 24 selects the rhythm information corresponding to the change pattern from the first storage unit 22 (step S16), and stores the selected rhythm information in the second storage unit 40. To do. And this flowchart is complete | finished.

  Note that the flowchart shown in FIG. 5 shows the color of the pixel group that constitutes an object using the extracted object when an object for one period of color change is extracted (stored) from the sequentially captured moving images. This shows an operation in the aspect of calculating the change pattern of, that is, the aspect of extracting rhythm information during imaging. However, the mode of extracting rhythm information is not limited to during imaging. For example, after the extraction unit 20 stores the entire moving image that is sequentially captured in the first storage unit 22, the calculation unit 24 and the selection unit 26 are based on the object graphic for one cycle in the entire moving image. Thus, rhythm information may be extracted.

  As described above with reference to FIGS. 1 to 5, according to the electronic device 1, rhythm information that is a numerical value indicating the object itself can be easily acquired from the object. Further, objects can be easily compared using rhythm information represented by numerical values. Furthermore, the comparison results between objects can be applied to various application processes (for example, object grouping based on object similarity, imaging device grouping based on object similarity by each imaging device, object similar to a reference object) Extraction).

  In the above embodiment, an example of using information indicating temporal changes in the average pixel value (average value of pixel values of a plurality of pixels in a pixel group) for each pixel group is used as the color change pattern of the pixel group. However, the value used as the color change pattern of the pixel group is not limited to this. For example, information indicating temporal change of the maximum pixel value for each pixel group (maximum value of pixel values of a plurality of pixels in the pixel group), the minimum pixel value for each pixel group (pixels of the plurality of pixels in the pixel group) Information indicating the temporal change in the minimum value), information indicating the temporal change in the median pixel value for each pixel group (the median value of the pixel values of a plurality of pixels in the pixel group), etc. It may be used as a color change pattern.

  In the above-described embodiment, a predetermined number of adjacent pixels are used as pixel groups, and information indicating temporal changes in the average pixel value (maximum pixel value, minimum pixel value, or median value of pixel values) for each pixel group is provided. In this aspect, the rhythm information corresponding to the color change of the pixel group is extracted as the pattern of the color change of the pixel group, but the aspect of extracting the rhythm information corresponding to the color change of the pixel group is not limited to this.

  As an example, an adjacent pixel whose pixel value difference is a predetermined value or less is set as a pixel group, and an average pixel value (maximum pixel value, minimum pixel value, or median value of pixel values) for each pixel group is changed with time. The indicated information may be a pattern of color change of the pixel group, and rhythm information corresponding to the color change of the pixel group may be extracted. FIG. 6 is an explanatory diagram for explaining another process of the extraction unit 20.

FIG. 6A schematically shows adjacent images having a pixel value difference equal to or less than a predetermined number in a pixel constituting the traffic light object (O ₁ ) shown in FIG. 2 as a pixel group. In FIG. 6A, Ga1 to Ga4 are pixel groups that are adjacent images in which the difference in pixel values is equal to or less than a predetermined number at any of the imaging timings (t1 to t7) (see FIG. 3B). Specifically, Ga1 represents a blue lamp region r1-1-1, Ga2 represents a yellow lamp region r1-2-1, Ga3 represents a red lamp region r1-3-1, and Ga4 represents a region other than the lamp. (See FIG. 2).

FIG. 6B shows a temporal change pattern of color for each pixel group (for each pixel group shown in FIG. 6A) constituting the traffic light object (O ₁ ) shown in FIG. Rhythm information “R0001 ′”. Each value (D1 to D7) is an average value of the pixel values of a plurality of pixels in the pixel group, and is the same as that in FIG. However, as described above, instead of the average value, the maximum pixel value (the maximum value of the pixel values of the plurality of pixels in the pixel group), the minimum pixel value (the minimum value of the pixel values of the plurality of pixels in the pixel group) The median value (the median value of the pixel values of a plurality of pixels in the pixel group) may be used.

  That is, as illustrated in FIG. 6, the extraction unit 20 sets adjacent pixels whose pixel value difference is equal to or smaller than a predetermined value as a pixel group, and average pixel values (maximum pixel value, minimum pixel value, or pixel) for each pixel group. The information indicating the temporal change in the median value) may be used as the pattern of the color change of the pixel group, and rhythm information corresponding to the color change of the pixel group may be extracted. Even when rhythm information is extracted in this way, the same effect as when rhythm information is extracted as shown in FIG. 3 can be obtained.

As another example, an adjacent pixel whose pixel value difference is equal to or less than a predetermined value is a pixel group, and
Information indicating a temporal change in the distribution of the pixel group may be used as a pattern of the color change of the pixel group, and rhythm information corresponding to the color change of the pixel group may be extracted. FIG. 7 is an explanatory diagram for explaining another process of the extraction unit 20.

FIG. 7A schematically shows adjacent images having a pixel value difference equal to or less than a predetermined number as a pixel group in the pixels constituting the traffic light object (O ₁ ) shown in FIG. In FIG. 7A, Gb1 and Gb4 are pixel groups of adjacent images whose pixel value difference is equal to or less than a predetermined number at the imaging timing (t1 to t3) when the signal is blue (see FIG. 3B). ). Specifically, Gb1 represents a blue region, and Gb4 represents a black and gray region (see FIG. 2). That is, it is assumed that the difference between the pixel values (values indicating black) in the areas of the yellow lamp and the red lamp being turned off (values indicating black) and the pixel values (values indicating gray) in the areas other than the lamps is equal to or less than a predetermined value.
In FIG. 7B, Gb2 and Gb4 are pixel groups of adjacent images whose pixel value difference is equal to or less than a predetermined number at the imaging timing (t4) when the signal is yellow (see FIG. 3B). Specifically, Gb2 represents a yellow region, and Gb4 represents a black and gray region (see FIG. 2). That is, it is assumed that the difference between the pixel values (values indicating black) in the areas of the blue lamp and the red lamp being turned off and the pixel values (values indicating gray) in the areas other than the lamps is equal to or less than a predetermined value.
In FIG. 7C, Gb3 and Gb4 are pixel groups of adjacent images whose pixel value difference is equal to or less than a predetermined number at the imaging timing (t5 to t7) when the signal is red (see FIG. 3B). ). Specifically, Gb3 represents a red region, and Gb4 represents a black and gray region (see FIG. 2). That is, the difference between the pixel values (values indicating black) in the areas of the blue lamp and the yellow lamp being turned off and the pixel values (values indicating gray) in the areas other than the lamps is not more than a predetermined value.

FIG. 7D shows the temporal change in distribution of each pixel group (each pixel group shown in FIGS. 7A to 7C) constituting the traffic light object (O ₁ ) shown in FIG. Rhythm information “R0001 ″” representing a pattern.
Each value (S1 to S7) in the table of FIG. 7D is the distribution (region shape) of each pixel group at each imaging timing. Specifically, S1 is a blue lamp area r1-1-1, S2 is a yellow lamp area r1-2-1, S3 is a red lamp area r1-3-1, S4 is a non-blue lamp area, S5. Represents a region other than the yellow lamp, and S6 represents a distribution of regions other than the red lamp.

  That is, as illustrated in FIG. 7, the extraction unit 20 sets adjacent pixels whose pixel value difference is equal to or less than a predetermined value as a pixel group, and displays information indicating temporal changes in the distribution of the pixel group as the color of the pixel group. The rhythm information corresponding to the color change of the pixel group may be extracted, and even when the rhythm information is extracted as shown in FIG. 7, the rhythm information as shown in FIG. The same effect as when extracted can be obtained.

  As described above, according to the electronic device 1, rhythm information that is a numerical value indicating the object itself can be easily acquired from the object. The mode shown in FIG. 3 is a mode in which a color change pattern in a pixel group is used as rhythm information, but the color change pattern can be any of hue, saturation, lightness, chromaticity, and contrast (ratio). Any one may be used as long as it expresses a change pattern including one or two or more (the same applies to the embodiment shown in FIG. 6). For example, in the modes shown in FIGS. 3 and 6, a pattern of contrast change for each pixel group (that is, light and dark for each pixel group, change in luminance with time) may be used as rhythm information. Further, for example, in the modes shown in FIGS. 3 and 6, a pattern of a change in contrast between pixel groups (that is, a change over time in light / darkness and luminance difference between pixel groups) may be used as the rhythm information (FIG. 6). The embodiment shown in FIG. Further, the mode shown in FIG. 6 is a mode in which adjacent images having a pixel value difference equal to or less than a predetermined number are grouped into pixels, and the pixel value is a hue, saturation, brightness, chromaticity, and contrast (ratio). Any one of them may be used (the same applies to the embodiment shown in FIG. 7). For example, in the modes shown in FIGS. 6 and 7, adjacent images in which the difference in contrast (brightness and brightness, luminance) is a predetermined number or less may be used as a pixel group.

In addition, the mode shown in FIG. 7 is a mode in which the distribution of pixel groups uses rhythm information as temporal changes, but the rhythm information expresses changes in the shape of each part (each pixel group) constituting the object. It is also a thing. For example, the rhythm information represents a periodic change in the shape of the pixel group Gb4 as shown in FIG.
Further, the mode shown in FIG. 7 also represents a change in the arrangement of each part (each pixel group) constituting the object. For example, if the pixel group Gb1 and the pixel group Gb3 are the same pixel group (both are Gb1) (for example, if Gb3 is blue instead of red), the rhythm information is the period of the arrangement of the pixel group Gb1. It expresses typical change.

In the above embodiment, as shown in FIG. 1, the rhythm information is directly extracted from the moving image captured by the imaging unit 10, but the reference light (predetermined depending on the external light condition) Filtering (color correction) may be performed so that light of color temperature, for example, natural light, hits, and rhythm information may be extracted from the filtered moving image.
Specifically, the electronic device 1 may further include a correction unit 11 (not shown) that corrects the color of the moving image captured by the imaging unit 10. That is, the correction unit 11 corrects the color of the moving image captured by the imaging unit 10 to the color when imaged under a predetermined reference light, and outputs the color to the extraction unit 20. The rhythm information may be extracted from the moving image corrected by the correction unit 11. As a result, stable rhythm information can be extracted regardless of the situation of external light when a moving image is captured.

  Note that a program for executing each process of the electronic apparatus 1 according to an embodiment of the present invention is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. Thus, each process of the electronic device 1 may be performed. Here, the “computer system” may include an OS and hardware such as peripheral devices. Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

  Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

DESCRIPTION OF SYMBOLS 1 ... Electronic device, 10 ... Imaging part, 11 ... Correction | amendment part 20 ... Extraction part, 22 ... 1st memory | storage part, 24 ... Calculation part, 26 ... Selection part, 40 ... 2nd memory | storage part

Claims (8)

An imaging unit;
An electronic apparatus comprising: an extraction unit that extracts rhythm information representing a color change pattern of an object in a moving image captured by the imaging unit. The electronic device according to claim 1,
A correction unit that corrects the moving image to a color when imaged under a predetermined reference light;
The extraction unit includes:
An electronic apparatus, wherein the rhythm information is extracted from the moving image corrected by the correction unit. The electronic device according to claim 1 or 2,
The extraction unit includes:
A storage unit that stores the rhythm information in association with a color change pattern of unit areas constituting the object;
A calculation unit that calculates a pattern of color change of the unit area in the moving image;
An electronic apparatus comprising: a selection unit that selects, from the storage unit, the rhythm information corresponding to the color change pattern of the unit area calculated by the calculation unit. The electronic device according to claim 3,
The unit area is
A pixel group consisting of a predetermined number of adjacent pixels,
The color change pattern of the unit area is:
An electronic device, which is information indicating a temporal change in an average pixel value, a maximum pixel value, a minimum pixel value, or a median value of pixel values for each pixel group. The electronic device according to claim 3,
The unit area is
A pixel group consisting of adjacent pixels having a pixel value difference equal to or less than a predetermined value,
The color change pattern of the unit area is:
An electronic device, which is information indicating a temporal change in an average pixel value, a maximum pixel value, a minimum pixel value, or a median value of pixel values for each pixel group. The electronic device according to claim 3,
The unit area is
A pixel group consisting of adjacent pixels having a pixel value difference equal to or less than a predetermined value,
The color change pattern of the unit area is:
An electronic apparatus characterized by being information indicating temporal changes in the distribution of the pixel groups. The electronic device according to any one of claims 1 to 6,
The color change is
An electronic apparatus characterized by being a change including any one of hue, saturation, brightness, chromaticity, and contrast ratio, or two or more. In an electronic apparatus including a storage unit that stores rhythm information representing a pattern of color change of an object in a moving image in association with a pattern of color change of a unit area constituting the object in the moving image, the image is captured by the imaging unit A selection method for selecting the rhythm information of the recorded moving image,
The calculation means of the electronic device calculates a color change pattern of the unit area in the moving image,
The selection method of the electronic device, wherein the rhythm information corresponding to the color change pattern of the unit area calculated by the calculation unit is selected from the storage unit.

Images