JP6579654B2 - Color code processing apparatus, color code processing method, and program - Google Patents

Description

  The present invention relates to an apparatus used for converting information into electronic data.

  As a conventional technique, two adjacent areas are divided into four equal parts so that they face the front, one adjacent two areas are free entry areas, and the other two adjacent areas have calendar calendars. There has been known a board device provided with a rotary board that is printed (see, for example, Patent Document 1).

JP 2012-61805 A (first page, FIG. 1 etc.)

  However, conventionally, there is a problem that it is difficult to appropriately convert information arranged in a captured image into electronic data. For example, when the information displayed on the board is converted to electronic data, it is necessary to manually input the data entered on the board using a keyboard, etc., and it takes time to complete the work, and the information is incorrect when the information is entered. There was a problem such as being input.

  The present invention has been made to solve such a problem, and an object of the present invention is to provide a color code processing device and the like that can easily and appropriately convert information arranged in a photographed image into electronic data. And

  The color code processing device of the present invention is two or more acquisition targets arranged in a first direction, two or more first acquisition targets that are acquisition targets associated with different attribute values, and two or more acquisition targets Two or more color codes arranged at positions corresponding to any one of the first acquisition targets, a reception unit that receives the captured image, and a color code from the captured image received by the reception unit And a plurality of pairs with the first acquisition target arranged at the position corresponding to the color code, and for each detected pair, the information corresponding to the color code and the first acquisition target respectively. The color code processing apparatus includes an acquisition unit that acquires read information that is attribute information and an output unit that outputs the read information acquired by the acquisition unit.

  With this configuration, the information arranged in the captured image can be converted into electronic data easily and appropriately. For example, information corresponding to the color code arranged in the photographed image and information corresponding to the first acquisition target can be acquired in association with each other.

  Further, the color code processing device of the present invention is the color code processing device, wherein the receiving unit includes two or more first acquisition targets and two or more arranged in a second direction different from the first direction. Two or more second acquisition targets that are acquisition targets associated with different attribute values, and one of two or more first acquisition targets and two or more second acquisition targets Two or more color codes respectively arranged at positions corresponding to any one of them are received, and the acquisition unit corresponds to the color code and the color code from the captured images received by the reception unit. A plurality of sets of the first acquisition target arranged at the position and the second acquisition target arranged at the position corresponding to the color code are detected, and information corresponding to the color code is detected for each detected set And first And attribute values corresponding to the acquisition target, a color code processing apparatus that acquires read information which is information having the attribute value corresponding to the second acquisition target.

  With this configuration, the information arranged in the captured image can be converted into electronic data easily and appropriately. For example, the information corresponding to the color code arranged in the photographed image, the information corresponding to the first acquisition target, and the information corresponding to the second acquisition target can be appropriately associated with each other and acquired.

  In the color code processing device of the present invention, in the color code processing device, the attribute value associated with the first acquisition target is a date and time, and the information associated with the color code is a user identifier. A color code processing apparatus.

  With this configuration, it is possible to easily acquire information in which a user identifier is associated with a date and time from information arranged in a captured image.

  In the color code processing device of the present invention, in the color code processing device, the attribute value associated with the first acquisition target is a date and time, and the attribute value associated with the second acquisition target is The information that is a user identifier and associated with the color code is a color code processing device that is behavior information indicating the behavior of the user.

  With this configuration, it is possible to easily acquire information in which date / time, user identifier, and behavior information are associated with each other from information arranged in a captured image.

  According to the color code processing apparatus and the like according to the present invention, information arranged in a photographed image can be converted into electronic data easily and appropriately.

Block diagram of a color code processing apparatus in an embodiment of the present invention A flowchart for explaining the operation of the color code processing apparatus The figure which shows the surface of the board which becomes the photographing object of the same color code processing device (Figure 3 (a)), and the figure which shows one example of the color code which is arranged on the board (Figure 3 (b)) The figure which shows the correspondence management table | surface of the color code processing apparatus Diagram for explaining the operation of the color code processing apparatus The figure which shows the reading information management table | surface of the color code processing apparatus The figure which shows the reading information management table | surface of the color code processing apparatus The figure which shows an example of the external appearance of the computer system The figure which shows an example of a structure of the computer system

  Hereinafter, embodiments of a color code processing apparatus and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.

(Embodiment)
FIG. 1 is a block diagram of a color code processing apparatus 1 in the present embodiment.

  The color code processing apparatus 1 includes a reception unit 101, a photographing unit 102, a correspondence storage unit 103, an acquisition unit 104, an output unit 105, and a reading information storage unit 106.

  The accepting unit 101 accepts a captured image. The captured image is an image in which two or more first acquisition targets and two or more color codes respectively arranged at positions corresponding to any of the two or more first acquisition targets are captured. . The two or more first acquisition targets captured in the captured image are two or more acquisition targets arranged in the first direction, and are acquisition targets associated with different attribute values.

  Two or more first acquisition targets are different acquisition targets. The acquisition target is, for example, a display object that can be acquired by an acquisition unit 104 (to be described later) from an image obtained by capturing the acquisition target with an attribute value associated with the acquisition target. The display object is composed of, for example, one or more of a character string, a figure, and a sign. For example, the display unit can detect an area where the acquisition target is captured in a captured image obtained by capturing the acquisition target. The acquisition target may be a sign. The acquisition target is usually arranged on a plane, but may be arranged on a surface other than a plane such as a curved surface. For example, the acquisition target is arranged on the surface of an object. The arrangement here is a concept including notation, printing, pasting, placement, adsorption, and the like. The object is, for example, a sheet-like member such as paper or film, a plate-like member, or the like. The plate-like member is, for example, a so-called white board, blackboard, cork board, or the like. The plate-like member may be a plate-like member capable of adsorbing a plate or sheet having a magnetic body with an acquisition target disposed on the surface by a magnetic force. It does not matter where and how the objects are arranged. For example, the acquisition target is a character or drawing drawn with ink or the like on a whiteboard (not shown) attached to the wall surface. The acquisition target is a character or a figure printed or drawn on a seal (not shown) or a plate attached on a whiteboard attached to a wall surface. This also applies to a second acquisition target described later.

  The first direction may be any direction. The first direction is usually the horizontal direction or the vertical direction, but may be another direction. Two or more first acquisition targets may be arranged at equal intervals or may not be arranged at equal intervals. Two or more first acquisition targets may not necessarily be arranged on the same straight line, and two or more first acquisition targets may be individually arranged on two or more different parallel straight lines extending in the first direction. May be arranged.

  The attribute values associated with two or more first acquisition targets (hereinafter referred to as first attribute values) are usually different attribute values. The first attribute value associated with two or more first acquisition targets may be any attribute value. Two or more first attribute values are different attribute values belonging to the same attribute, for example. The first attribute value may be an attribute value hierarchized in two or more hierarchies. When attribute values are hierarchized, when attribute values of the lowest hierarchy are different, they may be considered as different attribute values. The first attribute value is, for example, date and time. That is, the first attribute value may be an attribute value for the date / time attribute. The date and time here may be only the date, only the time, or a combination of the date and time. Further, the date and time here may be, for example, 1 to 9 o'clock to 12 o'clock. The time may be only the time zone or the like, or may be a time zone or period such as morning or afternoon of the date and day value. This also applies to the case where the captured image is an image obtained by capturing the first acquisition target and the second acquisition target, as will be described later.

  When the first acquisition target is a character string, the first acquisition target may be a character string indicating a first attribute value corresponding to the first acquisition target. The same applies to the second acquisition target described later.

  The color code is, for example, a code in which an array of a plurality of colors is associated with arbitrary information. The color code may be referred to as a color barcode, for example. For example, the color code is a code in which a plurality of colors are arranged on a matrix. The color code may be a code in which a plurality of colors are arranged on a ring. For example, this color code is also called a chameleon code. Information associated with the arrangement of a plurality of colors in the color code is information that is usually acquired by reading the color code. Hereinafter, information associated with the arrangement of a plurality of colors of the color code is referred to as color code information for convenience of explanation. The color code information is, for example, a character string such as an identifier assigned to the color code. Regarding processing for obtaining color code information such as a color code and a character string assigned to the color code from the color code, Japanese Patent No. 5695821 (Patent Document 2) and Japanese Patent Application Laid-Open No. 2003-178277 (Patent Document 3). ) Etc., since it is a well-known technique, detailed description is abbreviate | omitted here.

  The two or more color codes arranged in the captured image may all be different color codes, or at least some of them may be the same color code. The same color code is a color code having the same color arrangement, for example.

  The color code information may be associated with other information. Information associated with the color code information is stored in the correspondence storage unit 103, for example. Here, the color code information may be considered as information associated with the color code, and the information associated with the color code information may be considered as information associated with the color code. The acquisition unit 104 described later may acquire information associated with a color code, which is color code information, by reading one color code, for example. The reading here is, for example, obtaining color code information from a color code image. For example, the reading of the color code is to obtain color code information corresponding to the color arrangement of the color code. The acquisition unit 104 acquires color code information by reading one color code, and reads information associated with the acquired color code information from the correspondence storage unit 103 so that the information is associated with the color code. The acquired information may be acquired. In the following, an example in which the color code information is an identifier of the color code and the information associated with the color code information stored in the correspondence storage unit 103 is information associated with the color code. Will be described. However, the color code information may be information associated with the color code. For example, a character string that is color code information may be information associated with a color code.

  The information associated with the color code is, for example, a user identifier. The users here are, for example, two or more users to be associated with the first attribute value and the second attribute value described later. The user identifier may be the user's name, a code assigned to the user, or the user's email address or telephone number. Further, the user identifier may be a user membership number, an employee number, or the like. In this case, for example, the color code information and the user identifier are associated with each other and stored in the correspondence storage unit 103.

  The information associated with the color code is, for example, behavior information indicating the user's behavior. Behavior information is information, such as a character string showing a user's behavior, for example. For example, the behavior information includes information such as “attendance” indicating that the user is attending work, information such as “rest” indicating that the user is absent, and “business trip” indicating that the user is on a business trip. ", And a code corresponding to the information. Further, the behavior information may be information such as “in meeting” indicating that the user is participating in the meeting. In this case, for example, color code information and behavior information are associated with each other and stored in the correspondence storage unit 103.

  For example, the color code captured in the captured image is arranged on the same surface (for example, a plane) as the surface on which the first acquisition target is arranged. The color code to be photographed may be directly printed or drawn on the same surface as the surface on which the first acquisition target is arranged, for example. Further, a member (not shown) on which the color code is arranged, specifically, a printed or drawn member such as a plate, a sheet, or a seal is placed on the surface on which the color code is arranged (for example, the first code The color code to be photographed may be arranged on the surface on which the color code is arranged by being arranged on the same surface as the surface on which the acquisition target is arranged. The member in which the color code is arranged is a flat member such as a plate, a sheet, or a seal. For example, the photographed image is obtained by photographing a surface on which a member on which a color code is arranged is detachable. For example, the color code to be photographed is placed on the surface of a flat member that can be attached so as to be removable on the surface on which the color code is placed (for example, on the same surface as the surface on which the first acquisition target is placed). Color code. The flat member that can be attached so as to be detachable is, for example, a flat member that can be adsorbed onto the surface on which the color code is arranged. For example, when the surface on which the color code is arranged is a surface capable of attracting a magnet, it is a planar member having a magnet. Moreover, the planar member which can be attached so that attachment or detachment is possible is a planar member which has a suction cup etc. in a back surface side, or a planar member which can be stuck on the surface where a color code is arrange | positioned. In addition, a member (for example, a plate-like member to be described later) having a surface on which the planar member on which the color code is disposed is fitted with a lower side or a side side of the planar member at a position where the planar member can be disposed. A possible guide member (not shown) may be provided.

  Note that a character string or an image indicating information associated with the color code may be arranged in the vicinity of the color code, for example, in the upper or lower portion of the color code or the background portion of the color code. A character string or an image indicating information associated with the color code may be arranged in a margin or the like other than the portion where the color code is arranged on the planar member where the color code is arranged. The character string or image indicating the information associated with the color code may be, for example, information associated with the color code, or may be a part of the character string or image that is the information associated with the color code, A character string or an image that allows the user to recognize information associated with the color code may be used. Further, a character string or an image indicating information associated with the color code may be arranged on the back surface of the planar member on which the color code is arranged. From this character string or image, the user can recognize what color code the user arranges.

  In the captured image, the color code is arranged in association with the first acquisition target. For example, in the captured image, the first acquisition target in which one color code is associated with the color code is specified. It is arranged so that it is possible. The fact that one color code is arranged in association with the first acquisition target means, for example, that a specific direction different from the first direction from the first acquisition target, One color code is arranged in a specific region located in a direction different from the direction. For example, one color code is placed in one of the top, bottom, left, and right directions, or left diagonally up, right diagonally up, left diagonally down, and right diagonally down from the first acquisition target. It has been done. Here, the description is made in the direction viewed from the acquisition target, but the same applies to the case of considering the direction viewed from the color code. In addition, the fact that one color code is arranged in association with the first acquisition target means, for example, that the color code has a specific size and shape in a specific positional relationship with respect to the first acquisition target. For example, one color code may be arranged in the area.

  For example, when a plurality of first acquisition targets are arranged as items of a plurality of rows or columns constituting a table, the color code arranged in association with the first acquisition target is this one. The acquisition target may be a color code arranged in a row or column arranged as an item. Specifically, the first acquisition target corresponding to one color code may be a character string or an image arranged as an item of a column in which the color code is arranged. The items in the table here may be considered to include, for example, heading items, item names, and the like. In addition, the table | surface here may have a ruled line etc., and does not need to have it.

  Further, instead of a table, a coordinate system in which two or more first acquisition targets are arranged as items of the first axis may be considered. In this case, the color code arranged so that the value of the first axis is one item is considered as the color code arranged at a position associated with the first acquisition target that is this one item. Also good.

  The receiving unit 101 includes any one of the two or more first acquisition targets, the two or more second acquisition targets, the two or more first acquisition targets, and the two or more second acquisition targets. You may accept the picked-up image image | photographed with two or more color codes each arrange | positioned in the position corresponding to a heel. Two or more second acquisition targets are different acquisition targets. The two or more second acquisition targets are two or more acquisition targets arranged in a second direction different from the first direction described above, and are acquisition targets associated with different attribute values. Any of the terms herein may be considered to mean any one of them, for example. For example, the second acquisition target is arranged on the same surface (for example, a plane) as the first acquisition target.

  For example, the second direction is preferably a direction that can be clearly identified visually with respect to the first direction. The second direction is, for example, a direction in which the acquisition unit 104 described below can detect the correspondence between the color code and the first acquisition target and the correspondence between the color code and the second acquisition target. preferable. The second direction is preferably, for example, a direction that is substantially perpendicular to the first direction or a direction in which an angle formed with the first direction is a value within a range of 40 to 90 degrees. The position where two or more second acquisition targets are arranged may be a position that does not overlap any first acquisition target when two or more first acquisition targets are moved in the second direction. preferable.

  An attribute value (hereinafter referred to as a second attribute value) associated with two or more second acquisition targets is an attribute value different from the first attribute value, for example. Different attribute values are attribute values having different attributes, for example. For example, when the first attribute value is an attribute value for the date / time attribute, the second attribute value that is the attribute value for the place attribute is an attribute value that is different in attribute from the first attribute value. The second attribute value may be any attribute value as long as the attribute value is different from the first attribute value. For example, when the first attribute value is a date and time, that is, an attribute value for the date and time attribute, the attribute value associated with the second acquisition target may be a user identifier as described above. In this case, the information associated with the color code may be behavior information indicating the user's behavior as described above.

  In the captured image, the color code is arranged in association with the second acquisition target. The color code is associated with the first acquisition target as described above except that the acquisition target is different. It is the same as being arranged. In the captured image, one color code is arranged at a position corresponding to one of two or more first acquisition targets and one of two or more second acquisition targets. In the image, one color code is arranged so that one first acquisition target associated with the color code and one second acquisition target can be specified. The fact that one color code is arranged in association with the first acquisition target and the second acquisition target means that, for example, one color code is The color code is arranged in a specific direction different from the second direction, and the color code is arranged in a specific direction different from the second direction, as viewed from one second acquisition target.

  For example, a plurality of first acquisition targets are arranged as items of a plurality of rows constituting one table, and a plurality of second acquisition targets are arranged as items of a plurality of columns constituting the same table. In this case, one color code arranged at a position corresponding to one first acquisition object and one second acquisition object is, for example, one first code in this one table. This is a color code arranged in a column where the second acquisition target is arranged as an item in a row where the acquisition target is arranged as an item.

  Also, instead of the table, two or more first acquisition objects are arranged as items of the first axis, and two or more second acquisition objects are arranged as items of the second axis, etc. You may think. In this case, the color arranged so that the value of the first axis is the first acquisition target that is one item and the value of the second axis is the second acquisition target that is the one item The code may be considered as a color code arranged at a position associated with the first acquisition target that is the value of the first axis and the second acquisition target that is the value of the second axis.

  The captured image may be one or more still images or a moving image. The captured image may be a plurality of still images captured at regular or non-constant time intervals, and may be a plurality of frame images extracted from a moving image at regular or non-constant time intervals. Also good. The captured image may be a color image or a monochrome image. Further, the number of gradations of the captured image is not limited.

  It does not matter how the reception unit 101 receives a captured image. For example, the accepting unit 101 may accept a photographed image photographed by the photographing unit 102 included in the color code processing device 1, a photographed image photographed by a photographing unit separately provided outside the color code processing device 1, You may accept the picked-up image image | photographed and accumulate | stored in the recording medium etc. which are not shown in figure. When a captured image is received from an imaging unit provided outside or the like, the color code processing device 1 may not include the imaging unit 102. In the following, in the present embodiment, a case where the color code processing apparatus 1 includes the photographing unit 102 will be described as an example.

  The acceptance here is a concept including reception of information transmitted via a wired or wireless communication line, acceptance of information read from a recording medium such as an optical disk, a magnetic disk, and a semiconductor memory. The receiving unit 101 may be considered as an interface for receiving a captured image. The accepting unit 101 can be realized by, for example, a device driver for receiving or reading a captured image, control software for a menu screen, or the like.

  The photographing unit 102 photographs two or more first acquisition targets and two or more color codes respectively arranged at positions corresponding to any of the two or more first acquisition targets. Get an image. For example, a photographed image is obtained by photographing two or more first acquisition targets and a sheet-like member or plate-like member on which two or more color codes are arranged. An image captured by the imaging unit 102 may be a still image or a moving image. Further, the number of pixels of the image to be photographed is not limited. Also, the file format of the image captured by the image capturing unit 102 is not limited. Further, the image captured by the imaging unit 102 may be a color image or a monochrome image.

  The photographing unit 102 is usually realized by a digital camera, an optical scanner, a line sensor, or the like.

  The correspondence storage unit 103 stores two or more pieces of color code information and information associated with each color code information. In the correspondence storage unit 103, for example, two or more pieces of code correspondence information having color code information and information associated with the color code information are stored. The information associated with the color code information is, for example, a user identifier or behavior information.

  The correspondence storage unit 103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The same applies to other storage units.

  The acquisition unit 104 detects a plurality of sets of a color code and a first acquisition target arranged at a position corresponding to the color code from the captured image received by the reception unit 101. The acquisition unit 104 acquires read information for each detected pair. The read information is information having information corresponding to each detected set of color codes and an attribute value corresponding to the first acquisition target.

  The acquisition unit 104 includes a color code, a first acquisition target arranged at a position corresponding to the color code, and a second code arranged at a position corresponding to the color code from the captured image received by the reception unit 101. A plurality of sets with the acquisition target may be detected, and the read information may be acquired for each detected set. The read information here is information having information corresponding to the color code, an attribute value corresponding to the first acquisition target, and an attribute value corresponding to the second acquisition target. The read information here may be considered, for example, as a result of adding an attribute value corresponding to the second acquisition target to the read information described above.

  Hereinafter, a first process for detecting a plurality of sets of a color code and a first acquisition target from the captured image, and acquiring read information for each detected set, a color code, a first acquisition target, and a second A second process of detecting a plurality of sets with the acquisition target and acquiring read information for each detected set will be described.

(1) First processing (a) Detection of a plurality of sets For example, the acquisition unit 104 detects a color code and an acquisition target detected in a captured image, and uses the detected color code and the acquisition target to perform color detection. A plurality of sets of codes and first acquisition targets arranged at positions corresponding to the color codes are detected. Moreover, each color code is detected by detecting two or more color codes in the photographed image and detecting a first acquisition target at a position (for example, direction, column, row, etc.) corresponding to each detected color code. And a first acquisition target may be detected. Further, by detecting two or more acquisition targets in the captured image and detecting the color code at a position (for example, direction, column, row, etc.) where the color code corresponding to the detected acquisition target is arranged, A set of the color code and the first acquisition target may be detected.

  Detecting a color code from a photographed image means, for example, detecting a region where the color code is arranged from the photographed image, and information on the detected region (for example, information such as coordinates defining the outline of the region). Etc.) and an image of the detected color code. The same applies to detection of acquisition targets such as the first acquisition target and the second acquisition target.

  For example, the acquisition unit 104 detects a region where a color code is arranged in a captured image, and acquires information on each region. Alternatively, an image in the detected area is acquired. The area information is, for example, information on coordinates indicating the outline of the area. Since the process for detecting the area where the color code is arranged from the photographed image is a known technique as shown in the above-described Patent Document 2 and Patent Document 3 as a technique using the color code, here, Detailed description is omitted.

  In addition, the acquisition unit 104 detects, for example, each region where an acquisition target is arranged in a captured image, and acquires information on each region. Alternatively, an image in the detected area is acquired. The processing for detecting the area where the acquisition target is arranged from the captured image is a known technique in character recognition processing such as optical character recognition (OCR), image recognition processing, and the like, and thus detailed description thereof is omitted here. .

  Note that when the acquisition unit 104 detects the acquisition target from the captured image, the acquisition unit 104 may selectively detect only the first acquisition target as appropriate, separately from other acquisition targets or the like. You may do it. For example, since the first acquisition target associated with the color code is arranged in a specific direction with respect to the color code, the first acquisition target must be detected separately from other acquisition targets. In addition, the first acquisition target corresponding to the color code can be distinguished from other acquisition targets from the positional relationship between the color code and the acquisition target. However, they may be detected separately. The process of distinguishing and detecting will be described later. In addition, an acquisition target that satisfies a predesignated rule or the like may not be acquired. An acquisition target that satisfies a pre-specified rule is, for example, an acquisition target for a specific color, an acquisition target that is greater than or equal to a threshold value, or a size that is less than or equal to a threshold value, or an acquisition target that is arranged in a pre-specified area. is there.

  When detecting a color code or an acquisition target from a captured image, tilt correction or the like may be appropriately performed on the captured image. In addition, this tilt correction may be performed for each block by dividing the captured image into a plurality of blocks. It should be noted that since a technique for performing tilt correction or the like when detecting a color code or an acquisition target is a known technique, a detailed description thereof is omitted here.

  Note that the area where the color code detected by the acquisition unit 104 or the area where the acquisition target is arranged may be, for example, a color code or a minimum rectangular area including the acquisition target. Or the area | region represented with the outline of acquisition object may be sufficient. Further, when the acquisition unit 104 detects these areas, ruled lines and the like may be excluded from detection targets.

  Hereinafter, the acquisition unit 104 detects the color code and the acquisition target in the captured image, and uses the detected color code and the acquisition target to obtain the color code and the first acquisition arranged at a position corresponding to the color code. An example in the case of detecting a plurality of sets with the target will be described.

  First, the acquisition unit 104 detects a color code and an acquisition target in the captured image. The acquisition target detected here may be only the first acquisition target, or may be an acquisition target including the first acquisition target and an acquisition target other than the first acquisition target.

  Next, the acquisition unit 104 detects, for example, a first acquisition target arranged at a position corresponding to each color code detected above. For example, in the case where one color code is arranged in a specific direction different from the first direction when viewed from one first acquisition target in the photographed image, the photographed image is as described above. The first acquisition target arranged in the direction opposite to the specific direction is detected from the detected acquisition targets with respect to the area where the one color code detected in step 1 is arranged. For example, out of the two or more acquisition targets detected above, a representative point in the region where one color code is arranged, for example, the center point or the center of gravity extends in a direction opposite to the specific direction. The acquisition target whose distance from the half line is equal to or less than the threshold is detected as an area where the acquisition target at the position corresponding to one color code is arranged. The distance from the half line is, for example, the distance between the half line and a representative point to be acquired, for example, a center point or a center of gravity. This threshold is preferably a distance shorter than half of the distance between adjacent first acquisition targets, for example. Alternatively, when an area having the same size as one color code is translated in a direction opposite to the specific direction, the acquisition target overlapping the moved area is a position corresponding to the one color code. You may detect as the 1st acquisition object arranged at. A set of the first acquisition target detected for each color code and each corresponding color code is a plurality of sets of the color code detected by the acquisition unit 104 and the first acquisition target.

  When the first acquisition target in the captured image is an item of a plurality of rows (or columns) constituting one table, and the color code is arranged in the rows (or columns) of this table The acquisition target positioned above (or in the left direction) with respect to one color code may be detected as the first acquisition target arranged at a position corresponding to the one color code. Further, when the acquisition unit 104 can detect a ruled line or the like in the captured image and detect a row or a column constituting the table, the acquisition unit 104 is arranged in the same row (or column) as one color code. The target may be detected as a first acquisition target arranged at a position corresponding to one color code.

  Next, the acquisition unit 104 detects a color code in the captured image, and acquires corresponding to the color code at a position (for example, direction) where the first acquisition target corresponding to the detected color code in the captured image is arranged. An example in which a plurality of sets of a color code and a first acquisition target arranged at a position corresponding to the color code is detected by detecting the target will be described.

  First, the acquisition unit 104 detects a color code in a captured image. Next, the acquisition unit 104 detects an acquisition target, for example, at a position (for example, direction or area) corresponding to each color code detected above in the captured image. For example, in the captured image, when one color code is arranged in a specific direction different from the first direction when viewed from one first acquisition target, The first acquisition target may be detected by detecting the acquisition target in a direction opposite to the specific direction with respect to the area where the color code is arranged. For example, an acquisition target is detected in a region including a half line extending from a representative point in a region where one color code is arranged, for example, a center point or a center of gravity in a direction opposite to the specific direction. . It is detected as an area where an acquisition target at a position corresponding to one color code is arranged. Alternatively, an acquisition target that overlaps with a region obtained by translating a region having the same size as that of one color code in a direction opposite to the specific direction is detected. Thereby, the combination of the first acquisition target detected for each color code and each color code is a plurality of sets of the color code detected by the acquisition unit 104 and the first acquisition target.

  When the first acquisition target in the captured image is an item of a plurality of rows (or columns) constituting one table, and the color code is arranged in the rows (or columns) of this table The acquisition target detected in the region above (or leftward) with respect to one color code may be the first acquisition target arranged at a position corresponding to the one color code. In addition, when the acquisition unit 104 can detect a ruled line or the like in the captured image and detect a row or a column constituting the table, the acquisition target detected in the same row (or column) as one color code May be detected as a first acquisition target arranged at a position corresponding to one color code.

  In the captured image, an acquisition target such as the first acquisition target is detected, and a color code is detected at a position corresponding to each detected acquisition target, thereby arranging the color code and the position corresponding to the color code. The processing for detecting a plurality of sets with the first acquisition target is the same as the processing in the case where the above-described color code is replaced with the acquisition target, and thus detailed description thereof is omitted here. .

  Note that it does not matter how the acquisition unit 104 detects a plurality of sets of a color code and a first acquisition target arranged at a position corresponding to the color code from the captured image.

(B) Acquisition of Read Information Hereinafter, a process in which the acquisition unit 104 acquires read information for each of a plurality of sets of the color code detected as described above and the first acquisition target will be described. For example, the acquisition unit 104 detects a set of a color code and a first acquisition target arranged at a position corresponding to each color code, and then detects a color arrangement or the like for each detected color code. Then, the color code information corresponding to this array or the like is acquired. Specifically, the color code information is acquired by detecting the color arrangement or the like from each set of color code images. The process of detecting the color arrangement or the like of the color code may be considered as a process of reading the color code. The process of detecting the color arrangement and the like from the color code and acquiring the color code information is a known technique as shown in Patent Document 2 and Patent Document 3 described above as a technique using the color code. Therefore, detailed description is omitted here. When the acquisition unit 104 acquires color code information as information corresponding to a color code, the color code information acquired in this way is information corresponding to the color code. When the acquisition unit 104 acquires information associated with the color code information as information corresponding to the color code, the information associated with the color code information acquired as described above is stored in the correspondence storage unit 103. The information searched and detected in is acquired as information corresponding to the color code.

  Further, after the acquisition unit 104 detects a set of a color code and a first acquisition target arranged at a position corresponding to each color code, the first acquisition target of the detected set is arranged. The first attribute value that is the attribute value of the first acquisition target is acquired by performing character recognition processing such as OCR, pattern matching of the image, and the like using the first acquisition target image of the region. For example, when the first acquisition target is a character string of the first attribute value corresponding to the first acquisition target, the character string acquired by the character recognition process such as OCR is the attribute value of the first acquisition target. It is. In addition, when the character string acquired by the character recognition process such as OCR is a character string associated with the first attribute value, two or more first acquisition targets stored in advance in a storage unit (not shown) or the like. The first attribute value corresponding to the character string acquired by the character recognition process such as OCR is acquired by searching or the like from a plurality of pieces of information including the character string indicated by the character string and the first attribute value corresponding to each character string. Further, for example, when the first acquisition target is an image associated with the first attribute value, for example, a mark or the like, the acquisition unit 104 is determined to match the image that is the first acquisition target by pattern matching. A first attribute value associated in advance with the pattern may be acquired. Information that associates the pattern used for pattern matching with the first attribute value may be accumulated in advance in, for example, a storage unit (not shown). The same applies to the case where a second attribute value to be described later is acquired. Since character recognition processing such as OCR is a known technique, a detailed description thereof is omitted here. Further, since pattern matching is a known technique, detailed description thereof is omitted here. A pattern used in pattern matching may be considered as one or more feature amounts of an image used in pattern matching, for example.

  In this way, the information corresponding to the color code acquired for one set of the color code in the captured image and the first acquisition target arranged at the position corresponding to the color code, and the first acquisition A pair with the attribute value corresponding to the object is one read information.

  When the acquisition unit 104 detects a color code in the photographed image, the acquisition unit 104 detects a color arrangement or the like for the detected color code, color code information corresponding to the color arrangement or the like, and the color code. Information associated with information is acquired in advance and stored in association with each color code in a storage unit (not shown) or the like, and each of a plurality of sets of color codes and first acquisition targets is configured. When acquiring information corresponding to a color code, the color code information acquired and accumulated in advance as described above, and each of the information constituting the plurality of sets from the information associated with the color code information Color code information that corresponds to the color code and the information that is associated with this color code information by searching, etc. It may acquire the corresponding information. When the color code information acquired in advance at the time of detecting the color code is not information corresponding to the color code constituting the read information to be finally acquired, the color code information is acquired for each set, and then this color code information Information corresponding to the color code may be acquired as information corresponding to the color code.

  In addition, when the acquisition unit 104 detects an acquisition target such as the first acquisition target in the captured image, the acquisition unit 104 performs character recognition processing such as OCR or pattern matching on the detected acquisition target, and handles the acquisition target. Attribute values to be acquired in advance and stored in a storage unit (not shown) in association with each acquisition target, corresponding to the color code constituting each of a plurality of sets of color codes and first acquisition targets When acquiring information to be acquired, the attribute values associated with the respective first acquisition targets constituting a plurality of sets are acquired by searching or the like from the attribute values acquired and accumulated in advance as described above. By doing so, you may make it acquire the attribute value corresponding to the 1st acquisition object which comprises a some group, respectively.

  Note that the acquisition unit 104 may acquire the read information for the detected set every time one set is detected, or may acquire the read information for each set after detecting a plurality of sets.

  It does not matter how the acquisition unit 104 acquires the read information for each of the plurality of sets of the color code acquired above and the first acquisition target.

(2) Second Process (a) Detection of Multiple Sets Hereinafter, the case where the acquisition unit 104 performs the second process will be described. For example, as described above, the acquisition unit 104 detects the color code and the acquisition target from the photographed image, and the first acquisition target is arranged at a position corresponding to each area where each color code is arranged. Is detected in the same manner as described above, and a second acquisition target arranged at a position corresponding to each area where each color code is arranged is detected. Thereby, a plurality of sets of a color code, a first acquisition target arranged at a position corresponding to the color code, and a second acquisition target arranged at a position corresponding to the color code are detected. be able to. In addition, the process for detecting the area where the second acquisition target is arranged includes the position (for example, direction, area, row, and column) where the first acquisition target associated with the color code is arranged, and the color code. Is the same as the process for detecting the first acquisition target, except that the position (for example, direction, region, row, or column) where the second acquisition target associated with is different. Detailed description will be omitted.

  Further, the acquisition unit 104 detects two or more color codes from the captured image, and a position (for example, a direction, a region, a row, or a column) at which the first acquisition target corresponding to each color code in the captured image is arranged. Detecting the first acquisition target and detecting the first acquisition target at a position (for example, direction, region, row, or column) where the second acquisition target corresponding to each color code in the captured image is arranged. To detect a plurality of sets of a color code, a first acquisition target arranged at a position corresponding to the color code, and a second acquisition target arranged at a position corresponding to the color code. Also good.

  The acquisition unit 104 detects an acquisition target in the captured image, detects a color code at a position where a color code corresponding to the first acquisition target is arranged for each acquisition target in the captured image, A set of one acquisition target and a color code is detected. Similarly, for each acquisition target, a color code is detected at a position where the color code corresponding to the second acquisition target is arranged, and a pair of the second acquisition target and the color code is detected. The first acquisition target included in the plurality of sets associated with the same color code in the combination of the detected first acquisition target and the color code and the second acquisition target and the color code. And a second acquisition object and a color code, a color code, a first acquisition object arranged at a position corresponding to the color code, and a first code arranged at a position corresponding to the color code. You may make it detect as a group of 2 acquisition object.

  In addition, when detecting the acquisition target from the captured image, the acquisition unit 104 may detect the first acquisition target and the second acquisition target separately, or may detect them without distinction. For example, since the first acquisition target and the second acquisition target that are usually associated with the color code are arranged in different specific directions with respect to the color code, respectively, Even if the second acquisition target is not distinguished and detected, the first acquisition target corresponding to the color code and the second acquisition target can be distinguished and detected. However, they may be detected separately. In the case of detecting separately, among the detected acquisition targets, a plurality of acquisition targets arranged along the array direction of the first acquisition target are determined as the first acquisition target, and the second acquisition target array A plurality of acquisition targets arranged along the direction may be determined as second acquisition targets. Alternatively, when the acquisition target is detected from the captured image, character recognition processing such as OCR is performed on the acquisition target, and information about the acquisition target, for example, a character string indicating the acquisition target is acquired. You may determine whether it is a 1st acquisition object or a 2nd acquisition object. For example, when a character string specifying the first acquisition target specified in advance is included, the first acquisition target is determined, and when the character string is not included, the second acquisition target specified in advance is determined. If the character string to be specified is included, it may be determined as the second acquisition target. The same applies to the case where the first acquisition target and the second acquisition target are reversed. Also, for example, when it matches with any of a plurality of first acquisition targets prepared in advance, it is determined as the first acquisition target, and when it does not match, or with any of a plurality of second acquisition targets specified in advance If they match, the second acquisition target may be determined. The same applies to the case where the first acquisition target and the second acquisition target are reversed.

(B) Acquisition of read information Hereinafter, the acquisition unit 104 acquires read information for each of a plurality of sets of the detected color code, the first acquisition target, and the second acquisition target detected as described above. Processing will be described. The acquisition unit 104, for example, for each set detected as described above, similarly to the case of the first process, information corresponding to the color code, and a first attribute value corresponding to the first acquisition target The read information having the second attribute value corresponding to the second acquisition target is acquired. The process for acquiring the second attribute value corresponding to the second acquisition target is different from the process for acquiring the first attribute value corresponding to the first acquisition target in the first process described above. Therefore, detailed description is omitted here. As described above, after detecting a plurality of sets, the acquisition unit 104 detects a color arrangement or the like for each set of color codes, acquires color code information corresponding to the arrangement, and the like. The attribute value may be acquired by performing character recognition processing such as OCR or pattern matching on the first acquisition target and the second acquisition target of the set, and when the color code is detected from the photographed image, Detects an array, etc., acquires color code information corresponding to this array, etc., and acquires an attribute value by performing character recognition processing such as OCR, pattern matching, etc. when an acquisition target is detected from a captured image After detecting a plurality of sets from the color code information and attribute values acquired in advance in this way, the color code corresponding to each set, the first acquisition information, and the color corresponding to the second acquisition information Code information It may be acquired or attribute value, and the like.

  The acquisition unit 104 may acquire read information for the detected set each time a set of the color code, the first acquisition target, and the second acquisition target is detected, and may detect a plurality of sets. After that, the read information may be acquired for each group.

  For example, when the captured image is a moving image, the acquiring unit 104 sequentially extracts frame images constituting the moving image in the reproduction order or sequentially with a fixed or indefinite frame image, and the extracted frame image is described above. The detected color code or the acquisition target may be detected. If the detection cannot be performed, the next acquired frame image may be detected.

  Hereinafter, in the present embodiment, as an example, the first acquisition target is a character string of the first attribute value corresponding to the first acquisition target, and the second acquisition target is the second acquisition target. A case where the character string is the second attribute value corresponding to the acquisition target will be described as an example.

  Note that when the acquisition unit 104 performs processing for detecting a region such as a region where a color code is arranged, the captured image is appropriately copied or image processing such as binarization is performed on the captured image. You may do it.

  The acquisition unit 104 can usually be realized by an MPU, a memory, or the like. The processing procedure of the acquisition unit 104 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

  The output unit 105 outputs the read information acquired by the acquisition unit 104. The read information acquired by the acquisition unit 104 includes information corresponding to the color code and the first attribute value, or information corresponding to the color code, the first attribute value, and the second attribute value. May be considered as information having a relationship between

  The output here is a concept including transmission to an external device, accumulation in a recording medium, delivery of a processing result to another processing device or another program, and the like. The output here may be considered to further include, for example, a display for confirming read information to be transmitted or accumulated. For example, in the present embodiment, as an example, the output unit 105 accumulates the acquired read information in the read information storage unit 106.

  The output unit 105 may or may not include an output device such as a storage unit or a transmission unit. The output unit 105 can be implemented by output device driver software, or output device driver software and an output device.

  The reading information storage unit 106 stores the reading information acquired by the acquisition unit 104.

  Next, an example of the operation of the color code processing apparatus 1 will be described using the flowchart of FIG. Here, the imaging unit 102 includes two or more first acquisition targets, two or more second acquisition targets, the two or more first acquisition targets, and the two or more second acquisition targets. An example will be described in which two or more color codes respectively arranged at positions corresponding to any of the above are photographed.

  (Step S <b> 101) The imaging unit 102 includes two or more first acquisition targets, two or more second acquisition targets, the two or more first acquisition targets, and the two or more second acquisition targets. Two or more color codes respectively arranged at positions corresponding to any one of the objects are photographed.

  (Step S102) The accepting unit 101 accepts the captured image captured in step S101.

  (Step S103) The acquisition unit 104 detects a plurality of color codes in the captured image received in Step S102.

  (Step S104) The acquisition unit 104 detects a plurality of acquisition targets in the captured image received in step S102.

  (Step S105) The acquisition unit 104 substitutes 1 as the value of the counter m.

  (Step S106) The acquisition unit 104 determines whether or not the first color code is included in the color codes detected in step S103. If yes, the process proceeds to step S106. If not, the process ends.

  (Step S107) The acquisition unit 104 detects a first acquisition target arranged at a position corresponding to the mth color code.

  (Step S108) The acquisition unit 104 detects a second acquisition target arranged at a position corresponding to the mth color code.

  (Step S109) The acquiring unit 104 acquires information corresponding to the mth color code. For example, the acquisition unit 104 acquires color code information for the m-th color code, and acquires information associated with the color code information using information stored in the correspondence storage unit 103.

  (Step S110) The acquisition unit 104 acquires a first attribute value corresponding to the first authentication target acquired in Step S107.

  (Step S111) The acquisition unit 104 acquires a second attribute value corresponding to the second authentication target acquired in Step S107.

  (Step S112) The acquisition unit 104 stores information corresponding to the color code acquired in steps S109 to S111, the first attribute value, and one correspondence information having the second attribute value in the read information storage unit 106. . The accumulation here is, for example, additional writing.

  (Step S113) The acquisition unit 104 increments the value of the counter m by 1. Then, the process returns to step S105.

  In the flowchart of FIG. 2, the case has been described in which reading information is acquired for each set of one color code, the first authentication target, and the second authentication target, but in the present invention, For all the color codes detected in the photographed image, after detecting each color code, the first authentication target, and the second authentication target, the read information may be acquired for each set.

  In the flowchart of FIG. 2, the process is terminated by powering off or a process termination interrupt.

  Hereinafter, a specific operation of the color code processing apparatus 1 in the present embodiment will be described.

  FIG. 3 is a diagram (FIG. 3A) showing the surface of the whiteboard 3 hung on the wall to be photographed by the photographing unit 102, and a diagram showing an example of the color code arranged on the board 3 (FIG. 3). (B)). It is assumed that the board 3 is a board that can attract a plate (not shown) with a magnet or the like. It is assumed that a management table 300 for managing the attendance status of employees in the company is drawn on the surface of the board 3. In the management table 300, each item in a plurality of columns arranged in the horizontal direction at the top indicates a date and time indicating a work day, in particular, a date here. In the management table 300, each item in a plurality of rows arranged in the vertical direction on the left side indicates an employee name (here, an employee's last name) that is a user identifier of a user to be managed. Here, it is assumed that the character string indicating this date is the first acquisition target, and the character string indicating the employee name is the second acquisition target. The color code 5 is associated with the behavior information of the employee who is the user, and in the area (for example, cell) where one row and one column of the management table 300 intersect, for example, the user or the like It is arranged by. For example, a color that is an identifier that is stored in advance in the correspondence storage unit 103 and that is read from the color code 5 by an array of colors or the like using a correspondence management table that manages the correspondence between the identifier that is color code information and the behavior information Since the code information is associated with the behavior information, as a result, the color code 5 is associated with the user's behavior information. The behavior information is, for example, character string information indicating whether the user is taking a break, taking a half-break, or traveling.

  As shown in FIG. 3B, the color code 5 is printed on a film or the like (not shown) and attached on a plate 50 with a magnet. Here, for convenience of explanation, the color code 5 printed on a film or the like and attached to the plate 50 is simply referred to as a color code 5. Here, as an example, the color code is, as an example, a rectangular pattern having a maximum of eight colors such as light blue, purple, yellow, green, red, blue, and orange on a rectangular black background, with 3 rows and 9 columns. A case of a color barcode having a two-dimensional arrangement will be described. Since the color code 5 is affixed to the plate 50, the color code 5 can be arranged by adsorbing the plate 50 at an arbitrary position on the management table 300 of the board 3. Here, it is assumed that a plurality of three different color codes 5 are already arranged in the table 300. Note that a plurality of the same color codes 5 may be arranged on the management table 300. Here, it is assumed that two color codes of three different color codes 5 are arranged. It should be noted that information associated with each color code, for example, “rest”, “half-off”, etc., which are action information described later, is provided on the margin of the plate 50 to which each color code 5 is attached and on the back surface of the plate 50. A character string may be arranged.

  It is assumed that the color code information read from the color code 5 by the color arrangement or the like is a color code identifier that is an identifier assigned to the color code.

  FIG. 4 is a correspondence management table for managing the correspondence between color code identifiers that are color code information and behavior information. The correspondence management table has items of “code ID” which is a color code identifier and “behavior information” indicating behavior information. The color code identifier included in one record (row) is a color code identifier associated with the action information of the same record.

  First, it is assumed that one user has photographed the board 3 shown in FIG. 3A using the photographing unit 102 of the color code processing device 1. Here, it is assumed that the captured image acquired by the imaging unit 102 is a still image.

  The accepting unit 101 accepts the captured image acquired by the capturing unit 102. Note that if the captured image captured by the capturing unit 102 is a moving image, one frame image of the captured image may be acquired.

  The acquisition unit 104 detects a plurality of color codes 5 in the captured image received by the reception unit 101. Specifically, each of the plurality of color codes 5 is detected in the photographed image, and information on the area where the detected color code 5 is arranged, for example, four vertices indicating the vertices of the area where the color code 5 is arranged. Get the coordinates. The acquired area information is temporarily stored in, for example, a storage unit (not shown). Since the process of detecting the area of the color code 5 is known, detailed description thereof is omitted.

  In addition, the acquisition unit 104 detects a plurality of acquisition targets in the captured image received by the reception unit 101. Here, the acquisition target is a character string. For example, the acquisition unit 104 detects a group of a plurality of character strings in a photographed image, and for each group of character strings, information on an area in which the group is arranged, for example, a minimum rectangular shape surrounding the group of character strings. Four coordinates indicating the vertex of the region are acquired. The acquired area information is temporarily stored in an unillustrated storage unit or the like as the acquisition target area information.

  Note that when detecting the color code 5 or the acquisition target, it is preferable to perform inclination correction or the like on the captured image.

  FIG. 5 is a diagram for explaining the color code 5 detected in the captured image 4 and the acquisition targets 31 to 37. Here, for the sake of explanation, four color codes detected in the captured image 4 are shown as color codes 51 to 54.

  The acquisition unit 104 reads information on one of the detected color codes 51 to 54, for example, information on an area where the color code 51 is arranged from a storage unit (not shown), and the first corresponding to this area. The acquisition target area located in the direction in which the acquisition target is arranged is detected from the acquisition target areas acquired above and accumulated in a storage unit (not shown). Here, it is assumed that the direction in which the first acquisition target is arranged is the upward direction. The acquisition unit 104, for example, the coordinate range in the horizontal direction (for example, the x-axis direction) of the area where the color code 51 is arranged, and the horizontal direction of the area where the plurality of acquisition targets accumulated above are arranged, respectively. Is used to detect an acquisition target in which the horizontal coordinate range overlaps the horizontal coordinate range of the area where the color code 51 is arranged. Here, it is assumed that the acquisition target 32 in FIG. 5 is detected as an acquisition target in which the horizontal ranges of the arranged areas overlap. For this reason, the acquisition unit 104 detects the acquisition target 32 as a first acquisition target arranged at a position corresponding to the color code 51.

  Similarly, the acquisition unit 104 acquires the acquisition target region located in the direction in which the second acquisition target corresponding to the region in which the color code 51 is disposed is acquired and stored (not illustrated). Detected from the acquisition target area accumulated in the section. Here, it is assumed that the direction in which the second acquisition target is arranged is the left direction. For example, the acquisition unit 104 has a coordinate range in the vertical direction (for example, the y-axis direction) of the area where the color code 51 is arranged, and the vertical direction of the area where the plurality of acquisition targets accumulated above are arranged. Are used to detect an acquisition target in which the vertical coordinate range overlaps the horizontal coordinate range of the area where the color code 51 is arranged. Here, it is assumed that the acquisition target 35 in FIG. 5 is detected as an acquisition target in which the vertical ranges of the arranged areas overlap. For this reason, the acquisition unit 104 detects the acquisition target 35 as a second acquisition target arranged at a position corresponding to the color code 51.

  Next, the acquisition unit 104 detects a color arrangement or the like using the image of the one color code 51 detected above, and acquires a color code identifier that is color code information. This process is a known technique for reading a color code. It is assumed that the acquired color code information is “A1001”. The acquisition unit 104 detects the record (row) in which the value of the item “code ID” matches the acquired color code information “A1001” in the correspondence management table illustrated in FIG. Acquire "rest" that is the value of "information".

  The acquisition unit 104 performs character recognition processing such as OCR on the image of the acquisition target 32 that is the first acquisition target detected above, and acquires the character string “7/7”. Here, assuming that the first acquisition target is a character string indicating the first attribute value, the character string “7/7” acquired here corresponds to the first acquisition target 32 corresponding to the first acquisition target. One attribute value.

  Further, the acquisition unit 104 performs character recognition processing such as OCR on the image of the acquisition target 35 that is the second acquisition target detected above, and acquires the character string “7/7”. Here, assuming that the second acquisition target is a character string indicating the second attribute value, the character string “Kimura” acquired here corresponds to the second attribute corresponding to the acquisition target 35 that is the second acquisition target. Value.

  The output unit 105 includes “rest” that is behavior information corresponding to the color code 51 acquired by the acquisition unit 104 for one color code 51, “7/7” that is the first attribute value, and the second attribute value. The read information having a certain “Kimura” is stored in the read information storage unit 106.

  FIG. 6 is a read information management table for managing read information stored in the read information storage unit 106. The read information management table includes items of “behavior information” that is behavior information, “date” that is a date on which the behavior indicated by the behavior information is performed, and “user” that is a user name that performs the behavior indicated by the behavior information. is doing. Each record (row) of the read information management table indicates one read information. When the output unit 105 newly accumulates one piece of read information, for example, a new record is added, and the action information of this read information is accumulated as the value of the item “behavior information”, and the first attribute value Are stored as the value of the item “date”, and the second attribute value is stored in advance as the value of the item “user”. Here, the first record from the top in FIG. 6 is a record of reading information acquired for the newly accumulated color code 51. Here, it is assumed that other read information has already been accumulated.

  Similarly, the acquisition unit 104 performs the same process on the other color codes 52 to 54 detected from the captured image 4 and acquires read information. Then, the output unit 105 accumulates the acquired read information in the read information storage unit 106.

  FIG. 7 is a read information management table at the time when read information acquired for the color codes 52 to 54 is accumulated. The first to third records from the top are read information records corresponding to the color codes 52 to 54.

  In this way, information including the color code arranged on the board 3 can be acquired as electronic data and accumulated in the read information storage unit 106.

  In the above specific example, the case where the first acquisition target and the second acquisition target are detected for the color code in the photographed image has been described. However, the first is arranged at a position corresponding to the color code. Only the one acquisition target may be detected to acquire the first attribute value. For example, when only the first acquisition target is arranged as the acquisition target in the captured image, only the first acquisition target arranged at the position corresponding to the color code may be acquired. For example, even when the first acquisition target and the second acquisition target are arranged as acquisition targets in the captured image, only the first acquisition target arranged at a position corresponding to the color code is used. And the first attribute value may be acquired.

  As described above, according to the present embodiment, the arranged information can be converted into electronic data easily and appropriately.

  Also, the color code is different from a normal barcode, a two-dimensional barcode such as QR code (registered trademark), etc., in one captured image, for example, in one still image or one frame image, Since it is possible to detect a plurality of color codes at the same time and acquire information corresponding to the color codes, it is possible to acquire a plurality of read information from one captured image and detect the color codes. Therefore, it is not necessary to perform a plurality of shootings and the like, and the user's operation for shooting can be simplified.

  In addition, when a color code is used and a character string or an image indicating information associated with the color code is not arranged in the vicinity of the color code, what information each user has arranged, etc. It is not easily known to other users. For example, a user who takes a vacation places a color code associated with his / her user identifier in the portion associated with the date of the table in which the first acquisition target indicating the date is disposed. When managing attendance, etc., other users cannot easily find out who is taking a rest just by looking at the table. As a result, the user's privacy can be protected.

  In the above embodiment, the color code as described above may be used as the first acquisition target or the second acquisition target. In this case, the acquisition unit 104 acquires information corresponding to the color code as a process of acquiring an attribute value or the like corresponding to the first acquisition target that is the color code or the second acquisition target that is the color code in the captured image. What is necessary is just to perform the process similar to the process to perform. Note that in this case, the acquisition unit 104 receives the information that can be read from the color code, the color code that is the first acquisition target or the second acquisition target, and the color code that is arranged in association with these, and the color code It is preferable to distinguish and detect using the area | region etc. which are arrange | positioned.

  In the above embodiment, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.

  In the above embodiment, the case where the color code processing apparatus is a stand-alone has been described. However, the color code processing apparatus may be a stand-alone apparatus or a server apparatus in a server / client system. In the latter case, the output unit or the reception unit receives an input or outputs a screen via a communication line.

  In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

  The software that realizes the color code processing apparatus in the above embodiment is the following program. In other words, the program includes two or more first acquisition targets that are two or more acquisition targets arranged in the first direction and that are acquisition targets associated with different attribute values. Two or more color codes arranged at positions corresponding to any one of the first acquisition targets, a reception unit that receives the captured image, and a color code from the captured image received by the reception unit And a plurality of pairs with the first acquisition target arranged at the position corresponding to the color code, and for each detected pair, the information corresponding to the color code and the first acquisition target respectively. This is a program for functioning as an acquisition unit that acquires read information, which is information having an attribute value, and an output unit that outputs the read information acquired by the acquisition unit.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, a function that can be realized only by hardware such as a modem or an interface card in an acquisition unit that acquires information or an output unit that outputs information is not included in the function realized by the program.

  Further, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 8 is a schematic diagram showing an example of the external appearance of a computer that executes the program and realizes the color code processing apparatus according to the embodiment. The above-described embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

  In FIG. 8, the computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905, a keyboard 902, a mouse 903, and a monitor 904.

  FIG. 9 is a diagram showing an internal configuration of the computer system 900. In FIG. 9, in addition to the CD-ROM drive 905, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a bootup program, and the MPU 911, and receives instructions of an application program. A RAM (Random Access Memory) 913 that temporarily stores and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and a bus 915 that interconnects the MPU 911, ROM 912, and the like Prepare. The computer 901 may include a network card (not shown) that provides connection to the LAN.

  A program that causes the computer system 900 to execute the functions of the color code processing apparatus and the like according to the above-described embodiment may be stored in the CD-ROM 921, inserted into the CD-ROM drive 905, and transferred to the hard disk 914. Instead, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 when executed. The program may be loaded directly from the CD-ROM 921 or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the color code processing device according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 900 operates is well known and will not be described in detail.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the color code processing apparatus according to the present invention is suitable as an apparatus using a color code, and is particularly useful as an apparatus for converting information including a color code into electronic data. .

DESCRIPTION OF SYMBOLS 1 Color code processing apparatus 101 Reception part 102 Image | photographing part 103 Corresponding storage part 104 Acquisition part 105 Output part 106 Reading information storage part

Claims (5)

Two or more acquisition targets arranged in the first direction, and two or more first acquisition targets that are acquisition targets associated with different attribute values, and the second direction different from the first direction Two or more second acquisition targets that are two or more acquisition targets that are arranged in a direction and are associated with different attribute values, and any one of the two or more first acquisition targets And two or more color codes respectively disposed at positions corresponding to any one of the two or more second acquisition targets, and a reception unit that receives a captured image,
From the photographed image received by the receiving unit, a color code, a first acquisition target arranged at a position corresponding to the color code, and a second acquisition target arranged at a position corresponding to the color code A plurality of sets are detected, and for each detected set, information corresponding to a color code, an attribute value corresponding to the first acquisition target, and an attribute value corresponding to the second acquisition target An acquisition unit for acquiring certain read information;
A color code processing apparatus comprising: an output unit that outputs read information acquired by the acquisition unit. The attribute value associated with the first acquisition target is a date and time,
Information associated with the color code, according to claim 1 Symbol placement color code processing apparatus is a user identifier. The attribute value associated with the first acquisition target is a date and time,
The attribute value associated with the second acquisition target is a user identifier,
Information associated with the color code, color code processing apparatus according to claim 1, wherein the action information indicating the action of the user. A color code processing method performed using a reception unit, an acquisition unit, and an output unit,
The output unit is two or more acquisition targets arranged in a first direction, and two or more first acquisition targets that are acquisition targets associated with different attribute values; and the first direction Are two or more acquisition targets arranged in different second directions, two or more second acquisition targets that are acquisition targets associated with different attribute values, and the two or more first acquisition targets An accepting step of accepting a photographed image obtained by photographing two or more color codes respectively disposed at positions corresponding to any one of the two and two or more second acquisition targets ;
From the photographed image received in the receiving step, the acquisition unit receives a color code, a first acquisition target arranged at a position corresponding to the color code, and a second arranged at a position corresponding to the color code. A plurality of pairs with the acquisition target is detected, and for each detected pair, the information corresponding to the color code, the attribute value corresponding to the first acquisition target, and the attribute value corresponding to the second acquisition target an acquisition step of acquiring information in which the read information with bets,
A color code processing method , comprising: an output step in which the output unit outputs the read information acquired in the acquisition step . Computer
Two or more acquisition targets arranged in the first direction, and two or more first acquisition targets that are acquisition targets associated with different attribute values, and the second direction different from the first direction Two or more second acquisition targets that are two or more acquisition targets that are arranged in a direction and are associated with different attribute values, and any one of the two or more first acquisition targets And two or more color codes respectively disposed at positions corresponding to any one of the two or more second acquisition targets, and a reception unit that receives a captured image,
From the photographed image received by the receiving unit, a color code, a first acquisition target arranged at a position corresponding to the color code, and a second acquisition target arranged at a position corresponding to the color code A plurality of sets are detected, and for each detected set, information corresponding to a color code, an attribute value corresponding to the first acquisition target, and an attribute value corresponding to the second acquisition target An acquisition unit for acquiring certain read information;
A program for functioning as an output unit that outputs read information acquired by the acquisition unit.

Images