JP7427851B2 - Code processing device, code processing method, and program - Google Patents

Description

The present invention relates to a code processing device and the like.

BACKGROUND ART As a conventional technique, a technique is known in which a two-dimensional code area is specified from an image and information coded by the two-dimensional code is identified (see, for example, Patent Document 1).
(For example, see Patent Document 1).

Japanese Patent Application Publication No. 2001-195536 (Page 1, Figure 1, etc.)

However, the conventional code processing device has a problem in that it is not possible to appropriately group a plurality of captured codes.

The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a code processing device and the like that can appropriately group a plurality of captured codes.

The code processing device of the present invention has an image reception function that receives photographed images of two or more first cards on which first codes are arranged and one or more second cards on which second codes are arranged. a code detection unit that detects a code from the captured image received by the image reception unit; a code reading unit that reads the code detected by the code detection unit to obtain information corresponding to the code; a grouping part that groups each of the first codes and one or more second codes arranged in correspondence with each of the first codes; This is a code processing device including an output unit that outputs information regarding the converted groups.

With this configuration, a plurality of photographed codes can be appropriately grouped.

Further, in the code processing device of the present invention, in the code processing device, the grouping unit sets different areas corresponding to each of the first codes from the arrangement of the two or more first codes indicated by the captured image. , the second codes placed in different set areas may be grouped with the first code corresponding to each area.

With this configuration, it is possible to appropriately group a plurality of photographed codes using the area set according to the arrangement of the first codes.

Further, in the code processing device of the present invention, in the code processing device, the grouping section expands two or more rectangular areas respectively arranged on the two or more first codes in the right side direction and the bottom side direction. In order to ensure that the speed at which the edges of different areas are expanded is faster than the speed at which they are expanded in the left and top directions, the boundary line is the part where the sides of different areas meet each other when they are expanded continuously until they hit each other. Alternatively, two or more areas may be set, and the first code and second code placed in each of the two or more areas may be grouped for each area.

With this configuration, the second cord located on the right side and below the first cord is given priority over the second cord located on the left side and above the first cord. Can be grouped with codes.

According to the code processing device and the like according to the present invention, a plurality of captured codes can be appropriately grouped.

Block diagram of a code processing device according to an embodiment of the present invention Diagrams showing captured images for explaining grouping of the code processing devices (FIGS. 2(a) and 2(b)) Diagrams showing captured images for explaining grouping of the code processing devices (FIGS. 3(a) to 3(c)) Flowchart explaining the operation of the code processing device A diagram showing a code processing device and a whiteboard to be photographed to explain the operation of the code processing device. Diagram showing a group management table for explaining the operation of the code processing device A diagram showing an example of the configuration of a computer system according to an embodiment of the present invention.

Embodiments of the code processing device and the like will be described below with reference to the drawings. Note that in the embodiments, constituent elements with the same reference numerals perform similar operations, and therefore, repeated explanation may be omitted.

(Embodiment)
FIG. 1 is a block diagram of a code processing device 1 in this embodiment.

The code processing device 1 includes an image receiving section 100, a photographing section 101, a code detecting section 102, a code reading section 103, a grouping section 104, and an output section 105.

The image receiving unit 100 receives one or more captured images. The photographed image is an image obtained by photographing two or more first cards and one or more second cards. The first card is the card on which the first code is placed. The second card is a card on which a second code is placed. Hereinafter, when the first code and the second code are referred to without distinction, they may be simply referred to as a code. Further, when calling the first card and the second card without distinguishing them, they may be simply called cards.

A card is usually a plate-like or sheet-like object made of a material such as paper, resin, or metal. However, the material, thickness, and structure of the card, such as its laminated structure, does not matter. Further, the planar shape of the card is usually a rectangular shape or a rounded rectangular shape, and the size is such that it can be held in a hand, but the planar shape and size of the card are not limited. The color and pattern of the card does not matter. The term "card" here is a concept that includes bills, plates, and the like. A fastener such as a safety pin or a clip may be attached to the back surface of the card. For example, name tags and the like may also be considered a type of card here. Further, the card may be provided with a hole or the like. The first card and the second card may be the same card except for the code arranged, the information arranged on the surface, etc., or may be different cards. For example, the first card and the second card may have the same material, shape, size, color, etc., or may be different cards. At least one of the first card and the second card may be a sticker having an adhesive surface on the back surface of which an adhesive or the like is disposed.

At least one, preferably both, of the first card and the second card are preferably cards that can be removably attached to a desired surface by the user. The first card and the second card are preferably cards that are removably attached to the surface of a board, sheet, etc., for example. For example, the first card and the second card may be a card made of a magnetic sheet that is removably attached to a board or sheet having a magnetic material, or a card to which a magnet or the like is attached. Further, the first card and the second card may have a suction cup, an adhesive, a hook-and-loop fastener, etc. on the back surface or the like.

The first code and the second code are codes that can read information, for example, codes that can be detected from a photographed image and read the corresponding information. The code is, for example, a code represented by an image or the like other than a character string. For example, the code may be a color code such as a Chameleon code (registered trademark), a two-dimensional code such as a QR code (registered trademark), a bar code, or any other code. There may be. The code here is a code that can be read simultaneously using a photographed image. In the present embodiment, a case will be described below in which the first code and the second code are color codes.

Preferably, the first code and the second code are codes whose orientations can be specified. A code whose direction can be specified is a code whose vertical, horizontal, longitudinal, and transverse directions can be specified. In many ordinary codes such as the above-mentioned color code and two-dimensional code, the direction of the code can be specified in order to make the code readable.

The code is typically placed on the front of the card. It doesn't matter where the code is placed on the card. Preferably, the code is attached to the surface of the card. The first code and the second code are, for example, a code printed on the card or a code pasted on the card. However, it does not matter how the code is placed on the card. Character strings, images, etc. may be placed on the front side of the card other than the area where the code is placed, or on the back side. This character string or image may be a character string or image that represents information read from a code placed on the same card, or may be a character string or image that does not represent information read from the code. This character string or image may be a character string or image indicating whether the card is a first card or a second card.

The photographed images may be still images, moving images, or continuous still images. The number of pixels of the captured image does not matter. The data format or file format of the captured image does not matter. Further, the photographed image may be a color image or a monochrome image. However, when using a color code as a code in a photographed image, the photographed image usually needs to be a color image.

The photographed image is preferably an image of the surface on which the first card and the second card are placed. This surface may be, for example, the surface of a board or sheet on which the first card and the second card are attached, or the surface of a desk, table, or floor on which the first card and the second card are placed. , a wall surface, etc.

The first code is, for example, a key or central code for grouping. For example, grouping is performed for each first code, for example. The second code is, for example, a code that is grouped under the first code. For example, among the codes that make up one group, the first code is a code corresponding to the leader of a group consisting of multiple users, and the second code is a code corresponding to members other than the leader of this group. This is the code corresponding to .

The first code and the second code are distinguishable codes. An identifiable code is, for example, a code that can be identified as a first code or a second code based on information read from the code. For example, the first code is a code that includes information such as an identifier or flag indicating that the information read from the code is the first code, or information read from one or more first codes prepared in advance. It may be a code that matches any one of the following, or it may be a code that indicates that information such as a hash value obtained using information read from the code is the first code. . In this case, a code determined to be not the first code may be determined to be the second code. Further, the second code may be either a code containing information indicating that the information read from the code is the second code, or information read from one or more second codes prepared in advance. It may be a matching code, or it may be a code that indicates that the information obtained using the information read from the code is the second code. Further, both the first code and the second code may be the above codes. Furthermore, the first code and the second code may be codes of different types or code systems. In addition, at least one of the first code and the second code may include a specific arrangement of one or more dots or bars or one or more specific colors indicating whether the first code or the second code is the first code or the second code. The code may have a cell arrangement of .

For example, if multiple codes that can read the names of multiple members belonging to a group are placed in one captured image, the names of multiple leaders among these members may be registered in advance. If the name read from the code among multiple codes in the captured image matches the name of one of the pre-registered readers, this code is determined to be the first code and the code is read from the code. If the name does not match any of the pre-registered leaders, this code may be determined to be the second code. However, it does not matter how the first code and the second code are identified.

Note that although codes of the same type or code system are normally used as the plurality of first codes, codes of different types or code systems may be used. The same applies to the second code.

Preferably, the first card and the second card are cards that can be identified by the user visually or by touch. For example, it is preferable that the first card and the second card have different colors on their surfaces, or cards with different characters or marks arranged on their surfaces.

It is preferable that the photographed image is an image taken such that the upper side of the area where the first card and the second card are placed is the upper side of the image. For example, if the photographed image is an image of a first card and a second card placed on a wall, etc., the first card and second card should be placed so that the upper side of the image is on the ceiling side of the wall. It is preferable that the image is a photograph of the area where the cards are placed. Further, the photographed image is, for example, an image obtained by photographing a first card and a second card arranged with a predetermined direction facing upward, such that the upper direction is the upper direction of the photographed image. Good too.

The reception of a photographed image here may be the reception of photographic information photographed by a photographing section 101 described later, which has a photographing section similar to the photographing section 101 described below provided outside the code processing device 1. It may also be the reception of photographed images transmitted via a wired or wireless communication line from a photographing device (not shown), etc., and read from a recording medium (not shown) such as an optical disk, magnetic disk, or semiconductor memory. It may also be possible to accept a photographed image that has been taken. How the image receiving unit 100 receives captured images is not limited to the above.

In this embodiment, as an example, a case will be described where the code processing device 1 includes the photographing section 101 and the image receiving section 100 receives a photographed image taken by the photographing section 101. When the code processing device 100 receives a photographed image from a photographing section or the like provided externally, the code processing device 1 does not need to have the photographing section 101 such as a camera to be described later. For example, when the image receiving unit 100 receives a photographed image taken with a camera included in a so-called smartphone or the like and transmitted from the smartphone, the photographing unit 101 described later may be omitted.

The image reception unit 100 may be considered as an interface or the like for accepting captured images. The image reception unit 100 is realized by, for example, a device driver for receiving and reading captured images, menu screen control software, and the like.

The photographing unit 101 acquires a photographed image. For example, the photographing unit 101 acquires a photographed image by photographing an area where two or more first cards and one or more second cards are arranged. The image photographed by the photographing section 101 is the photographed image as described above in relation to the image receiving section 100. In addition to the first card and the second card, the photographing unit 101 further arranges one or more cards on which a code different from both the first code and the second code is arranged. You may also photograph the area where the image is displayed.

The photographing unit 101 is usually realized by a digital camera, an optical scanner, a line sensor, or the like.

The code detection unit 102 detects a code from the captured image received by the image reception unit 100. Detecting a code from a photographed image may mean, for example, detecting an image of the code or detecting an area or outline of the code within the photographed image. The codes that the code detection unit 102 detects from the captured image are, for example, a first code and a second code. The code detection unit 102 normally detects all the codes in the photographed image, but may detect only some codes. In cases such as when the first code and the second code are of different types, the code detection unit 102 determines whether each detected code is different from the first code and the second code when detecting the code. You may also obtain information indicating which code it is. Since the process of detecting one or more codes from a photographed image is a known technique, detailed explanation will be omitted here.

The code reading unit 103 reads each code detected by the code detection unit 102 and obtains information corresponding to the code. The codes to be read here are the first code and the second code. The information that the code reading unit 103 acquires by reading the code (hereinafter referred to as read information) may be, for example, information such as an identifier that is read directly from the code, and is associated with information such as an identifier that is read from the code. The information may be information stored in a storage unit (not shown). If the code detected by the code detection unit 102 includes a code other than the first code and the second code, the code other than the first code and the second code may also be read. The read information may be any information. In the following, an example will be described in which the code reading unit 103 acquires information such as an identifier obtained by directly reading the first code and the second code as read information. Note that since the process of reading the code is a known technique, a detailed explanation will be omitted here.

For example, the code reading unit 103 may use information read from the code to determine whether the read code is a first code or a second code. For example, if the information read from the code has information indicating that it is the first code, or if it matches one of the pieces of information read from one or more first codes stored in advance in a storage unit (not shown), etc. In this case, the read code may be determined to be the first code. Further, if information such as a hash value obtained using information read from the code is a value corresponding to the first code, it may be determined that the code is the first code. Further, a code from which information other than these can be obtained may be determined to be a second code. Further, the code reading unit 103 may perform similar processing using information read from the code to determine whether or not it is the second code.

Note that the process of detecting the first code and the second code from each code detected by the code detection unit 102 is performed by the code detection unit 102 or the grouping unit 104 other than the code reading unit 103. Also good.

The grouping unit 104 includes each of the first codes among the plurality of codes detected by the code detection unit 102, and one or more second codes arranged in association with each of the first codes. group. The grouping performed by the grouping unit 104 is, for example, grouping based on the first code, center, or core. The grouping performed by the grouping unit 104 may be considered to be a group using the first code as a so-called key. Each group grouped by the grouping unit 104 is a group having at least one first code. The arrangement here may be considered as an arrangement within a photographed image or an arrangement in real space. It goes without saying that grouping codes can be considered as grouping cards on which codes are placed.

Grouping the first code and the second code may be thought of as, for example, correlating the reading information of the first code with the reading information of the second code. Grouping the first code reading information and the second code reading information means acquiring information having the first code reading information and the second code reading information, A group identifier or the like indicating that they belong to the same group may be added to each of the first code reading information and the second code reading information.

The grouping unit 104 may determine which arrangement relationship the second code has with the first code as the second code arranged in association with the first code. Hereinafter, as examples of this grouping process, (1) grouping based on the distance between codes, and (2) grouping based on the area where the codes are arranged will be explained.

(1) Grouping based on the distance between codes FIG. 2(a) shows an example of captured images 200 received by the image receiving unit 100 to explain grouping based on the distance between codes performed by the grouping unit 104. It is a diagram. In the photographed image 200, three first codes 201a to 201c and five second codes 202a to 202e are arranged. Note that when the first codes 201a to 201c are not distinguished, they are simply referred to as the first code 201. Furthermore, when the second codes 202a to 202e are not distinguished from each other, they are simply referred to as the second code 202. It is assumed here that the first code 201 and the second code 202 are both color codes having rectangular outer diameters. The first codes 201a to 201c and the second codes 202a to 202e are codes with different corresponding reading information. Note that this also applies to the description of other groupings below. The first code 201 is placed on the first card 211. The second code 202 is located on the second card 212.

The grouping unit 104 uses the position information of the codes 201a to 201c, which the code reading unit 103 has determined to be the first code, among the codes detected in the captured image 200 by the code detection unit 102, and the position information of the codes 201a to 201c, which are determined to be the first code, and The location information of the codes 202a to 202e determined to be present is acquired. Then, using the acquired code position information, for each of the second codes 202, the first code 201 having the closest distance between the codes is detected. Then, each second code is grouped with the first code 201 that is closest to each other. For example, the distance between the second code 202a and each of the first codes 201a to 201c is calculated using the position information of each code, the first code 201a with the closest distance is detected, and the detected The first code 201a and the second code 202a are grouped. For example, the read information of the second code 202a is stored in a storage unit (not shown) in association with the read information of the first code 201a. The read information here is, for example, a code identifier. The accumulation here may be temporary memory. Similarly, the distance between the second code 202b and each of the first codes 201a to 201c is calculated using the position information of each code, and the first code 201b with the closest distance is detected. The first code 201b and the second code 202b are grouped. Similar processing is also performed for the other second codes 202c to 202e. Thereby, the first code 201 and the second code 202 can be grouped.

Note that the code position information includes the coordinates of the center of each code area in the photographed image 200, the coordinates of a specific position such as the center of gravity, one of the four corners, and the like, and the representative point of each code. Here, an example is explained in which the coordinates of the center of the code are used as the position information. The code area is, for example, an area where a code image is arranged. Note that the code detection unit 102 detects the card by image recognition processing or the like, and the grouping unit 104 uses the position information of the card on which the code is placed (for example, the code (coordinates of representative points, etc.) may be obtained. The code position information may be acquired by the code detection unit 102, the code reading unit 103, or the like. This also applies to other groupings described below.

(2) Grouping by area where codes are arranged The grouping unit 104 sets different areas corresponding to each of the first codes from the arrangement of two or more first codes shown in the captured image, and The second codes placed in different areas are grouped with the first code corresponding to each area. The different regions corresponding to each of the first codes are usually non-overlapping regions, and are regions in which only one first code is arranged in one region. The different areas corresponding to the respective first codes are, for example, different areas in which different first codes are respectively arranged. The first code corresponding to each area is, for example, the first code placed in each area.

It does not matter how the grouping unit 104 sets different areas corresponding to each of the first codes based on the arrangement of the two or more first codes indicated by the captured image. Here, we will discuss (2-1) an example of grouping using a Voronoi diagram, and (2-2) an example of grouping using a region obtained by continuously enlarging the rectangle corresponding to the first code. (2-3) An example in which grouping is performed using an area divided by a rightward half-line and a downward half-line with the top left of each of the plurality of first cards as the apex will be described.

(2-1) Grouping using Voronoi regions FIG. 2(b) is an example of captured images 200 received by the image receiving unit 100 to explain grouping using a Voronoi diagram performed by the grouping unit 104. 2(a), the same reference numerals as in FIG. 2(a) indicate the same or corresponding parts. In the figure, center point 210 is the center point of each first cord 201. Here, the photographed image 200 is the same photographed image as in FIG. 2(a), and the first code 201 and the second code 202 are arranged in the same position as in FIG. 2 in the photographed image 200. shall be. Further, here, for convenience of explanation, illustration of the card on which the code is arranged is omitted.

The grouping unit 104 selects a center point 210 for each of the first codes 201a to 201c, which the code reading unit 103 has determined to be the first code, among the codes detected in the captured image 200 by the code detection unit 102. is detected and the position information of the center point 210 is obtained. Then, using these center points 210 as generating points, the captured image is divided into a plurality of Voronoi regions. A Voronoi region is a region composed of a set of points having the shortest distance to each generating point. Specifically, for example, perpendicular bisectors 2102 are drawn from each of straight lines 2101 connecting center points 210 that are adjacent generating points, and the perpendicular bisectors are connected at a point 2103 where the perpendicular bisectors intersect. Then, the captured image is divided by the combined perpendicular bisectors to obtain Voronoi regions 2104a to 2014c. The grouping unit 104 groups the first code 201 and the second code 202 included in each of the Voronoi regions 2104a to 2014c divided in this way. For example, the read information of the first code 201a and the read information of the second codes 202a and 202b in the same Voronoi region 2104a are stored in a storage unit (not shown) in association with each other. The read information here is, for example, a code identifier. The accumulation here may be temporary memory. Note that whether or not each code is placed within the divided area may be determined using the position information of the code or the position information of the card on which the code is placed. The determination may be made based on whether or not the area in which the cards placed in the area are located is at least the majority of the codes and cards. This also applies to the following.

Note that the process of dividing in the Voronoi region is a well-known technique, so the detailed process will be omitted. Furthermore, processes other than those described above may be used as the process of dividing the Voronoi region.

Furthermore, here, a case has been described in which the captured image is divided into a plurality of Voronoi regions using the center point of the first code 201 as a generating point, but instead of the center point of the first code 201, the The captured image may be divided into Voronoi regions using representative points other than the center point of the first code 201 or the center point of the first card 211.

(2-2) Grouping using enlarged areas FIGS. 3(a) and 3(b) show grouping performed by the grouping unit 104 using enlarged areas of rectangular areas corresponding to each code. 2A is a diagram illustrating an example of a photographed image 200 received by an image reception unit 100 for explaining. In the diagram, the same reference numerals as in FIG. 2A indicate the same or corresponding parts. Here, the photographed image 200 is the same photographed image as in FIG. 2(a), and the first code 201 and the second code 202 are arranged in the same position as in FIG. 2 in the photographed image 200. shall be. For convenience of explanation, illustration of the card on which the code is arranged is omitted. Furthermore, here, a case will be described in which the first code 201 has a rectangular outline.

Here, the grouping unit 104 expands the two or more rectangular areas arranged on the two or more first codes in the right side direction and the bottom side direction at a speed that is increased in the left side direction and the top side direction. In order to be faster than the speed, two or more areas are set such that when each part of the sides of different areas are continuously expanded until they hit each other, the part where the sides hit each other becomes the boundary line, and these two areas are A case will be described in which the first code and second code arranged in each of the above areas are grouped by area.

As shown in FIG. 3A, the grouping unit 104 selects a plurality of first codes that the code reading unit 103 determines to be the first code among the codes detected in the captured image 200 by the code detecting unit 102. Rectangular areas 301a to 301c are arranged on the codes 201a to 201c, respectively. Note that if the rectangular areas 301a to 301c are not distinguished, they may be simply referred to as the rectangular area 301. These rectangular areas 301a to 301c are, for example, rectangular areas having the same outline as the first codes 201a to 201c, which are the respective placement destinations, in the photographed image 200, and are It is arranged so as to be overlapped with the first cords 201a to 201c. However, in FIG. 3A, the size of the rectangular area 301 is illustrated to be slightly larger than the first code 201 for convenience of explanation. In each of the rectangular areas 301a to 301c, the side located on the right side of the photographed image 200 is the right side, the side located on the left side of the photographed image 200 is the left side, the side located above the photographed image 200 is the top side, and the side located on the left side of the photographed image 200 is the top side. Let the side located on the lower side be the bottom side. Each side of the rectangular area 301 may be considered as part of the outline of the area 301.

Then, these rectangular areas 301a to 301c are continuously enlarged while being superimposed on the first codes 201a to 201c, respectively. At this time, the speed at which each rectangular area 301 is expanded in the right side direction and the bottom side direction is made faster than the speed at which it is expanded in the left side direction and the top side direction. For example, the speed ratio is set to 5:1. Note that the speeds at which the different regions 301a to 301c are expanded in the right side direction and the bottom side direction are preferably the same, but may be different. Further, it is preferable that the speed at which the different regions 301a to 301c are expanded in the left side direction and the top side direction is the same, but may be different.

Furthermore, each of the rectangular regions 301a to 301c is continuously enlarged until each part of the sides of different regions 301a to 301c collide with each other, and two or more regions are created such that the part where the sides collide with each other becomes a boundary line. Set. For example, in the process of continuous expansion, the parts of the sides of the regions 301a to 301c where the sides of the regions 301a to 301c collide with each other are , after reaching the end, the enlargement is stopped, and for the portions where the end has not been reached, the enlargement is continued until the end is reached or the side hits the outer periphery of the photographed image. For example, two or more areas where the parts where the sides meet are a boundary line are two or more areas separated by a line indicated by the parts where the sides meet, or where the parts where the sides meet are the outlines. There are two or more areas such that The sides here are the sides of the rectangular areas 301a to 301c, and may be considered to be the outline of the rectangular area 301a or a part of the outline. Note that two or more rectangular regions 301a to 301c are continuously enlarged until the sides of different regions 301a to 301c collide with each other, and the boundary line is the part where the sides collide with each other. The region may be considered to be an embodiment of two or more regions obtained when different rectangular regions 301a to 301c are successively enlarged so that they do not overlap with each other.

FIG. 3(b) is a schematic diagram showing a state in which rectangular regions 301a to 301c are expanding continuously. It is assumed that between the rectangular regions 301a to 301c, the speed of expansion in the right side direction and the bottom side direction is the same, and the speed of expansion in the left side direction and the top side direction is also the same. Then, during continuous enlargement, if the sides of different rectangular areas 301 collide with each other, further enlargement is stopped. In FIG. 3B, a dotted line 302 indicates a portion where the rectangular regions 301 collide with each other in the process of being continuously enlarged. As the information on the bumped portion, for example, position information such as the coordinates of the bumped portion is acquired.

The rectangular area 301 is expanded at least until the expanded rectangular area 301 covers the entire area of the photographed image. After the enlargement is completed, as shown in FIG. 3(c), a plurality of areas 304a to 304c are photographed with boundaries 303 drawn by the areas where the sides of the enlarged rectangular area 301 collide with each other. Set to 200. Then, the first code 201 and the second code 202 arranged in the set areas 304a to 304c are grouped for each area 304a to 304c. For example, the read information of the first code 201a and the read information of the second codes 202a and 202c in the same area 304a are stored in a storage unit (not shown) in association with each other. Further, the read information of the first code 201b and the read information of the second codes 202b and 202d in the same area 304b are stored in a storage unit (not shown) in association with each other. Further, the read information of the first code 201c and the read information of the second code 202e in the same area 304c are stored in a storage unit (not shown) in association with each other. The read information here is, for example, a code identifier. The accumulation here may be temporary memory.

Normally, when a user places a second card 212 near a first card 211 to group cards etc. into the same group as this first card 211, the user The second card 212 is often placed on the right side or below the first card 211. Therefore, as described above, the speed at which the rectangular area 301 placed on the first code 201 is expanded in the right side direction and the bottom side direction is faster than the speed at which it is expanded in the left side direction and the top side direction. By continuously enlarging the area and setting a plurality of areas, the first code 201 and the second code 202 can be appropriately grouped.

Note that the speed at which each side of the rectangular area 301 is enlarged may be considered to be the speed at which each side is moved in parallel. Further, the speed at which the rectangular region 301 is expanded in the right side direction and the lower side direction is, for example, the direction in which the right side and the lower side of the rectangle move outward in parallel. Further, the speed at which the rectangular area 301 is expanded in the left side direction and the upper side direction is, for example, the direction in which the left side and the upper side of the rectangle move in parallel toward the outside.

In addition, here, we have explained an example in which the speed ratio of the speed of expansion in the right side direction and bottom side direction and the speed of expansion in the left side direction and top side direction is 5:1. The speed ratio may be any other ratio as long as the speed at which the image is expanded is faster than the speed at which the image is expanded in the left side direction and the top side direction. However, the speed ratio is preferably in the range of 3:1 to 8:1, most preferably 5:1.

The area initially placed on the first code 201, that is, the rectangular area before expansion is a rectangular area with the same shape and size as the outline of the first code 201 to which it is placed. is preferred, but may be rectangular in different shapes and sizes. For example, the code may be smaller in size or larger than the code to be placed, or may be a rectangle that has a different aspect ratio or length of one or more sides from the code to be placed. Furthermore, when the outline of the first code 201 is not rectangular, the area initially placed on the first code 201 may be a rectangular area (for example, a square). Further, it is preferable that the four sides of the quadrangle initially placed on the first code 201 are parallel to each side of the first code 201 to which it is placed, but at least one side is not parallel. Good too. For example, the first quadrangular region may be a quadrangular region composed of four sides parallel to the four sides of the photographed image. Note that the rectangle placed on the first card 211 on which the first code 201 is placed may be treated as the rectangle placed first on the first code 201. For example, the rectangle initially placed on the first code 201 may have the same shape as the outline of the first card 211 on which the first code 201 is placed. Note that the rectangular area placed on the first code 201 to be enlarged above may be considered as the rectangular area where the first code 201 is placed. Further, as the area of the first code 201, a rectangular area where the first card 211 on which the first code 201 is placed may be used.

Note that here, the grouping unit 104 arranges rectangular areas 301 on two or more first codes 201 of the photographed image, and enlarges each rectangular area 301 in the right side direction and the bottom side direction. Two or more areas are expanded continuously until the sides of different regions 301 collide with each other so that the speed is faster than the speed of expansion in the left side direction and the top side direction, and the part where the sides collide with each other becomes a boundary line. As described above, the grouping unit 104 expands the two or more rectangular areas respectively arranged on the two or more first codes in the right side direction and the bottom side direction. In order to ensure that the speed at which the edges of different areas are expanded is faster than the speed at which they are expanded in the left and top directions, the boundary line is the part where the sides of different areas meet each other when they are expanded continuously until they hit each other. If two or more areas are to be set, the process of actually arranging or enlarging a rectangular area 301 etc. on the captured image is performed to set multiple areas to be used for grouping. You don't have to. For example, by performing calculations using the position information of the first code 201, etc., two or more rectangular areas respectively placed on two or more first codes can be expanded in the right side direction and the bottom side direction. In order to ensure that the speed at which the edges of different areas are expanded is faster than the speed at which they are expanded in the left and top directions, the boundary line is the part where the sides of different areas meet each other when they are expanded continuously until they hit each other. Alternatively, two or more areas may be set, and the first code and second code placed in each of the set areas may be grouped.

(2-3) Grouping using areas delimited by right-pointing and downward-pointing half-lines The grouping unit 104, for example, uses right-pointing half-lines and downward-pointing An area separated by a half straight line and each having a first card is set as an area corresponding to each first card, and the first card corresponding to the set area and this area are and one or more second cards placed in the group. The areas corresponding to the first card are set so that they do not overlap. If the half-line hits the left side or bottom side of the photographed image, this left side or bottom side may be considered as the left side or bottom side of the area corresponding to the first card. Also, if the right-facing half-line and downward-facing half-line set for the first card here collide with other first cards or right-facing or downward-facing half-lines for other first cards. Let this rightward half-line and downward half-line be line segments that extend to this end position. The area corresponding to one or more first cards includes, for example, a rightward half-line or line segment whose apex is the upper left of one or more first cards, a downward half-line or line segment, and the left side of the photographed image. This is a continuous area having one first card surrounded by a combination of four or more of the above and the lower side of the photographed image, and is an area that does not overlap with other areas. A continuous area is, for example, an area that is not separated by line segments, half straight lines, or the like. Note that the first code may be used instead of the first card. Also, a second code may be used instead of the second card.

In (1) and (2) above, a case has been described in which the photographed image 200 is an image of three first cards 211 and five second cards 212. The first card may be 2 or more, and the second card may be 1 or more.

Note that the grouping unit 104 corrects the captured image received by the image receiving unit 100 by performing projective transformation etc. so that the first code etc. has the original aspect ratio of the first code etc. Grouping may be performed using this corrected captured image. Note that such correction may be performed by the image receiving section 100, the code detecting section 102, the code reading section 103, or the like.

The output unit 105 outputs information regarding the groups grouped by the grouping unit 104. The information regarding groups is, for example, information that associates the first code and the second code that constitute each group. The information regarding groups may be, for example, information including a first code and a second code that constitute each group. Further, the information regarding groups may be, for example, information in which one or more first codes and one or more second codes are associated with a group identifier of a group to which each code belongs. The first code described here may be considered to be read information such as an identifier read from the first code. Similarly, the second code described here may be considered to be read information such as an identifier read from the first code. For example, the information that associates the first code and the second code that make up each group above is the information that is read from the first code that makes up each group, and the information that is read from the second code that makes up each group. It may be considered that the information is associated with the read information that has been read.

Output here refers to displaying on a monitor, projecting using a projector, printing to a printer, sending to an external device, storing on a recording medium, and transmitting processing results to other processing devices or programs. This is a concept that includes things like delivery.

The output unit 105 may or may not include output devices such as a monitor, a speaker, and a communication device. The output unit 105 can be realized by output device driver software, output device driver software and the output device, or the like.

Next, an example of the operation of the code processing device 1 will be explained using the flowchart of FIG. 4.

(Step S101) The photographing unit 101 determines whether to photograph an area where two or more first codes and one or more second codes are arranged. For example, when a reception unit (not shown) or the like receives an operation to perform photography as described above, the photography unit 101 determines to perform photography. If photographing is to be performed, the process advances to step S102; if not, the process returns to step S101.

(Step S102) The photographing unit 101 photographs an area where two or more first codes and one or more second codes are arranged to obtain a photographed image.

(Step S103) The image receiving unit 100 receives the photographed image acquired in step S102.

(Step S104) The code detection unit 102 detects a plurality of codes in the captured image received by the image reception unit 100. For example, the code detection unit 102 obtains information on the outline of each detected code.

(Step S105) The code reading unit 103 reads each code detected in step S104 and obtains information corresponding to the code.

(Step S106) The code reading unit 103 uses the information read in step S105 to detect a first code and a second code from each code detected in step S104. This process may be considered as a process for determining whether each code detected in step S104 is the first code or the second code. Note that when detecting the codes in step S104, if it can be determined whether each code is the first code or the second code, this process may be omitted.

(Step S107) The grouping unit 104 groups one first code and one or more second codes for each first code detected in step S106. This grouping is, for example, based on the distance between codes as described above or the area in which the codes are arranged. The grouping unit 104 obtains, for example, information in which one first code and one or more second codes belonging to the same group are associated with each other.

(Step S108) The output unit 105 outputs information regarding each group grouped in step S107. For example, information that associates one first code with one or more second codes included in each group is output. Information that associates one first code and one or more second codes included in one group is, for example, reading information of one first code and reading information of one or more second codes. This is information that associates the The output here is, for example, transmission or storage. For example, information that associates one first code and one or more second codes included in one group may be stored in a database or the like. Then, the process ends.

Note that in the flowchart shown in FIG. 4, an example has been described in which the code detection unit 102 detects a plurality of codes in the photographed image, and then the code reading unit 103 reads each code. The code reading unit 103 may read the detected code each time a code is detected. This also applies to the process of determining the first code and the like.

Hereinafter, the specific operation of the code processing device 1 in this embodiment will be explained by giving an example.

First, in order to group eight users belonging to one organization, an administrator creates a first code that corresponds to each of the three predetermined group leaders among the eight users. Suppose we have prepared three first cards arranged in . It is assumed that each first code is a code whose read information is a user identifier of a group leader. It is assumed that the user identifiers of these three group leaders are stored in advance in a storage unit (not shown) or the like. It is assumed that the user identifiers of the three group leaders are "L1001," "L1002," and "L1003."

In addition, for each of the remaining 5 users other than the 3 group leaders, we prepared 5 second cards on which the second codes corresponding to each of the 5 users were individually arranged. do. Here, for convenience of explanation, the remaining users will be referred to as general users. It is assumed that the read information of each second code is a user identifier corresponding to each of the five users.

Note that the first code and the second code are both color codes. The color of the front surface of the first card is different from the color of the front surface of the second card so that the second card can be visually identified. It is assumed that the name of the corresponding user is placed adjacent to the code on both the first card and the second card. It is assumed that the user identifiers respectively associated with the first code and the second code are, for example, character strings such as an employee number or membership number assigned to the user. It is assumed that the first card and the second card are cards made of a magnetic sheet that are removably attached to a whiteboard that has a magnetic material inside.

First, in order to perform grouping, an administrator who performs grouping places first cards corresponding to three group leaders on the surface of a whiteboard hung on the wall with wide intervals between them. Then, the administrator places a second card of a general user who wants to be assigned to the same group as each group leader, close to the first card of each group leader.

FIG. 5 is a diagram showing a whiteboard or the like on which the first card and the second card are arranged in this manner. First codes 201a to 201c are arranged on the three first cards 211 arranged on the whiteboard 300, respectively, and second codes 202a to 202e are arranged on the five second cards 212. It is assumed that there is

It is assumed that the administrator who performed the grouping uses the photographing unit 101 of the code processing device 1 to photograph the whiteboard 300 on which the three first cards 211 and the five second cards 212 are arranged. Here, it is assumed that the code processing device 1 is a so-called smartphone, and the photographing unit 101 is a camera included in the smartphone.

Here, the photographed image taken and acquired by the photographing unit 101 is the photographed image 200 shown in FIG. Assume that the photographed image 200 has the user's name placed adjacent to the user's name, and the arrangement of the first codes 201a to 201c and the second codes 202a to 202e in this photographed image is as shown in FIG. 2(a) and FIG. Assume that it is similar to a) to FIG. 3(c).

When the image reception unit 100 receives a photographed image 200 photographed by the photographing unit 101, the code detection unit 102 detects first codes 201a to 201c and second codes a to 202e in the photographed image 200, respectively. , the code reading unit 103 reads the detected code. Then, it is determined whether the read information matches any one of the user identifiers of the three group leaders previously stored in the storage unit (not shown) described above. If they match, the detected code is determined to be the first code, and if they do not match, the detected code is determined to be the second code. As a result of this determination, the first codes 201a to 201c are detected within the photographed image.

The grouping unit 104 performs grouping using the detected first codes 201a to 201c. Here, as explained using FIGS. 3(a) to 3(c) in (2-2) above, the rectangular areas corresponding to the first codes 201a to 201c are Two or more areas are set for the photographed image 200, such as those obtained when continuously enlarged, so that the speed at which the image is enlarged is faster than the speed at which it is enlarged in the left side direction and the top side direction, and each of the set areas is The first codes 201a to 201c and the second codes 202a to 202e arranged in the area are grouped.

Here, since the photographed image 200 is the same as the photographed image 200 used in the explanation of grouping above, the area where the code of the photographed image 200 is arranged is the first one as shown in FIG. 3(c). It is divided into three regions 304a to 304c in which the codes 201a to 201c are arranged, respectively.

The grouping unit 104 uses the user identifier “L1001” read by the code reading unit 103 from the first code 201a placed in the area 304a, and the code reading unit from the second codes 202a and 202c placed in the same area 304a. 103 obtains information that associates the read user identifiers "U0001" and "U0003" with each other. Further, the user identifier "L1002" read by the code reading unit 103 from the first code 201b placed in the area 304b, and the code reading unit 103 read from the second codes 202b and 202d placed in the same area 304b, respectively. information in which the user identifiers "U0002" and "U0004" are associated with each other is obtained. Furthermore, the user identifier "L1003" read by the code reading unit 103 from the first code 201c placed in the area 304c, and the user identifier read by the code reading unit 103 from the second code 202e placed in the same area 304c. Information associated with "U0005" is acquired.

Then, the output unit 105 outputs the user identifiers that the grouping unit 104 has acquired for the first code and second code belonging to each group. Here, user identifiers obtained for each group are stored in a storage section (not shown) for each group.

FIG. 6 is a group management table in which user identifiers acquired from grouped codes stored in a storage unit (not shown) by the output unit 105 are managed in association with each group. The group management table has attributes of "leader ID" and "general ID." “Leader ID” is the user identifier of the group leader read from any of the first codes 201a to 201c. “General ID” is a user identifier of a general user read from any of the second codes 202a to 202e. The attribute value of "leader ID" and the attribute value of "general ID" in the same record (row) indicate the user identifier of the group leader and the user identifier of the general user belonging to the same group. Further, the attribute value of "general ID" of different records (rows) with the same attribute value of "reader ID" indicates the user identifier of a general user belonging to the same group.

By displaying the group management table as shown in FIG. 6 outputted by the output unit 105 on, for example, a monitor (not shown), it is possible to know which group each user belongs to.

As described above, in this specific example, by arranging and photographing the first code and second code corresponding to the user in groups, it is possible to appropriately group the plurality of photographed codes. , it is possible to easily obtain information for managing user grouping.

As described above, according to the present embodiment, a plurality of photographed codes can be appropriately grouped. Thereby, for example, reading information corresponding to a plurality of codes arranged in groups by the user can be appropriately grouped and output.

In each of the above embodiments, each process (each function) may be realized by being centrally processed by a single device (system), or may be realized by being distributed by multiple devices. may be done.

Further, in each of the above embodiments, a case has been described in which the code processing device is a standalone device, but the code processing device may be a standalone device or a server device in a server/client system. In the latter case, the output unit and reception unit will accept input via a communication line and output a screen.

Further, in each of the embodiments described above, each component may be configured by dedicated hardware, or components that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution section may execute the program while accessing a storage section (for example, a recording medium such as a hard disk or a memory).

Note that the software that implements the code processing device in each of the above embodiments is the following program. In other words, this program causes the computer to receive captured images of two or more first cards on which first codes are arranged and one or more second cards on which second codes are arranged. A reception section, a code detection section that detects a code from the captured image received by the image reception section, a code reading section that reads the code detected by the code detection section and obtains information corresponding to the code, and a code detection section. a grouping unit that groups each of the first codes among the detected codes and one or more second codes arranged in correspondence with each of the first codes; This is a program that functions as an output unit that outputs information about the grouped groups.

Note that in the above program, the functions realized by the program do not include functions that can only be realized by hardware. For example, functions that can only be realized by hardware such as a modem or an interface card in an acquisition unit that acquires information, an output unit that outputs information, etc. are not included in the functions that are realized by the above program.

Further, the number of computers that execute this program may be one or more. That is, centralized processing or distributed processing may be performed.

FIG. 7 is a diagram showing an example of a computer system 900 that executes the above program to realize the code processing device according to the above embodiment. The above embodiments may be implemented by computer hardware and a computer program executed on the computer hardware.

In FIG. 7, a computer system 900 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 such as a flash memory in which programs such as a boot-up program, application programs, system programs, and data are stored, and the MPU 911. It includes a RAM 913 that temporarily stores instructions of an application program and provides a temporary storage space, a touch panel 914, a wireless communication module 915, and a bus 916 that interconnects the MPU 911, ROM 912, and the like. Note that instead of the wireless communication module 915, a wired communication module may be provided. Further, instead of the touch panel 914, a display and an input device such as a mouse or a keyboard may be provided.

A program that causes the computer system 900 to execute the functions of the code processing device according to the embodiment described above may be stored in the ROM 912 via the wireless communication module 915. The program is loaded into RAM 913 during execution. Note that the program may be loaded directly from the network.

The program does not necessarily need to include an operating system (OS) or a third party program that causes computer system 900 to execute the functions of the code processing device according to the above embodiment. A program may include only those portions of instructions that call appropriate functions or modules in a controlled manner to achieve desired results. How computer system 900 operates is well known and will not be described in detail.

It goes without saying that the present invention is not limited to the above-described embodiments, and that various modifications can be made, and these are also included within the scope of the present invention.

As described above, the code processing device or the like according to the present invention is suitable as a device for processing codes, and is particularly useful as a device for grouping codes.

1 code processing device 100 image reception section 101 photographing section 102 code detection section 103 code reading section 104 grouping section 105 output section

Claims (3)

an image reception unit that receives captured images of two or more first cards on which first codes are arranged and one or more second cards on which second codes are arranged;
a code detection unit that detects a code from the captured image received by the image reception unit;
a code reading unit that reads the code detected by the code detection unit and obtains information corresponding to the code;
A grouping unit that groups each of the first codes among the codes detected by the code detection unit and one or more second codes arranged in correspondence with each of the first codes. and,
an output unit that outputs information regarding the groups grouped by the grouping unit ,
The grouping unit is configured to expand two or more rectangular areas respectively arranged on the two or more first codes indicated by the photographed image in the right side direction and the bottom side direction at a speed that is expanded in the left side direction and in the top side direction. In order to increase the speed faster than the current speed, two or more different areas are set such that when each part of the sides of different areas are continuously expanded until they hit each other, the part where the sides hit each other becomes the boundary line. A code processing device that groups first codes and second codes arranged in two or more set areas, respectively, for each area . A code processing method performed using an image reception unit, a code detection unit, a code reading unit, a grouping unit, and an output unit, the method comprising:
an image reception step in which the image reception unit receives photographed images of two or more first cards on which first codes are arranged and one or more second cards on which second codes are arranged; ,
a code detection step in which the code detection unit detects a code from the captured image received in the image reception step;
a code reading step in which the code reading unit reads the code detected in the code detection step and obtains information corresponding to the code;
The grouping unit selects each of the first codes among the codes detected in the code detection step and one or more second codes arranged in association with each of the first codes. a grouping step for grouping;
The output unit includes an output step of outputting information regarding the groups grouped in the grouping step ,
In the grouping step, two or more rectangular areas respectively arranged on the two or more first codes indicated by the photographed image are enlarged at a speed that is enlarged in the right side direction and in the lower side direction, and in a left side direction and in the upper side direction. In order to increase the speed faster than the current speed, two or more different areas are set such that when each part of the sides of different areas are continuously expanded until they hit each other, the part where the sides hit each other becomes the boundary line. A code processing method that groups first codes and second codes placed in two or more set areas, respectively, for each area . computer,
an image reception unit that receives captured images of two or more first cards on which first codes are arranged and one or more second cards on which second codes are arranged;
a code detection unit that detects a code from the captured image received by the image reception unit;
a code reading unit that reads the code detected by the code detection unit and obtains information corresponding to the code;
A grouping unit that groups each of the first codes among the codes detected by the code detection unit and one or more second codes arranged in correspondence with each of the first codes. and,
Functioning as an output unit that outputs information regarding the groups grouped by the grouping unit ,
The grouping unit is configured to expand two or more rectangular areas respectively arranged on the two or more first codes indicated by the photographed image in the right side direction and the bottom side direction at a speed that is expanded in the left side direction and in the top side direction. In order to increase the speed faster than the current speed, two or more different areas are set such that when each part of the sides of different areas are continuously enlarged until they hit each other, the part where the sides hit each other becomes the boundary line. A program that groups first codes and second codes placed in two or more set areas by area .

Images