JP2012029115A - Address color system, address color generation method based on camera pickup image, encoding and decoding methods using color photography image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To propose a concept of an address color optimum for encoding and decoding on a portable phone and the like, and to provide an address color system and the like that are capable of cryptically sending any message when distributing information and the like, and of realizing an object allocation even in the case of a color photographic image with a small color variation width or the number of colors limited.SOLUTION: An address color system is applicable to a device such as a portable phone having a camera and a display part, and generates a discretionary color photographic image on a portable phone and the like by extracting a part or the entirety of the color photographic image from plural blocks of two-dimensional array zones constituting a display screen of a display part, the image that is handled by a color code table and is handled as a computer object. For each of the plural blocks, an address color (Cn) is generated from a number (n) given on the basis of block positional information, and a color (C) expressed by the corresponding block.

Description

The present invention is applied to a portable computer terminal such as a cellular phone, or an external computer terminal that can communicate with the portable terminal, and an address color system using a color photographic image for information distribution and the like, and an address color creation based on a camera-captured image The present invention relates to a method, an encoding method and a decoding method used in the address color system.

Mobile phones and the like (generally, portable computer terminals having a display screen with a relatively small area including mobile phones, digital cameras, smartphones, mobile terminals, etc.), various devices related to the mobile phones, Or data and information such as documents, characters, figures, mathematical formulas, images, voices, etc. handled by a computer system consisting of a plurality of mobile phones connected by communication lines (
Etc.) are called “computer objects”. For such computer objects, recognizable languages, diagrams, pictures, etc. are normally used in conventional mobile phones and the like. In other words, the “normal state” of this use means that if the data of the language or the like is always obtained, the contents can be recognized directly and immediately. The same applies to recording, reproduction, compression, etc. of computer objects in a mobile phone or the like.

In information distribution related to computer objects between mobile phones and the like via communication lines such as the Internet, there is a tendency that information distribution is performed in the above-described normal state.

In the above-described system such as a mobile phone, information leakage and theft are likely to occur by an unrelated person.

Therefore, conventionally, in order to prevent the information leakage and theft described above, a technique for performing an encryption process has been proposed in order to make it impossible to directly recognize the contents of the information (for example, Patent Document 1).
etc).

In addition, the present applicant has previously proposed an invention relating to “expression of computer objects using color” (Patent Document 2). The present invention is a technique for expressing data or information handled inside a computer or handled via a computer by using color (color) with an expression means such as a color dot. When necessary data or information (a computer object or simply an object) is recorded in a narrow portion on the surface of paper or the like, it is expressed by color dots or the like. As a result, a large amount of data can be expressed with simple notation. The invention also refers to a method of creating a cipher using color.

In recent years, for example, a color photographic image (generally a color image) obtained by imaging with a camera such as a mobile phone is used as information to be distributed, and a mobile phone on the information receiving side from a mobile phone on the information distribution side or other computer. It is often transmitted via the Internet. Recent mobile phones have a camera function and can easily obtain color photographic images. Color photographic images are useful as a medium for providing information.
In addition, the encoding method and the decoding method are said to be effective in preventing information leakage as encryption. However, these methods enable the delivery of user messages to a large number of specific and unspecified mobile terminals. Therefore, it can also be used to distribute advertisements, product details, pamphlet details, and the like. Also in this case, by associating a certain photographic image with favorite information in advance, additional information related to the color photographic image obtained by the camera is displayed on the screen of the portable terminal. can do. Furthermore, if you use the speaker of your mobile device,
Information can be distributed by voice. Therefore, it can also be used as a pronunciation material for language.

JP 2006-40250 A International Publication WO00 / 72228

In recent years, for example, when information is distributed from a certain mobile phone or the like to another mobile terminal or the like via the Internet, information distributed on the Internet may be stolen. That information
If the computer object remains normal, the information content can be easily eavesdropped. Computer information is encrypted in information distribution between mobile terminals and the like via communication lines such as the Internet, and it is required to realize complete secrecy of data and the like handled in information distribution.

Furthermore, when a color photographic image is distributed using a mobile phone or the like and via the Internet, there is a demand for embedding a message other than the image content in the color photographic image. This is in line with the desire to send the necessary information in an encrypted format.

Further, even a color photographic image is not expressed in full-color colors, but may be a color photographic image with a small color change width and a small number of colors, such as a landscape painting. Even in such a color photographic image, it is desired to perform allocation processing using a color reduced to a desired predetermined number (for example, 65,536) to enable allocation of the predetermined number of objects.

In view of the above problems, the object of the present invention is to propose an optimal color concept for encoding and decoding in information distribution or the like via a communication line by a portable computer terminal such as a mobile phone,
When delivering color photographic images, messages such as texts and voices can be sent in an encrypted manner. Furthermore, even if the color photographic image has a small color change width and a small number of colors, object assignment can be performed. Color system, address color creation method based on camera image,
An object is to provide an encoding method and a decoding method using color photographic images.

In order to achieve the above object, an address color system, an address color creation method based on a camera-captured image, an encoding method, and a decoding method according to the present invention are configured as follows.

An address color system according to the present invention is an address color system applied to a portable computer terminal equipped with a camera and a display unit,
Arbitrary color photographic images on a portable computer terminal that is handled by a color code table and handled as a computer object are formed by extracting some or all of a plurality of blocks in a two-dimensional array area forming a display screen of a display unit Address color system to
For each of the plurality of blocks, the address color (Cn) is created from the number (n) given based on the block position information and the color (C) represented by the corresponding block. Yes.

The address color system according to the present invention is formed by extracting a part or all of a plurality of blocks of a two-dimensional array forming a display screen for displaying an arbitrary color photographic image captured by the camera in a portable computer terminal. Address color system to
For each of the plurality of blocks, an address color (Cn) is created from a number (n) given based on the block position information and a color (C) represented by the corresponding block. .

Furthermore, the address color system according to the present invention is formed by extracting a part or all of a plurality of blocks in a two-dimensional array forming a display screen for displaying an arbitrary color photographic image captured by the camera in a portable computer terminal. Address color system to
For a plurality of blocks expressed in the same color for each of the plurality of blocks, the number (n) given based on the position information of the corresponding block is assigned to the color (C) expressed by the block. It is characterized in that an address color (Cn) is created in combination.

An address color creation method based on a camera-captured image according to the present invention includes a step of selecting a two-dimensional specific region of an image captured by a camera provided in a portable computer terminal;
Dividing the two-dimensional specific region into a plurality of blocks of n × m (n and m are natural numbers other than 1);
determining a representative color for each of a plurality of blocks divided into n × m,
determining a code relating to an address color in the two-dimensional specific area based on a plurality of representative colors determined for each of the n × m blocks and address information based on position information of the corresponding block; ,
It is characterized by having.

An encoding method using a color photographic image according to the present invention includes a two-dimensional array determined on a display screen for displaying the color photographic image from a color photographic image obtained by imaging with a camera of a portable computer terminal. Creating an address color based on each block number (n) and a plurality of colors (C) of the plurality of blocks to be formed;
Creating an address color code correspondence table (CnO table, CO table) that associates each of the plurality of address colors (Cn) listed in the address color with the object (O);
It is characterized by comprising.

The encoding method using a color photographic image according to the present invention is a two-dimensional array defined on a display screen for displaying the color photographic image from a color photographic image obtained by imaging with a camera of a portable computer terminal. Creating an address color one-dimensional array based on the block number (n) and the plurality of colors (C) of the plurality of blocks forming
Creating an ONCn correspondence table corresponding to each of a plurality of address colors (Cn) listed in the address color one-dimensional array, an object (O) described in the text, and a color numerical value (N);
Using the ONCn correspondence table, the address color list (NCn) and the object list (
NO) and encoding to create
It is characterized by comprising.
A decoding method using a color photographic image according to the present invention is a method of decoding a color photographic image encoded by the above-described encoding method according to the present invention,
The above color photographic image is converted into an address color code table (CnO table,
Using the CO table, the address color (Cn) is converted back to the object (O) and decoded.

An encoding system according to the present invention is an encoding system that executes the above-described encoding method, and includes a processing step of performing encoding based on a color photographic image obtained by imaging with a camera of a portable computer terminal. It is characterized by being executed by the arithmetic processing means of the computer terminal.
Furthermore, an encoding system according to the present invention is an encoding system that executes the above-described encoding method, and is provided between a portable computer terminal and an externally connected communicably between the portable computer terminal and the portable computer terminal. A processing step in which an encoding is performed based on a color photographic image obtained by imaging with a camera of a portable computer terminal, and an operation in an external computer terminal to which the color photographic image is transmitted from the portable computer terminal It is characterized in that it is executed by the processing means and then the information obtained by the encoding is transmitted to the portable computer terminal.
A decoding system according to the present invention is a decoding system that executes the above-described decoding method, and performs a processing step of performing decoding based on a color photographic image obtained by imaging with a camera of a portable computer terminal. It is characterized by being executed by the arithmetic processing means of the computer terminal.
Furthermore, a decoding system according to the present invention is a decoding system for executing the above-described decoding method, wherein the portable computer terminal is connected to an external device that is communicably connected to the portable computer terminal. Computation in the external computer terminal to which the color photographic image is transmitted from the portable computer terminal, comprising the computer terminal and performing the decoding step based on the color photographic image obtained by imaging with the camera of the portable computer terminal It is characterized in that it is executed by the processing means and then the information obtained by decoding is transmitted to the portable computer terminal.

Hereafter, the color of the color code table handled on the portable computer terminal and the color used as the object of the computer object will be referred to as “virtual color”, and any color table composed of such color will be referred to as “virtual color”. It will be called “color sheet”.
Therefore, in other words, the address color system according to the present invention comprises a color photographic image and an image of a virtual color sheet virtual on a portable computer terminal, and the virtual color sheet is assigned to the virtual color sheet. The address color (Cn) is created from the number (n) given based on the position information of the “block” and the color (C) represented by the block number (n).
The address given to the block constituting the virtual color sheet does not require a physical pixel area, and since the color is a computer-generated color, the physical color characteristics are not required. Both colors are used as digital values.
By making use of the virtual area and color characteristics of such computers, it is possible to create any number of colors that can be handled on a portable computer terminal and create address colors that do not depend on changes in the external environment of colors. It is attached.

In the configuration of the address color system described above, the color (color) has a problem that it looks different in nature in the display environment, the OS environment, the environmental conditions of the mobile camera, the surroundings of the material, etc. The purpose is to make C available according to the color code table.
The color on the closed portable computer terminal is specified as the color of the code specified by the color code as the color, and the specific color can be used as the color “C” based on the color code table. Therefore, full color can be used freely. Although there was a condition that the use of color fluctuated in various ways due to the influence of the outside world, it is relatively easy to specify a color that can be specified in a color photographic image as an address color. The use of computer objects can be expected in this field.
The purpose of the photographic image is to extract effective colors from the image that are affected by the environmental conditions of the outside world. In general, it is useful because it is difficult to designate as a “specific color” due to color blur. This is a configuration for specifying a color that can be used in CO or the like, and at the same time, it is also an introduction for using “ONC by color based on a color code table” that can be used in full color.

The present invention has the following effects.
First, according to the address color system of the present invention, a part or all of a plurality of blocks (divided areas) of a two-dimensional array forming a display screen for displaying an arbitrary color photographic image on a mobile phone or the like is extracted. , Number given to each block based on block position information (
n) and the color (C) represented by the block are combined to create a “address color (Cn)” so that the color information of the block and the position information of the block are combined to obtain the same color. However, these colors can be distinguished as address colors, and a large amount of information can be encoded / decoded using these address colors.
Second, according to the address color system according to the present invention, even when the number of colors obtained from a color photographic image is small, even if the same color is obtained by combining the block color information and the position information of the block, Colors can be distinguished as address colors, and a large amount of information can be encoded / decoded using these address colors.
Third, an address color list is created based on a two-dimensional array block based on a color photographic image using the address color system created using a color photographic image. Since the CO correspondence table is created using the above and the encoding or decoding is performed based on the CO correspondence table, for example, a color photographic image transmitted over the Internet or the like is associated with an object, It contains no information about the object, and the encryption effect that it cannot be decrypted is exhibited.
Fourth, the color photographic image transmitted from the information distribution side to the information receiving side can be decoded only by a CO correspondence table prepared in advance, and the CO correspondence table is an address based on the object list and the color photographic image. Since it is created based on the color list, even if the transmitted color photo image (color encryption key) is wiretapped on the Internet, the CO correspondence table cannot be made without the object list, and the color photo image The effect that cannot be deciphered is demonstrated.

It is a perspective view which shows the state which images the picture which is a target object with the attached camera of a mobile phone with a camera. FIG. 5 is a block configuration diagram for explaining a display state of a captured image on a display unit and data storage contents in a memory when a picture is captured by a mobile phone camera. It is a figure which shows an example of the picture which is an imaging target object. It is a figure explaining the block division of the captured image on the screen of a display part. It is a flowchart which shows the preparation method of the two-dimensional code structure (two-dimensional color code) formed with an address color. It is a conceptual image figure which shows an example of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the frame which determines the effective representative color and invalid representative color in a two-dimensional code structure (two-dimensional color code). It is a figure which shows an example of an image file. It is a figure which shows an example of a color code table file. It is a figure which shows HIS color 6 colors RGBXWK. It is a figure which shows 6 colors CMYXWK of HIS color. It is a flowchart which shows the encoding method. It is a flowchart which shows a decoding method. It is a figure which shows Example 1 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the address color code table (CO table) in Example 1. FIG. It is a figure which shows Example 2 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the address color code table (CO table) in Example 2. FIG. It is a figure which shows Example 3 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the address color code table | surface (CO table | surface) in Example 3. FIG. It is a figure which shows the address color code table (CO table) in Example 4 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows an example of the one-dimensional arrangement | sequence of the address color (Cn) for Example 5 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the address color code table (CnO table) in Example 5 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the correspondence of the color numerical value (N), the object (O), and address color (Cn) in the address color coding in Example 5. It is a figure which shows the object list | wrist (correspondence relationship between a color numerical value (N) and an object (O)) in the address color coding in Example 5. It is a figure which shows the address color list (correspondence relationship between an address color (Cn) and a color numerical value (N)) in Example 5. It is a figure which shows Example 6 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the address color code table (CO table) in Example 6. It is a figure which shows Example 7 of a two-dimensional code structure (two-dimensional color code). It is a figure which shows the address color code table (CO table) in Example 7. It is a figure which shows the other address color code table (general-purpose data structure) in Example 7. FIG. It is a flowchart which shows the example which performs the decoding method based on the system configuration which combined the mobile telephone and the external computer terminal. It is a figure which shows the other Example of 5 * 5 about a two-dimensional code structure (two-dimensional color code). FIG. 33 is a diagram illustrating a relationship between 25 color addresses and one object (message) in the two-dimensional code configuration (two-dimensional color code) illustrated in FIG. 32.

  DESCRIPTION OF EMBODIMENTS Preferred embodiments (examples) of the present invention will be described below with reference to the accompanying drawings.

The address color system using a color photographic image according to the present invention is a technique for representing an information file such as a sentence typically handled on a mobile phone by a digital color photographic image. In other words, the address color system related to the portable version. Here, the “color photographic image” is an image that is typically captured by a camera (mobile camera) installed in a camera-equipped mobile phone. The target (original image) to be imaged is arbitrary, for example, a printed matter such as a color photograph,
This includes storefront advertisements, books, and displays.
The color photographic image obtained by the camera of the mobile phone constructs the address color system according to the present invention, and based on the address color system, encodes the color photographic image including information such as a document for information distribution and the like. use.
When used for information distribution, the information distribution side selects and determines a color photographic image, and uses information content based on a CO table (conversion table used as conversion means) created using an address color system. Encode an object. On the other hand, on the side of the information receiving device, based on the CO table (used as inverse conversion means) provided in advance, the color photographic image after the encoding process sent by the communication line etc. is received, and this is received. Decrypt and take out the object.
The image content of the color photographic image is arbitrary as described above. In the present invention, preferably,
For example, the present invention can also be applied to a color photographic image having a small color change width and a small number of colors such as a landscape painting. Data relating to a color photographic image is transmitted from a certain mobile phone on the information distribution side to another portable computer terminal on the information reception side via a communication line.
Note that the above address color system, encoding method, and decoding method are applied to a portable computer terminal such as a single cellular phone and used as a system for encrypting text stored in the portable computer terminal. It is also possible.

Since the concept of “address color” in the address color system of the portable version according to the present invention is applied to a portable computer terminal such as a mobile phone, “color with block position number (
Position Number Suffixed Color) ”. In addition, the concept of “block” refers to a plurality of pixels (pixels) constituting a display screen of a relatively small area mobile phone or the like
, Each of a plurality of blocks obtained by dividing the display screen as a two-dimensional array (matrix). One block is formed of, for example, a plurality of pixels forming a rectangular plane, and is usually set to a square shape. Details thereof will be described in the following embodiments.
“Address colorization” means that a serial number (address) is assigned to each element separately for each color set defined by a block. In the address numbering, numbering (numbering or numbering) is performed using the position number or the like for the same color.

Using the above color photo image and using a CO table etc. (combination of a specific address color list and an object list) sent by another route or route related to physical distribution such as mailing or home delivery, the color photo Based on the structure of a specific color arrangement (color arrangement or color configuration) drawn on the image, it is possible to acquire necessary data or information on the receiving side. The CO table is a correspondence table of color (C) and object (O),
Made based on color photographic images.
Note that by adding a color numerical value (N) to the above, the correspondence table becomes an ONC correspondence table.

In the above, the “color photographic image” is drawn on a color photographic image (including a color image) displayed on a display screen of a display device (display device) such as a mobile phone, and an arbitrary material such as a book or paper. Any color photographic image (including a color image) is conceptually included.

Here, with reference to FIG. 1 and the like, an apparatus configuration example will be described in which a color image (color code image) drawn on paper or the like is captured and input by a camera.
FIG. 1 shows a state in which a target picture, image or the like (hereinafter referred to as “picture”) is captured using a camera (mobile camera) installed in a camera-equipped mobile phone. FIG. 2 is a block diagram showing a schematic configuration relating to a camera built in a mobile phone and its peripheral portion.

The picture 11 is arbitrary including a plurality of colors (colors), and may be, for example, a picture of a picture book, a cartoon picture, or a picture such as a picture displayed at a store. An example of picture 11 is shown in FIG.
Shown in This picture 11 is, for example, a color photographic image 30 showing an image of Momotaro's demon extermination. In the color photographic image 30, 30a depicts Momotaro, 30b depicts a demon, and 30c depicts a dog. By capturing the picture 11 with the camera 13 of the mobile phone 12 with camera, an image (video) obtained by the imaging is displayed on the screen 15 of the display unit 14 provided in the mobile phone 12 and also related to the image. Data is stored in the RAM 17 of the memory 16.

In FIG. 1, an area A indicated by a broken line is the entire area that can be photographed by the camera 13 of the mobile phone 12. Accordingly, the area A is displayed as a whole on the image displayed on the screen 15 of the mobile phone 13, and the image of the picture 11 is shown as a part of the image on the screen 15.

The display unit 14 is a color LCD or the like, and an image captured in a two-dimensional array of pixels (pixels) forming the screen 15 of the display unit 14 is displayed. The image displayed on the screen 15 of the display unit 14 is defined by a frame area (31 shown in FIG. 4) set on the screen 15, and is displayed on the screen 15 based on the frame area 31 as a frame. Position information about the displayed image is determined.

The data related to the captured image related to the picture 11 stored in the RAM 17 of the memory 16 stores the same content as the content displayed on the screen 15 of the display unit 14 as array data. Screen 15
The image at is expressed as a set of pixels. Display unit 1 in mobile phone 12
The number of pixels on the screen 15 of 4 is arbitrary.

FIG. 4 shows the frame region 31 defined for the image displayed on the screen 15 of the display unit 14. The frame region 31 relating to the captured image is, for example, a square or a rectangle. According to the illustrated example of FIG. 3, the frame region 31 of the captured image is a square, and the square frame region 31 is, for example, 25 blocks (divided regions) of 5 × 5 (two-dimensional array or matrix structure). ) 31a is divided. The divided block 31a is 5 ×.
It is not necessary to be limited to 5, and is generally a plurality of divided regions of n × m (n and m are natural numbers other than 1). A frame region 31 for displaying a captured image on the screen 15 of the display unit 14 is divided into a relatively small number of blocks 31a. Multiple blocks 31a
Each includes the same number of pixel arrays. In each of the plurality of blocks 31a, the color of each of a large number of pixels is determined according to the color of the corresponding portion of the picture 11 taken.

In the mobile phone 12, an arithmetic processing unit 18 composed of a CPU or MPU, an input operation unit 19 including an input number button, an instruction button, and the like, a communication unit 20 for calling and data communication.
A ROM 21 that incorporates various application programs provided in the memory 16 is provided.
In ROM 21, a program related to a method for creating a two-dimensional code configuration (address color or two-dimensional color code) using an address color system based on a camera captured image, a program for recognizing the two-dimensional code configuration, and the like are mounted. is doing.

In the above embodiment, the image is captured by the camera built in the mobile phone, but the camera is not limited to the camera of the mobile phone. For example, it may be a general portable computer terminal such as a portable digital camera, a digital camera having a communication function, a fixed camera, or a smartphone.
In addition, when the encoding and decoding methods are employed in the above method, the third party can associate the relationship between the camera-captured image (C) and the object (O) unless the “address color code table” described later is stolen. And there is no problem of information leakage.
In the above description, it is assumed that the object is encoded in the mobile phone 12 or the like (the details of the encoding process will be described with reference to FIG. 12). Is not limited to mobile phones and the like, and as will be described later, various communication devices, etc. (wireless LAN, data communication, infrared communication, Bluetooth, etc.) that are already incorporated in mobile phones etc. , Send the image to an external computer without encryption, and execute the encoding / decoding processing of the information depending on the external computer. It is possible to adopt a system configuration or method of transmitting to the other side.

Next, an address color system based on a camera captured image and a method for creating a two-dimensional code configuration (two-dimensional color code) using the address color system will be described with reference to FIGS. In order to implement the creation method, as described above, the RO 16 in the memory 16 of the mobile phone 12
A program related to a method for creating a two-dimensional code configuration of a camera-captured image is installed in M21. FIG. 5 shows a flowchart relating to processing contents realized by the program.

A two-dimensional code configuration (two-dimensional color code) created using a camera captured image is created by the image included in the frame area 31 described above. The image is obtained by imaging the picture 11 to be photographed by the camera 13. Therefore, in the flowchart of FIG. 5, first, imaging by the camera 13 is performed (step S11). Thereby, a captured image is acquired (step S12). The image data related to the captured image is stored in the RA 16 of the memory 16.
It is stored in M17 (step S13).

The RAM 17 is an SD memory, for example, and includes a video RAM. RAM17 video R
The captured image stored in the AM is an image whose range is defined by the frame region 31 defined on the screen and the range displayed on the screen 15 in the display unit 14. Corresponding to the image drawn in the range of the frame region 31 on the screen 15, each color pixel (color dot, hereinafter referred to as “pixel (or pixel)”) that forms a display image in the RAM 17 corresponding to the range of the frame region 31. Color data (RGB data) for determining the color of each pixel is written at a memory position (address) corresponding to the position of “

A two-dimensional code configuration based on the picture 11 is created in the following procedure using the image data related to the captured image stored in the RAM 17, that is, the image data corresponding to the image in the frame region 31.

The frame region 31 can define the position based on the position of each pixel. Position information relating to the frame region 31 is acquired (step S14). The position information includes, for example, the origin position (x0, y0) and the lengths of the vertical and horizontal sides. Next, the frame area 31 is divided by a 5 × 5 matrix based on the acquired position information, and position information relating to the 25 divided areas 31a is acquired (step S15). Based on the color data of each of the plurality of pixels included in each of the 25 divided areas 31a, the representative color of each divided area 31a is determined based on a predetermined standard (step S16). Based on each block 31a, a two-dimensional code configuration (address color or two-dimensional color code) corresponding to the captured image included in the frame region 31 divided into 5 × 5 is created (step S17), which will be described later in the RAM 17 It is saved as a part of the image file (step S18).

FIG. 6 shows an example of a two-dimensional code configuration based on a square frame 32 shown corresponding to the frame region 31. A frame 32 shows the two-dimensional code structure as a graphic conceptual structure. The square frame 32 is divided into 5 × 5 blocks (divided regions) 32a. For convenience, the divided blocks 32a include, for example, “W (white)” and “B (Blue)”. "," G (Green
: Green) "or" R (Red: red) "are written, and a two-dimensional code configuration is created based on the color (color) expressed by these letters. As a real thing, each block 32a of the frame 32 is drawn with a color corresponding to the written character. In addition, “D (Dark: black)” may be included as another color. According to such a two-dimensional code configuration (contents of the frame 32), when stored in the RAM 17 and displayed on the screen 15 of the display unit 14, four designated representative colors (including W (white)) are displayed. For example, four kinds of colors (W, B, G, R) as shown in FIG. 6 are represented and displayed. This design itself is configured to include the concept of “address color”, and “two-dimensional color configuration”, that is, “
2D color code "is formed.

The method of determining each of the 25 blocks 31a of the frame region 31 shown in FIG. 4 (corresponding to the block 32a of the frame 32 in FIG. 6) is preferably, for example, by changing the colors of a plurality of pixels included in each block 31a. Performs 5 colors for red, green, blue, white and black, and blocks 3
The color having the highest appearance frequency among the colors of the plurality of pixels included in 1a is selected in the block 31.
The representative color of a is assumed.
The above five-color processing of red, green, blue, white and black is the HSI space diagram (see FIGS. 10 and 11).
As shown in FIG. 4, the color whose brightness (0 ≦ I ≦ 200) is close to I = 0 is black (D), and I = 2
A color close to 00 is white (W). The hue (0 ≦ H ≦ 360) is 60 ≦ H ≦ 180.
And the color of 180 ≦ H ≦ 300 is blue (B), 0 ≦ H ≦ 60,
The color of 300 ≦ H ≦ 360 is red (R).
In addition, for example, a color ratio can be obtained for the colors of a plurality of pixels included in each block 31a, and a color determined based on the ratio can be used as the representative color of the block 31a.
As the color ratio, the color (RGB) having the largest ratio is set as the representative color based on the RGB ratio of the RGB histogram accumulated value obtained from the RGB histogram distribution of the plurality of pixels in the block 31a.

As described above, four representative colors as shown in FIG. 6 ("W" of each block 32a,
2D code structure (frame 32) formed by arranging “B”, “G”, “R”) in a matrix
Is created (step S17). When the two-dimensional code configuration is displayed on the screen of the display unit 14 of the mobile phone 12 or printed by the printing means, it is displayed as a color pattern based on four colors.

However, the two-dimensional code configuration created in this way is that the picture 11 that is the same object is captured by the camera 13 of the mobile phone 12 at another time point, and the two-dimensional code structure is obtained in the same procedure based on the captured image. Even if the code configuration is created, the imaging conditions, illumination conditions, environmental conditions, and the like at that time may be different, so the same two-dimensional code configuration is not always created. That is, the completely same two-dimensional code configuration is not always created based on the same imaging object. In other words, the problem of reproducibility is included. The same applies to the case where a two-dimensional color configuration is created and acquired by taking an image with another mobile phone or the like.

Therefore, in order to improve the reproducibility, a mechanism for determining an effective representative color having a good influence on reproducibility and an invalid representative color having a bad influence on reproducibility is provided.
FIG. 7 shows an example in which another frame 33 corresponding to the frame 32 related to the two-dimensional code configuration shown in FIG. 6 is set. Further, the frame 33 is divided by 5 × 5 to form a divided region 33a. Each block of the two-dimensional code structure (frame 32) corresponding to each of the 25 divided areas 33a is assigned with flags of "1 (valid)" and "0 (invalid)" to each of the 25 divided areas 33a. Valid or invalid for the representative color of 32a is determined.
That is, a representative color assigned “1” is treated as an effective reproducible color (effective representative color) contributing to reproducibility, and a representative color assigned “0” is an invalid indefinite color that does not contribute to reproducibility. It is treated as (invalid representative color). Therefore, 2 shown by the frame 32
In the dimension code configuration, reproducibility is evaluated based on effective representative colors related to, for example, seven blocks 32 a indicated by “1” in the frame 33.

In the above, in the frame 32 expressing the two-dimensional code configuration (two-dimensional color code) using the address color, the validity or invalidity of each of the 25 blocks 32a is determined by, for example, a recognition rate test (reproduction test) or the like. To be determined. The recognition rate test is performed in advance using, for example, one or a plurality of the same pictures in advance and using the same mobile phone camera with different lighting environments (bright environment, dark environment, etc.). Create a two-dimensional color code by imaging the required multiple times, or create a two-dimensional code configuration by taking an image using the camera of a different mobile phone under the same conditions described above, and determine the consistency or inconsistency Thus, an effective representative color and an invalid representative color can be determined. A two-dimensional color code 32 composed of a plurality of valid representative colors and a plurality of invalid representative colors thus determined is finally registered. In this embodiment, this registration is stored in the RAM 17 of the memory 16 of the mobile phone 12 for convenience. The finally determined two-dimensional code configuration can be transmitted to a server or the like via the communication unit 20, and can be registered and stored in the server or the like.

As another method for determining the validity or invalidity of each of the 25 blocks 32a in the frame 32 related to the two-dimensional code configuration, the data (RGB components) between the R, G, and B in the data (RGB component) related to the captured image. Since the boundary color (boundary color) varies in recognition rate, it is not used as a color but is treated as an invalid representative color.

An example of the information content of the image file 34 stored in the RAM 17 is shown in FIG. In the image file 34, “5, 5” 34a in the first line is divided into “5 × 5” 2 shown in FIG.
The division structure of the frame 32 which concerns on a dimension code structure is shown. The size of the division is determined by each block 32.
It is determined in consideration of the number of pixels a. The array 34b composed of “1” and “0” in the second row is a row of flags specifying the above-mentioned validity and invalidity. “B”, “W”, “G” and “R” in the third row
The array 34c is an array of representative colors of the 25 blocks 32a of the frame 32 according to the two-dimensional code configuration. Note that the structure of the information file related to the image file 34 is not limited to the structure shown in FIG. 8, and may be configured with an arbitrary matrix structure.

According to the description of the above embodiment, based on a program relating to a method for creating a two-dimensional code configuration (two-dimensional color code) implemented in the ROM 21 of the memory 16 of the mobile phone 12, an arbitrary image captured by the camera 13 can be obtained. Although the creation method of the two-dimensional code structure based on the picture 11 and the creation method of the image file 34 based on this have been described, the two-dimensional code structure and the image file 34 are separately created using, for example, a dedicated camera. You can also.

In the next stage, for example, a color code table file is created according to a separate rule using the frame 32 related to the two-dimensional code configuration as described above and the image file 34 including the two-dimensional code configuration. It is possible to transmit / receive information that is appropriately determined or required by using the frame 32 or the like related to the code configuration through communication means such as the Internet.

The color code table file is composed of a multi-line file, for example. Each row forming the color code table file is composed of six elements “file number, color, column number, row number, content identifier, object” from the left end to the right end. The “file number” is assigned in advance. “Color” is any one of the above five colors, for example. “Content identifier” is “1” or “2”. For example, “1” is a character string, and “2” is an audio file name. The “object” is content included in target information, and is content that specifies specific character string content or an audio file. An example of the color code table file is shown in FIG. According to the color code table file 35 shown in FIG. 9, character string information or the like is assigned to each of the effective representative colors of the 25 blocks 32a forming the two-dimensional code structure.

As described above, n × m (n and m are other than 1) obtained by dividing the two-dimensional specific region (frame region 31) of the color photographic image obtained by capturing the picture 11 with the camera 13 of the mobile phone 12. The color code is separately applied to the frame 32 relating to the two-dimensional color structure (address color) obtained by determining the representative color (block 32a) based on the above-mentioned predetermined standard in each of the natural number blocks (31a). Table file 35 is formed and assigned, and color code table file 35
An object (consisting of a message, a text file, a sound file, an image file, etc.) is incorporated in the image 11, and the message, sound, image, etc. are transmitted from the picture 11.

The plurality of invalid representative colors included in the two-dimensional code configuration is not a color that contributes to recognition of the two-dimensional code configuration, but information such as other codes is assigned to each of the plurality of invalid representative colors. Can be used.

Further, the color code table file 35 can handle, for example, a color pattern itself defined by a two-dimensional code configuration, that is, an arrangement pattern of a plurality of effective representative colors expressed by address colors, as a color code table file.

Next, with reference to FIG. 12 and FIG. 13, the flow of the encoding process using the said address color and the flow of a decoding process are demonstrated.

The encoding process shown in FIG. 12 creates color photographic image data by picking up an arbitrarily selected picture with the camera 13 of the mobile phone 12 and relates to various information handled by the computer using the color photographic image. This is a process of encoding (encrypting) the object. The arbitrarily selected picture is generally a color print image, for example, the picture 11 described above.
The content of the encoding process shown in FIG. 12 is substantially the same as the creation method of the two-dimensional code configuration (two-dimensional color code) using the address color system described based on the flowchart of FIG. This two-dimensional code configuration is re-recognized from the viewpoint of “encoding (encryption)”.

In FIG. 12, in the first step S <b> 21, the picture 11 is picked up by the camera 13 (mobile camera) of the mobile phone 12. In the color photographic image obtained by this imaging, block division processing is performed, the representative color of each block (block 31a) is determined, and address colorization is executed (step S22). That is, in step S22, an address color system unique to the color photographic image is created based on the color photographic image (corresponding to the picture 11) acquired by the camera 13. Next, an object to be encoded is assigned to the representative color (address color) of each block (31a) using the created address color (step S23). Thereby, the encoding using the “address color” of the portable version according to the present invention is performed. As described with reference to FIG. 7, the address color assigned to the object has valid or invalid, and therefore the valid / invalid flag is assigned in the next step S <b> 24. Based on the above, an address color code table (CO table) is created (step S25), and the address color code table is recorded and stored in a recording medium (step S26). The “address color code table (CO table)” is a table showing the correspondence between the address color (C) and the object (O). Specific examples of the “address color code table (CO table)” will be described later as Examples 1 to 7. Thus, encoding (encryption) using an address color for an arbitrary object is performed.

The decoding process shown in FIG. 13 is basically a content that, for example, in another mobile phone having a function equivalent to that of the mobile phone 12, the object subjected to the above-described encoding process is extracted by performing the reverse process. It is. For this purpose, it is a condition that the address color code table (CO table) created in step S25 is acquired by another route. The result obtained by encoding the object is the two-dimensional code configuration (two-dimensional color code) shown in FIG. 6 or a color print image as an original image including the two-dimensional code configuration, ie, picture 1
1. In the flow of the decoding process shown in FIG. 13, as an example, the decoding process is performed based on a color print image. In the first step S31, a color print image (picture 11 or the like) is picked up by another portable camera, and then an address color is obtained by performing block division (step S32). Next, the acquired address color is decoded into an object using the above-described address color code table (CO table) acquired by another route (step S33). Finally, the decrypted object is output by the corresponding output means (step S34).
The contents of the object are a message (text, text, etc.), sound, image, etc., as will be described later. Thus, the decoding process using the address color is completed. If the two-dimensional color configuration (two-dimensional color code) can be directly acquired as data, the above steps S31 and S32 are omitted. Further, when a two-dimensional color configuration (two-dimensional color code) is provided as a printed matter or the like, it is necessary to capture an image with a portable camera.

Next, the contents of the object to which the address color system of the portable version according to the present invention is applied,
The contents of an object assigned to a two-dimensional code configuration (two-dimensional color code) using an address color for a portable version (two-dimensional color code) and an application example will be described with examples.
In the above-described embodiment, the two-dimensional code configuration (two-dimensional color code) of the 5 × 5 matrix has been described. However, in the following description, in principle, the number of block divisions of the frame region 31 described above is small ( An example of a large scale (3 × 3 matrix) to a large scale (8 × 8 matrix) will be described.

FIG. 14 shows an example (Example 1) when the object is a message (sentence).
A message (sentence or character string) is included in a color photographic image and sent. In FIG. 14, reference numeral 101 denotes a two-dimensional code configuration (two-dimensional color code) created by dividing a color photographic image into blocks. That is, it is a two-dimensional code configuration 101 in which a picture 11 or the like is captured by a portable camera and a color photographic image obtained thereby is divided into blocks by, for example, a 3 × 3 matrix. The two-dimensional code configuration 101 has nine blocks 101a, and R1 to R3, B1 to B4, G1, and G2 are assigned to the nine blocks 101a as address colors. Each of these nine address colors is associated with the message as written in FIG. 14 by separately preparing the address color code table (CO table) 102 as shown in FIG. ing. The entire message is "Hello how are you? See you. The good-bye.". The last address color B4 is not associated with any message and is in a space state.
As described above, by assigning an object (message) to each of the eight address colors among the nine address colors defined in the two-dimensional code structure 101, that is, by creating the address color code table 102, “encoding” is performed. Is done. On the contrary, by extracting the above message from the color photographic image using the address color code table 102, “
Decryption "is performed.

FIG. 16 shows an example (Example 2) when the object is a message with voice.
The two-dimensional code configuration (two-dimensional color code) 101 and the nine blocks 101a are basically the same as those in the first embodiment. The difference is that, as shown in FIG. 16, in the two-dimensional code structure 101, the address color B4 is not a space, and “sound file n” is assigned to the address color B4. Therefore, in the address color code table (CO table) 103 shown in FIG. 17, “sound file n” is associated with the address color B4. The meaning of “n” in “audio file n” means that an arbitrary audio file is selected and designated from N audio files (n = 1 to N).
By assigning an object (message and voice) to each of the nine address colors defined in the two-dimensional code structure 101 as described above, that is, the address color code table 10
By creating 3, “encoding” is performed. On the contrary, “decoding” is performed by extracting the above message and voice from the color photographic image using the address color code table 103.

FIG. 18 illustrates an example in which the object is a message with an image and a sound (Example 3).
Indicates.
The two-dimensional code configuration (two-dimensional color code) 101 and the nine blocks 101a are basically the same as those in the first embodiment. As shown in FIG. 18, in the two-dimensional code configuration 101, the differences are as follows. For each of the assigned address colors R1 to R3, B1 to B4, G1 and G2, with respect to the association of the objects to the nine blocks 101a. Objects as shown in the address color code table (CO table) 104 in FIG.
3, audio files 1 to 3 and MSG files 1 to 3) are associated with each other. The contents of the image files 1 to 3, the audio files 1 to 3, and the MSG files 1 to 3 are specified in the remarks column of the address color code table (CO table) 104.
As described above, by assigning objects (image, sound, and message) to each of the nine address colors defined in the two-dimensional code structure 101, that is, by creating the address color code table 104, "encoding" is performed. Is called. On the other hand, “decoding” is performed by extracting the image, sound and message from the color photographic image using the address color code table 104.

FIG. 20 shows another example (Example 4) of the address color code table (CO table).
This address color code table (CO table) 105 assumes a two-dimensional code configuration in which the obtained color photographic image is divided into blocks by a 5 × 5 matrix, and the above 2 described with reference to FIGS.
This corresponds to the dimension code configuration (frame 32).
In the address color code table (CO table) 105 shown in FIG. 20, in addition to the “address color” and “object” fields, a “flag” field is provided. The address color is B1-B
5, W1 to W10, G1 to G5, and R1 to R5, each having a valid flag (1) or an invalid flag (0). A character string (text) and an audio file (mom2, mld) are assigned to the address color for which the valid flag (1) is set.
According to the above, by assigning objects (character strings and voices) to the 25 address colors defined in the two-dimensional code structure (frame 32) appropriately using the valid flag and the invalid flag, that is, the address color code table ( By creating the (CO table) 105, “encoding” is performed. On the contrary, “decoding” is performed by extracting the character string and the sound from the color photographic image using the address color code table (CO table) 105.

21 to 25 show another example (Example 5) of the address color code table (CO table).
The fifth embodiment assumes a two-dimensional code configuration in which the obtained color photographic image is divided into blocks by an 8 × 8 matrix, and a one-dimensional array structure (FIG. 21) obtained from the two-dimensional code configuration ( Based on the address color (Cn) 201 having R, G, and B in this example, an address color code table (CO table) 202 as shown in FIG. 22 is created.

In the process of performing address colorization, address colorization is performed on an RGB one-dimensional array created from a two-dimensional code configuration (two-dimensional color code). “Address colorization” means RGB1
With regard to the dimension array, it means that a serial number (address) is assigned to each element separately for each of the R set, the G set, and the B set. That is, an “address color” is formed by assigning an address to each block of the RGB one-dimensional array obtained from the 8 × 8 two-dimensional code configuration. Numbering using the position number etc. for the same color at the address numbering (
(Numbering or numbering) is performed.

In the case of the one-dimensional array of the address colors shown in FIG. 21, 13 “R” s for the R set.
R1 to R13 are assigned to elements, G1 to G13 are assigned to 13 “G” elements for the G set, and B1 to B2 are assigned to 21 “B” sets for the B set.
Numbers up to 1. Each address color (Cn) using the generated one-dimensional array of address colors
The “address color list” is created by assigning a color numerical value (N) to.

No corresponding color value is assigned to each address color (Cn) in the one-dimensional array of address colors shown in FIG. Next, the address color is encoded using the address color one-dimensional array generated in this way.

This address color coding is based on the address color one-dimensional array 201 shown in FIG.
This means that an object is assigned to each of the 47 address colors to create an ONC correspondence table. FIG. 22 shows a Cn-O correspondence table (C
nO table) example 202 is shown. An object is an example of all strings. The object is
A long sentence (computer object) having a specific message is divided and created. The number of divisions and how to divide the long sentence are arbitrary. In the fifth embodiment, each of the 47 address colors (R1 to R13, G1 to G13, B1 to B21) is divided so that an object (character string) is assigned thereto. Each address color (Cn) and object (O
) Is as shown in the list or chart shown in FIG.
An O table (substantially a CO table) is created.

FIG. 23 shows an address color code table 203 generated by organizing based on color numerical values (1 to 36). FIG. 23 is a table in which object numbers (O) in the table of FIG. 22 are sorted by characters, words, phrases, and assigned a sequential color value (N). According to the address color code table, the correspondence between the color numerical value (N), the object (O), and the address color (Cn) is shown. In the address color (Cn) column, a plurality of address colors (Cn) are associated with the same object (for example, “,”, “no”, etc.). The association between the color numerical value (N) and the object (O) / address color (Cn) can be arbitrarily determined.

FIG. 24 shows an N-O correspondence portion extracted from the correspondence table shown in FIG. 23 and shows it as an object list (encoding) 204. The object list of FIG. 24 is created by the object list generation process.

FIG. 25 shows an address color list 205 showing the correspondence between the address color (Cn) and the color numerical value (N). After extracting the Cn-N corresponding part from the correspondence table shown in FIG.
It is the table sorted by the alphanumeric of the address color (Cn). The address color list is created by an address color list generation process. The ONC correspondence table (object list and address color list) is created as described above.

In the creation of the address color code table (CO table) in Example 5, R is obtained using a color photographic image.
GB three-color color reduction is performed to create an RGB one-dimensional array, and address color coding is performed using the RGB one-dimensional array related to the address color.

Next, FIG. 26 illustrates an example in which the object is a message with an image ID (Example 6).
Indicates.
The two-dimensional code configuration (two-dimensional color code) 101 and the nine blocks 101a are basically the same as those in the first embodiment. The difference is that, as shown in FIG. 26, in the two-dimensional code configuration 101, the correspondence of objects to nine blocks 101a is as follows.
For each of the assigned address colors R1-R3, B1-B4, G1, G2, FIG.
The object (message and image ID) as shown in the address color code table (CO table) 301 is associated. "Image ID" for address color B4 that was a space
Are associated. Here, the “image ID” is ID information (name information) for specifying an image separately stored in a place.
As described above, “encoding” is performed by assigning objects (messages and image IDs) to each of the nine address colors defined in the two-dimensional code structure 101, that is, by creating the address color code table 301. . On the contrary, “decoding” is performed by extracting the message and the image ID from the color photographic image using the address color code table 301. The contents of the image itself are accessed and acquired using the extracted image ID.

FIG. 28 shows an example (Example 7) when the object is a message with an image ID and an image attribute.
The two-dimensional code configuration (two-dimensional color code) 101 and the nine blocks 101a are basically the same as those in the first embodiment. The difference is that, as shown in FIG. 28, in the two-dimensional code configuration 101, the correspondence of objects to nine blocks 101a is as follows.
For each of the assigned address colors R1-R3, B1-B4, G1, G2, FIG.
The objects (message, image ID, and image attribute) shown in the address color code table (CO table) 302 are associated with each other. Specifically, the object associated with the address color R3 is a message “Now”, the object associated with the address color B3 is information “image attribute”, and the object associated with the address color B4 is The above “image ID”.
FIG. 30 shows an example of the data structure of the address color code table according to the seventh embodiment. In the table shown in FIG. 30, an “image ID / attribute” column, an “address color list” column, and a “function file (function file)” column are provided. In the “Image ID / Attribute” column, “Image I
“D” and “image attributes” such as array, image name, purpose / use, creator, creation date, creation location, etc. are set. In the “address color list” column, the contents of the address colors are stored in a list. In the “function file (function file)” column, an image file, an audio file, an execution file (program file), and the like are stored.
As described above, by assigning objects (message, image ID, and image attribute) to each of the nine address colors defined in the two-dimensional code structure 101, that is, by creating the address color code table 302, "encoding" Is done. On the contrary, “decoding” is performed by extracting the message, the image ID, and the image attribute from the color photographic image using the address color code table 302. The contents of the image itself are accessed and acquired using the extracted image ID. Further, according to the image attribute, related information relating to the image content can be acquired using the address color code table having the data structure shown in FIG.

In the two-dimensional code configuration (two-dimensional color code) according to the first to sixth embodiments described above, as illustrated in FIGS. 1 and 2, when the picture 11 is captured by the camera 13 of the mobile phone 12, basically one 1 for a color photographic image, ie one 2D code configuration (2D color code)
The information is associated with one pattern. However, one two-dimensional code configuration (2
It is also possible to form information association (multiple layer structure) of a plurality of patterns for a (dimensional color code). That is, it can be configured to have a two-dimensional code configuration (two-dimensional color code) having a plurality of layer structures. In this case, as described in the seventh embodiment, each of the plurality of layers is distinguished by using the aforementioned “image ID” and assigning different image IDs.
The contents of the object that can be associated with the two-dimensional code configuration (two-dimensional color code) include an executable file (program / program) in addition to the message, audio file, image file, and the like described in the first to seventh embodiments. Function files) can also be included.
When the encoding and decoding methods are adopted in the methods according to the above-described embodiments, it can be used for recognition of a specific range of a color photographic image obtained by a camera such as a mobile phone or application of recognition processing for the entire image. It is.
Furthermore, in the above, a color photographic image captured by a mobile terminal is divided into a plurality of blocks in a two-dimensional matrix, and thereby an object corresponding to each block (address) can be acquired from the color code table. . Therefore, in the color code table, each object has a one-to-one relationship with each block. However, it is not necessarily one-to-one, and many-to-one is possible. For example, a 5 × 5 matrix may be associated as one object (25: 1) with 25 divided color addresses. Such a modification is shown in FIG.
2 and FIG. In FIG. 32, the region of the two-dimensional code configuration (two-dimensional color code) 101 is divided into 25 blocks of 5 × 5. In FIG. 33, “25 color addresses” are shown on the left side, and “1 object (message)” is shown on the right side.

In each of the above embodiments, the object is configured to be encoded in the arithmetic processing 18 inside the mobile phone 12. The flow of the encoding process in the mobile phone 12 has already been described with reference to FIG. 12, and the flow of the decoding process in another similar mobile phone has been described with reference to FIG. However, as described above, the encoding process or the decoding process is not limited to the mobile phone 12 or the like. An image captured by the camera 13 such as the mobile phone 12 is used for various communication devices already incorporated in the mobile phone 12 or the like (wireless LAN, data communication, infrared communication,
Bluetooth, etc.), the image is temporarily transmitted to an external computer terminal without being encrypted, and the information is encoded or decrypted by the external computer terminal.
Only necessary information may be transmitted to the mobile phone 12 or the like. FIG.
The system configuration will be described with reference to the flowchart of FIG. FIG. 31 shows an example of a decoding process for extracting a message from a captured color photographic image.

In FIG. 31, the flow of this flowchart is the flow of processing on the mobile phone side (A),
It is divided into a processing flow (B) on the side of an external computer terminal (PC or the like).
In the processing on the mobile phone side, a target color print image (picture 11 or the like) is first captured by the camera of another mobile phone (step S41). The image obtained by imaging is transmitted to an external computer terminal by the communication means of the mobile phone (step S42). Thereafter, the mobile phone enters a standby state.
On the computer terminal side, the captured image transmitted from the mobile phone is received (step S51). Thereafter, an image recognition process is performed on the received captured image and the captured image is determined (step S52). In other words, the address color is obtained by performing block division on the captured image. Next, a message search is performed (step S53). In the message search, the obtained address color code table (CO table) obtained by another route is used to decode the obtained address color into an object, that is, a message. As a matter of course, for the decoding process in the combination configuration of the mobile phone and the computer terminal,
On the computer terminal side, the condition is that the address color code table (CO table) created in advance on the message transmission side is acquired by another route. The message acquired by executing the decryption process in this manner is transmitted from the external computer terminal side to the mobile phone side by the communication means (step S54).
The mobile phone in the standby state receives the message transmitted from the computer terminal (step S43). After that, the received message is output / output by the corresponding output means.
Playback is performed (step S44). Thereafter, the process returns to step S41, and the above-described decoding process is repeated as necessary.

The example of the process in FIG. 31 is an example of a decoding process for extracting a message from a color photographic image captured by a mobile phone. However, encoding is performed based on the configuration of a similar combination system of a mobile phone and an external computer terminal. Of course, the process steps can be realized.

The configurations, shapes, sizes, and arrangement relationships described in the above embodiments are merely schematically shown to the extent that the present invention can be understood and implemented. Therefore, the present invention is not limited to the described embodiments, and can be variously modified without departing from the scope of the technical idea shown in the claims.

An address color system, a coding method, and a decoding method using a color photographic image according to the present invention encrypt document information and the like using a color photographic image having a small number of colors in a portable computer terminal such as a cellular phone. And is used for transmission over the Internet or the like.

DESCRIPTION OF SYMBOLS 11 Picture 12 Mobile phone 13 Camera 14 Display part 15 Screen 16 Memory 17 RAM
18 Arithmetic Processing Unit 19 Input Operation Unit 20 Communication Unit 30 Color Photo Image 31 Frame Area 31a Block (Division Area)
32 frames (two-dimensional code structure, two-dimensional color code)
32a block (representative color)
33 Frame 34 Image file 35 Color code table file 101 2D code configuration (address color, 2D color code)
101a Block 102 Address color code table (CO table)
Address 103 color code table (CO table)
104 address color code table (CO table)
105 address color code table (CO table)
202 address color code table (CO table)
Address 203 color code table (CO table)
Address 301 color code table (CO table)
302 address color code table (CO table)

Claims (25)

An address color system applied to a portable computer terminal equipped with a camera and a display unit,
Arbitrary color photographic images on the portable computer terminal, which are handled in the color code table and handled as computer objects, form the display screen of the display unit 2
An address color system that forms a part or all of a plurality of blocks in a dimensional array area,
A number (n) given based on block position information for each of the plurality of blocks
) And the color (C) represented by the corresponding block, an address color (Cn) is created. In the portable computer terminal, an address color system that is formed by taking out a part or all of a plurality of blocks of a two-dimensional array forming a display screen for displaying an arbitrary color photographic image captured by the camera,
A number (n) given based on block position information for each of the plurality of blocks
) And a color (C) expressed by the corresponding block, an address color (Cn) is created. In the portable computer terminal, an address color system that is formed by taking out a part or all of a plurality of blocks of a two-dimensional array forming a display screen for displaying an arbitrary color photographic image captured by the camera,
For each of the plurality of blocks, in the plurality of blocks expressed in the same color, a number (n) given to the color (C) expressed by the block based on the position information of the corresponding block ) To create an address color (Cn). 4. The address color system according to claim 1, wherein the number of the colors (C) is four colors including three representative colors and one other color. 5. The address color system according to claim 4, wherein the representative three colors are R (red), G (green), and B (blue). 5. The address color system according to claim 4, wherein the representative three colors are C (cyan), M (magenta), and Y (yellow). Selecting a two-dimensional specific region of an image captured by a camera provided in a portable computer terminal;
Dividing the two-dimensional specific region into a plurality of blocks of n × m (n and m are natural numbers other than 1);
determining a representative color for each of the plurality of blocks divided into n × m;
A code related to an address color in the two-dimensional specific region is determined based on the plurality of representative colors determined for each of the n × m blocks and the address information based on the position information of the corresponding block. And steps to
An address color creation method based on a camera-captured image. 8. The address color creation method based on a camera-captured image according to claim 7, wherein a color related to a color pixel that exists in each of the plurality of n × m blocks is determined as the representative color of each block. . In the step of determining the representative color, a ratio of colors related to a plurality of color pixels existing in each of the n × m blocks is obtained, and a color determined based on the ratio is used as the representative color of each block. 8. The address color creation method based on a camera-captured image according to claim 7, wherein the address color creation method is determined. The step of determining the representative color includes an effective representative color that contributes to recognition of the image by a recognition rate test for the plurality of representative colors determined for the n × m blocks, and recognition of the image. Including the step of determining an invalid representative color (indefinite color) that does not contribute to
8. The address color creation method based on a camera-captured image according to claim 7, wherein a code related to the address color of the two-dimensional specific region is determined based on the effective representative color. 11. The address color creation method based on a camera-captured image according to claim 10, wherein the invalid representative color (undefined color) uses code information other than the code related to the address color. From a color photographic image obtained by imaging with a camera of a portable computer terminal, each block number (n) and a plurality of blocks forming a two-dimensional array defined on a display screen for displaying the color photographic image Creating an address color based on the color (C) of
Each of the plurality of address colors (Cn) listed in the address color and the object (O)
Creating an address color code correspondence table (CnO table, CO table) for associating
An encoding method using a color photographic image comprising: From a color photographic image obtained by imaging with a camera of a portable computer terminal, each block number (n) and a plurality of blocks forming a two-dimensional array defined on a display screen for displaying the color photographic image Creating a one-dimensional array of address colors based on the color (C) of
Creating an ONCn correspondence table that associates each of the plurality of address colors (Cn) listed in the address color one-dimensional array, the object (O) described in the text, and the color numerical value (N);
Encoding by creating an address color list (NCn) and an object list (NO) using the ONCn correspondence table;
An encoding method using a color photographic image comprising: In the step of creating the address color code correspondence table (CnO table, CO table), one or several specific address colors among the plurality of address colors (Cn) and specific to the color photographic image 13. The encoding method using color photographic images according to claim 12, wherein the image identification numbers are associated with each other. In the step of creating the address color code correspondence table (CnO table, CO table), one or several specific address colors among the plurality of address colors (Cn) and specific to the color photographic image The image identification number and the image attribute are associated with each other.
2. An encoding method using the color photographic image described in 2. In the step of creating the ONCn correspondence table, one or several specific address colors among the plurality of address colors (Cn) listed in the address color one-dimensional array, and the color photographic image 14. The encoding method using color photographic images according to claim 13, wherein a unique image identification number is associated with the color numerical value. In the step of creating the ONCn correspondence table, one or several specific address colors among the plurality of address colors (Cn) listed in the address color one-dimensional array, and the color photographic image 14. The encoding method using a color photographic image according to claim 13, wherein a unique image identification number and image attribute are associated with the color numerical value. The encoding method using a color photographic image according to any one of claims 12 to 17, wherein the object assigned to the address color is a text element including a word and a idiom. The object assigned to the address color is a function file including a message file, an audio file, an image file, and an execution file.
18. An encoding method using the color photographic image according to any one of 17 above. A method for decoding a color photographic image encoded by the encoding method according to any one of claims 12 to 19, comprising:
The color photographic image is converted into an address color code table (CnO table, C
A decoding method using a color photographic image, characterized by performing inverse conversion from an address color (Cn) to an object (O) using the O table). A method for decoding a color photographic image encoded by the encoding method according to any one of claims 12 to 19, comprising:
The color photographic image is divided into an address color list (NCn) and an object list (NO
), And reverse decoding in the order of address color (Cn), color numerical value (N), and object (O) for decoding. An encoding system for executing the encoding method according to any one of claims 12 to 19,
It is composed of one portable computer terminal,
Coding characterized in that the processing step of performing coding based on the color photographic image obtained by imaging with the camera of the portable computer terminal is executed by arithmetic processing means provided in the portable computer terminal. system. An encoding system for executing the encoding method according to any one of claims 12 to 19,
One portable computer terminal and one external computer terminal connected to the portable computer terminal so as to communicate with each other,
The external computer terminal to which the color photographic image is transmitted from the portable computer terminal has a processing step of performing encoding based on the color photographic image obtained by imaging with the camera of the portable computer terminal. The encoding system is characterized in that it is executed by the arithmetic processing means, and thereafter the information obtained by the encoding is transmitted to the portable computer terminal. A decoding system for executing the decoding method according to any one of claims 20 and 21, comprising:
It consists of one portable computer terminal,
A decoding system characterized in that the processing step of performing decoding based on the color photographic image obtained by imaging with a camera of the portable computer terminal is executed by arithmetic processing means provided in the portable computer terminal. . A decoding system for executing the decoding method according to any one of claims 20 and 21, comprising:
One portable computer terminal and one external computer terminal connected to the portable computer terminal so as to communicate with each other,
A processing step of performing decoding based on the color photographic image obtained by imaging with the camera of the portable computer terminal is provided in the external computer terminal to which the color photographic image is transmitted from the portable computer terminal. A decoding system, characterized in that the decoding system is executed by an arithmetic processing means and thereafter transmits information obtained by the decoding to the portable computer terminal.

Images