WO2005112438A1 - 画像処理装置 - Google Patents
画像処理装置 Download PDFInfo
- Publication number
- WO2005112438A1 WO2005112438A1 PCT/JP2005/008866 JP2005008866W WO2005112438A1 WO 2005112438 A1 WO2005112438 A1 WO 2005112438A1 JP 2005008866 W JP2005008866 W JP 2005008866W WO 2005112438 A1 WO2005112438 A1 WO 2005112438A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- processing
- collation
- image processing
- information
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
- H04N1/00204—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00127—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
- H04N1/00204—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
- H04N1/00244—Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server with a server, e.g. an internet server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00838—Preventing unauthorised reproduction
- H04N1/00856—Preventive measures
- H04N1/00864—Modifying the reproduction, e.g. outputting a modified copy of a scanned original
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00838—Preventing unauthorised reproduction
- H04N1/00856—Preventive measures
- H04N1/00864—Modifying the reproduction, e.g. outputting a modified copy of a scanned original
- H04N1/00867—Modifying the reproduction, e.g. outputting a modified copy of a scanned original with additional data, e.g. by adding a warning message
- H04N1/0087—Modifying the reproduction, e.g. outputting a modified copy of a scanned original with additional data, e.g. by adding a warning message with hidden additional data, e.g. data invisible to the human eye
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/00962—Input arrangements for operating instructions or parameters, e.g. updating internal software
- H04N1/00973—Input arrangements for operating instructions or parameters, e.g. updating internal software from a remote device, e.g. receiving via the internet instructions input to a computer terminal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
- H04N1/3876—Recombination of partial images to recreate the original image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/44—Secrecy systems
- H04N1/4406—Restricting access, e.g. according to user identity
- H04N1/444—Restricting access, e.g. according to user identity to a particular document or image or part thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/44—Secrecy systems
- H04N1/448—Rendering the image unintelligible, e.g. scrambling
- H04N1/4486—Rendering the image unintelligible, e.g. scrambling using digital data encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2101/00—Still video cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/0077—Types of the still picture apparatus
- H04N2201/0084—Digital still camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
- H04N2201/3242—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of processing required or performed, e.g. for reproduction or before recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
- H04N2201/325—Modified version of the image, e.g. part of the image, image reduced in size or resolution, thumbnail or screennail
Definitions
- Patent Document 3 it is possible to easily and effectively apply predetermined information for copyright protection or the like of the target information to the target information without deteriorating the target information such as electronic permeability processing.
- An information processing device that can be embedded is disclosed.
- the recording means when recording predetermined information for protecting the copyright of the target information with respect to the target information (captured image) generated based on the shooting operation of the user, uses a user (photographer) at the time of shooting. If the biometric information of the user is registered in advance and the relevant user information associated with the biometric information at the time of the registration is acquired, the corresponding user information is recorded as the predetermined information in the target information.
- Patent Document 2 Japanese Patent Application Laid-Open No. 2002-182275
- Patent Document 3 JP 2003-204427 A
- the present invention provides an image processing apparatus, a server apparatus, an image capturing apparatus, and an image processing system capable of facilitating the handling of captured image data. It is an object to provide an image processing method and an image processing program.
- the image processing apparatus further includes a photographing unit that photographs the subject to generate the photographed image, and writes the generated photographed image to the first image storage unit.
- the image processing device is connected to a photographing device via a network, and the photographing device generates a photographed image by photographing a subject, and transmits the generated photographed image to a network.
- a receiving unit that receives the captured image from the imaging device via a network via the network.
- Writing means for writing the received photographed image into the first image storage means For writing the received photographed image into the first image storage means.
- the image processing device receives the captured image from the imaging device via the network and writes the received image in the first image storage unit, so that the image processing device is far away from the image processing device.
- Image processing can also be performed on a photographed image generated by the photographing device provided at the point where the collation image is included in the photographed image.
- the image processing device is connected to a server device via a network, and the server device stores the processing command and the collation image in advance, and responds to a request from the image processing device.
- the image processing apparatus further transmitting the processing instruction and the request for the collation image to the server device, Receiving means for receiving the processing instruction and the collation image from the server device, writing the received processing instruction in the instruction storage means, and writing the received collation image in the second image storage means Loading means.
- the transmitting unit transmits the processing command satisfying a predetermined condition and a request for the collation image.
- the predetermined condition is that the processing command and the collation image relate to the image processing apparatus, and the transmitting unit transmits the processing command and the request for the collation image relating to the image processing apparatus.
- the server device stores the processing command and the collation image according to the image processing device, and transmits the processing command and the collation image.
- the predetermined condition is that the processing command and the collation image correspond to a user identifier for identifying the image processing apparatus
- the transmitting unit includes, as the request, the image processing apparatus.
- the server device stores the processing command and the collation image in association with the device identifier, and the processing command and the collation command corresponding to the received device identifier. And transmits the extracted processing instruction and the collation instruction.
- the processing command and the collation image corresponding to the device identifier for identifying the image processing device are received, the processing command and the collation image appropriate for the image processing device can be obtained reliably.
- the predetermined condition is that the processing command and the collation image relate to a subject to be photographed, and the transmitting unit transmits the processing command and the request for the collation image relating to the subject.
- the server device stores the processing instruction and the collation image related to the subject, and transmits the processing instruction and the collation image.
- the predetermined condition is that the processing instruction and the collation image correspond to a tag identifier for identifying an IC tag attached to a subject.
- the apparatus further includes an acquiring unit that acquires a tag identifier for identifying the IC tag from the IC tag attached to the subject, the transmitting unit transmits the acquired tag identifier as the request, and the server device Storing the processing instruction and the collation image in association with the tag identifier, extracting the processing instruction and the collation instruction corresponding to the received tag identifier, extracting the extracted processing instruction and the collation Send instructions.
- the transmission unit transmits the processing command and the request for the collation image to the server device as needed.
- the processing instruction and the collation image are received at any time, the received processing instruction and the collation image can be used at any time to determine whether the captured image contains the collation image. Image processing can be performed.
- the transmitting unit periodically and repeatedly transmits the processing command and the request for the collation image to the server device.
- the collation image appears in the captured image without increasing the communication amount between the server device and the image processing device.
- Image processing can be performed in accordance with the presence or absence of the force.
- the image processing is image overwriting processing by computer graphic processing
- the execution unit performs computer graphic processing on a portion corresponding to the collation image.
- a computer graphic process is performed as an image overwriting process on a portion where the collation image is captured, so that the portion can be reliably replaced with another image.
- the execution means performs the encryption processing based on two keys which are distributed and held by the two parties.
- the executing means performs the image processing when the determining means determines that there is no portion corresponding to the collation image in the captured image.
- the image processing apparatus when the image processing apparatus is determined to be outside the predetermined range, it is determined whether or not a portion corresponding to the collation image exists in the captured image. In this case, the image processing can always be performed according to the comparison result. In this way, it is possible to limit the captured images output to the outside.
- the collation image and the processing command can be reliably transmitted to the image processing apparatus via the network.
- FIG. 4 shows an example of a data structure of control information 141 stored in information storage section 103.
- FIG. 8 shows an example of a data structure of control information 145 stored in information storage section 103.
- FIG. 10 shows an example of a data structure of additional information 152 stored in information storage section 103.
- FIG. 12 shows an example of data stored in an information storage unit 204.
- FIG. 13 is a block diagram showing a structure of a memory card 300.
- FIG. 15 is a block diagram showing a configuration of an IC chip section 410 provided in the IC tag 400.
- FIG. 16 shows an example of a power supply circuit included in a power supply section 404 provided in the IC chip section 410.
- FIG. 17 is a flowchart showing the operation of the image processing system 10 when shooting an object.
- FIG. 19 shows an example of a data structure of additional information 151a.
- FIG. 20 shows an example of a data structure of additional information 152a.
- FIG. 21 shows an example of a data structure of additional information 153.
- FIG. 22 shows an example of a data structure of additional information 154.
- FIG. 23 shows an example of a data structure of additional information 155.
- FIG. 24 shows an example of a data structure of additional information 156.
- FIG. 25 shows an example of a data structure of additional information 157.
- Short-range communication control unit Short-range communication unit I / O unit
- the image processing system 10 includes a server device 100 and a plurality of digital cameras 200a, 200b,.
- the server device 100 and the digital cameras 200a, 200b,... are connected via the Internet 20 and the mobile phone network 30.
- the user uses the digital camera 200a to photograph one or more various objects (also referred to as subjects).
- An IC tag 400 communicable wirelessly using radio waves that is, a non-contact communicable IC tag 400 is attached to some of the above objects in advance.
- the IC tag 400 holds a tag identifier for identifying the IC tag.
- the digital camera 200a captures these objects and generates image data by a user's operation.
- the digital camera 200a wirelessly transmits the tag identifier from the IC tag 400. get.
- the digital camera 200a When the digital camera 200a captures an image of these objects, the digital camera 200a stores a user identifier internally stored for identifying the user and, if acquired, the tag identifier, the wireless base station. 31.
- the server device 100 that transmits to the server device 100 via the mobile phone network 30 and the Internet 20 associates a pattern image with a user identifier for identifying the user and a tag identifier for identifying the IC tag in advance.
- Control information and additional information are stored internally.
- the no-turn image is image data, and the control information and the additional information each include an operation command indicating that mosaic processing, image replacement, and the like described below are to be performed on image data generated by imaging.
- the server device 100 extracts the pattern image from the internal image, and outputs the extracted pattern image to the Internet 20. , Via the mobile phone network 30 and the wireless base station 31 to the digital camera 200a.
- the digital camera 200a searches the image data generated by shooting for a portion that matches the received pattern image, and if there is a matching portion, requests the server device 100 for control information and additional information. In addition, the server device 100 transmits the corresponding control information or the control information and the additional information to the digital camera 200a.
- Digital camera 200a performs processing on the generated image data according to the received control information or an operation command included in the control information and the additional information. For example, mosaic processing is performed on a part that matches the received pattern image, or the part is replaced with other image data, and the image data on which these processings have been performed is written to the memory card 300.
- the server device 100 includes a control unit 101, a transmission / reception unit 102, and an information storage It comprises a unit 103 and is connected to the display unit 111 and the input unit 112.
- the server device 100 is, specifically, a computer system including a microprocessor, a ROM, a RAM, a hard disk unit, a communication unit, a display unit, a keyboard, a mouse, and the like.
- a computer program is stored in the RAM or the hard disk unit.
- the server device 100 achieves its functions by operating according to the microprocessor power and the computer program.
- the information storage unit 103 stores a user information table 121, pattern images 131, 132,..., Control information 141, 142,..., And additional information 151, 152,. It is stored in advance.
- the user information table 121 includes a plurality of pieces of user information as shown in an example of the data structure in FIG.
- One or more pieces of user information included in the user information table 121 correspond to one user.
- Each user information includes a user identifier, one or more pattern image identifiers, and one control information identifier. Some of the user information further includes a tag identifier, and some further includes an additional information identifier.
- the user identifier is identification information that uniquely identifies a user of each digital camera.
- the nottern image identifier is identification information for uniquely identifying any one of the pattern images stored in the information storage unit 103.
- the tag identifier is identification information for uniquely identifying an IC tag.
- the IC tag will be described later.
- the control information identifier is identification information that uniquely identifies any one of the pieces of control information stored in the information storage unit 103.
- the additional information identifier is identification information that is stored in the information storage unit 103 and uniquely identifies any additional information.
- Pattern images 131, 132, ... are generated by compressing image data obtained by shooting with each digital camera or a part of the image data with high efficiency according to the JPEG (Joint Photographic Experts Group) standard. Image information.
- JPEG Joint Photographic Experts Group
- the pattern images 131, 132, ... are image data obtained by photographing the persons ⁇ , ⁇ , ⁇ ⁇ ⁇ also from the front.
- the pattern images 131, 132,... May be image data obtained by photographing the whole body, upper body, head, and the like of person A from the front.
- the pattern images 131, 132, and, respectively, show the head of person A in front, 45 degrees to the left, 45 degrees to the right, side, 45 degrees in front of top, 45 degrees in front of bottom, and 45 degrees in front of bottom.
- It may be image data obtained by shooting from.
- the pattern images 131, 132,... May be image data obtained by imaging the structures ⁇ , ⁇ ,.
- the structure is, for example, a building, a temple, a tower, a bridge, an aircraft, a train, a passenger car, or the like.
- the pattern images 131, 132,... May include all of the above examples.
- Each piece of control information is composed of a plurality of pieces of operation information, and each piece of operation information includes an execution number, an operation command, and detailed information.
- Each control information is, specifically, a computer program, and each operation information is a computer instruction in a machine language format.
- These machine language forms are forms that are decoded and executed by each digital camera, and each control information is used by each digital camera.
- the contents of each control information will be described, but in order to facilitate understanding of the contents of each control information, the operation is not described using machine language instructions as shown in FIGS. Instructions and detailed information are expressed in the language normally used by humans.
- the execution number is a number indicating the order in which the corresponding operation command is executed by each digital camera.
- the operation instruction corresponding to the execution number "1" is executed first, and then the operation instruction corresponding to the execution number "2" is executed.
- the operation instructions are executed in the order indicated by the execution numbers.
- the operation instruction is an instruction for instructing an operation for each digital camera. This is information specified in association with each operation command.
- the operation command includes, for example, a mosaic processing command, a recording command, an image replacement command, an information addition command, a frame deletion command, and the like.
- the mosaic processing instruction is to apply the mosaic processing to all or a part of the image data obtained by shooting with the digital camera (or the image data immediately before performing the mosaic processing, that is, the image data subjected to other processing). Instruction.
- all or a part of the captured and generated image data is divided into a plurality of rectangular (square) block areas, and one block included in the block area is divided for each block area. Is determined, and the pixel value of the determined pixel is written back to the block area as the pixel values of all other pixels included in the block area.
- the one pixel as an example, the upper left pixel in the block area is selected.
- the detailed information includes a condition and a size.
- the condition indicates a condition under which the mosaic processing instruction is executed.
- An example of the condition is “pattern image matching”.
- the mosaic processing instruction is executed on the part in the image data. If no part corresponding to the pattern image exists in the image data, the mosaic processing instruction is not executed.
- the pattern image is an image specified separately.
- the condition is “match pattern image A”.
- the mosaic processing instruction is executed on a part of the image data. If a portion that matches pattern image A does not exist in the image data, The mosaic processing instruction is not executed.
- the pattern image A is an image specified under the above conditions.
- the size indicates the size of the block area.
- the sizes “5”, “4”, “3”, and “2” indicate block areas of 64 pixels ⁇ 64 pixels, 32 pixels ⁇ 32 pixels, 16 pixels ⁇ 16 pixels, and 8 pixels ⁇ 8 pixels, respectively.
- a block area of a pixel X a pixel is formed by arranging a X a pixels in a matrix in a total of a pixels vertically and a pixels horizontally. It is.
- the recording instruction is based on JPEG or MPEG4 (Moving Pictures Experts Group 4) for the image data obtained by shooting with the digital camera (or the immediately preceding image data, that is, the image data subjected to other processing).
- the instruction indicates that compressed image data is generated by performing image compression, and the generated compressed image data is written into a specified storage area.
- JPEG Joint Photographic Experts Group 4
- MPEG4 is used when instructing to capture a moving image
- the detailed information includes a condition and an identifier of image data.
- Another example of the condition is "match with pattern image A".
- the image replacement command is executed on a part of the image data. If a portion corresponding to the Notarn image A does not exist in the image data, the image replacement command is not executed.
- the pattern image A is an image specified within the above conditions.
- the information addition command is a command indicating that additional information is added to the compressed image data generated by the digital camera.
- the detailed information includes an additional information identifier for identifying additional information to be added.
- additional information will be described later.
- the frame erasing command is a command indicating that when a plurality of frame images are obtained by photographing with a digital camera, if any one of the frame images satisfies a specified condition, the frame image is deleted.
- the detailed information includes a condition. If the condition is satisfied, the frame is deleted
- control information 141, 142, ⁇ ⁇ ⁇ (Specific examples of control information 141, 142, ⁇ ⁇ ⁇ )
- the control information 141 includes a mosaic processing command and a recording command, as shown as an example in FIG.
- the detailed information corresponding to the mosaic processing instruction includes the condition “pattern image match”, and the size of the mosaic block is “5”.
- a memory card is specified as a recording destination.
- control information 141 When the control information 141 is executed, if it is determined that a part in the image data obtained by photographing with the digital camera matches the pattern image, the block in the part of the image data is compared with the part in the image data. A mosaic processing instruction having a size of “5” is executed, and then the mosaiced image data S is written to the memory card.
- the control information 142 includes an image replacement command and a recording command, as shown as an example in FIG.
- the detailed information corresponding to the image replacement command includes the condition “pattern image match” and the CG data identifier “CG004”.
- the recording instruction specifies the inside of the digital camera as the recording destination.
- control information 142 When the control information 142 is executed, if it is determined that a part in the image data obtained by photographing with the digital camera matches the pattern image, the part in the image data is represented by “CG004”. The image data is replaced with the identified CG data, and a part of the image data is written into the digital camera.
- the additional information identified by the additional information identifier “X001” is added to the image data obtained by photographing with the digital camera, and the additional information is added to the image data. Force Written inside the digital camera.
- the control information 144 is composed of a frame erasing command and a recording command, as shown as an example in FIG.
- the detailed information corresponding to the frame erasing command is described in the condition " Match ".
- the recording instruction specifies the inside of the digital camera as a recording destination.
- control information 144 When the control information 144 is executed, if a part of the plurality of frame images photographed by the digital camera matches the pattern image, the frame image is deleted. Except for erased frame images, multiple frame images are written inside the digital camera.
- the control information 145 includes a mosaic processing command, an image replacement command, a frame deletion command, and a recording command, as shown as an example in FIG.
- the detailed information corresponding to the mosaic processing instruction includes the condition “matches pattern image A”, and the size of the mosaic block is “4”.
- the detailed information corresponding to the image replacement instruction includes the condition “matches pattern image B” and the replacement image identifier “G001”.
- the detailed information corresponding to the frame erasure command includes the condition “matches pattern image C”.
- a memory card is specified as a recording destination.
- the control information 145 When the control information 145 is executed, if it is determined that among the plurality of frame images captured by the digital camera, the partial force pattern image A in the frame image matches the pattern image A, a part of the frame image is displayed. On the other hand, a mosaic processing instruction with a block size of “4” is executed. Next, when it is determined that a part in the frame image matches the pattern image B, the part in the frame image is replaced with a replacement image identified by “G001”. Next, if any of these frame images has a pattern image C that coincides with the pattern image C, the frame image is deleted, and then the above-described mosaic processing is performed except for the deleted frame image. Alternatively, one or a plurality of frame images subjected to image replacement processing are written to the memory card.
- Each piece of additional information is composed of a plurality of pieces of operation information, like the control information, and each piece of operation information includes an execution number, an operation command, and detailed information.
- Each additional information is, specifically, a computer program, and each operation information is a computer instruction in a machine language format.
- These machine language forms are those that are decoded and executed by each digital camera, and each additional information is used by each digital camera.
- Each operation information is the same as the operation information included in the control information, and therefore, the description is omitted.
- the operation instructions include, for example, a mosaic instruction, an image replacement instruction, an encryption instruction, and the like.
- the mosaic instruction is as described above.
- the detailed information corresponding to the mosaic instruction includes the range information and the size.
- the size is as described above.
- the range information indicates a region in the image on which the mosaic processing is performed by the mosaic instruction. This area has a rectangular shape.
- the upper left point of the image is the origin, the upper side of the image is the X coordinate axis, and the left side of the image is the Y coordinate axis.
- the range information includes an X coordinate value X1 and a Y coordinate value Y1 of the upper left point of the rectangle, and an X coordinate value X2 and a Y coordinate value Y2 of the lower right point.
- Range information ((X1, Y1) — (X2, Y2))
- the range information is, for example,
- each coordinate value in the range information shown in FIG. 9 is “9999”. This indicates that the area on the image to which the mosaic processing is to be performed is undetermined.
- the region on the image is determined when the digital camera performs matching using the pattern image and detects a partial image that matches the pattern image.
- the image replacement command is as described above.
- the detailed information corresponding to the image replacement instruction includes, for example, range information and CG data identifier.
- the CG data identifier is identification information for identifying CG data.
- the range information is as described above, and indicates an area in which the CG data indicated by the CG data identifier is overwritten. Specifically, as shown in FIG. 10, the range information is, for example,
- each coordinate value in the range information shown in FIG. 10 is “9999”, which is as described above, which indicates that the area on the image where the CG data is to be overwritten is undetermined. I have.
- the region on the image is determined when the digital camera performs matching using the pattern image and detects a partial image that matches the pattern image.
- the encryption command is a command indicating that the compressed image data to which the additional information has been added is subjected to an encryption process determined by an algorithm specification included in the detailed information.
- the algorithm designation indicates an encryption algorithm used in encryption.
- the encryption algorithm is, for example, DES (Data Encryption Standard).
- the additional information 151 includes a mosaic processing instruction as shown as an example in FIG.
- the detailed information corresponding to the mosaic processing instruction includes range information ((9999, 9999) -one (9999, 9999)) and size “2”.
- the additional information 151 is stored in the server device 100. When the additional information 151 is attached to the compressed image data by the digital camera 200, the additional information 151 is overwritten with the range information as the additional information 151a shown in FIG.
- the detailed information included in the additional information 151a includes range information ((010, 010)-(020, 020)).
- the additional information 151a is executed by the digital camera 200
- the compressed image data to which the additional information is added is copied
- the compressed image data is temporarily expanded to generate image data.
- a mosaic processing instruction with a block size of “2” is applied to the rectangular area indicated by the range information ((010, 010)-(020, 020)) included in the additional information 151a on the divided image data. Be executed.
- the additional information 152 includes an image replacement instruction and an encryption instruction as shown as an example in FIG.
- the detailed information corresponding to the image replacement instruction includes range information ((9999, 9999)-(9999, 9999)) and a CG data identifier “CG005”.
- Detailed information corresponding to the encryption instruction The report contains the algorithm "DES”.
- the additional information 152 is stored in the server device 100.
- the caro information 152 is overwritten with the range information as the additional information 152a shown in FIG.
- the detailed information included in the attached caro information 152a includes range information ((020, 020)-(035, 035)).
- the compressed image data to which the additional information is added is copied, the compressed image data is temporarily expanded to generate image data.
- CG data identified by the CG data identifier “CG005” for the rectangular area indicated by the range information ((020, 020) 1-1 (035, 035)) included in the additional information 152a CG processing is performed, and the image data subjected to the CG processing is compression-encoded to generate compressed image data, and the generated compressed image data is subjected to DES encryption. Encrypted compressed image data is generated.
- the control unit 101 receives one user identifier from the digital camera 200a via the wireless base station 31, the mobile phone network 30, the Internet 20 and the transmitting / receiving unit 102, or receives one user identifier. And one or more tag identifiers and a request for control information.
- the control unit 101 When only one user identifier is received, the control unit 101 attempts to read out the user information including the received user identifier from the user information table 121 stored in the information storage unit 103. If the corresponding user information does not exist in the user information table 121, the non-existence information indicating that the pattern image does not exist is transmitted to the digital camera 200a via the transmission / reception unit 102, the Internet 20, and the mobile phone network 30. Send.
- the control unit 101 When there is one or more corresponding user information, the control unit 101 reads all the corresponding user information from the user information table 121 and temporarily stores the read user information.
- the pattern image identifier included in the user information is extracted for all the user information stored and read out. Thus, one or more pattern image identifiers Is extracted.
- a pattern image identified by the pattern image identifier is read from the information storage unit 103, and the read pattern image is transmitted to the transmitting / receiving unit 102, the Internet 20, and the mobile phone network 30. Via the digital camera 200a. Thus, one or more pattern images are sent
- the control unit 101 determines from the user information table 121 stored in the information storage unit 103 the user including the received user identifier. Attempt to read information. If the corresponding user information does not exist in the user information table 121, the absence information indicating that the pattern image does not exist is transmitted via the transmission / reception unit 102, the Internet 20, and the mobile phone network 30. To the digital camera 200a.
- the control unit 101 When there is one or more corresponding user information, the control unit 101 reads all the corresponding user information from the user information table 121, and then reads all the read user information. Received from the person information! Attempt to extract user information that includes the tag identifier of /.
- the non-existence information indicating that the pattern image does not exist is transmitted to the digital camera 200a via the transmitting / receiving unit 102, the Internet 20, and the mobile phone network 30. Send.
- the control unit 101 temporarily stores the user information, and then, for all extracted user information, The pattern image identifier included in the user information is extracted. Thus, one or more pattern image identifiers are extracted. Next, for all the extracted pattern image identifiers, a pattern image identified by the pattern image identifier is read from the information storage unit 103, and the read pattern image is transmitted and received by the transmission / reception unit 102, the Internet 20, and the mobile phone network 30. To the digital camera 200a via the. Thus, one or more pattern images are transmitted.
- the control unit 101 When a request for control information is received, the control unit 101 One control information identifier included in the user information is extracted from each user information, and if the user information includes an additional information identifier, one additional information identifier is also included. Extract.
- control unit 101 reads control information identified by the extracted control information identifier from the information storage unit 103, and reads the read control information via the transmission / reception unit 102, the Internet 20, and the mobile phone network 30, Send to digital camera 200a. Thus, one piece of control information is transmitted.
- the control unit 101 reads the additional information identified by the extracted additional information identifier from the information storage unit 103, and transmits the read additional information to the transmitting / receiving unit 102, The data is transmitted to the digital camera 200a via the Internet 20 and the mobile phone network 30. Thus, when additional information exists, one piece of additional information is transmitted.
- the transmission / reception unit 102 is connected to the digital camera 200 via the Internet 20 and the mobile phone network 30, and transmits and receives information between the digital camera 200a and the control unit 102.
- Each of the digital cameras 200a, 200b,... Has the same configuration, and therefore is described here as the digital camera 200.
- the digital camera 200 includes an LSI (Large Scale Integration) unit 218, an image display unit 205, a display unit 209, an input unit 210, an input / output unit 214, and an antenna.
- the LSI unit 218 includes an image storage unit 201, a photographing unit 202, an image processing unit 203, an information storage unit 204, a wireless control unit 206, a wireless communication unit 207, a control unit 208, and a short circuit. It comprises a distance communication control unit 211, a short distance communication unit 212, an authentication unit 213, and an encryption unit 217.
- the LSI unit 218 is a super-multifunctional LSI manufactured by integrating the above-described components on a single chip. Specifically, the LSI unit 218 includes a microprocessor, a ROM, a RAM, and the like. Computer system. The RAM stores a computer program. ing. By operating according to the microprocessor power and the computer program, the LSI unit 218 achieves its function.
- the information storage unit 204 has an area for storing information, and stores a user identifier, replacement image data, and CG data in advance, as shown in FIG. Further, the compressed image data and other information are written in the information storage unit 204.
- the user identifier is identification information for identifying a user having the digital camera 200.
- the replacement image data is compressed image data generated according to the JPEG standard.
- a replacement image identifier for identifying the replacement image data is added to the replacement image data.
- the CG data includes the shape of a graphic image to be drawn on the image data, coordinate data indicating the position of the graphic in the image data, the size of the graphic, the line segments constituting the graphic, and the shape of the curve.
- figure drawing data which is detailed information required for drawing figures, such as color and thickness, hatching instructions in closed areas, their patterns and colors, filling instructions in closed areas, their patterns and colors, etc. .
- a CG data identifier for identifying the CG data is added to the CG data.
- Radio control section 206 radio communication section 207 and antenna 215
- the radio communication unit 207 amplifies a radio frequency signal received by the antenna 215, converts an output signal into an IF signal, amplifies the IF signal, demodulates the amplified IF signal into a baseband signal, and The signal modulates a high frequency signal, converts its output to a radio frequency, amplifies the radio frequency, and outputs it to the antenna 215.
- Radio control section 206 generates a baseband signal and outputs it to radio communication section 207, and receives a baseband signal from radio communication section 207.
- the wireless control unit 206, the wireless communication unit 207, and the antenna 215 transmit and receive information to and from the server device 100 connected via the wireless base station 31, the mobile phone network 30, and the Internet 20. Do.
- Short-range communication control unit 211 Short-range communication control unit 211, short-range communication unit 212, antenna 216
- Short-range communication section 212 includes a transmission / reception section that transmits and receives signals via antenna 216, and a modulation / demodulation section that modulates and demodulates signals. Processes various signals input and output between Further, the short-range communication control unit 211 establishes a communication channel for short-range wireless communication with the short-range communication control unit 211 of the IC tag 400, and thereafter performs communication via the established communication channel.
- short-range communication control unit 211 in response to the read instruction from control unit 208, short-range communication control unit 211, short-range communication unit 212, and antenna 216 acquire the tag identifier from IC tag 400, and replace the acquired tag identifier with the tag identifier. Output to control unit 208.
- the input / output unit 214 writes information to the memory card 300 or reads information from the memory card 300 under the control of the control unit 208.
- the authentication unit 213 performs mutual device authentication with the memory card 300 before outputting information to the memory card 300 or reading information from the memory card 300, and performs mutual device authentication. Only when this succeeds, the input / output unit 214 is permitted to input and output the subsequent information. If the mutual device authentication fails, the input / output of information to / from the memory card 300 to the input / output unit 214 is prohibited.
- the image storage unit 201 has an area for storing information. Mainly, it stores image data generated by the photographing unit 202 and image data to be subjected to various processes by the image processing unit 203.
- the photographing unit 202 measures a distance to an object, a plurality of combined lens groups, a lens control unit that brakes a distance between the lenses, and a distance to the lens control unit according to the measured distance.
- AF unit that indicates the distance of the camera, a CCD that has a plurality of optical elements and outputs an electric signal generated according to the light received by each optical element through the lens group, etc.
- the image display unit 205 displays the reduced image generated by the image processing unit 203 based on an instruction from the control unit 208.
- the display unit 209 displays conditions for shooting the target object, the remaining number of shootable images, and other information based on instructions from the control unit 208.
- the input unit 210 includes a shutter button for instructing shooting, a copy button for instructing copying of the compressed image data stored in the information storage unit 204, and other buttons.
- the corresponding instruction information is output to control section 208.
- the input unit 210 respectively issues an instruction to shoot a target object and a compression command stored in the information storage unit 204.
- a data identifier for identifying the image data, an instruction to copy the compressed image data, and other instructions are output to the control unit 208.
- the control unit 208 receives, from the input unit 210, an instruction to shoot a target object, a data identifier for identifying the compressed image data stored in the information storage unit 204, an instruction to copy the compressed image data, and other instructions.
- the control unit 208 Upon receiving the instruction to shoot the object, the control unit 208 outputs an instruction to shoot the object to the imaging unit 202, and sends the tag identifier to the short-range communication control unit 211.
- a read instruction to read is output.
- a user identifier is read from the information storage unit 204.
- the read tag identifier is received.
- control unit 208 transmits the read user identifier to the server device 100 via the wireless control unit 206, the wireless communication unit 207, the antenna 215, the wireless base station 31, the mobile phone network 30, and the Internet 20. Send to
- control unit 208 transmits the server device 10 via the wireless control unit 206, the wireless communication unit 207, the antenna 215, the wireless base station 31, the mobile phone network 30, and the Internet 20. 0, or when receiving information from the server device 100 via the Internet 20, the mobile phone network 30, the wireless base station 31, the antenna 215, the wireless communication unit 207, and the wireless control unit 206. Simply states that the control unit 208 transmits information to the server device 100 via a network, or the control unit 208 receives information from the server device 100 via a network. .
- control unit 208 transmits the received tag identifier to the server device 100 via the network.
- control unit 208 receives the absence information or one or more pattern images from the server device 100 via the network, and temporarily stores the received absence information or the received pattern image therein. I do.
- control unit 208 issues a compression encoding instruction to the image processing unit 203 to indicate that the image data obtained by the imaging by the imaging unit 202 is to be compression encoded. And instructs the input / output unit 214 to write the generated compressed image data to the memory card 300.
- control unit 208 sends to the image processing unit 203 an image data obtained by capturing a portion corresponding to the received pattern image. It outputs a matching instruction indicating that matching is performed on whether or not there is a matching part in the image, and receives a matching result indicating whether or not a matching part exists from the image processing unit 203.
- control unit 208 sends the image data obtained by the photographing by the photographing unit 202 to the image processing unit 203 using a compression code. And instructs the input / output unit 214 to write the generated compressed image data to the memory card 300.
- the control unit 208 transmits a request for control information to the server device 100 via the network, and transmits the request from the server device 100 to the network.
- One piece of control information, or one piece of control information and one piece of additional information is received, and the received control information, or the received control information and the received additional information are temporarily stored therein. I do.
- the control unit 208 sorts the operation information included in the received control information in the order of the execution numbers included in the operation information. Therefore, the read operation information is analyzed to extract the operation instruction and the detailed information, and it is determined whether the extracted operation instruction is mosaic processing, image replacement, information addition, frame deletion, or recording.
- the control unit 208 sets the mosaic processing instruction and the image that indicate the mosaic processing, the image replacement, or the frame deletion, respectively.
- a replacement instruction or a frame deletion instruction is output to the image processing unit 203.
- the detailed information included in the extracted operation command is also output to the image processing unit 203.
- the control unit 208 extracts the detailed information power condition and the additional information identifier extracted corresponding to the information addition instruction, and the current situation matches the extracted condition. It is determined whether or not the force is applied.
- the current situation is, for example, the result of the above-mentioned matching processing by the image processing unit 203, and the extracted conditions are, for example, "pattern" as shown in FIG. If the matching result received from the image processing unit 203 indicates that there is no matching part, the following additional information is added to the compressed image data. Don't do it.
- the additional information identified by the extracted additional information identifier among the received additional information Is selected is read from the information storage unit 204.
- This range information is written into the information storage unit 204 by the image processing unit 203, as described later, and indicates the position of the partial image that matches the pattern image on the image generated by shooting. This is coordinate information.
- the read range information is overwritten with the range information included in the detailed information in the selected additional information.
- FIGS. The additional information 151a shown in FIG. Contains range information ((010, 010)-(020, 020)).
- This range information is coordinate information indicating the position of the partial image that matches the pattern image on the image generated by shooting, where (010, 010) is the upper left point, and (020, 020) is the right. Show the rectangular area to be the lower point!
- This range information is coordinate information indicating the position of a partial image that matches the pattern image on the image generated by shooting, where (020, 020) is the upper left point, and (035, 035) is the right Show the rectangular area to be the lower point!
- the image processing unit 203 compresses and encodes the image data stored in the image storage unit 201. Is output. As a result, the compressed image data is written into the information storage unit 204.
- the control unit 208 writes the compressed image data written in the information storage unit 204 with the additional information in which the range information is overwritten. Further, the control unit 208 instructs the input / output unit 214 to write the compressed image data (to which the additional information is added) stored in the information storage unit 204 to the memory card 300.
- the image data stored in the image storage unit 201 is compression-encoded to the image processing unit 203, and the generated compressed image data is stored in the information storage unit. Instruct section 204 to write. As a result, the compressed image data is written into the information storage unit 204.
- the control unit 208 adds the selected additional information to the compressed image data written in the information storage unit 204 and writes the compressed image data.
- the control unit 208 When it is determined that the extracted operation command is a record, that is, when it is determined that no information addition command exists in the control information before the operation command, the control unit 208 If the extracted detailed information is a “memory card”, a compression coding instruction indicating that the image data stored in the image storage unit 201 is to be compression-coded is output to the image processing unit 203 and input. The output unit 214 is instructed to write the compressed image data stored in the information storage unit 204 to the memory card 300. The extracted detailed information is When it is inside the digital camera, the image processing unit 203 is instructed to compress and encode the image data stored in the image storage unit 201 and write the generated compressed image data to the information storage unit 204.
- the control unit 208 repeatedly reads, analyzes, and executes all the operation information included in the control information in the order of the execution numbers included in the operation information.
- the control unit 208 Upon receiving the data identifier for identifying the compressed image data and the copy instruction, the control unit 208 reads the user identifier from the information storage unit 204. Next, the compressed image data identified by the received data identifier is selected from the information storage unit 204, and additional information added to the compressed image data is extracted from the selected compressed image data.
- control unit 208 analyzes the extracted additional information, extracts each piece of operation information, further extracts an operation command and detailed information from each piece of the extracted pieces of operation information, and reads out the extracted detailed information. Determine whether or not the force includes a determination as to whether or not the pattern image coincides with the deviation.If the determination is included as a condition in the extracted detailed information, the control unit 208 controls the network via the network. The user identifier is transmitted to the server device 100. Next, one of the absence information and one or more pattern images is received from the server device 100 via the network.
- the control unit 208 instructs the image processing unit 203 to match a part matching the received pattern image. Outputs a matching instruction indicating that matching is performed in the image data obtained by shooting, and receives a matching result indicating whether there is a matching part from the image processing unit 203.
- control unit 208 analyzes the additional information to extract each operation information, analyzes the extracted operation information according to the order of the execution numbers included in each operation information, and executes the operation instruction and details.
- the information is extracted, and the extracted operation command power is determined to be one of mosaic processing, image replacement, and encryption.
- control unit 208 sends the received data identifier to the image processing unit 203, A decompression instruction indicating that the compressed image data identified by the data identifier is decompressed is output. As a result, the image data obtained by expanding the compressed image data is written into the image storage unit 201 by the image processing unit 203.
- the control unit 208 transmits the mosaic processing instruction and the image replacement instruction indicating the mosaic processing and the image replacement, respectively, to the image processing unit. Output to 203. At this time, the detailed information included in the extracted operation command is also output to the image processing unit 203. As a result, the image data subjected to the mosaic processing or the Z and image replacement is stored in the image storage unit 201.
- the control unit 208 sends the image data stored in the image storage unit 201 to the image processing unit 203 using compression coding. It outputs a compression encoding instruction indicating that the compressed image data is to be written, and instructs the input / output unit 214 to write the compressed image data stored in the information storage unit 204 to the memory card 300.
- the image processing unit 203 is instructed to perform a compression encoding instruction to compress and encode the image data stored in the image storage unit 201. Output.
- the information storage unit 204 stores the compressed image data.
- the control unit 208 outputs the data identifier and an encryption instruction indicating encryption to the encryption unit 217.
- the information storage unit 204 stores the encrypted compressed image data.
- the input / output unit 214 is instructed to write the encrypted image data stored in the information storage unit 204 to the memory card 300.
- control unit 208 Upon receiving another instruction, control unit 208 performs other processing corresponding to the received other instruction.
- the image processing unit 203 receives a compression encoding instruction, a decompression instruction, a matching instruction, a mosaic processing instruction, an image replacement instruction, and a frame deletion instruction from the control unit 208. Further, detailed information may be received from the control unit 208 together with each instruction. Further, a data identifier for identifying compressed image data and a system identifier indicating a compression encoding system may be received from the control unit 208 in some cases. [0123] (Compression encoding)
- the image processing unit 203 Upon receiving the compression encoding instruction, the image processing unit 203 performs compression encoding on the image data stored in the image storage unit 201 in accordance with the specified compression encoding method, and generates compressed image data. Then, the generated compressed image data is written to the information storage unit 204.
- the specified compression coding method is specified by JPEG or specified by MPEG4.
- the designation of the compression encoding method is instructed by the user before shooting of the target object.
- JPEG is specified
- the shooting of moving image is specified.
- MPEG4 is specified.
- the image processing unit 203 Upon receiving the decompression instruction, the image processing unit 203 further receives a data identifier for identifying the compressed image data from the control unit 208. Next, the compressed image data identified by the received data identifier is read from the information storage unit 204, and the header part included in the read compressed image data is analyzed to be used when the compressed image data is generated. Acquire a scheme identifier indicating the compression encoding scheme.
- the image processing unit 203 performs decompression decoding on the read compressed image data to generate image data, and generates the generated image data. Is written to the image storage unit 201.
- control unit 208 Upon receiving the matching instruction, the control unit 208 further receives a pattern image from the control unit 208, and determines whether or not a portion corresponding to the received pattern image exists in the image data stored in the image storage unit 201. The matching is performed as described below, and then the matching result indicating whether or not the matching portion exists is temporarily stored internally, and the matching result is output to the control unit 208.
- the image processing unit 203 performs the matching as described below.
- Step a The image data stored in the image storage unit 201 is represented by S, and a partial image having the same size as the pattern image is selected in the image data S. First, the selection is performed such that the upper left point of the partial image matches the upper left point of the image.
- the pattern image is represented by P
- the value of the pixel in the pattern image P is represented by P [i]. i is information indicating the position of a pixel in the pattern image P, and l ⁇ i ⁇ n. n is the number of pixels in the pattern image P.
- the partial image is represented by B (j), and the value of the pixel in the partial image B (j) is represented by B (j) [i].
- j is information indicating the position of a partial image in the image data S stored in the image storage unit 201, and l ⁇ j ⁇ m.
- i is information indicating the position of a pixel in the partial image B (j).
- Step b The absolute value of the difference between the values of all the pixels included in the pattern image P and the values of all the pixels present at the positions corresponding to the respective pixels in the partial image B (j) Calculate the sum Sum (j).
- step e If the condition is satisfied, proceed to step e.
- step d If the condition is not satisfied, proceed to step d.
- Step d In the image data S, the partial image is shifted from left to right or from top to bottom by one pixel, and a new partial image is selected.
- the image processing unit 203 Since the partial image existing at the position indicated by X obtained in this way can be assumed to be an image that matches the pattern image, the image processing unit 203 firstly stores the position information X indicating the position of the partial image that matches the pattern image. To memorize.
- the image processing unit 203 sets the X coordinate value XI and the Y coordinate value Yl of the upper left point of the partial image on the image data. , And the X coordinate value ⁇ 2 and ⁇ coordinate value ⁇ 2 of the lower right point.
- the X coordinate value XI and ⁇ coordinate value Y1 of the upper left point and the X coordinate value ⁇ 2 and ⁇ coordinate value ⁇ 2 of the lower right point constitute range information.
- Range information (( ⁇ 1, ⁇ 1) — ( ⁇ 2, ⁇ 2))
- the image processing unit 203 writes the range information into the information storage unit 204.
- the image processing unit 203 Upon receiving the mosaic processing instruction, the image processing unit 203 further receives the detailed information, and extracts the condition and size of the received detailed information power.
- the conditions and size are as described above.
- the image processing unit 203 determines whether or not the current situation is a force that matches the extracted condition, and if it matches, the mosaic processing described below is performed based on the extracted size. I do. If they do not match, the mosaic processing is not performed.
- condition is a pattern image match.
- the image processing unit 203 indicates that there is a part that matches the matching result power temporarily stored, the above condition is satisfied. Matches.
- the matching result indicates that there is no matching part, the condition is not met.
- the image processing unit 203 performs mosaic processing as described below.
- Position information that is temporarily stored and indicates the position of the partial image that matches the pattern image
- the partial image indicated by x is divided into a plurality of rectangular (square) block areas, one pixel included in the block area is determined for each block area, and the pixel value of the determined pixel is calculated as the corresponding pixel value. Write back to the block area as pixel values of all other pixels included in the block area.
- the image processing unit 203 Upon receiving the image replacement instruction, the image processing unit 203 further receives detailed information and extracts a condition and a replacement image identifier or a condition and a CG data identifier from the received detailed information.
- the condition, replacement image identifier and CG data identifier are as described above.
- the image processing unit 203 determines whether or not the current situation is a force that matches the extracted condition, and if so, performs the following image replacement based on the extracted size. . If they do not match, image replacement is not performed.
- the image processing unit 203 performs image replacement as follows.
- the replacement image data or the CG data identified by the replacement image identifier or the CG data identifier extracted from the information storage unit 204 is read.
- the partial image that is temporarily stored and indicated by the position information X indicating the position of the partial image that matches the pattern image is replaced with the read replacement image data, or Draw a graphic image based on the read CG data on the indicated partial image.
- the image processing unit 203 Upon receiving the frame erasure instruction, the image processing unit 203 further receives the detailed information, and extracts the condition for the received detailed information power.
- the conditions are as described above.
- the image processing unit 203 determines whether the current situation is a force that matches the extracted condition, and if so, deletes the frame image that matches the condition. If they do not match, do not delete the frame image.
- the encryption unit 217 receives, from the control unit 208, a data identifier for identifying an encryption target and an encryption instruction indicating encryption. Upon receiving the encryption instruction, the compressed image data identified by the data identifier is read from the information storage unit 204, and the read compressed image data is subjected to an encryption algorithm to generate encrypted compressed image data. Then, the generated encrypted compressed image data is written to the information storage unit 204.
- the encryption algorithm is based on DES, for example.
- the memory card 300 includes an input / output unit 301, an authentication unit 302, an information storage unit 303, and a control unit 304.
- Control unit 304 (1) Control unit 304
- the control unit 304 is specifically composed of a microprocessor, a ROM, a RAM, and the like, and a computer program is stored in the ROM. By operating in accordance with the computer program described above, the control unit 304 achieves its function.
- the information storage unit 303 is specifically configured by a large-capacity flash memory. As shown in FIG. 13, for example, the information storage unit 303 stores compressed image data 311.
- the compressed image data 311 is identified by the data identifier “F001”.
- the authentication section 302 When the memory card 300 is attached to the digital camera 200, the authentication section 302 performs challenge-response mutual device authentication with the authentication section 213 of the digital camera 200.
- authentication section 302 receives authentication by authentication section 213. Next, the authentication unit 302 performs authentication of the authentication unit 213.
- the authentication unit 302 permits the input / output unit 301 to output information to the digital camera 200 and receive information from the digital camera 200 when the authentication of both is successful. If both authentications fail, data input / output to the input / output unit 301 is prohibited.
- the IC tag 400 has an IC chip portion 410 and an antenna portion 401 enclosed in a resin formed in a plate shape having a length of 30 mm, a width of 5 mm, and a thickness of 0.5 mm. It is formed.
- the communication range of the IC tag 400 is within about lm, and the communication speed is 1Mbps.
- the IC chip unit 410 includes a demodulation unit 402, a modulation unit 403, a power supply unit 404, a control unit 405, an identification code storage unit 406, an input / output unit 407, and a memory unit 408.
- the dimensions of the IC chip section 410 are lmm in length, lmm in width, and 0.25 microns in thickness.
- the identification code storage unit 406 stores an identification code for individually identifying the IC tag 400.
- the identification code consists of 32 bits.
- the manufacturer identification code (10-bit length) that identifies the manufacturer that manufactures the wireless IC tag, and if the wireless IC tag has multiple specifications and types, the specifications and types And a serial number (12-bit length), which is set to a different value for each manufacturer and type.
- the memory unit 408 is generally composed of an EEprom (Electronically Erasable and Programmable Read unly Memory) having a storage capacity of 1 Kbyte.
- EEprom Electrically Erasable and Programmable Read unly Memory
- a hi-ROM may be used instead of the EEprom.
- a hi-ROM is a type of memory that cannot be erased once data is written. By using the fuse ROM, data falsification can be prevented. Also, you may use both EEprom and Hi ROM.
- the memory unit 408 stores information on a product or the like to which the IC tag 400 is attached. For example, the manufacturer name, product number, and date of manufacture.
- Power supply unit 404
- the power supply unit 404 is connected to the antenna unit 401, receives a power signal from the antenna unit 401, and stores the received power signal as a charge. In addition, power is supplied to each component of the IC tag 400.
- FIG. 16 shows an example of a power supply circuit included in the power supply section 404.
- the power supply circuit shown in FIG. 16 includes four diodes D1 to D4 and a battery E.
- Diodes D1 and D2 are connected in series in the same direction
- diodes D3 and D4 are connected in series in the same direction
- diodes D1 and D2 and diodes D3 and D4 are connected in parallel in the same direction.
- One end of the antenna unit 401 is connected to an intermediate point between the diodes D1 and D2
- the other end of the antenna unit 401 is connected to an intermediate point between the diodes D3 and D4.
- One end of the battery E is connected to the midpoint between the diodes D1 and D3, and the other end of the battery E is connected to the midpoint between the diodes D2 and D4.
- the demodulation unit 402 receives the power signal from the antenna unit 401, selects a signal having a frequency of 2.45 GHz from the received power signal, extracts a pulse signal wave from the selected signal, and outputs the extracted pulse signal wave to the control unit. Output to 405.
- the control unit 405 receives the pulse signal wave from the demodulation unit 402. It decodes the received pulse signal wave and extracts instructions and operands. These instructions include an identification code request instruction that requests an identification code.
- control unit 405 Upon receiving the identification code request command, control unit 405 reads the identification code from identification code storage unit 406, and outputs the read identification code to modulation unit 403.
- Modulating section 403 receives the identification code from control section 405, and switches the impedance of antenna section 401 in accordance with the bit (0 or 1) included in the bit string constituting the received identification code. Specifically, when each bit is “1”, the impedance is set to a first value, and when each bit is “0”, the impedance is set to a second value. As a result, the amplitude and phase of the radio wave re-emitted from the antenna unit 401 can be changed, and the change in the amplitude and phase allows information to be changed. Can be transmitted.
- the input / output unit 407 writes information to or reads information from the memory unit 408 under the control of the control unit 405.
- the antenna unit 401 is a receiving antenna, receives a radio wave, converts the received radio wave into a power signal, and outputs the power signal to the demodulation unit 402 and the power supply unit 404. It also reflects (re-emits) the received radio waves.
- the antenna unit 401 holds two types of impedance that can be switched, and is switched by the modulation unit 403 as described above.
- the control unit 208 receives an instruction to shoot an object from the input unit 210 (step S100), and reads out a user identifier from the information storage unit 204 (step S101). ).
- the photographing unit 202 photographs the object (step S102), and the antenna 216, the short-range communication unit 212, and the short-range communication control unit 211 acquire a tag identifier from the IC tag (step S102).
- S 103 ).
- control unit 208 transmits the read user identifier and, if acquired, the tag identifier to the server device 100 via the network (step S104).
- the control unit 101 reads the pattern image corresponding to the received user identifier and tag identifier from the information storage unit 103, and generates the absence information if the pattern image does not exist (step S105).
- the read pattern image or the absence information is transmitted to the digital camera 200 via the network (step S106).
- the control unit 208 compresses and encodes the image data obtained by the photographing by the photographing unit 202 to the image processing unit 203.
- the image processing unit 203 outputs the compression encoding instruction indicating
- the control unit 208 instructs the input / output unit 214 to write the generated compressed image data to the memory card 300, and the input / output unit 214 transmits the information to the information storage unit (step SI14).
- the compressed image data is read from 204, and the read compressed image data is written to the memory card 300 (step S115).
- the process ends.
- the control unit 208 instructs the image processing unit 203 to find a part that matches the received pattern image.
- the image processing unit 203 outputs a matching instruction indicating that matching exists in the image data obtained by shooting, and the image processing unit 203 performs a matching process.
- a matching result indicating whether there is a matching part is received (step S108).
- step S109 If the received matching result indicates that there is no matching part (step S109), the image processing unit 203 generates compressed image data (step S114), and the input / output unit 214 The compressed image data is written to the memory card 300 (Step S115). This ends the process.
- step S109 If the received matching result indicates that a matching part exists (step S109), the control unit 208 transmits a request for control information to the server 100 via the network (step S109). (S110), the control unit 101 also reads out the corresponding control information from the information storage unit 103, and reads out the additional information if the corresponding additional information exists (step S11 1). Or one piece of control information and one piece of additional information are transmitted to the digital camera 200 (step S112).
- Control unit 208 reads, analyzes, and executes the operation information included in the received control information in the order of the execution number included in the operation information. Thus, mosaic processing, image replacement, information addition, frame deletion, recording, and the like included in the read operation information are performed (step S113). Thus, the process ends.
- control unit 208 receives a data identifier for identifying the compressed image data from input unit 210 (step (Step S201), reads out the compressed image data identified by the specified data identifier from the information storage unit 204 (Step S202), and operates according to the additional information included in the read out compressed image data (Step S203).
- the output unit 214 writes the compressed image data into the memory card 300 (step S204).
- the image processing system includes a server device and a digital camera connected via a network! RU
- the server stores a pattern image, control information, and additional information corresponding to the user identifier and the tag identifier.
- the user identifier is information for identifying the user of the digital camera
- the tag identifier is an identification number unique to the IC tag held by the IC tag attached to the subject.
- the no-turn image is an image to be compared, and the control information and the additional information include operation commands for various types of image processing.
- the digital camera takes an image of a subject according to a user operation. At this time, if an IC tag is affixed to the subject, the digital camera acquires the tag identifier as well as the IC tag strength. Next, the digital camera acquires a pattern image, control information, and additional information from the server device. These pattern images, control information and additional information correspond to the user identifier and the tag identifier.
- the digital camera determines whether or not there is a portion that matches the acquired pattern image from the image data generated by shooting, and if there is a matching portion, the operation command included in the control information.
- the operation instruction is mosaic processing, apply mosaic processing to the corresponding part.
- the operation command is image replacement, the matching part is replaced with a predetermined image, or the matching part is subjected to CG processing.
- the operation command is a frame deletion, the image data is deleted.
- the digital camera writes the processed image data in the camera or on the memory card.
- the operation command is information addition, additional information is added to image data and written. If the image data to which the additional information has been added is copied to the outside of the camera, image processing is performed at this time according to the additional information.
- the object registered in advance is determined from the captured video and image, A predetermined process is performed on the object.
- the predetermined processing is, for example, mosaic processing, image replacement, and frame deletion.
- the shot subject may go out of frame.
- a predetermined process is performed on the entire image stream by determining whether or not a pattern image is included in the captured video or image. For example, if the partial force corresponding to the pattern image goes out of frame or is unclear, it does not match the pattern image and is deleted. In addition, for example, only a few frame images before and after the target object are left, and the remaining frame images are deleted. This makes subsequent organization easier.
- the digital camera transmits the user identifier or the user identifier and the tag identifier to the server device, and the server device receives and receives the user identifier or the user identifier and the tag identifier.
- the server device receives and receives the user identifier or the user identifier and the tag identifier.
- the corresponding pattern image, control information and additional information are extracted, and the extracted pattern image, control information and additional information are transmitted to the digital camera.
- the digital camera transmits the user identifier or the user identifier and the tag identifier to the server device, and the server device receives and receives the user identifier or the user identifier and the tag identifier.
- the digital camera transmits a request to transmit a pattern image, control information, and additional information to a server device, and the server device transmits all stored pattern images, control information, and additional information to a digital device. It may be transmitted to the camera.
- the server device stores the pattern image, the control information, and the additional information in association with the device identifier for identifying the digital camera.
- the digital camera transmits the device identifier to the server device, and Extracts the pattern image, control information, and additional information corresponding to the received device identifier, and extracts the extracted pattern image, control information, and additional information. May be sent to a digital camera.
- the digital camera internally stores image data generated by shooting without performing image matching and mosaic processing at the time of shooting, or compressed image data generated by compression-encoding the image data.
- the digital camera communicates with the server device to acquire a pattern image and control information, and performs image matching, mosaic processing, and the like. May be performed.
- the digital camera internally stores image data generated by shooting without performing image matching and mosaic processing at the time of shooting, or compressed image data generated by compression-coding image data.
- the digital camera has a position detection unit based on GPS (Global Positioning System), and obtains its own current position by the position detection unit, and the digital camera uses the obtained current position to execute a predetermined operation. If the digital camera determines that the digital camera is within the domain, and determines that the digital camera has been taken out of the domain, the digital camera communicates with the server device and exchanges the Noturn image and the control information. It is also possible to acquire and perform image matching and mosaic processing.
- GPS Global Positioning System
- the server device stores in advance timing information indicating a point in time at which image comparison and mosaic processing are to be performed, and transmits the stored timing information to the digital camera when a user identifier is transmitted from the digital camera.
- the digital camera may receive the timing information and perform image matching, mosaic processing, and the like in accordance with the received timing information.
- an example of the timing information is the time of shooting. Another example is generated by shooting It is time to output the obtained image data to the outside of the digital camera. Another example is when the digital camera is also brought out of a predetermined range force.
- the target of the image comparison and the mosaic processing may be not only the image data currently being photographed by the digital camera but also the image data photographed and stored before.
- the digital camera transmits the image data generated by shooting to the storage server device
- the storage server device receives and stores the image data
- the storage server device is connected to the digital camera according to the embodiment.
- image collation and mosaic processing are performed on the stored image data.
- the storage server device communicates with the server device 100 to obtain the pattern image and the control information before performing the image comparison and the mosaic processing.
- the storage server device may further have the same configuration as the server device 100, and may acquire the pattern image and the control information from inside the storage server device.
- the image data already stored before the registration of the pattern image is Image matching and mosaic processing may be performed. In this way, the portrait right of a person or the like registered as a pattern image is protected.
- the generated encrypted image data may be held only inside the digital camera. Further, the encrypted image data may be written together with the image data subjected to the image processing to the memory card in response to a request from the user. [0174] Further, it is also possible to generate one file that combines the image data subjected to the image processing and the generated encrypted image data, and write the generated file to the memory card! / ⁇ It is not necessary to encrypt the entirety of the image data generated by shooting, but to encrypt only the portion corresponding to the pattern image out of the image data to generate encrypted partial image data. The generated encrypted data may be stored.
- a single file may be generated by integrating the image data subjected to the image processing and the generated encrypted partial image data, and the generated file may be written to the memory card. At this time, information indicating the position of a portion corresponding to the pattern image in the image data may be stored in the file.
- the encryption key is divided into a high-order bit partial key and a low-order bit partial key, and two devices or two recording media of two different parties or two different organizations, respectively. It is recorded in! / ⁇ The encryption key is reproduced only when both the upper bit partial key and the lower bit partial key recorded on each device or recording medium are prepared, and only then, using this encryption key. Then, the image data is obtained by decrypting the encrypted image data.
- the digital camera accepts input of a registration password, and stores the accepted registration password internally.
- the digital camera requests the user to enter a password for authentication, accepts the password for authentication, and the password for registration stored internally matches the received password for authentication.
- the digital camera can shoot the person himself.
- the above-mentioned authentication of the individual is not limited to the password.
- a digital camera pre-stores the fingerprint and iris characteristic information of the person in advance, requests input of the fingerprint and iris at the time of photographing, and stores the input fingerprint and iris characteristic information in advance. Authentication may be performed by comparing the feature information with the user.
- camera identification information for identifying a digital camera is registered in the server device in advance, and the digital camera inquires at the time of shooting whether or not the digital camera is registered in the server device. Image collation and mosaic processing may not be performed. Conversely, a registered digital camera may perform image matching and mosaic processing.
- the digital camera inquires of the server device to acquire the pattern image and the control information every time an image is captured.
- the present invention is not limited to this.
- all or part of all stored pattern images, control information, additional information, user information tables, and the like are periodically transmitted from the server device to the digital camera. , Receive and store them.
- a digital camera acquires a pattern image and control information from inside without requesting information from a server device at the time of photographing, and performs image matching and mosaic processing using the acquired pattern image and control information. Do.
- the traffic volume between the digital camera and the server device can be reduced, and the load on the server device can be reduced.
- the digital camera may temporarily record therein image data generated by shooting, and periodically transmit the recorded image data to the server device.
- Server device The data is received, and the received image data is recorded therein.
- the server device acquires the pattern image and the control information from the inside, and performs image matching, mosaic processing, and the like using the acquired pattern image and the control information.
- the digital camera may perform image matching, mosaic processing, and the like only when used in a specific location, when capturing a specific subject, or when a specific user operates.
- the digital camera does not perform image matching, mosaic processing, and the like, generates only image data by performing photographing, and transmits the image data to the server device.
- the server device is the same as the digital camera of the above embodiment.
- the image data may be subjected to image matching and mosaic processing.
- this digital camera is a live camera that shoots a subject at all times or at regular intervals, and transmits image data obtained by shooting to a server device. I do.
- the server device may receive the image data, and perform image collation and mosaic processing on the received image data. Thereafter, the server device distributes the image data on which the mosaic processing and the like have been performed to another device such as a personal computer via a network, for example, the Internet.
- the digital camera generates an image data by photographing a subject, transmits the image data to the server device, and the server device receives the image data and accumulates the received image data.
- the server device is thus used for storing image data.
- the digital camera receives the image data specified by the user by the user's operation, and performs the image matching and the mosaic processing on the received image data in the same manner as in the above embodiment. You can do it ⁇ .
- the additional information is added to the image data.
- the additional information may be embedded in the image data by using a digital watermark technique.
- the pattern image is enlarged by 1.5 times the area ratio to generate an enlarged pattern image, and the image generated by shooting The data may be compared with the generated enlarged pattern image. Also, It is also possible to reduce the turn image to 0.75 times the area ratio to generate a reduced image and compare the reduced image with the screen data.
- the comparison between the screen data and the pattern image, the comparison between the screen data and the enlarged pattern image, and the comparison between the screen data and the reduced pattern image may be performed simultaneously.
- the enlargement ratio and the reduction ratio may be changed to different ones.
- the comparison with the above-described enlarged pattern image and reduced pattern image may be combined. That is, even if the comparison of the screen data with the pattern image, the comparison of the screen data with the enlarged pattern image, the comparison of the screen data with the reduced pattern image, and the comparison of the screen data with the partial pattern image are performed simultaneously. Good.
- the partial pattern image may be enlarged or reduced to generate an enlarged partial pattern image and a reduced partial pattern image, and the generated enlarged partial pattern image and reduced partial pattern image may be used for comparison.
- the pattern image may include information indicating the position of the partial pattern image to be extracted in advance.
- the pattern image strength is also obtained by extracting the information, a partial pattern image is specified by the extracted information, and the specified partial pattern image is used in comparison.
- pixels may be extracted from the image data every two pixels to generate extracted image data, and pixels may be extracted from the pattern image every two pixels to generate an extracted pattern image. Further, intervals for taking out pixels may be provided.
- the degree of matching thus obtained may be linked to the size at the time of performing the above-described mosaic processing. For example, when the degree of matching is high, the size of the mosaic processing may be increased, and when the degree of matching is low, the size of the mosaic processing may be reduced.
- This method can also be applied when performing CG processing.
- the first CG data including many drawing commands and the second CG data including fewer drawing commands are prepared.
- the degree of matching is high, the first CG data is used. If the degree of coincidence is low, the CG processing may be performed using the second CG data.
- the CG data includes drawing commands for drawing a line segment, a straight line, a circle, a point, and the like. These drawing commands overwrite the original image, and It does not include the drawing command that fills the entire area to be drawn. Thereby, the same effect as the mosaic processing can be obtained.
- the additional information may include an instruction indicating processing such as mosaic processing, image replacement, frame erasure, etc., in association with usage control information such as the number of duplications and duplication period, or may correspond to usage control information.
- usage control information such as the number of duplications and duplication period, or may correspond to usage control information.
- detailed information of each process may be included.
- the number of duplications refers to the number of times that the compressed image data stored in the information storage unit 204 is copied to the memory card 300
- the duplication period is the compression period stored in the information storage unit 204. This is the time limit during which copying of image data to the memory card 300 is permitted.
- the compressed image data stored in the information storage unit 204 is copied to the memory card 300.
- the digital camera 200 performs corresponding processing on the compressed image data in accordance with the usage control information included in the additional information added to the compressed image data and the operation command indicating each processing.
- the additional information 153 shown in FIG. 21 is an example in which the same processing is associated with different numbers of copies, and the additional information 154 shown in FIG. This is an example.
- the additional information 155 shown in FIG. 23 is an example in which the same processing is associated with different duplication periods, and the additional information 156 shown in FIG. This is an example of being associated.
- the additional information 157 shown in Fig. 25 is an example of the above-mentioned mixed type, in which different processing is associated with different duplication periods and duplication periods.
- the additional information 153 to 157 is used as range information indicating a region after matching with a pattern image is performed, a partial image that matches the pattern image is detected, and a region to be processed is determined. Is overwritten.
- range information ((9999,9999)-(9999,9999)) as shown in FIG. 9 is written in the additional information 153 to 157.
- the additional information in which the range information ((9999,9999)-(9999,9999)) is written is stored in the server device 100.
- the digital camera 200 acquires, from the server device 100, additional information in which range information ((9999,9999)-(9999,9999)) is written, as described in the above embodiment.
- the range information indicating the area is overwritten on the additional information.
- additional information 153 to 157 is obtained.
- the additional information 153 shown in FIG. 21 includes the same processing instruction in association with three different types of duplication times.
- the additional information 153 includes an operation command indicating a mosaic process.
- the additional information 153 includes range information ((010,010)-(020,020) and size (1) as detailed information in association with the range of the number of times of copying (1 to 4 times). 5 to 10 times), including range information ((010,010)-(020,020) and size (3) as detailed information.
- the range information ((000,000)-(999,999) and the size (5) are included as detailed information in association with the range (11 times or more).
- the range information ((000,000)-(999,999)) It shows the entire range.
- the digital camera 200 stores, in the information storage unit 204, the cumulative number of times that the compressed image data stored in the information storage unit 204 before the current time and indicating the number of times the compressed image data has been copied to the memory card 300. I remember.
- the control unit 208 of the digital camera 200 uses the additional information 153 added to the compressed image data from the operation command and detailed information. Is read, and then the number of comparisons obtained by adding “1” to the cumulative number of times stored in the information storage unit 204 is included in the detailed information in the range of the number of times of duplication of deviation. to decide.
- control unit 208 sends the range information ((010,010)-(020,020) >> and size (1) are output to the image processing unit 203, and the image processing unit 203 operates according to the received operation instruction, range information, and size.
- control unit 208 transmits the range information together with the operation instruction indicating the mosaic processing.
- control unit 208 transmits the range information together with the operation instruction indicating the mosaic processing.
- the image processing unit 203 ((000,000)-(999,999) and the size (5) are output to the image processing unit 203, and the image processing unit 203 operates according to the received operation command, range information, and size. Since the surrounding information ((000,000)-(999,999)) indicates the entire range of the image, the image processing unit 203 performs a mosaic process with a size (5) on the entire range of the image.
- Control unit 208 overwrites the number of comparisons with the cumulative number of times stored in information storage unit 204.
- the additional information 154 shown in FIG. It contains three different types of processing instructions.
- the additional information 154 includes an operation instruction indicating the mosaic processing in association with the range of the number of times of duplication (1 to 4 times), and includes range information ((010,010)-(020,020) and size) as detailed information.
- it includes an operation instruction indicating image replacement in association with the range of the number of times of duplication (5 to 10 times), and includes range information ((010,010)-(020,020 >> and CG data) as detailed information.
- the digital camera 200 stores the cumulative number in the information storage unit 204.
- the control unit 208 of the digital camera 200 uses the additional information 154 added to the compressed image data to execute the operation command and detailed information. Is read, and then the number of comparisons obtained by adding “1” to the cumulative number of times stored in the information storage unit 204 is included in the detailed information in the range of the number of times of duplication of deviation. to decide.
- the control unit 208 sends the range information ((010,010)-(020,020) together with the operation instruction indicating the mosaic processing.
- >> and the size (3) are output to the image processing unit 203, and the image processing unit 203 operates according to the received operation instruction, range information, and size.
- control unit 208 determines that the comparison count is included in the range of the copy count (5 to 10 times), the control unit 208 transmits the range information ((010,010)-(020,020)) together with an operation instruction indicating image replacement.
- the CG data identifier (CG009) is output to the image processing unit 203, and the image processing unit 203 operates according to the received operation command, range information, and CG data identifier.
- control unit 208 when determining that the number of comparisons is included in the range of the number of times of copying (11 or more times), the control unit 208 outputs an operation instruction indicating frame deletion to the image processing unit 203.
- the image processing unit 203 operates according to the received operation command.
- the control unit 208 overwrites the number of comparisons with the accumulated number of times stored in the information storage unit 204.
- the additional information 155 includes an operation command indicating a mosaic process.
- the additional information 153 includes range information ((010,010)-(020,020) and size (1) as detailed information in association with the duplication period (2005.10.01 to 2005.10.31), and the duplication period (2005.11. .01 to 2005.11.30), including range information ((010,010)-(020,020)) and size (3) as detailed information, and detailed information in association with the duplication period (2005.12.01-)
- range information ((010,010)-(020,020)) and size (1) as detailed information in association with the duplication period (2005.12.01-)
- range information ((010,010)-(020,020) and size (1) as detailed information in association with the duplication period (2005.10.01 to 2005.10.31), and the duplication period (2005.11. .01 to 2005.11.30), including range information ((010,010)-(020,020)) and size (3) as detailed information, and
- the control unit 208 of the digital camera 200 acquires the current date and time and adds the current date and time to the compressed image data.
- the operation command and the detailed information are read from the information 155, and it is determined which of the duplication periods in the detailed information includes the current date and time obtained next.
- control unit 208 transmits the range information together with the operation instruction indicating the mosaic processing.
- control unit 208 determines that it is included in the current date and time duplication period (2005.11.01 to 2005.11.30), the control unit 208 transmits the range information together with the operation instruction indicating the mosaic processing.
- the control unit 208 transmits the range information ((000,000)-(999,999)) and the size together with the operation instruction indicating the mosaic processing.
- (5) is output to the image processing unit 203, and the image processing unit 203 operates according to the received operation command, range information, and size.
- the image processing unit 203 Since ((000,000)-(999,999) indicates the entire range of the image, the image processing unit 203 performs a mosaic process with the size (5) on the entire range of the image.
- the additional information 156 shown in FIG. 24 includes three different types of processing instructions in association with three different types of duplication periods. Specifically, the additional information 156 includes an operation instruction indicating the mosaic processing in association with the duplication period (2005.10.01 to 2005.10.31), and includes range information as detailed information.
- the control unit 208 of the digital camera 200 acquires the current date and time and adds the current date and time to the compressed image data.
- the operation command and the detailed information are read from the information 156, and then it is determined which of the duplication periods in the detailed information includes the obtained current date and time.
- control unit 208 transmits the range information together with an operation instruction indicating image replacement.
- CG009 CG data identifier (CG009) are output to the image processing unit 203, and the image processing unit 203 operates according to the received operation command, range information, and CG data identifier. I do.
- control unit 208 outputs an operation instruction indicating frame deletion to the image processing unit 203, and The unit 203 operates according to the received operation command.
- the additional information 157 shown in FIG. 25 includes three different types of processing instructions in association with three different types of duplication times and duplication periods.
- the additional information 157 includes an operation instruction indicating the mosaic processing in association with the range of the number of times of duplication (1 to 4 times), and includes range information ((010,010)-(020,020) and size information as detailed information). (3). Also includes an operation instruction indicating image replacement in association with the range of the number of times of copying (5 to 10 times), and includes range information ((010,010)-(020,020 >>) and CG data identifier (CG009) as detailed information. In addition, it includes an operation command indicating frame erasure in association with the duplication period (2005.12.01-).
- the digital camera 200 stores the cumulative number in the information storage unit 204.
- the control unit 208 of the digital camera 200 acquires the current date and time, and adds additional information 157 added to the compressed image data. Then, the operation instruction and the detailed information are read out, and then the number of comparisons obtained by adding “1” to the cumulative number stored in the information storage unit 204 is within the range of any of the number of duplications in the detailed information. It is determined whether it is included, and whether the obtained current date and time is included in the duplication period in the detailed information.
- the control unit 208 sends the range information ((010,010)-(020,020) together with the operation instruction indicating the mosaic processing.
- >> and the size (3) are output to the image processing unit 203, and the image processing unit 203 operates according to the received operation instruction, range information, and size.
- control unit 208 determines that the comparison count is included in the range of the copy count (5 to 10 times), the control unit 208 transmits the range information ((010,010)-(020,020)) together with an operation instruction indicating image replacement.
- the CG data identifier (CG009) is output to the image processing unit 203, and the image processing unit 203 operates according to the received operation command, range information, and CG data identifier.
- control unit 208 when it is determined that the current date and time is included in the duplication period (2005.12.01 or later), the control unit 208 outputs an operation instruction indicating frame deletion to the image processing unit 203, The image processing unit 203 operates according to the received operation command.
- the range information replaced with the range information respectively corresponds to the server device. 100
- the digital camera 200 performs matching with the pattern image, detects a partial image that matches the pattern image, and determines the area to be subjected to each processing. Will be overwritten. As a result, as shown in Figs. 21 to 25, If additional information can be obtained.
- the information overwritten in the additional information is not limited to the above range information.
- the range of the number of duplications and the duplication period included in the additional information shown in FIGS. 21 to 25 may be overwritten by the digital camera 200 even if they are overwritten! /.
- the duplication period (X1 to X2) , (X3 to X4) and (X5 to;).
- X1 to X5 are character strings indicating that the respective dates are not fixed.
- the control unit 208 of the digital camera 200 When copying the compressed image data stored in the information storage unit 204 to the memory card 300, the control unit 208 of the digital camera 200 obtains the current date and time, and then obtains , X1 to X5 are calculated.
- control unit 208 writes the calculated date in a position corresponding to each duplication period.
- the image replacement command is displayed on a part of the image data (or the immediately preceding image data, that is, the image data on which other processing has been performed) obtained by photographing with the digital camera. It may be an instruction to change the size or orientation of an object (ie, a person or a building). Further, the instruction may be a command for adjusting the color tone of the portion, for example, a command for changing brightness or contrast or performing two gradations.
- control information and the additional information are computer programs, and each operation information is a computer instruction in a machine language format. Is not limited.
- control information and the additional information may be configured as a sequence information including control information corresponding to the above-described mosaic processing, recording, image replacement, frame deletion, and the like.
- Digital camera power The camera is installed so that the area around the entrance of an apartment building (apartment) is photographed.
- This digital camera is provided for crime prevention, and the image data generated by this digital camera is analyzed, for example, when a crime such as theft occurs in an apartment building, and the criminal is arrested.
- the images obtained by the digital camera also show residents of the apartment house, and such image data may violate the privacy rights of the residents of the apartment house! / There's a problem.
- Security service providers provide camera-based security services to multiple apartment buildings.
- the digital camera 200a is installed on the upper inside of the entrance of a certain apartment house so as to photograph the door direction of the entrance.
- the digital camera 200a repeatedly photographs the direction of the door repeatedly, specifically, once every five seconds, and records the image data obtained by the photographing inside.
- digital camera 200b is installed in another apartment house in the same manner as digital camera 200a, and operates in the same manner as digital camera 200a. Further, other digital cameras are similarly installed in yet another apartment house, and the server device 100 that operates similarly is installed in the office of a security service provider.
- the information storage unit 103 of the server device 100 stores face images of all residents of all the apartment houses to which the security service provider provides the security service as pattern images 131, 132, ... I have.
- the user identifier identifies an apartment house. In other words, users are responding to apartments.
- the control information 141 stored in the information storage unit 103 of the server device 100 is an example. As shown in FIG. 4, it is composed of a mosaic processing instruction and a recording instruction.
- the detailed information corresponding to the mosaic processing instruction includes the condition “pattern image match”, and the size of the mosaic block is “5”.
- the recording instruction a memory card is specified as a recording destination.
- control information 141 When the control information 141 is executed, if it is determined that a part of the image data obtained by photographing with the digital camera 200a matches the pattern image (that is, the face photograph of the inhabitants), the part of the image data is determined. A mosaic processing instruction with a block size of “5” is executed for the face of the inhabitant (that is, the face of the inhabitants), and then the mosaiced image data is written to the memory card.
- the image data is recorded as it is without performing mosaic processing. In this way, it is possible to achieve both protection of the privacy rights of residents and security functions.
- the present invention is not limited to the mosaic processing.
- the face of the resident may be replaced by another image, or the image of the resident may be deleted and the image data may be deleted.
- the force that the security service provider provides the above security service to a plurality of apartment houses is not limited to this.
- the digital cameras 200a and 200b and the server device 100 are installed in one apartment house, and the image processing system 10 provides the above-described security service only for the one apartment house. It may be provided ⁇ .
- a system LSI is a super-multifunctional LSI manufactured by integrating multiple components on a single chip.
- a system LSI is a computer system that includes a microprocessor, ROM, RAM, etc. .
- the RAM stores a computer program.
- the microprocessor operates according to the computer program, the system LSI achieves its function.
- each part of the constituent elements constituting each of the above devices may be individually integrated into one chip, or may be integrated into one chip so as to include part or all.
- LSI is used, but depending on the degree of integration, it can also be called IC, system LSI, super LSI, or ultra LSI.
- the method of circuit integration is not limited to LSI, but may be realized by a dedicated circuit or a general-purpose processor.
- Programmable FPGA Field
- a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside a programmable gate array (LSI) or LSI.
- a part or all of the constituent elements of each of the above devices may be configured as an IC card detachable to each device or a single module.
- the IC card or the module is a computer system including a microprocessor, a ROM, a RAM, and the like.
- the IC card or the module may include the above super multifunctional LSI.
- the microprocessor operates according to the computer program, the IC card or the module achieves its function. This IC card or this module may have tamper resistance!
- the present invention may be the method described above.
- these methods are
- the program may be a computer program realized by a computer, or may be a digital signal having the above-mentioned computer program power.
- the present invention provides a computer-readable recording medium capable of reading the computer program or the digital signal, for example, a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, BD (Blu-ray Disc), semiconductor memory, etc. Further, the present invention may be the computer program or the digital signal recorded on the recording medium.
- the computer program or the digital signal may be transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, or the like.
- the present invention may be a computer system including a microprocessor and a memory, wherein the memory stores the computer program, and the microprocessor operates according to the computer program.
- Each device constituting the image processing system of the present invention is used business-wise, repetitively, and continuously in an industry that uses image data obtained by photographing.
- each device is used in the electrical equipment manufacturing industry for management, repetitive and continuous use by being produced and sold.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Computer Security & Cryptography (AREA)
- Studio Devices (AREA)
- Processing Or Creating Images (AREA)
- Television Signal Processing For Recording (AREA)
- Closed-Circuit Television Systems (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006513578A JP4795941B2 (ja) | 2004-05-18 | 2005-05-16 | 画像処理装置 |
EP05739130A EP1748642A1 (en) | 2004-05-18 | 2005-05-16 | Image processing apparatus |
US11/579,869 US8077980B2 (en) | 2004-05-18 | 2005-05-16 | Image processing apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004147396 | 2004-05-18 | ||
JP2004-147396 | 2004-05-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005112438A1 true WO2005112438A1 (ja) | 2005-11-24 |
Family
ID=35394524
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2005/008866 WO2005112438A1 (ja) | 2004-05-18 | 2005-05-16 | 画像処理装置 |
Country Status (5)
Country | Link |
---|---|
US (1) | US8077980B2 (ja) |
EP (1) | EP1748642A1 (ja) |
JP (1) | JP4795941B2 (ja) |
CN (1) | CN1954592A (ja) |
WO (1) | WO2005112438A1 (ja) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007104149A (ja) * | 2005-09-30 | 2007-04-19 | Fuji Xerox Co Ltd | 監視システム |
JP2009083211A (ja) * | 2007-09-28 | 2009-04-23 | Oki Data Corp | 画像形成装置 |
JP2009522679A (ja) * | 2006-01-06 | 2009-06-11 | ノキア コーポレイション | キャプチャされたコンテンツを管理するためのシステム及び方法 |
JP2009194439A (ja) * | 2008-02-12 | 2009-08-27 | Canon Inc | 撮像装置、画像処理装置、撮像装置の制御方法、画像処理方法、プログラム及び記憶媒体 |
JP2009302887A (ja) * | 2008-06-13 | 2009-12-24 | Kyocera Mita Corp | 情報秘匿化方法および情報秘匿化装置 |
JP2010016544A (ja) * | 2008-07-02 | 2010-01-21 | Nikon Corp | 撮像装置および画像処理装置、並びに画像処理プログラム |
JP2011510521A (ja) * | 2007-09-12 | 2011-03-31 | ディジセンサリー・テクノロジーズ・プロプライアタリー・リミテッド | チップ上スマート・ネットワーク・カメラ・システム |
JP2016208128A (ja) * | 2015-04-16 | 2016-12-08 | パナソニックIpマネジメント株式会社 | 事件映像ログデータ生成装置、事件映像処理システム、事件映像ログデータ生成方法、及びプログラム |
CN110969167A (zh) * | 2018-09-29 | 2020-04-07 | 北京利络科技有限公司 | 一种实时图像处理分析方法 |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4690785B2 (ja) * | 2005-06-09 | 2011-06-01 | 株式会社リコー | 画像形成装置、記録媒体 |
US8234502B2 (en) | 2008-08-29 | 2012-07-31 | International Business Machines Corporation | Automated password authentication |
KR101297720B1 (ko) * | 2008-09-25 | 2013-08-26 | 삼성전자주식회사 | 스캐너, 이를 포함하는 화상형성장치, 스캐너의 이미지 처리방법 및 화상형성장치의 인쇄방법 |
KR20110047398A (ko) * | 2009-10-30 | 2011-05-09 | 삼성전자주식회사 | 영상제공시스템 및 그 영상제공방법 |
JP5435142B2 (ja) * | 2010-09-30 | 2014-03-05 | 富士通株式会社 | 画像暗号化システムおよび画像復号システム |
US9591149B2 (en) * | 2012-04-30 | 2017-03-07 | Qualcomm Incorporated | Generation of a combined image of a presentation surface |
US20140168396A1 (en) * | 2012-12-18 | 2014-06-19 | General Electric Company | Method for viewing contents of a refrigerator appliance |
WO2014173588A1 (en) * | 2013-04-22 | 2014-10-30 | Sony Corporation | Security feature for digital imaging |
US10545092B2 (en) | 2016-11-07 | 2020-01-28 | Alarm.Com Incorporated | Automated optical device monitoring |
CN107329845B (zh) * | 2017-07-05 | 2020-10-16 | 武汉斗鱼网络科技有限公司 | 图像处理方法、装置、终端及服务端 |
JP7030534B2 (ja) | 2018-01-16 | 2022-03-07 | キヤノン株式会社 | 画像処理装置および画像処理方法 |
CN111031348B (zh) * | 2019-12-11 | 2022-03-15 | 浙江宇视科技有限公司 | 一种视频加扰方法、装置、服务器和存储介质 |
JP2021190780A (ja) * | 2020-05-27 | 2021-12-13 | 富士フイルムビジネスイノベーション株式会社 | 情報処理装置及びプログラム |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000278584A (ja) * | 1999-03-19 | 2000-10-06 | Minolta Co Ltd | 画像処理機能を備えた画像入力装置および画像処理プログラムを記録した記録媒体 |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6456729B1 (en) * | 1994-04-14 | 2002-09-24 | Lewis J. Moore | Anti-counterfeiting and tracking system |
US6628824B1 (en) * | 1998-03-20 | 2003-09-30 | Ken Belanger | Method and apparatus for image identification and comparison |
US6765608B1 (en) * | 1999-03-09 | 2004-07-20 | Minolta Co., Ltd. | Image processing apparatus and system executing predetermined image processing on image data shot by camera, and image recording medium recorded with image processing program |
JP3548096B2 (ja) * | 1999-04-14 | 2004-07-28 | インターナショナル・ビジネス・マシーンズ・コーポレーション | 改変判定装置およびその方法 |
JP2001086407A (ja) * | 1999-09-17 | 2001-03-30 | Matsushita Electric Ind Co Ltd | モザイク機能付きの撮像装置およびモザイク処理装置 |
JP3678404B2 (ja) | 2000-05-12 | 2005-08-03 | 株式会社東芝 | 映像情報処理装置 |
JP2002182275A (ja) | 2000-12-19 | 2002-06-26 | Konica Corp | 写真撮影許可機能付きカメラ、写真撮影許可システム及び写真撮影許可方法 |
JP2002334097A (ja) * | 2001-02-09 | 2002-11-22 | Seiko Epson Corp | サービス提供システム、管理端末、移動体、サービス提供プログラム及びサービス提供方法 |
JP2003032616A (ja) * | 2001-07-17 | 2003-01-31 | Nhk Computer Service:Kk | 映像情報生成装置及び映像編集装置及び映像情報生成プログラム並びに映像編集プログラム |
JP2003204427A (ja) | 2002-01-08 | 2003-07-18 | Canon Inc | 情報処理装置、情報処理方法、画像データの処理方法、記憶媒体、及びプログラム |
US7076101B2 (en) * | 2002-02-14 | 2006-07-11 | Sun Microsystems, Inc. | Method and apparatus for local image quantification verification |
JP4179836B2 (ja) * | 2002-09-26 | 2008-11-12 | 富士フイルム株式会社 | 情報記録装置 |
JP2004312511A (ja) * | 2003-04-09 | 2004-11-04 | Nippon Telegr & Teleph Corp <Ntt> | 映像編集システム,園児モニタリングシステム,福祉施設モニタリングシステム,記念ビデオ作成システム,行動モニタリングシステムおよび映像編集方法 |
JP4206888B2 (ja) * | 2003-09-30 | 2009-01-14 | カシオ計算機株式会社 | 画像処理装置及びプログラム |
US7330593B2 (en) * | 2004-06-25 | 2008-02-12 | Stmicroelectronics, Inc. | Segment based image matching method and system |
-
2005
- 2005-05-16 CN CNA2005800158688A patent/CN1954592A/zh not_active Withdrawn
- 2005-05-16 JP JP2006513578A patent/JP4795941B2/ja active Active
- 2005-05-16 US US11/579,869 patent/US8077980B2/en active Active
- 2005-05-16 WO PCT/JP2005/008866 patent/WO2005112438A1/ja active Application Filing
- 2005-05-16 EP EP05739130A patent/EP1748642A1/en not_active Withdrawn
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000278584A (ja) * | 1999-03-19 | 2000-10-06 | Minolta Co Ltd | 画像処理機能を備えた画像入力装置および画像処理プログラムを記録した記録媒体 |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007104149A (ja) * | 2005-09-30 | 2007-04-19 | Fuji Xerox Co Ltd | 監視システム |
JP2009522679A (ja) * | 2006-01-06 | 2009-06-11 | ノキア コーポレイション | キャプチャされたコンテンツを管理するためのシステム及び方法 |
JP2011510521A (ja) * | 2007-09-12 | 2011-03-31 | ディジセンサリー・テクノロジーズ・プロプライアタリー・リミテッド | チップ上スマート・ネットワーク・カメラ・システム |
JP4505004B2 (ja) * | 2007-09-28 | 2010-07-14 | 株式会社沖データ | 画像形成装置 |
JP2009083211A (ja) * | 2007-09-28 | 2009-04-23 | Oki Data Corp | 画像形成装置 |
US8363839B2 (en) | 2007-09-28 | 2013-01-29 | Oki Data Corporation | Image forming apparatus |
JP2009194439A (ja) * | 2008-02-12 | 2009-08-27 | Canon Inc | 撮像装置、画像処理装置、撮像装置の制御方法、画像処理方法、プログラム及び記憶媒体 |
JP2009302887A (ja) * | 2008-06-13 | 2009-12-24 | Kyocera Mita Corp | 情報秘匿化方法および情報秘匿化装置 |
JP2010016544A (ja) * | 2008-07-02 | 2010-01-21 | Nikon Corp | 撮像装置および画像処理装置、並びに画像処理プログラム |
JP2016208128A (ja) * | 2015-04-16 | 2016-12-08 | パナソニックIpマネジメント株式会社 | 事件映像ログデータ生成装置、事件映像処理システム、事件映像ログデータ生成方法、及びプログラム |
US10026448B2 (en) | 2015-04-16 | 2018-07-17 | Panasonic Intellectual Property Management Co., Ltd. | Case video log data generating apparatus, case video processing system, and case video log data generating method |
US10573346B2 (en) | 2015-04-16 | 2020-02-25 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Case video log data generating apparatus, case video processing system, and case video log data generating method |
CN110969167A (zh) * | 2018-09-29 | 2020-04-07 | 北京利络科技有限公司 | 一种实时图像处理分析方法 |
Also Published As
Publication number | Publication date |
---|---|
US8077980B2 (en) | 2011-12-13 |
JP4795941B2 (ja) | 2011-10-19 |
EP1748642A1 (en) | 2007-01-31 |
JPWO2005112438A1 (ja) | 2008-03-27 |
US20070286496A1 (en) | 2007-12-13 |
CN1954592A (zh) | 2007-04-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4795941B2 (ja) | 画像処理装置 | |
US11155725B2 (en) | Method and apparatus for redacting video for compression and identification of releasing party | |
US7984300B2 (en) | System and method of authenicating a digitally captured image | |
US20060104483A1 (en) | Wireless digital image capture device with biometric readers | |
US7511859B2 (en) | Mobile terminal having camera for inserting watermark data into image data and method thereof | |
US20080089554A1 (en) | Device and method for digitally watermarking an image with data | |
JP2008269486A (ja) | 撮像機器及びその認証方法 | |
CN104079830B (zh) | 暗码添加方法和装置、暗码照片处理方法和装置 | |
US7400349B2 (en) | Electronic camera and image processing method | |
JP2009033738A (ja) | 撮像装置、画像ファイルのデータ構造 | |
KR101460552B1 (ko) | 프라이버시 영역의 마스킹 및 복원 방법 | |
CN104092926A (zh) | 一种数码相机及该相机的图像保密方法 | |
US20070292034A1 (en) | Device and method for digitally watermarking an image with GPS data | |
US20110125998A1 (en) | Network photographing apparatus having a partial encryption function | |
US20070242852A1 (en) | Method and apparatus for watermarking sensed data | |
WO2008048356A2 (en) | Device and method for digitally watermarking an image with gps data | |
KR100678035B1 (ko) | 휴대단말기의 촬영자 식별장치 및 방법 | |
JP4654330B2 (ja) | 映像変更装置、映像変更方法および映像変更プログラム | |
JP4105533B2 (ja) | 画像仲介システム | |
JP2009027503A (ja) | 撮像装置、改竄検出方法、および改竄検出装置 | |
JP4449717B2 (ja) | 携帯端末 | |
JP2011223109A (ja) | 撮像装置および画像ファイル生成方法 | |
JP6213238B2 (ja) | 情報処理装置、情報処理装置の制御方法、及びプログラム | |
JP2015115741A (ja) | 画像管理装置、画像管理方法およびプログラム | |
JP3792242B2 (ja) | 画像撮影装置および画像撮影方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2006513578 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 200580015868.8 Country of ref document: CN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005739130 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2005739130 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11579869 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 11579869 Country of ref document: US |