JP4561095B2 - Image photographing apparatus and program - Google Patents

Description

The present invention captures an imaging target, relates to an image capturing apparatus and a program download images.

  In recent years, electronic tags using RFID (Radio Frequency ID) or the like have become widespread instead of tags using barcodes or the like, and various management systems using electronic tags have been proposed accordingly.

For example, in Patent Document 1, when an electronic tag storing an ID with a unified data format is attached to an article or service, a new product or service is registered in a database, or various services are performed. Information is read from this electronic tag and used to register this information in a database or distributed over a network to manage goods and services.
JP 2002-150241 A (paragraphs [0009], [0046] to [0048], FIG. 1)

  As described above, various types of devices that manage articles and services using electronic tags have been proposed. However, there is no management method using an electronic tag that has been proposed at present, in which information in the electronic tag is associated with a captured image associated with a product or service to which the electronic tag is attached.

An object of the present invention is to provide a technique capable of providing information on a photographed object together with the photographed image when photographing an article or the like.
It is another object of the present invention to provide a technique for attaching an electronic tag to an article or the like and associating information read from the electronic tag with a photographed image.

The image photographing apparatus of the present invention is a mode setting means for setting a mode, a photographing means for photographing a photographing target such as an article to which an electronic tag is attached in response to the photographing operation, and in response to the photographing operation. The electronic tag information stored in the electronic tag is read, and the electronic tag reading / writing means for writing the date and time taken by the photographing means to the electronic tag, and the mode setting means is set during the photographing operation. Image storage means for storing mode information indicating a current mode, image data of an image captured by the imaging means, and electronic tag information read by the electronic tag reading means, and corresponding in the image storage means A communication interface for transmitting the mode information, image data, and electronic tag information stored together with the data to an external data processing device. The mode information is information indicating processing to be performed by the data processing apparatus.

According to the present invention, the apparatus main body is provided with an electronic tag reading unit that reads out electronic tag information as well as an imaging unit as an imaging target, and in response to the imaging operation, imaging of the imaging target and reading / writing of the electronic tag information are performed. The date and time when the image was taken is written to the electronic tag, and mode information, image data, and electronic tag information indicating the mode are stored in association with the electronic tag, so image data and electronic tag information corresponding to the mode information are stored. Can be acquired accurately, and the processing according to the mode information can be executed promptly and reliably in the external data processing apparatus transmitted via the communication interface .

An embodiment according to the present invention will be described below with reference to the drawings.
In the present embodiment, an electronic tag storing information on the product as electronic tag information is added to the product to be managed. When photographing with an image photographing device such as an electronic camera, the electronic tag information is read from the electronic tag, and the read electronic tag information and the photographed image photographed by the image photographing device are associated with each other and managed.

  Using such technology, for example, in logistics and inventory management, a returned item such as a defective product is verified, and when the location that caused the return such as a defective portion is photographed, the article that has been photographed has Various information on the product such as the serial number stored in the electronic tag is read out and stored in association with the photographed image. Then, the photographed image data is notified to the manufacturer or the trading company that wholesales the product as data for return processing.

  As a result, the reason for the return is clarified, so that the manufacturer or the like can easily check the return state of the returned article and can reliably perform the return process such as investigation of the cause. Moreover, since it can confirm with an image, possibility that an error will arise in returned goods processing decreases.

  Or, for example, a new product or a product that is focused on sales is attached with an electronic tag that records information that the manufacturer etc. wants to notify the store that handles this product as a product, such as PR for this product. So when this product arrives, you can shoot this product and read the information from the electronic tag of the product to obtain information that can be used when creating advertisements and flyers, or information such as precautions for sales. Can be obtained.

FIG. 1A is a schematic diagram of an image photographing apparatus used for commodity photographing in the present embodiment.
The image photographing apparatus 1 shown in the figure is characterized in that a tag reader / writer 2 and a mode switch 6 are provided.

  Of these, the mode switch 6 switches a purchase mode, a return mode, and a mode OFF, which will be described later. When the mode switch 6 is set to the purchase mode or the return mode, an electronic tag in the electronic tag of the object to be photographed is set. When the tag information is read and stored and managed together with the photographed image, and the mode switch 6 is OFF, the image photographing device 1 does not read out the electronic tag information and does not read out the normal image such as a camera. Functions as a photographing device.

  The tag reader / writer 2 reads electronic tag information from the electronic tag and writes information. Note that the tag reader / writer 2 communicates by radio waves only with the electronic tag possessed by the subject to be photographed by the image photographing device 1, so that it transmits and receives radio waves having directivity in the direction in which the photographing lens 3 faces. It is configured.

FIG. 1B shows an example of a transmission / reception antenna provided in the tag reader / writer 2.
The transmission / reception antenna 21 shown in FIG. 1 has directivity by covering the opposite side and both left and right sides of the direction of the photographic lens 3 with a shield plate 22. It is configured to transmit and receive radio waves. Note that the configuration of the antenna in the figure is merely an example, and directivity may be given by another configuration. Further, an object may be specified by providing an antenna in the vicinity of the photographing lens 3, increasing directivity by using a transmission / reception radio wave in a high frequency band such as a short wave band or a microwave band, or measuring an electric field strength. Good.

  In the image photographing apparatus 1 in FIG. 1A, when the shutter button 5 is pressed halfway with the mode switch 6 set to the purchase mode or the return mode, the tag reader / writer 2 faces the photographing lens 3. A radio wave is transmitted in the direction in which the electronic tag is attached, a response radio wave is received from the electronic tag attached to the article, and the obtained electronic tag information is stored. This information is displayed on a display unit (not shown) together with a through image taken by the photographing lens 3. When the shutter button 5 is fully pressed in this state, an image is captured and photographed, and the photographed image and electronic tag information read from the electronic tag are associated and stored.

FIG. 2 is a block diagram illustrating an internal configuration example of the image capturing apparatus 1 of FIG.
In the example of the figure, the image capturing apparatus 1 includes an A / D converter 13, an image processing unit 15, an input / output control unit 16, an image processing memory 19, an electronic tag memory 20, an image memory 23, a communication interface 24, a memory. The card interface 25 and the tag reader / writer 27 are connected by a bus line 28 and configured to exchange data with each other via the bus 28.

  The lens 10 includes an optical lens made of glass or plastic and a driving device thereof, and is driven in the optical axis direction according to a control instruction from the photographing control unit 14 to perform focusing or realize a zoom function. The CCD 11 converts an optical signal into an electric signal, photoelectrically converts an optical image of a subject formed through the lens 10 and outputs an analog imaging signal corresponding to the optical image of the subject. The imaging process 12 amplifies an analog signal input from the CCD image recording apparatus 11 when a control instruction is issued from the imaging control unit 14, samples it, and outputs it to the A / D converter 13. The A / D converter 13 converts the analog signal input from the imaging control unit 14 into a digital signal. The shooting control unit 14 controls image shooting processing by the image shooting apparatus 1, and executes a program stored therein to control the lens 10 to realize focusing and zoom functions, or the CCD 11. In addition, a shooting function such as controlling the imaging process 12 and recording the captured image in the image memory is realized. The image processing unit 15 performs image processing in consideration of various shooting conditions set in advance on the output from the A / D converter 15 when shooting, and then performs compression processing to perform shooting. Generate image data of an image. Further, the image processing unit 15 generates image data of an image obtained by combining the product information in the electronic tag memory 20 with the image data of the through image output from the A / D converter 15 in the image processing memory 19.

  The input / output control unit 16 executes a program stored therein to display various processes in response to an input instruction from the input unit 17 by the user, a through image displayed on the display unit 18 and various information displays. Process control is performed. The input unit 17 is a switch or the like for a user to input an operation, and includes a plurality of operation keys such as a shutter button, a power key, a mode selection key, a cross key, and an enter key. A key input signal corresponding to the key operation is output to the input / output control unit 16. The display unit 18 includes a color LCD and a driving circuit thereof, and displays a subject image captured by the CCD 11 as a through image, or displays a captured image stored in the image memory 23 or a memory card. The image processing memory 19 is a memory for storing image data that has been subjected to image processing by the image processing unit 15, and the input / output control unit input / output control unit 16 performs display by the display unit 18 based on the image data in the memory. Or the image data of the photographed image is stored in the image memory 23. The electronic tag memory 20 is a memory for storing information read from the electronic tag by the tag reader / writer 27. The image memory 23 is a memory in which data of a plurality of photographed images photographed by the image photographing device 1 is stored. The communication interface 24 is an interface for transferring data by connecting to a data processing device or the like, which will be described later. The memory card interface 25 is an interface for mounting a memory card for storing image data. Based on a user instruction, the input / output control unit 16 mounts image data in the image memory 23 on the memory card interface 25. Transfer to memory card. The timer 26 measures the date and time, and the input / output control unit 16 sets the date and time counted by the timer 26 as the system date and time.

  The tag reader / writer 27 accesses the electronic tag according to an instruction from the input / output control unit 16, and includes a control unit 271, a memory 272, a transmission / reception unit 273, and an antenna 274.

  When there is an instruction to read / write the electronic tag from the input / output control unit 16, the control unit 271 transmits radio waves to the transmission / reception unit 273, converts the radio waves received as a response into digital data by the transmission / reception unit 273, and then stores them in the memory 272. Remember. When the input / output control unit 16 requests data read from the electronic tag, the control unit 271 transfers the data stored in the memory 272 to the electronic tag memory 20.

  FIG. 3 is a diagram illustrating a configuration example of the electronic tag information stored in the electronic tag added to the object to be photographed by the image photographing device 1 and readable by the tag reader / writer 27.

  In the electronic tag, an ID code 31 and product information 32 are stored as electronic tag information. When receiving the radio wave from the tag reader / writer 27 of the image capturing apparatus 1, the electronic tag returns the ID code 31 and the product information 32 as a response.

  The ID code 31 is an identifier that uniquely identifies each electronic tag. The product information 32 indicates various information about the article to which the electronic tag is attached. The product information 32 identifies the product such as the product name, model number, and manufacturing number, and the performance, advertisement, handling method, etc. Product information such as precautions is stored in the electronic tag as product information 32. In this embodiment, when an article to which an electronic tag is added is photographed by the image photographing apparatus 1, product information 32 is stored together as additional information of the photographed image.

  The product information is not stored as it is but the information (IP address, URL, etc.) indicating the location on the network where these pieces of information are stored is stored and a flyer is created. Alternatively, the information may be read out and displayed together via a network.

The ID code 31 may also serve as product specifying information by adding a number corresponding to the product number or product name to the ID code 31.
FIG. 4 is a diagram illustrating a configuration example of data regarding a captured image stored in the image memory 23.

  The image memory 23 stores data on a plurality of captured images captured by the image capturing apparatus 1. This data includes image information and electronic tag information. Image information, which is information about a captured image captured by the image capturing apparatus 1, is associated with the electronic tag information read from the electronic tag in the image memory 23. Remembered.

  The data in the image memory 23 is read into a data processing apparatus that manages logistics and inventory via a memory card mounted on the memory card interface 25 or is sent by network communication through the communication interface 24. It is done. This data is recorded and managed in a database as management information on the data processing device.

  In the configuration example of FIG. 4, the data for one captured image includes the image data 41 of the captured image, such as JPEG, as attribute information 42, the shooting date and time, shooting settings (white balance, shutter speed, aperture, etc.), etc. Is remembered. When the mode switch 6 is set to the purchase mode or the return mode at the time of shooting, the attribute information 42 includes an identifier of the electronic tag generated from the ID code read from the electronic tag.

  The electronic tag information includes an identifier 43 generated from the ID code, a setting mode when the electronic tag information is read out, mode information (stocking mode / return mode) 44, and an electronic tag read out from the electronic tag. The product identification information (product name, model number, serial number, etc.) 45 for identifying the product being stored and the product information 46 which is the information desired to be notified to the above-mentioned store are stored, and the electronic tag information and the image information are The identifier in the attribute information 42 is associated with the identifier 43.

  The data in the image memory 23 stored in such a data structure is read into the data processing device of the store through the memory card mounted on the memory card interface 25 and the communication interface 24. When a captured image is displayed based on this data, the corresponding information in the product information 46 is also displayed together with the captured image. This data is registered in each database as a record of purchases and returns.

FIG. 5 is a diagram illustrating a configuration example of a data processing device used in the present embodiment.
The data of the photographed image photographed by the data processing device 1 is used for purchase and return processing by a data processing device provided at a store that handles the product to be photographed.

  In the figure, the data processing apparatus includes a CPU 51, an input / output unit 52, a medium driving unit 53, a ROM 54, a RAM 55, an external interface 56, and a hard disk 57, which are connected by a bus 58 and exchange data with each other. ing.

  The CPU 51 implements processing for captured image data, which will be described later, by executing programs and data stored in the ROM 54, RAM 55, and hard disk 57. The input / output unit 52 is a device serving as a man-machine interface with the user, a device such as a keyboard or a pointing device for a user to input instructions, and a device for outputting a processing result by a data processing device such as a display or a printer to the user. Have The medium drive unit 53 accesses a portable storage medium such as a magnetic tape, a flexible disk, a CD-ROM, or an MO. Further, the medium driving unit 53 reads out data of a captured image captured by the image capturing apparatus 1 from the memory card. The ROM 54 is a nonvolatile read-only memory and stores a basic program such as BIOS. The RAM 55 is a volatile memory and is mainly used as a work area for the CPU 51. The external interface 56 is an interface connected to an external device such as the image capturing device 1 or a printer, and the data processing device exchanges data with the external device via the external interface 56. The hard disk 57 is a large-capacity nonvolatile memory that stores programs executed by the CPU 51 and data processed by the CPU 51.

  The hard disk 57 stores the inventory management data, the return data, and the purchase data as a database and stores them as an inventory management database 571, a return database 572, and a purchase database 573.

  The inventory management database 571 manages the inventory of products handled at a store, and records and manages information about the product name, supplier, number of stocks, etc. of each product handled at this store in a database. ing. The returned goods database 572 manages merchandise that has been handled as returned goods due to defects or the like, and includes information such as a photographed image taken at the time of return, product identification information such as a serial number read from the electronic tag, and photographing date and time (return date and time). It is recorded and managed as a database. The purchase database 573 stores information about products purchased from manufacturers, trading companies, wholesale points, etc. as a database. In addition to the information on the date of purchase and the number of purchased items, the photographed image of the product, the product name, Electronic tag information such as product information and shooting dates are recorded in a database and managed.

  In this data processing apparatus, data of a photographed image photographed by the image photographing apparatus 1 is read out from a memory card mounted on the medium driving unit 53 or is read via the external interface 56, and is read out together with the photographed image from an electronic tag at the time of photographing. The electronic tag information is displayed on the screen or output to a printer.

  Further, by registering this information in the return database 572 and the purchase database 573, the information is used for inventory, return, and purchase management. When creating a flyer advertisement or the like, a photographed image of the corresponding product or product information provided by a manufacturer is extracted from the purchase database 573 and used for creating an advertisement.

Next, usage examples and operations of the image capturing apparatus 1 and the data processing apparatus will be described.
When the merchandise is received at the store, the image photographing apparatus 1 is set to the purchase mode to photograph the merchandise. When the product is returned, the image capturing apparatus 1 is set in the return mode, and the part that caused the return such as a defective part is imaged. When shooting is performed in a state where the mode switch 6 is set to the purchase mode or the return mode, the image shooting apparatus 1 reads the electronic tag information stored in the electronic tag held by the shooting target, and uses this as image data of the shot image. Store in association with each other.

  Next, the captured image data is read from the image capturing apparatus 1 to the data processing apparatus and registered in the return database 572 and the purchase database 573. When returning goods, the data of the photographed image is sent to the return destination in a return notice to the return destination. As a result, the recipient of the return notice can easily identify the cause of the return, and can promptly and reliably perform the return process. In addition, when a purchase is made, the purchased product and the product information provided by the manufacturer are registered in the purchase database 573. This can be used for creating an advertisement, or from the precautions in the product information. Decide how to handle, store, and display the product.

  FIG. 6 is a flowchart showing an operation process of the image capturing apparatus 1 when the shutter button 5 of the image capturing apparatus 1 is half-pressed. When the shutter button 5 is pressed halfway, the image capturing apparatus 1 transmits radio waves from the tag reader / writer 27 and reads information from the electronic tag.

The processing shown in FIG. 6 is realized by the input / output control unit 16 executing a program stored in its own internal memory.
When the shutter button 5 is pressed halfway down by the user, this process is started, and the input / output control unit 16 first clears the image processing memory 19 as an initialization process (step S1), and then the electronic tag. The memory 20 is cleared (step S2).

  Next, the input / output control unit 16 takes in the image data output from the A / D converter 13 to the image processing memory 19 in step S3. In step S4, a through image is displayed on the display unit 18 based on the image data.

  Next, the input / output control unit 16 checks the setting state of the mode button 6 in step S5. As a result, if the mode switch 6 is not set to the stocking mode or the return mode (step S6, N), the image photographing device 1 does not read out the electronic tag information in the electronic tag held by the photographing object, so this processing is performed. Exit.

  In step S6, if the mode button 6 is set to the purchase mode or the return mode (step S6, Y), the tag reader / writer 27 is made to read the electronic tag information from the electronic tag as step S7. As a result, when the information cannot be read because the object to be imaged does not have an electronic tag (step S8, N), this process is terminated.

  In step S8, when the electronic tag information can be read from the electronic tag (step S8, Y), the information is transferred from the tag reader / writer 27 to the electronic tag memory 20 and stored in step S9.

  Next, the input / output control unit 16 generates an identifier of the electronic tag based on the ID code read from the electronic tag in step S10, and stores it in the image processing memory 19 (step S11). In step S12, the product information read from the electronic tag in the electronic tag memory is displayed on the display unit 18 by superimposing the product information on the image, and the process ends.

  FIG. 7 is a flowchart showing an operation process performed in the image photographing apparatus 1 at the time of photographing an image. The processing in FIG. 6 is also realized by the input / output control unit 16 executing a program stored in its own internal memory.

  This process is started when the shutter button 5 is pressed by the user. In step S21, the input / output control unit 16 instructs the imaging control unit 14 to perform shooting, and the imaging control unit 14 Thus, the output data from the A / D converter 13 is corrected by a parameter set such as white balance, and then compressed to generate image data and store it in the image processing memory 19. The input / output control unit 16 transfers the image data from the image processing memory 19 to the image memory 23 and stores it.

  Next, the input / output control unit 16 determines whether or not an identifier is generated in step S10 of FIG. 6 and stored in the image processing memory 19 for the captured image. (Step S22, N), the mode switch 6 is set to OFF, and the electronic tag information is not read, so this processing is terminated.

  If an identifier has been generated in step S22 (Y in step S22), the information read from the electronic tag and the photographed image are stored in association with each other, so the product information in the electronic tag memory 20 is stored together with this identifier in the image memory 23. (Step S23).

  Next, in step S24, the input / output control unit 16 uses the tag reader / writer 27 to read the information from the electronic tag again and perform collation. Then, the date / time information is read from the timer 6 (step S25), and this is written in the electronic tag together with the ID code of the image capturing apparatus 1 as step S26, and then the present process is terminated. The date and time information and ID code written in the electronic tag in step S26 are used for the purpose of checking when the image photographing apparatus 1 photographed the product that became the photographing object at a later date.

  6 and 7, the image photographing apparatus of the present embodiment can record the image data of the photographed image in association with the electronic tag information read from the electronic tag possessed by the photographing object.

FIG. 8 is a flowchart showing a process for data of a captured image by the image capturing apparatus 1 by the data processing apparatus.
This processing is executed when the data processing device that has captured the captured image data from the data processing device 1 registers this data in each database. The processing in FIG. 5 is the data processing device shown in FIG. This is implemented by the CPU 51 executing the programs on the RAM 55 and the hard disk 58.

  When the process shown in FIG. 6 is started, first, image information of an image designated by the user is read in step S31. If no identifier is set in the attribute information in the image information (N in step S32), only the image display process is performed in step S40, and the process proceeds to step S41.

  In step S32, if an identifier is set in the attribute information (Y in step S32), mode information 44, product specifying information 45, and product information 46 in the electronic tag information corresponding to this identifier are read in step S33. Then, it is determined from the mode information 44 whether the image was taken in the purchase mode or the return mode, and if it was taken in the return mode (step S34, return), the process returns to the return database 572 as step S35. Image data 41, product identification information 45, shooting date and time, etc. are registered.

  When notifying the supplier of the return (step S36, Y), the contact information to the supplier is read from the management database 571 as step S37, and the image data of the photographed image and the electronic home information (product specifying information 45) are read out. Etc.) Notify the supplier after sending a return notification to the supplier's contact information by sending it over the network etc. (in the case of notification by telephone or mail, put it on the notification list) If not (step S36, N), the stock management database 571 is updated as step S39, and the process is terminated.

  In step S34, if the photographed image is photographed in the purchase mode from the mode information 44 (step S34, purchase), as step S40, the image data 41 and the electronic tag information (product specifying information 45, Product information 46 etc.), shooting date and time, etc. are registered. Finally, after updating the inventory management database 571 including registration of supplier information in step S39, the present process is terminated.

  As described above, the data of the photographed image photographed by the image photographing device of the present embodiment stores information associated with the article read from the electronic tag at the time of photographing. The photographed image and the information read from the electronic tag at the time of photographing can be associated with each other and used for logistics management, purchase, return, and inventory management.

Note that the image capturing apparatus of the present embodiment may be configured not only as a single apparatus but also as a part of another apparatus, for example, a part of a mobile phone.
Further, in the present embodiment, the electronic tag information read from the electronic tag attached to the article is stored and managed in association with the photographed image. However, audio data or moving image data obtained by recording the electronic tag information on the article, It may be stored and managed in association with character data or the like, or may be stored and managed in association with a plurality of such data such as still images and audio data.

(A) is a schematic diagram of an image photographing apparatus of the present embodiment, (b) is a diagram showing an example of a transmission / reception antenna provided in a tag reader / writer. It is a block diagram which shows the internal structural example of an image imaging device. It is a figure which shows the structural example of the electronic tag information memorize | stored in the electronic tag added to a to-be-photographed object. It is a figure which shows the structural example of the data about the picked-up image memorize | stored in the image memory. It is a figure which shows the structural example of the data processor used by this embodiment. It is a flowchart which shows the operation | movement process of an image imaging device when a shutter button is made into a half-pressed state. It is a flowchart which shows the operation | movement process performed within an image imaging device at the time of imaging | photography of an image. It is a flowchart which shows the process performed when reproducing | regenerating the image image | photographed with the image imaging device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image photographing device 2 Tag reader / writer 3 Shooting lens 5 Shutter button 6 Mode switch 10 Lens 11 CCD
DESCRIPTION OF SYMBOLS 12 Imaging process 13 A / D converter 14 Image | photographing control part 15 Image processing part 16 Input / output control part 17 Display part 18 Output part 19 Memory for image processing 20 Memory for electronic tag 21 Transmission / reception antenna 22 Shield plate 23 Image memory 24 Communication interface 25 Memory Card Interface 26 Timer 27 Tag Reader / Writer 28 Bus Line 51 CPU
52 I / O unit 53 Medium drive unit 54 ROM
55 RAM
56 External interface 57 Hard disk 58 Bus 571 Inventory management database 572 Returns database 573 Purchase database

Claims (2)

Mode setting means for setting the mode;
In response to the photographing operation, photographing means for photographing a photographing object such as an article with an electronic tag attached thereto ;
In response to the photographing operation, reads the electronic tag information the electronic tag is stored, and electronic tag reading / writing means for writing the date and time that is taken by the imaging means to the electronic tag,
The mode information indicating the mode set by the mode setting means at the time of the photographing operation, the image data of the photographed image by the photographing means, and the electronic tag information read by the electronic tag reading means are stored in association with each other. Image storage means for
A communication interface for transmitting mode information, image data, and electronic tag information stored in association with each other in the image storage means to an external data processing device;
In the apparatus main body, and the mode information is information indicating processing to be performed by the data processing apparatus. A program executed in the image capturing device,
A function to set the mode,
In response to a shooting operation, a function of shooting a shooting target such as an article with an electronic tag ;
In response to the photographing operation, reads the electronic tag information the electronic tag is stored, and a function of writing the date and time that is taken by the imaging means to the electronic tag,
Mode information indicating a mode set by the function for setting the mode at the time of the shooting operation, image data of a shot image by the shooting function, and electronic tag information read by the function of reading the electronic tag A function of storing the information in association with each other;
A function of transmitting the mode information, image data, and electronic tag information stored in association with each other to an external data processing device;
The mode information is information indicating processing to be performed by the data processing apparatus.

Images