JP2006270719A - Communication terminal device and data processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To ensure strict security in a communication terminal device having a barcode collation function and a data processing device including the communication terminal device. <P>SOLUTION: The data processing device comprises a photographing means for acquiring an image of a photographing object having a barcode indicated thereon; a receiving means for receiving operation instruction information transmitted from an external management device; an instruction means for instructing the operation instruction information received by the receiving means to a worker; a barcode decoding means for decoding a barcode acquired by the photographing means according to the operation instruction information instructed by the instruction means; an collating means for collating the barcode decoded by the barcode decoding means an identification code instructed by the operation instruction information; a photographing instruction means for outputting a photographing instruction of the photographing object to the photographing means when both codes are coincident as the result of the collation by the collating means; and a transmission means for transmitting the photographed image of the photographing object to the management device. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a communication terminal device equipped with a security function and a data processing device including the communication terminal device.

  In recent years, most products on the market are provided with barcodes, and information for identifying products can be acquired. There are various types of barcodes, and not only for product management but also for security functions.

  For example, in a camera using a brownie film, it is essential for the brownie film to be used to have film sensitivity information written on its barcode. Without this description, overexposure and underexposure may occur. Is high, and shooting fails. In Patent Document 1, since a bar code detecting means is mounted, if the bar code cannot be detected, the film sensitivity is prompted to be input, and the operation of the release switch is disabled so that the photographing cannot be performed. A camera that can avoid the problem is disclosed.

In addition, digital cameras capable of wireless communication are being developed, but security is a problem in such wireless data communication. Therefore, Patent Document 2 discloses a digital camera that can read a bar code representing authentication information by an imaging unit of the camera and can be secured by the read information.
JP 11-119291 A JP 2004-15284 A

  However, according to such a conventional technique, system control and information recognition are performed by detecting a bar code. However, since only bar code is collated, actual photographing data can be visually confirmed. There was a problem that could not.

  Accordingly, an object of the present invention is to enable a strict security check on a subject to be photographed in a communication terminal device equipped with a barcode collation function and a data processing device including the same.

  In order to solve the above problem, the invention described in claim 1 is a photographing unit that acquires an image of a photographing target on which a barcode is displayed, and a receiving unit that receives operation instruction information transmitted from an external management device. And instruction means for indicating to the operator the operation instruction information received by the receiving means; barcode decoding means for decoding the barcode acquired by the photographing means according to the operation instruction information indicated by the instruction means; The collation means for collating the barcode decoded by the barcode decoding means with the identification code indicated by the operation instruction information, and when the result of the collation by the collation means is the same, A photographing instruction means for outputting a photographing instruction for the photographing object, and a transmission means for transmitting a photographed image of the photographing object to the management device. There.

  The invention according to claim 2 is a data processing device in which a management device is connected to the communication terminal device according to claim 1 via a communication network, wherein the management device identifies feature data of the photographing object. Storage means for storing as a reference image in association with a code, transmission means for transmitting operation instruction information to the communication terminal apparatus, reception means for receiving a photographed image of a photographing object from the communication terminal apparatus, and the reception means Extracting the feature of the object to be photographed from the photographed image of the object to be photographed and collating it with the reference image; and if the result of the collation by the collating means is a mismatch, the operation instruction to the transmitting means And a control means for retransmitting information.

  According to the present invention, the instructed identification code and the bar code (see FIG. 9) read by the bar code decoding means are collated, and the photographing instruction is given only when they match, and the acquired image data is also collated. Thus, it is possible to provide a data processing apparatus capable of strict security. In addition, as an identification code for identifying an object to be photographed, there are a product code, a component code, a material code, and the like. In this embodiment, a product code is used.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Hereinafter, the data processing apparatus according to the present embodiment is assumed to be used, for example, for inventory management of a store such as a retail store, the communication terminal apparatus is operated by an operator, and the server as the management apparatus is an administrator. However, the present invention is not limited to this.

  First, the configuration in the embodiment of the present invention will be described. FIG. 1 shows a system configuration of a data processing apparatus 100 according to the embodiment. As shown in FIG. 1, the data processing device 100 includes a server 10 and a communication terminal device 20.

  The server 10 is composed of, for example, a PC (Personal Computer) or the like, and includes DB (database) storage means such as an HDD (hard disk) (not shown). The DB storage unit is a storage unit that stores image data of each of a plurality of products, detailed characteristics of each product, and the like. Further, the data stored in the storage means includes a product code attached to each product, and the server 10 transmits the product code to the communication terminal device 20 so that the product to be photographed by the communication terminal device 20 is obtained. Instruct. Further, the server 10 extracts the feature of the product from the image data photographed by the communication terminal device 20, and compares the extracted feature with the image data of the product stored in the storage unit and the feature of the product. Have

  The communication terminal device 20 is a portable information terminal such as a handy terminal, has a barcode decoding function, and has means for checking whether or not the read barcode matches the product code instructed by the server 10. . The photographing means included in the communication terminal device 20 is provided with photographing instruction means that permits photographing only when collation is matched by the collating means and outputs a photographing command.

  The server 10 and the communication terminal device 20 described above are connected via the communication network 3 to configure the data processing device 100. The number of communication terminal devices 20 connected to one server 10 via the communication network 3 is not particularly limited. Here, the communication network 3 is, for example, a network such as a public line, a telephone line, an ISDN line, a wireless communication line, a dedicated machine, or a CATV line. The communication network 3 preferably has a security function accessible only to a specific user from the viewpoint of reliability of information management.

  Next, with reference to FIG. 2, the main part structure of the server 10 which comprises the data processing apparatus 100 is demonstrated. The server 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a V-RAM (Video Random Access Memory) 14, a key input unit 15, a display unit 16, and an image verification unit. The unit 17, the storage unit 18, and the communication interface 19 are configured.

  The CPU 11 is a central processing unit that executes processing based on a predetermined program in accordance with an input instruction and transfers instructions and data to each functional unit. Specifically, the CPU 11 reads a program stored in the ROM 12 in accordance with an operation signal input from the key input unit 15 and executes processing according to the program. Then, the processing result is displayed on the display unit 16. For example, when image data captured by the communication terminal device 20 is acquired, a program for extracting product features from the image data is executed. And the result of collating the extracted feature and the feature included in the pre-stored product information is displayed on the display unit 16.

  The ROM 12 stores data related to execution of programs necessary for the operation of the data processing apparatus 100. These programs are programs that do not need to be rewritten or programs that must not be rewritten.

  The RAM 13 develops various programs executed by the CPU 11 in a program storage area. The RAM 13 temporarily stores data such as processing results generated when various programs are executed in the work area.

  The V-RAM 14 is a memory that holds contents displayed on the screen of the display unit 16.

  The key input unit 15 includes a cursor key, a numeric input key, and various function keys, and outputs an operation signal corresponding to the key pressing operation to the CPU 11. For example, an instruction to capture an image is input to the communication terminal device 20.

  The display unit 16 is configured by a CRT display or a liquid crystal display. For example, when the photographed image data transmitted from the communication terminal device 20 is received, the photographed image is displayed on the display unit 16 so that the manager visually confirms the product photographed by the operator.

  The image collation unit 17 is a collation unit that collates the image data captured by the communication terminal device 20 with the image data and product characteristics of each product stored in the storage unit 18 in advance. By this collation, it is confirmed whether or not the instructed product has been photographed without error.

  The storage unit 18 is a storage unit that stores product information, and includes a DB (database) storage unit such as an HDD (hard disk). The storage means stores a file 18a for storing information such as the barcode and price of each product, a data table storing product features, and an image DB 18b for storing image data of each product.

  The communication interface (I / F) 19 mediates exchange of information and data between the server 10 and the communication terminal device 20.

  FIG. 3 illustrates the main configuration of the communication terminal device 20 included in the data processing device 100. As shown in FIG. 3, the communication terminal device 20 includes a CPU 21, a ROM 22, a RAM 23, a V-RAM 24, an input unit 25, a display unit 26, a barcode reading unit 27, a camera imaging unit 28, a communication interface 29, and the like. .

  Similar to the CPU 11, the CPU 21 is a central processing unit that performs processing based on a predetermined program in accordance with an input instruction and transfers instructions and data to each functional unit. Specifically, the CPU 21 reads a program stored in the ROM 22 in accordance with a signal input from the input unit 25, and executes a process according to the program. Then, the processing result is displayed on the display unit 26. For example, when an instruction from the server 10 is received and the barcode of the instructed product is scanned, the operation of the barcode reading unit is controlled according to the program stored in the ROM, and the operation of each other unit is controlled. To do.

  The ROM 22 stores data related to execution of programs necessary for the operation of the data processing apparatus 100. These programs are programs that do not need to be rewritten or programs that must not be rewritten.

  The RAM 23 develops various programs executed by the CPU 21 in a program storage area. The RAM 23 temporarily stores data such as processing results generated when various programs are executed in the work area.

  The V-RAM 24 is a memory that holds contents displayed on the screen of the display unit 26.

  The input unit 25 includes button keys 25a and a touch panel 25b. An operation signal corresponding to the pressing operation of these keys is output to the CPU 21.

  The display unit 26 is configured by a liquid crystal display. An instruction from the server 10, captured image data, and the like are displayed. When shooting, the object is shown as a viewfinder.

  The barcode reader 27 reads the barcode by irradiating the barcode with laser light and capturing the reflected light. The read data is output to the CPU 21. The configuration is not limited to this laser method, but may be a CCD method or a pen method.

  When the server 10 permits the image capturing, the camera image capturing unit 28 captures the designated product and outputs the acquired image data to the CPU 21. When the image data is output to the CPU 21, the image data is transmitted to the server 10.

  The communication interface (I / F) 29 mediates exchange of information and data between the server 10 and the communication terminal device 20.

  Next, a schematic external view of the communication terminal device 20 is shown in FIG. The description of the function of each part is the same as in FIG. When the instruction transmitted from the server 10 is displayed on the display unit 26 of the communication terminal device 20, the communication terminal device 20 is operated by the worker according to the instruction, and the work is started. The input unit 25 of the communication terminal device 20 includes button keys 25a and a touch panel 25b as operation means. The touch panel 25b may be operated by transmitting an operation signal by directly touching the display unit 26, or may be configured to transmit an operation signal using a pen or the like, for example. In addition to the instruction from the server 10, the display unit 26 has a function as a finder at the time of shooting, for example, and further displays image data acquired by shooting. The barcode reading unit 27 turns on the laser light, applies the laser light to the barcode, reads the barcode, and outputs the read information to the CPU 21.

  FIG. 5 shows a block configuration diagram of the server 10 and the communication terminal device 20 constituting the data processing device 100, and the flow of processing will be described.

  First, when a product is specified by an administrator and an instruction to photograph the product is transmitted from the key input unit 15 of the server 10 to the communication terminal device 20 together with a product code of the product, the display unit 26 ( Hereinafter, this is displayed on the display screen). After confirming the display screen, the worker starts reading the barcode attached to the product by the barcode reading unit 27 of the communication terminal device 20 and outputs the acquired data to the CPU 21. When the CPU 21 acquires the data read by the communication terminal device 20, the CPU 21 compares the data with the product code transmitted from the server 10 so that the product corresponding to the scanned barcode is photographed by the server 10. It is determined whether or not the product is instructed. This determination confirms that the operator has identified the product to be photographed as instructed by the administrator.

  When the CPU 21 determines that the product corresponding to the barcode scanned by the worker matches the product designated by the administrator, the CPU 21 displays that fact on the display screen. Further, the CPU 21 cancels the security function of the camera imaging unit 28 in accordance with the result of the collation match determination, and controls the camera imaging state. When it is displayed that photographing by the camera imaging unit 28 is possible, the worker starts photographing, and the photographed image data is output to the CPU 21. When the captured image data is output, the CPU 21 outputs the data to the CPU 11 of the server 10 via the communication interfaces 29 and 19.

  When the image data is input, the CPU 11 of the server 10 reads the image data and the data table of the product instructed to shoot from the storage unit 18 and outputs the data to the image collating unit 17. Based on these data, the image collation unit 17 determines whether the product photographed by the operator matches the product designated by the administrator. When the determination result is output to the CPU 11, the CPU 11 displays the acquired determination result on the display unit 16 of the server 10. When the determination result displayed on the display unit 16 of the server 10 is confirmed by the administrator, the fact is input from the key input unit 15. The CPU 11 outputs the operation signal to the CPU 21 of the communication terminal device 20 via the communication interfaces 19 and 29. The CPU 11 of the communication terminal device 20 displays the determination result transmitted from the server 10 on the display unit 26. If the images do not match as a result of the collation by the image collation unit 17, the imaging instruction is transmitted to the communication terminal device 20 again.

  In addition, although the collation of image data is automatically performed by the server 10, the collation operation may be performed by the administrator operating the server 10.

  FIG. 6 shows an example of a data table stored in the file 18 a stored in the storage unit 18 of the server 10. As shown in FIG. 6, a product table, an image table, and a feature table are stored in the data table of the file 18a. Images of each product are registered in the image table, and a product table and a feature table are stored in association with the image data. In the product table, product information such as a product code, a product name, a standard name, and a manufacturer name of products corresponding to each image data is stored in detail. In the feature table, features such as product shapes, colors, characters, and pictures corresponding to each image data are registered in detail, and these feature data are essential data for collating image data. When the image data photographed by the operator is acquired, the image collation unit 17 extracts the characteristics of the obtained image data and collates with the information in the data table, so that the photographed product is the designated product. Determine whether. It is confirmed whether or not the designated product has been photographed reliably by collating images by feature extraction. The configuration of this data table is an example, and configuration items may be added or changed as necessary.

  Next, processing executed by the data processing apparatus 100 will be described with reference to an example of a screen (hereinafter, display screen) displayed on the flowchart of FIG. 7 and the display unit 26 of FIG.

  First, the administrator operates the server 10 to transmit a photographing instruction mail so as to photograph a desired product to the communication terminal device 20 (step S1). This mail is attached with a file storing the product code of the product to be photographed. At this time, it is possible to attach a plurality of files, and the administrator can instruct to shoot a plurality of products. In step S1, a photographing instruction mail with the product code of the designated commodity attached is transmitted, and when the communication terminal device 20 receives the instruction mail (step S2), a message to that effect is displayed on the display screen of the communication terminal device 20. (FIG. 8 (a)). An operator sees this display screen and starts work.

  The camera imaging unit 28 of the communication terminal device 20 is equipped with a security function in order to prevent unintentional shooting. Shooting can be started by releasing the state locked by the security function by the following method.

  First, the user confirms the shooting instruction mail from the server 10 and when the operator tries to activate the camera, the camera is not activated and the product code of the attached file is imported because the camera is locked by the security function. Is displayed (FIG. 8B). The operator designates a file into which the product code is imported by operating the input unit 25 of the communication terminal device 20, and starts the import (FIG. 8C). When the import of the product code is completed, an instruction to scan the barcode of the designated product is displayed (FIG. 8D). When the display is confirmed, the operator scans the barcode of the designated product using the communication terminal device 20. When the barcode of the product is scanned, the barcode reading unit of the communication terminal device 20 starts reading the scanned barcode (step S3). In step S3, reading of the barcode is started, and in order to determine whether or not the read barcode matches the product code transmitted in the attached file, the collation is started (step S4). .

  In step S4, collation between the product code and the scanned barcode is started, and it is determined whether or not they match (step S5). If it is determined in step S5 that the transmitted product code does not match the scanned barcode (step S5; NO), the process returns to step S3 and the processes of steps S3 to S5 are repeated again. If it is determined in step S5 that the transmitted product code matches the scanned barcode (step S5; YES), the security function of the camera imaging unit 28 is canceled and a message to that effect is displayed (FIG. 5). 8 (e)). When the operator sees the display screen in FIG. 8E and confirms that the security lock has been released and the camera is ready to shoot, the camera imaging unit 28 causes the designated product to be displayed on the display screen (FIG. 8 ( f)), photographing is started (step S6).

  In step S6, when photographing of the designated product is completed, the photographed image data is transmitted to the server 10 (step S7). When the server 10 receives the image data from the communication terminal device 20 (step S8), the server 10 extracts features of the image data (step S9). In step S9, when the features of the image data are extracted, features such as the image data, shape, and color of the designated product are called from the data table 18a stored in advance in the storage unit 18, and the captured image is captured by the image matching unit 17. A verification check is started (step S10).

  In step S10, when collation of the characteristics of the captured image data and the characteristics of the designated product is started, the determination result is transmitted to the communication terminal device 20 by mail (step S11). This determination result mail is transmitted both when the images match and when the images do not match. The communication terminal device 20 receives the determination result mail from the server 10 (step S12), ends the process when the images match, and waits until a new instruction is received next. When the server 10 receives an image matching result indicating that the images do not match (step S12), the process ends and waits until an imaging instruction is received again.

  In step S11, when the server 10 transmits the determination result to the communication terminal device 20, the server 10 determines whether or not the determination result is an image match (step S13). If it is determined in step S13 that the determination result is an image match (step S13; YES), the process ends. If it is determined in step S13 that the determination result is not image coincidence, that is, the images are not coincident (step S13; NO), the process returns to step S1, and the imaging instruction is transmitted to the communication terminal device 20 again.

  As described above, the security function is installed in the camera of the communication terminal device 20, and the product code instructed by the administrator matches the barcode attached to the product input by the operator using the communication terminal device 20. By enabling photography only in this case, it is possible to prevent unnecessary photographing of other products, and for example, it is possible to avoid leakage of information on new products. In addition, because it is possible to shoot the specified product reliably, when it is confirmed by the administrator after shooting, it is found that the product is different from the specified product, you have to reshoot It is possible to avoid the situation. Therefore, it is possible to carry out the work reliably and quickly, and an improvement in work efficiency can be expected.

  Furthermore, by extracting the characteristics of the captured image data and checking the image data against the pre-stored image data of the product and other detailed product information, the specified image is accurately captured. It can be confirmed whether it was done. Further, as shown in FIG. 8F, even when a product other than the designated product is photographed together, detailed product information is stored, so that detailed features of the product can be extracted, and the image data Confirmation can be done accurately. Therefore, when the target product is a trade secret, it is possible to reliably prevent the product from being illegally photographed, and an accurate operation can be performed under high security.

  In addition, even though the specified product code and the barcode scanned by the terminal device match, if it is determined that the product does not match by matching the image data, there may be a mistake in attaching the barcode, etc. Other mistakes can be found, and not only improvement in work efficiency but also reliable product management can be realized.

  FIG. 9 shows an example of a barcode as an identification mark attached to each product. The identification mark is not limited to this, and may be any of various barcodes such as JAN code, NW7, and CODE39. The same effect can be obtained by using a two-dimensional code or an RFID (Radio Frequency Identification System) as a substitute for the barcode.

  Although the data transfer between the server 10 and the communication terminal device 20 is performed by e-mail, the present invention is not limited to this, and the same effect can be obtained by a configuration performed by a dedicated application program.

1 shows a system configuration of a data processing apparatus according to the present embodiment. It is a block diagram which shows the principal part structure of the server which comprises the data processor of FIG. It is a block diagram which shows the principal part structure of the communication terminal device which comprises the data processor of FIG. It is a schematic external view of the communication terminal device which comprises the data processor of FIG. It is a block block diagram which shows the flow of the process performed with the data processor which concerns on this embodiment. It is an example of the data table which the server which comprises the data processor of FIG. 1 memorize | stores. It is a flowchart which shows the process performed in the data processor of this embodiment. It is an example of the display screen displayed on a communication terminal device during the process performed in the data processor of this embodiment. It is an example of the barcode attached | subjected to each goods.

Explanation of symbols

10 Server 11 CPU
12 ROM
13 RAM
14 V-RAM
15 Key input unit 16 Display unit 17 Image collation unit 18 Storage unit 18a File 18b Image DB
19 Communication Interface 20 Communication Terminal Device 21 CPU
22 ROM
23 RAM
24 V-RAM
25 Input unit 25a Button key 25b Touch panel 26 Display unit 27 Bar code reading unit 28 Camera imaging unit 29 Communication interface 30 Storage unit 100 Data processing device 3 Communication network

Claims (2)

Photographing means for acquiring an image of the photographing object on which the barcode is displayed;
Receiving means for receiving operation instruction information transmitted from an external management device;
Instruction means for indicating to the operator the operation instruction information received by the receiving means;
Barcode decoding means for decoding the barcode acquired by the imaging means according to the operation instruction information indicated by the instruction means;
Collating means for collating the barcode decoded by the barcode decoding means with the identification code indicated by the operation instruction information;
As a result of the collation by the collation means, when both match, a photographing instruction means for outputting a photographing command for the photographing object to the photographing means;
Transmitting means for transmitting a photographed image of the photographing object to the management device;
A communication terminal device comprising: In a data processing device in which a management device is connected to the communication terminal device according to claim 1 via a communication network.
The management device includes storage means for storing feature data of the photographing object as a reference image in association with an identification code;
Transmitting means for transmitting operation instruction information to the communication terminal device;
Receiving means for receiving a photographed image of a photographing object from the communication terminal device;
Collating means for extracting features of the photographing object from the photographed image of the photographing object received by the receiving means and collating with the reference image;
A control unit that causes the transmission unit to transmit the operation instruction information again when there is a mismatch as a result of the verification by the verification unit;
A data processing apparatus comprising:

Images