JP2021131658A - Code reader, code reading method and program - Google Patents

Abstract

To allow a user to select a desired code efficiently when an image contains multiple codes.SOLUTION: A code reader according to the present disclosure comprises image acquisition means for acquiring a picked-up image containing multiple codes, information acquisition means for acquiring information indicated by each of the plurality of codes contained in the picked-up image, and output means for outputting a display image in which the information indicated by each of the plurality of the codes is associated with the code.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to reading the code.

A code reading device that inputs information by using a code in which data such as a character string, a sequence, and a symbol string is represented by a one-dimensional or two-dimensional image is widely known. For example, in a store, a code reading device captures a one-dimensional code (hereinafter, also referred to as a bar code) or a two-dimensional code attached to a product with a camera to register the product purchased by the customer. Further, in the guidance to the website, the code reading device acquires and displays the information of the website by taking a picture of the two-dimensional code indicating the link of the website with a camera.

In such a code reading device, when a plurality of codes are present in an image captured by a camera, the user needs to select a desired code from the plurality of codes. Patent Document 1 discloses an example of a code reading device capable of selecting a code from a plurality of codes. The information processing apparatus described in Patent Document 1 searches a database for registration information corresponding to a two-dimensional code selected from a plurality of two-dimensional codes, and displays the searched registration information on a display together with an captured image.

Japanese Unexamined Patent Publication No. 2001-075971

In the information processing device of Patent Document 1, the user needs to repeatedly select and confirm the displayed registration information for each of the plurality of two-dimensional codes, so that the desired code cannot be efficiently selected. ..

One of the objects of the present disclosure is to provide a code reading device, a code reading method, and a program capable of efficiently selecting a desired code even when an image contains a plurality of codes. be.

The code reading device according to the present disclosure includes an image acquisition means for acquiring an captured image including a plurality of codes, an information acquisition means for acquiring information indicated by each of the plurality of codes included in the captured image, and the plurality of codes. It is provided with an output means for outputting a display image in which the information indicated by each of the above is associated with the code.

The code reading method according to the present disclosure acquires a captured image including a plurality of codes, acquires information indicated by each of the plurality of codes included in the captured image, and the information indicated by each of the plurality of codes is the code. Outputs the display image associated with.

The program according to the present disclosure includes a process of acquiring a captured image including a plurality of codes, a process of acquiring information indicated by each of the plurality of codes included in the captured image, and information indicated by each of the plurality of codes. Have the computer execute the process of outputting the display image associated with the code.

According to the present disclosure, when a plurality of codes are included in an image, a user's desired code can be efficiently selected.

It is a block diagram which illustrates the structure of the code reading apparatus 100 which concerns on 1st Embodiment. It is a flowchart which shows the operation example of the code reading apparatus 100 which concerns on 1st Embodiment. It is a figure which shows the example of the display image 30. It is a figure which shows another example of the display image 30. It is a block diagram which illustrates the structure of the code reading apparatus 200 which concerns on 2nd Embodiment. It is a flowchart which shows the operation example of the code reading apparatus 200 which concerns on 2nd Embodiment. It is a block diagram which illustrates the structure of the mobile terminal 500 which concerns on 3rd Embodiment. It is a block diagram which illustrates the system structure of the 1st specific example which concerns on 3rd Embodiment. It is a figure explaining the operation example of the mobile terminal 500 which concerns on 1st specific example. It is a figure explaining another operation example of the mobile terminal 500 which concerns on 1st specific example. It is a block diagram which illustrates the system structure of the 2nd specific example which concerns on 3rd Embodiment. It is a figure which shows the example of the information which associated with the product ID and the product name which concerns on the 2nd specific example. It is a figure which shows the example of the information which associates the customer ID and the product which a customer purchases with respect to the 2nd specific example. It is a figure which shows the example of the screen displayed by the display unit 300 which concerns on the 2nd specific example. It is a figure which shows another example of the display image 30. It is a figure which shows another example of the display image 30. It is a figure which shows the code and the example of the information which a code shows. It is a figure which shows another example of the display image 30. It is a figure explaining the scene of reading a code. It is a figure explaining the hardware configuration.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[First Embodiment]
(composition)
FIG. 1 is a block diagram illustrating the configuration of the code reading device 100 according to the first embodiment. The code reading device 100 includes an image acquisition unit 101, an information acquisition unit 102, and an output unit 103. The image acquisition unit 101, the information acquisition unit 102, and the output unit 103 are embodiments of the image acquisition means, the information acquisition means, and the output means of the present disclosure, respectively.

The image acquisition unit 101 acquires an captured image including a plurality of codes. The code is printed on various media with, for example, ink. In addition, the code may be projected onto an object by a projector or may be displayed on a display. The code is, for example, a bar code or a two-dimensional code. The code represents data such as a character string, a sequence of numbers, and a symbol string by the width of the barcode and the arrangement of dots of the two-dimensional code.

The information acquisition unit 102 acquires the information indicated by each of the plurality of codes included in the captured image. Here, the information acquisition unit 102 converts the width of the bar code and the arrangement of the dots of the two-dimensional code into data such as a character string, a sequence of numbers, and a symbol string for each of the plurality of codes according to a predetermined rule. The rules for converting the code into data are stored in advance, for example, in a storage unit (not shown).

Then, the information acquisition unit 102 acquires the information indicated by the code for each of the plurality of codes based on the data converted from the code. Here, the information acquisition unit 102 may use the data (character string, sequence, symbol string, etc.) converted from the code itself as the information indicated by the code. Further, the information acquisition unit 102 may also use information (words, sentences, images, etc.) associated with the data (character string, sequence, symbol string, etc.) converted from the code as the information indicated by the code. In this case, the information acquisition unit 102 acquires the information associated with the data converted from the code by referring to, for example, the correspondence between the data and the information stored in advance in a storage unit (not shown).

The output unit 103 receives the captured image from the image acquisition unit 101, and receives the information indicated by the code from the information acquisition unit 102. The output unit 103 outputs a display image in which the information indicated by each of the plurality of codes is associated with the code. Here, the output unit 103 generates a display image and outputs it to a display unit (not shown).

The display image output by the output unit 103 will be described with reference to the drawings. 3 and 4 are diagrams showing an example of the display image 30, respectively. In FIGS. 3 and 4, the sequence 31 is an example in which the information indicated by the code is data (sequence) converted from the code. Further, in FIGS. 3 and 4, the URL (Uniform Resource Locator) 32 is an example in which the information indicated by the code is data converted from the code (character string indicating the URL).

The output unit 103 may associate the code with the information indicated by the code by a leader line or an arrow. In FIG. 3, the code included in the captured image and the information indicated by the code are associated with each other by arrows in the displayed image.

Further, the output unit 103 has an image in which an identifier assigned to each of the plurality of codes is associated with the code, and an image in which the information indicated by each of the plurality of codes is associated with the identifier assigned to the code. An image including and may be output as a display image. In FIG. 4, each of the plurality of codes and the information indicated by the code are associated with each other by the code identifier 34. The mode of the displayed image is not limited to the examples of FIGS. 3 and 4.

(Operation example)
Hereinafter, the operation of the code reading device 100 according to the first embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing an operation example of the code reading device 100 according to the first embodiment. When the camera captures an image including a plurality of codes, the image acquisition unit 101 acquires the captured captured image (step S11). The information acquisition unit 102 acquires the information indicated by each of the plurality of codes included in the captured image (step S12). The output unit 103 outputs a display image in which the information indicated by each of the plurality of codes is associated with the code (step S13).

(effect)
According to the first embodiment, even when a plurality of codes are included in the captured image, the user can efficiently select the codes. The reason is that the image acquisition unit 101 acquires the captured image including the plurality of codes, the information acquisition unit 102 acquires the information indicated by each of the plurality of codes, and the output unit 103 uses each of the plurality of codes. This is because the indicated information outputs a display image associated with the code.

Further, when the description is printed together with the code on the medium on which the code is printed, the description may not match the description of the actual code. Further, the medium on which the code is printed may not have a description of the code. According to the first embodiment, even in these cases, the user can confirm the information indicated by the code. The reason is that the output unit 103 outputs a display image in which the information indicated by the code is associated with the code.

[Second Embodiment]
(composition)
FIG. 5 is a block diagram illustrating the configuration of the code reading device 200 according to the second embodiment. The code reading device 200 according to the second embodiment is different from the code reading device 100 according to the first embodiment in that it includes an execution unit 104. The execution unit 104 is an embodiment of the execution means of the present disclosure. Regarding the configuration of the image acquisition unit 101, the information acquisition unit 102, and the output unit 103 according to the second embodiment, the same configuration as the image acquisition unit 101, the information acquisition unit 102, and the output unit 103 according to the first embodiment is detailed. The explanation is omitted.

The display image output by the output unit 103 is displayed on a display unit (not shown). Based on the displayed display image, the user grasps the information indicated by the code and selects the code. The execution unit 104 accepts the selection of the code and executes the process associated with the selected code. The process executed by the execution unit 104 differs depending on the application included in the code reading device 200. Specific examples of the processing executed by the execution unit 104 will be described later in the description according to the third embodiment of the present disclosure.

(Operation example)
Hereinafter, the operation of the code reading device 200 according to the second embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing an operation example of the code reading device 200 according to the second embodiment.

When the camera captures an image including a plurality of codes, the image acquisition unit 101 acquires the captured image captured by the camera (step S11). The information acquisition unit 102 acquires the information indicated by each of the plurality of codes included in the captured image (step S12). The output unit 103 outputs a display image in which the information indicated by each of the plurality of codes is associated with the code (step S13). When the user selects a code based on the displayed image, the execution unit 104 executes the process associated with the selected code (step S14).

(effect)
According to the second embodiment, even when a plurality of codes are included in the captured image, the process associated with the code desired by the user can be efficiently executed. The reason is that the output unit 103 outputs a display image in which the information indicated by the code is associated with the code, and the execution unit 104 executes the process associated with the selected code.

[Third Embodiment]
(composition)
FIG. 7 is a block diagram illustrating the configuration of the mobile terminal 500 according to the third embodiment. The mobile terminal 500 according to the third embodiment includes a code reading device 200 according to the second embodiment, a display unit 300, a camera 400, and a communication unit 410. A detailed description of the code reading device 200 having the same configuration as that described in the second embodiment will be omitted.

The display unit 300 displays the display image output by the output unit 103. The display unit 300 may be, for example, a touch panel. Further, the display unit 300 accepts the selection of the code by the user. The user touches the code or the area of the information indicated by the code in the display unit 300 to select the code. The display unit 300 passes the information indicated by the selected code to the execution unit 104.

The camera 400 captures an image including a plurality of codes and transmits the captured image to the image acquisition unit 101.

The execution unit 104 receives the information indicated by the selected code from the display unit 300, and executes the process associated with the selected code. Hereinafter, two specific examples of the processing associated with the selected code executed by the execution unit 104 will be shown.

-First Specific Example As a first specific example, a specific example will be described in which the information indicated by each of the plurality of codes indicates the acquisition destination of the information. For example, the information indicated by each of the plurality of codes may be a URL indicating a web page. In this case, for example, the mobile terminal 500 is a terminal owned by the user, and the image acquisition unit 101, the information acquisition unit 102, and the output unit 103 are realized by the application program of the camera included in the mobile terminal 500. Further, the execution unit 104 is realized by a web browser. The execution unit 104 acquires and displays the content of the web page indicated by the URL as the acquisition destination information indicated by the selected code. FIG. 8 is a block diagram illustrating the configuration of the system according to the first specific example. In FIG. 8, the communication unit 410 is communicably connected to the web server 610.

FIG. 9A is a diagram illustrating an operation example of the mobile terminal 500 according to the first specific example. The captured image acquired by the image acquisition unit 101 includes a plurality of codes indicating URLs. The output unit 103 outputs a display image 30 in which the URL 32 acquired by the information acquisition unit 102 by converting the code is associated with the code. As shown in FIG. 9A, the display unit 300 displays the display image 30.

When the user selects a code, the execution unit 104 acquires the content of the web page from the web server via the communication unit 410 based on the URL indicated by the selected code. Then, as shown in FIG. 9A, the execution unit 104 displays the acquired content 60 on the display unit 300.

In the above example, the URL 32 is displayed in association with the code as the information indicated by each of the plurality of codes in the display image 30. Not limited to this, information acquired based on the URL may be used as the information indicated by each of the plurality of codes in the display image 30.

FIG. 9B is a diagram illustrating another operation example of the mobile terminal 500 according to the first specific example. In the example of FIG. 9B, in the display image 30, the image 33 is displayed in addition to the URL 32 as the information indicated by each of the plurality of codes. Image 33 is a thumbnail image (reduced image of the web page) of the web page acquired based on the URL. The output unit 103 may use the title of the web page acquired based on the URL instead of the thumbnail image such as the image 33 as the information indicated by the code. Further, when the thumbnail image or title of the web page is displayed, the URL 32 may be omitted. By looking at the display image 30, the user can grasp the outline of the link destination of the URL 32 corresponding to each of the plurality of codes before selecting the code.

Further, in the above example, the information acquired by the execution unit 104 is the information of the URL indicated by the selected code. Not limited to this, the information acquired by the execution unit 104 may be other information as long as it can be acquired based on the information indicated by each of the plurality of codes (information indicating the acquisition destination). For example, suppose that the information indicated by each of the plurality of codes is information that identifies an account of a social network service (SNS). In this case, for example, the mobile terminal 500 is a terminal owned by the user, and the image acquisition unit 101, the information acquisition unit 102, the output unit 103, and the execution unit 104 are realized by the SNS application program. The execution unit 104 acquires and displays the profile information corresponding to the SNS account as the acquisition destination information indicated by the selected code.

In this case, the captured image acquired by the image acquisition unit 101 includes a plurality of codes for identifying the account. The information acquisition unit 102 acquires the account name indicated by the code. The output unit 103 outputs a display image in which the captured code is associated with the account name. The execution unit 104 acquires and displays the profile information corresponding to the account name based on the selected code.

The information that identifies the account may be the account name. The information acquisition unit 102 includes thumbnail images of profile information corresponding to the account name and a part of the profile information (for example, an image and a name of a user corresponding to the account name) as information indicated by each of the plurality of codes. May be used. In this case, the output unit 103 outputs a display image in which a part of the profile is associated with the code.

-Second Specific Example As a second specific example, a specific example will be described in which the information indicated by each of the plurality of codes indicates a product identifier. For example, the information indicated by each of the plurality of codes may be an identifier of a product purchased by the user (hereinafter, also referred to as an ID (Identifier)).

In stores such as convenience stores and supermarkets, customers use a mobile terminal 500 to read a code attached to a product and store the product to be purchased in the PoS server 620. In this case, the image acquisition unit 101, the information acquisition unit 102, the output unit 103, and the execution unit 104 are realized by, for example, a product registration application program included in the mobile terminal 500.

When it is not possible to directly attach a code to a product, for example, the code of a plurality of products is printed on a code sheet. Since a plurality of codes are printed close to each other on the code sheet, the camera 400 included in the mobile terminal 500 captures an image including the plurality of codes.

FIG. 10 is a block diagram illustrating the configuration of the system according to the second specific example. In FIG. 10, the communication unit 410 is communicably connected to the PoS (Point of Sales) server 620.

FIG. 11 is a diagram showing an example of information in which a product ID and a product name are associated with each other, which is stored in an external device (not shown). FIG. 12 is a diagram showing an example of information in which the customer ID and the information about the product purchased by the customer are associated with each other, which is stored in the PoS server 620.

FIG. 13 is a diagram showing an example of a screen displayed by the display unit 300. When the customer presses the "add product" button, the camera 400 is activated to capture the code. The image acquisition unit 101 acquires an captured image. The information acquisition unit 102 converts the code 20 attached to the product based on the captured image, and acquires the sequence 31 which is the product ID. The output unit 103 outputs, for example, a display image 30 in which the captured code and the product ID are associated with each other.

The information acquisition unit 102 may refer to the database in which the product ID and the product name are associated as shown in FIG. 11 and acquire the product name related to the code. In this case, the output unit 103 outputs, for example, a display image 30 in which the captured code 20 and the acquired product name 35 are associated with each other.

The customer looks at the display image 30 and selects a code corresponding to the product to be purchased. In FIG. 13, the user selects the product name 35 “cafe latte (M)” indicated by the code 20 with the code identifier 34 “circled 1”. The execution unit 104 transmits the product ID of the selected product to the PoS server 620 via the communication unit 410. The communication unit 410 transmits, for example, the customer ID to the PoS server 620. Based on the received information, the PoS server 620 updates the information associated with the customer ID shown in FIG. 12 and the product purchased by the customer. The execution unit 104 may receive a list of registered products from the PoS server 620 as the content 60. In this case, as shown in FIG. 13, the display unit 300 displays the content 60 in which the "M size cafe latte" is added to the registered product screen.

The customer can further read the product ID by pressing the "add product" button again. The customer can purchase the registered product by pressing the "payment" button. The mobile terminal 500 may be a smartphone owned by the customer or a terminal rented out at a store.

Although the case where the display unit 300 included in the mobile terminal 500 accepts the selection of the code has been described above in the third embodiment, the configuration of the mobile terminal 500 is not limited to this. An input device (not shown) such as a keyboard or a mouse may be connected to the mobile terminal 500. The execution unit 104 included in the mobile terminal 500 may accept the selection of a code from the input device.

(effect)
FIG. 18 is a diagram illustrating a scene where the code is read. When the code is imaged using the customer's mobile terminal, it is necessary to hide the other code by hand or paper as shown in FIG. 18 in order to execute the process related to the desired code.

According to the third embodiment, when the captured image contains a plurality of codes, the user can efficiently select the codes. According to the mobile terminal 500 according to the present disclosure, the code can be easily selected even when the code indicating the URL is arranged close to each other. Further, according to the mobile terminal 500 according to the present disclosure, a desired barcode can be selected and a product can be registered.

[Transformation example of display image]
Another example of the display image 30 will be described. The output unit 103 may output a display image in which the display image is divided into a plurality of areas, the captured image is arranged in one area, and the information indicated by the code is arranged in the other area. 14 and 15 are views showing another example of the display image 30.

In the example of FIG. 14, the display image 30 is divided into an upper area and a lower area. The captured image is arranged in the upper area, and the information indicated by the code is arranged in the lower area. Six codes are imaged, and information indicated by two of the six codes is arranged in the lower area. An arrow button 54 for displaying another code may be arranged. The user presses the arrow button 54 to display the information indicated by the other code. The user may swipe the area where the information indicated by the code is arranged to display the information indicated by another code. Also, the arrow buttons 54 may not be arranged to indicate that there are no other undisplayed codes. Further, the end mark 55, which is a grayed out arrow button, may be arranged.

In the example of FIG. 15, the captured image is reduced and arranged at the top, and the information indicated by the code is arranged over the entire screen. When it is not possible to display all the information indicated by the code on one screen, a frame 53 indicating which code the information corresponding to which code is displayed may be superimposed on the captured image. The output unit 103 may output the display image 30 as shown in FIGS. 14 and 15.

FIG. 16 is a diagram showing a code and an example of the information indicated by the code. As shown in FIG. 16, the code B may form a part of the code A. At this time, the information acquisition unit 101 of the code reading device acquires the information of the code B without making the user who is trying to acquire the information of the code A recognize it, and the execution unit 104 executes a process not intended by the user. There is a possibility that it will be done.

FIG. 17 is a diagram showing another example of the display image 30. In order to solve the above problem, in the display image 30, when a part of the specific code forms another code, the output unit 103 has the other code added to the specific code as shown in FIG. It may be indicated by a plurality of arrows that it is included. As a result, the user can cause the execution unit 104 to execute the process after confirming the content indicated by each code.

Further, the output unit 103 may indicate the number of codes included in the captured image in the display image 30 as shown in FIG. In the example of FIG. 17, it is displayed that the captured image contains five codes. By showing the number of codes included in the captured image on the display image, the user can confirm whether the number of codes recognized by the user matches the number of codes acquired by the code reading device. If the numbers do not match, the user can determine that one code may form part of another.

[Hardware configuration]
FIG. 19 is a diagram illustrating a hardware configuration. The above procedure can be realized by a program that realizes the functions of the code reading devices 100, 200 and the mobile terminal 500 on the computer 9000 that functions as the code reading devices 100 and 200 and the mobile terminal 500. Such a computer is exemplified in a configuration including a CPU (Central Processing Unit) 9010, a communication interface 9020, a memory 9030, and an auxiliary storage device 9040 in FIG. That is, the CPU 9010 in FIG. 19 may execute the program and update each calculation parameter held in the auxiliary storage device 9040 or the like.

Each part (processing means, function) of the device shown in each of the above-described embodiments causes the processors mounted on the code reading devices 100, 200, and the mobile terminal 500 to execute each of the above-mentioned processes by using the hardware thereof. It can be realized by a computer program.

The present disclosure has been described above by using the above-described embodiment as a model example. However, the present disclosure is not limited to the embodiments described above. That is, the present disclosure can be applied in various aspects that can be understood by those skilled in the art within the scope of the present disclosure.

100, 200 Code reader 101 Image acquisition unit 102 Information acquisition unit 103 Output unit 104 Execution unit 20 Code 30 Display image 31 Sequence 32 URL
33 Image 34 Code identifier 35 Product name 300 Display unit 400 Camera 410 Communication unit 500 Mobile terminal 53 Frame 54 Arrow button 55 End mark 610 Web server 620 PoS server 60 Content

Claims (10)

An image acquisition means for acquiring an captured image containing a plurality of codes, and
An information acquisition means for acquiring information indicated by each of the plurality of codes included in the captured image, and
An output means for outputting a display image in which the information indicated by each of the plurality of codes is associated with the code, and
A code reader equipped with. An execution means for executing the process associated with the selected code among the plurality of codes, and
The code reading device according to claim 1. The information indicated by each of the plurality of codes represents the acquisition destination of the information.
The code reading device according to claim 2, wherein the executing means acquires and displays information on the acquisition destination indicated by the selected code. The information indicated by each of the plurality of codes represents an identifier of the product.
The code reading device according to claim 2, wherein the executing means registers a product indicated by the selected code. The output means
The identifier assigned to each of the plurality of codes is attached to the image associated with the code and the image.
The information indicated by each of the plurality of codes is associated with an image associated with an identifier assigned to the code, and
The code reading device according to any one of claims 1 to 4, which outputs a display image including. The output means claims 1 to 1 to claim 1, wherein the display image is divided into a plurality of areas, the captured image is arranged in one of the areas, and the information indicated by the code is arranged in the other areas. The code reading device according to any one of 5. The display image includes information indicating the number of codes included in the captured image when a part of the specific code forms another code among the plurality of codes. The code reading device according to any one of the following items. The display image includes information indicating that the specific code includes another code when a part of the specific code forms another code among the plurality of codes. The code reading device according to any one of items 7 to 7. Acquire a captured image containing multiple codes and
The information indicated by each of the plurality of codes included in the captured image is acquired, and the information is shown.
The information indicated by each of the plurality of codes outputs a display image associated with the code.
How to read the code. The process of acquiring an image containing multiple codes and
The process of acquiring the information indicated by each of the plurality of codes included in the captured image, and
A process of outputting a display image in which the information indicated by each of the plurality of codes is associated with the code, and
A code reader that lets your computer run.

Images