CN116324797A - Information acquisition device, information acquisition program, and information acquisition method - Google Patents
Information acquisition device, information acquisition program, and information acquisition method Download PDFInfo
- Publication number
- CN116324797A CN116324797A CN202180066888.7A CN202180066888A CN116324797A CN 116324797 A CN116324797 A CN 116324797A CN 202180066888 A CN202180066888 A CN 202180066888A CN 116324797 A CN116324797 A CN 116324797A
- Authority
- CN
- China
- Prior art keywords
- information
- code
- unit
- image
- information acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 21
- 235000008429 bread Nutrition 0.000 description 16
- 238000010411 cooking Methods 0.000 description 16
- 238000004891 communication Methods 0.000 description 11
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 235000013305 food Nutrition 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 240000007594 Oryza sativa Species 0.000 description 2
- 235000007164 Oryza sativa Nutrition 0.000 description 2
- 240000004808 Saccharomyces cerevisiae Species 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 235000012054 meals Nutrition 0.000 description 2
- 235000009566 rice Nutrition 0.000 description 2
- 241000209140 Triticum Species 0.000 description 1
- 235000021307 Triticum Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 235000013312 flour Nutrition 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 239000004615 ingredient Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 235000015927 pasta Nutrition 0.000 description 1
- 235000013550 pizza Nutrition 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 150000003839 salts Chemical class 0.000 description 1
- 239000012257 stirred material Substances 0.000 description 1
- 238000003756 stirring Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Toxicology (AREA)
- Tourism & Hospitality (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
The information acquisition device includes an image acquisition unit, a display control unit, a code identification unit, a code selection unit, and a code reading unit. The image acquisition unit acquires an image including an information code. The display control unit displays the image acquired by the image acquisition unit on the display device. The code recognition unit recognizes an information code included in the image acquired by the image acquisition unit. The code selecting section receives a selection instruction for selecting an information code to be read from among the information codes displayed on the display device and recognized by the code recognizing section, from the user. The code reading section reads information stored in the information code selected by the user.
Description
Technical Field
The invention relates to an information acquisition device, an information acquisition program, and an information acquisition method.
Background
Under the current situation that many people hold mobile terminals such as smart phones, information codes such as QR codes (registered trademark) readable by the mobile terminals are widely used.
For example, patent document 1 discloses a music listening trial service system. In this system, a two-dimensional code is read as digital image data. And decoding and transmitting the music identification symbol of the requested music content according to the read digital image data of the two-dimensional code. The requested music content is received and played.
Prior art literature
Patent literature
Patent document 1: japanese patent laid-open No. 2006-227240
Disclosure of Invention
Information codes are expected to be used more frequently in a wide range of fields such as information provision and settlement. Therefore, a technique for further improving the convenience of the user when reading the information code is required.
The present invention provides a technology for improving the convenience of a user when reading information codes.
One embodiment of the present invention is an information acquisition apparatus. The information acquisition device of the present embodiment includes a display device, an image acquisition unit, a display control unit, a code recognition unit, a code selection unit, and a code reading unit.
The image acquisition unit acquires an image including an information code. The display control unit causes the display device to display the image acquired by the image acquisition unit. The code recognition unit recognizes an information code included in the image acquired by the image acquisition unit.
The code selecting section receives a selection instruction for selecting an information code to be read from among the information codes recognized by the code recognizing section displayed on the display device, from the user. The code reading section reads information stored in the information code selected by the user.
Another aspect of the present invention is an information acquisition program in an information acquisition apparatus including a computer and a display device. The information acquisition program according to the present embodiment causes a computer to function as an image acquisition unit, a display control unit, a code identification unit, a code selection unit, and a code reading unit.
The image acquisition unit acquires an image including an information code. The display control unit causes the display device to display the image acquired by the image acquisition unit. The code recognition unit recognizes an information code included in the image acquired by the image acquisition unit.
The code selecting section receives a selection instruction for selecting an information code to be read from among the information codes recognized by the code recognizing section displayed on the display device, from the user. The code reading section reads information stored in an information code selected by a user.
According to the technology of the invention, the convenience of a user when reading the information code can be improved.
Drawings
Fig. 1 is a block diagram of an information providing system according to an embodiment of the present invention.
Fig. 2 is a diagram showing an example of a menu list.
Fig. 3 is a diagram showing an example of a display screen displayed by the information acquisition device.
Fig. 4A is a diagram showing an example of layers constituting a display screen displayed by the information acquisition apparatus.
Fig. 4B is a diagram showing an example of layers constituting a display screen displayed by the information acquisition apparatus.
Fig. 5 is a view showing another example of a display screen displayed by the information acquisition device.
Fig. 6 is a structural diagram of an information acquisition device according to an embodiment.
Fig. 7 is a flowchart showing a procedure of the information acquisition method of the embodiment.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, a detailed description other than that necessary may be omitted. For example, descriptions of known matters or repeated descriptions of substantially the same structure may be omitted.
The drawings and the following description are provided to enable those skilled in the art to fully understand the present invention, and are not intended to limit the subject matter described in the technical scheme.
In this embodiment, an information code storing information is read to acquire information. The information code is, for example, a one-dimensional code such as a bar code, a two-dimensional code such as a QR code, or a graphic code such as a three-dimensional code. The two-dimensional code may be a matrix type such as a QR code or a stacked type in which a plurality of one-dimensional bar codes are stacked.
The present embodiment is an example of reading an information code storing address information for accessing an information providing server providing recipe information of a cooking which can be cooked using a cooker. The address information is a path on the information providing server storing recipe information.
The address information may be URL (uniform resource locator) or the like which can be accessed by a protocol such as HTTP (hypertext transfer protocol). The address information may be a character string, a symbol, or the like for generating an address by a predetermined procedure.
When address information is stored with information available to a general browser such as URL, a general service can be provided in which the information providing server can be accessed by a general information code reader and browser to obtain recipe information.
The technique of the present invention can be applied to a heating cooker capable of performing at least a part of the cooking steps. The heating cooker includes a microwave oven, an oven, a baking oven, a gas oven, an electric rice cooker, a home bread machine (briad machine), an IH cooking heater (induction cooktop), an electric grill, a pressure cooker, and the like.
The technique of the present invention can be applied to cookers such as blenders, juicers, and food processors. The technique of the present invention can be applied to a terminal device used for information provision, settlement, and the like, and a general household electrical appliance product having an information code.
An example of reading the information code to obtain recipe information of a cooking capable of cooking with the home-type bread machine from the information providing server will be mainly described below.
[1-1. Structure ]
Fig. 1 shows a configuration of an information providing system 10 according to an embodiment of the present invention. The information providing system 10 includes a home-type bread maker 20, an information acquisition device 100, an information providing server 200, and a communication network 12 connecting the two.
The home-type bread maker 20 is a device for automatically making bread such as white toast (pan de mie), square bread, and bread roll (brioche) from materials such as wheat flour, yeast (yeast), salt, and water. The home-type bread maker 20 includes setting information for automatically performing a process of stirring materials, a process of fermenting the stirred materials, a process of baking the fermented materials, and the like for each type of bread.
The home-type bread maker 20 further includes setting information for making bread dough, pizza dough, roux, pasta, and the like, and setting information for making cakes, jams, fillings, rice cakes, and the like. The user specifies the desired cooking from these ingredients via the user interface 21. The home-type bread maker 20 automatically cooks according to the set information of the designated cooking.
The information providing server 200 provides recipe information showing required materials, pretreatment, and the like. The information providing server 200 has recipe information for each cooking capable of automatic cooking.
The information acquisition device 100 is used for a user to view recipe information and the like. The information acquisition device 100 may be a mobile phone terminal such as a smart phone, a tablet terminal, or the like.
The user retrieves the desired cooking from the menu list 30 attached to the home toaster 20. The menu list 30 records, for each cooking, an information code 40 storing address information for acquiring recipe information of the cooking that can be automatically cooked by the home-type bread maker 20.
The user causes the information acquisition device 100 to read the information code 40, and the information code 40 stores address information for acquiring recipe information of a desired food. The information acquisition device 100 accesses the information providing server 200 using the read address information, acquires recipe information from the information providing server 200, and displays the recipe information.
Fig. 2 shows an example of the menu list 30. The menu list 30 includes menu numbers of cooking that the home-type bread maker 20 can automatically cook, cooking names, and information codes 40a to 40d. The information codes 40a to 40d store address information of the information providing server 200, respectively, and the information providing server 200 provides recipe information of each cooking.
Fig. 3 shows an example of a display screen 150 displayed by the information acquisition apparatus. In order to acquire recipe information from the information providing server 200, the user uses the imaging device of the information acquisition device 100 to capture the information code 40 of the menu list 30. The information acquisition device 100 displays the captured image on a display device.
When the information code 40 is included in the captured image, the information acquisition device 100 recognizes the information code included in the captured image. For example, the QR code has a square shape as a whole, and has a position detection pattern at three of its four corners. The information acquisition device 100 detects a position detection pattern from the captured image, and recognizes the information code 40 when all three position detection patterns of the information code 40 are detected. The information acquisition device 100 displays the identified information code so as to be identifiable.
As shown in fig. 3, in order to indicate that the information code is recognized, a block 41 of the mode a is displayed around the recognized information code. AR display is a technique of overlapping a virtual reality image on a computer with a real world image.
The information acquisition device 100 reads the information code 40 recognized from the photographed device in the background, and displays the decoded information code 40 in a recognizable manner. As shown in fig. 3, in order to indicate that the information code is readable, a block 42 of the mode B is displayed around the information code that was successfully read.
If the information acquisition apparatus 100 recognizes the information code 40c but cannot decode it, the AR displays the block 41 of the mode a instead of the block 42 of the mode B. In this case, the meaning of not being decoded may be displayed.
Only two of the three position detection patterns of the information code 40d are included in the captured image. Therefore, the information acquisition apparatus 100 cannot identify the information code 40d. Therefore, neither the block 41 of the mode a nor the block 42 of the mode B performs AR display in the information code 40d.
When the user selects the information code 40a or 40B of the frame 42 of the mode B displayed on the AR via the touch panel or the like, the display screen changes. That is, the information acquisition device 100 accesses the information providing server 200 using the address information stored in the selected information code 40. The information acquisition device 100 acquires recipe information of a meal corresponding to the selected information code 40, and displays the recipe information on the display device.
Even if the captured image includes three position detection patterns, there are cases where the information code cannot be recognized due to out-of-focus or the like. In this case, neither the block 41 of the mode a nor the block 42 of the mode B performs AR display in the information code.
When a user selects this information code as an information code to be read via a touch panel or the like, adjustment is performed so that the focus of the image pickup element is aligned with the information code. As a result, the information code is recognized. In order to indicate that the information code is recognized, a block 41 of the mode a is displayed around the recognized information code. When the identified information code is decoded, AR displays block 42 of mode B.
When a user photographs an information code with an imaging device in order to read the information code, a conventional information code reader acquires information stored in the information code that was first identified. Therefore, as shown in fig. 3, when a plurality of information codes are displayed in proximity to each other, another information code may be read before the information code that the user wants to read. In this case, the information code to be read cannot be read.
To solve this problem, the information acquisition apparatus 100 does not immediately access the information providing server 200 when reading the information stored in the information code. The information acquisition apparatus 100 waits until the user selects the information code to be read. The information code to be read is an information code that the user wants to read by the information acquisition apparatus 100.
Thus, the user can read a desired information code by the information acquisition device 100, and the user's convenience can be improved.
The information acquisition device 100 receives, from a user, a selection instruction of an information code to be read from among the identified information codes displayed on the display device. Thus, a user interface that is intuitively easy to understand can be provided, and convenience for the user can be improved.
Fig. 4A and 4B show examples of layers (layers) constituting a display screen displayed by the information acquisition apparatus 100. Fig. 4A shows a layer 151 that displays an image captured by the image capturing device of the information acquiring apparatus 100. Fig. 4B shows a layer 152 for the information acquisition apparatus 100 to display the frame 41 of mode a and the frame 42 of mode B.
In layer 152, box 41 of embodiment a is displayed at the location of the information code identified by information acquisition device 100. Block 42 of mode B is displayed at the position where the information acquisition apparatus 100 successfully reads the information code. The information acquisition device 100 displays the layer 151 and the layer 152 on the display device in an overlapping manner, thereby AR displaying the frame 41 of the mode a and the frame 42 of the mode B.
The display positions on the captured images of the frame 41 of the mode a and the frame 42 of the mode B are made to follow the movement of the information code 40 in the captured image by the physical movement or the like of the information acquisition device 100.
When the information codes 40a, 40B, 40c disappear from the captured image with the movement, and the identification or decoding of the information is not performed, the AR display of the block 41 of the mode a and the block 42 of the mode B is stopped.
Therefore, it is possible to prevent the AR display associated with the information code detected at one time from being accumulated and the photographed image from being difficult to see. It is possible to prevent difficulty in discriminating which information code is actually detected at present.
Fig. 5 shows another example of a display screen displayed by the information acquisition apparatus 100. When the user uses the information acquisition device 100 to photograph the information code 40, information such as a menu number or a cooking name may not be included in the photographed image. In this case, the user cannot recognize which information code 40 is the information code for acquiring the recipe information of the desired food preparation from the captured image.
In order to solve this problem, the information acquisition device 100 displays the associated information 43a and 43b associated with the information stored in the identified information code on the AR immediately above or in the vicinity of the information code. Thus, even when information or the like recorded around the information code 40 is not included in the captured image, the user can recognize the desired information code 40 by the associated information 43a and 43 b. As a result, the user's convenience can be improved.
The related information 43a and the related information 43b may be text, numerals, symbols, graphics, images, icons, or the like. The related information 43a and 43B may be displayed on the layer 152 of the frame 41 of the display format a and the frame 42 of the format B, or may be displayed on another layer in an overlapping (overlapping) manner.
The association information 43a, 43b may also be displayed within the box 42. The association information 43a, 43b may also be displayed outside the box 42 if the association information 43a, 43b is displayed in the vicinity of the information code 40 and the user is able to identify which information code the association information corresponds to.
At this time, even if the user selects the related information 43a, 43b via a touch panel or the like instead of the information code 40, the display screen changes. The information acquisition device 100 accesses the information providing server 200 using the address information stored in the selected information code 40. The information acquisition device 100 acquires recipe information of a meal corresponding to the selected information code 40 and displays the recipe information on the display device.
The display positions of the related information 43a and 43b on the captured image are made to follow the movement of the information code 40 on the captured image based on the physical movement of the information acquisition device 100 or the like. When the information codes 40a, 40b disappear from the captured image with the movement, and the identification or decoding of the information is not performed, the AR display of the associated information 43a, 43b is stopped.
Therefore, it is possible to prevent the AR display associated with the information code detected at one time from being accumulated and the photographed image from being difficult to see. It is possible to prevent difficulty in discriminating which associated information is displayed.
For example, the associated information may be stored in a predetermined location of the information read from the information code 40. The associated information may be stored separately from the main information to be read out from the information stored in the information code 40 by predetermined separation information.
The separation information may be a prescribed bit, character, string, symbol, or the like. In the present embodiment, address information is stored in the information code 40. Thus, also? The "equal character" stores the associated information as a query string as a separator character, such as "https:// xxx/menu1. Htmlar= Bai Tusi".
In this case, the information acquisition device 100 uses information stored before the separation information, among the information read from the information code 40, as the address information. The information acquisition device 100 uses information stored after separating the information as the associated information.
In the case where the amount of information stored in the information code 40 is smaller than the amount of information that the information code 40 can store, padding to supplement meaningless prescribed bits after valid data can be performed. That is, the information stored in the information code 40 includes "valid data", "predetermined terminal pattern", "padding".
In this case, the associated information may be stored at a position where the padding bit is stored. A general information code reader reads only valid data in the case of reading the information code 40. However, the information acquisition apparatus 100 can also read the padding bits to acquire the associated information when reading the information code 40. Accordingly, the AR display of the related information is enabled.
In this example, a general service that enables a general information code reader to read main information can be provided.
The associated information may be stored in another information code recorded or displayed in the vicinity of the information code 40. For example, the GS1 Datagram composition symbol (GS 1 DataBar Composite symbol) standardized to ISO/IEC24723 may also be utilized. The GS1 data bar synthetic symbol includes a symbol in which a plurality of one-dimensional bar codes are synthesized, a symbol in which a plurality of one-dimensional bar codes and two-dimensional codes are synthesized, a symbol in which a plurality of two-dimensional codes are synthesized, and the like.
The address information and the associated information may also be stored in different information codes using such a composite symbol. In this case, the information acquisition device 100 acquires the related information by reading the information code storing the type of the related information. The information acquisition device 100 acquires address information by reading an information code of the type of the stored address information.
The association information may also be provided from the information providing server 200. In this case, the information acquisition device 100 reads the information code to acquire the address information. The information acquisition device 100 accesses the information providing server 200 by using the address information to acquire the associated information.
The same address information may also be used to obtain the association information and recipe information. The address for acquiring the associated information may be different from the address for acquiring the recipe information.
In the latter case, the information acquisition device 100 generates an address for acquiring the associated information based on the address information read from the information code. The information acquisition device 100 accesses the information providing server 200 by using the address to acquire the related information.
The information acquisition device 100 may access the information providing server 200 each time the associated information is acquired. The information acquisition device 100 may download and hold the related information from the information providing server 200 at a predetermined timing.
In the former case, the latest information held in the information providing server 200 can be acquired. The amount of data held by the information acquisition apparatus 100 can be reduced. In the latter case, the delay time until the associated information is displayed can be reduced. The related information can be displayed even when the information acquisition apparatus 100 cannot communicate with the information providing server 200.
Fig. 6 shows a configuration of an information acquisition device 100 according to an embodiment. The information acquisition device 100 includes a communication device 101, an imaging device 102, an input device 103, a display device 104, a storage device 105, and a control device 120.
The communication device 101 controls communication by any communication method of wired or wireless. The image pickup device 102 picks up an image including the information code 40. The input device 103 accepts an instruction input from a user and transmits the instruction input to the control device 120. The display device 104 displays the display screen generated by the control device 120. The storage device 105 stores data, programs, parameters, and the like used by the control device 120.
The control device 120 includes an image acquisition unit 121, a code recognition unit 122, a code selection unit 123, a code reading unit 124, a related information acquisition unit 125, a recipe information acquisition unit 126, and a display control unit 127.
The control device 120 is composed of hardware such as a CPU (central processing unit: central processing unit), a memory, and other LSIs (large scale integrated circuits), and software such as programs stored in the memory.
In the present embodiment, the control device 120 is a functional block configured by cooperation of these elements. Therefore, those skilled in the art can easily understand that the control device 120 may be configured in various ways such as hardware alone, or a combination of hardware and software.
The image acquisition unit 121 acquires an image including an information code. The image acquisition unit 121 may acquire a captured image from the imaging device 102, or may acquire an image from another device via the communication device 101. The image acquisition unit 121 may acquire a moving image or a still image.
The image acquisition unit 121 may read out a moving image or a still image captured by the imaging device 102 and stored in the storage device 105. The image acquisition unit 121 may acquire a display image on a web browser (web browser) displaying a website (web) on which an information code is to be recorded. The image acquisition unit 121 may acquire an image of a website on which the information code is recorded from a document file such as a description of the use of the information code.
The code recognition unit 122 recognizes an information code included in the image acquired by the image acquisition unit 121. The code recognition unit 122 recognizes the information code by detecting a position detection pattern of the information code, for example.
When the code recognition unit 122 recognizes a plurality of information codes, the code selection unit 123 selects the information code to be read. The code selecting unit 123 may receive a selection instruction of the information code from the user via the input device 103. The code selecting unit 123 may automatically select the information code according to a predetermined rule. The code selecting unit 123 may preferentially select an information code closer to the center of the image, for example.
The code selecting unit 123 waits for a selection instruction from the user until a predetermined time elapses. The code selecting unit 123 may automatically select the information code according to a predetermined rule when a predetermined time elapses without receiving a selection instruction from the user. The rules may also be specified by the user in advance.
When one information code is recognized by the code recognition unit 122, the code selection unit 123 may automatically select the recognized information code when a predetermined time elapses without recognizing the state of the second information code.
The code selecting unit 123 may wait until receiving a selection instruction from the user without automatically selecting the information code. The user may designate in advance whether the code selecting section 123 automatically selects the information code, a standby time until the code selecting section 123 automatically selects the information code, or the like.
The code reading section 124 reads information stored in the information code. The code reading unit 124 may read information after the information code of the object to read information is selected by the code selecting unit 123. The code reading unit 124 may read information in the background before the code selecting unit 123 selects the information code to be read.
The related information acquisition unit 125 acquires related information related to information stored in the information code. The method for acquiring the related information is as described above. The related information acquisition unit 125 may acquire related information from the information providing server 200 at a predetermined timing, and store the related information in the storage device 105.
The recipe information acquiring unit 126 acquires address information stored in the information code selected by the code selecting unit 123 from the code reading unit 124. The recipe information obtaining unit 126 requests the information providing server 200 via the communication device 101 with recipe information using the address information. The recipe information acquiring unit 126 stores the recipe information acquired from the information providing server 200 in the storage device 105.
The display control unit 127 causes the display device 104 to display the image acquired by the image acquisition unit 121. The display control unit 127 displays the information code recognized by the code recognition unit 122 so as to be able to recognize the information code.
As described above, the display control unit 127 may superimpose the frame 41 of the display mode a on the identified information code. The display control unit 127 obtains the position information of the information code recognized by the code recognition unit 122 from the code recognition unit 122, and displays the frame 41 of the mode a at the position of the recognized information code in the layer 152.
The display control unit 127 displays the information code that the code reading unit 124 successfully read in a recognizable manner. As described above, the display control unit 127 may superimpose the frame 42 of the display mode B on the information code that has been successfully read.
The display control unit 127 obtains the position information of the information code recognized by the code recognition unit 122 from the code recognition unit 122, and displays the frame 42 of the format B at the position of the information code that has been successfully read in the layer 152.
The display control unit 127 displays the associated information associated with the information stored in the information code in the vicinity of the information code. As described above, the display control unit 127 may display the related information in the vicinity of the information code. The display control unit 127 may automatically adjust the position, size, display mode, etc. of the display related information so that the related information does not exceed the display screen.
The display control unit 127 obtains the position information of the information code recognized by the code recognition unit 122 from the code recognition unit 122, and displays the related information in the vicinity of the recognized information code in the layer 152. The position, size, display mode, etc. for displaying the related information may be specified by the user in advance.
The display control unit 127 causes the display device 104 to display the recipe information acquired by the recipe information acquisition unit 126.
In the image acquired by the image acquisition unit 121, a state in which one information code is not recognized by the code recognition unit 122 may be a case where a predetermined time has elapsed. In this case, the display control unit 127 may display the information code that is not recognized on the display device 104.
The user may select an information code that can be recognized by the code recognition unit 122 but cannot be read by the code reading unit 124. In this case, the display control unit 127 may display the meaning that it is not readable on the display device 104.
[1-2. Action ]
Next, the operation and operation of the information providing system 10 configured as described above will be described.
Fig. 7 is a flowchart showing a procedure of the information acquisition method according to the present embodiment. The image pickup device 102 of the information acquisition device 100 picks up an image of the information code described in the menu list 30 (step S10). The image acquisition unit 121 acquires an image including an information code (step S12). The display control unit 127 displays the image acquired by the image acquisition unit 121 on the display device 104 (step S14).
The code recognition unit 122 recognizes the information code included in the image acquired by the image acquisition unit 121 (step S16). The display control unit 127 superimposes the frame of the display mode a on the information code recognized by the code recognition unit 122 (step S18).
The code reading section 124 reads information stored in the information code recognized by the code recognition section 122 in the background (step S20). The display control unit 127 superimposes the frame of the display mode B on the information code successfully read by the code recognition unit 122 (step S22).
The related information acquiring unit 125 requests the information providing server 200 for related information related to the information stored in the information code (step S24). The information providing server 200 transmits the requested associated information to the information acquiring apparatus 100 (step S26).
The display control unit 127 superimposes and displays the acquired related information in the vicinity of the information code (step S28). When the related information is acquired from the information code or the like, the related information acquisition unit 125 acquires the related information from the information code or the like instead of step S24 and step S26.
The code selecting unit 123 receives a selection instruction of the information code from the user via the input device 103 (step S30). The recipe information acquiring unit 126 acquires address information stored in the information code selected by the code selecting unit 123 from the code reading unit 124. The recipe information obtaining unit 126 requests the information providing server 200 via the communication device 101 with recipe information using the address information (step S32).
The information providing server 200 transmits the requested recipe information to the information acquiring apparatus 100 (step S34). The display control unit 127 causes the display device 104 to display the recipe information acquired by the recipe information acquisition unit 126 (step S36).
[1-3. Effect etc. ]
As described above, in the present embodiment, the information acquisition device includes the image acquisition unit, the display control unit, the code identification unit, the code selection unit, and the code reading unit.
The image acquisition unit acquires an image including an information code. The display control unit displays the image acquired by the image acquisition unit on the display device. The code recognition unit recognizes an information code included in the image acquired by the image acquisition unit.
The code selecting unit receives a selection instruction from the user to select an information code to be read from among the information codes recognized by the code recognizing unit displayed on the display device. The code reading section reads information stored in an information code selected by a user.
Thus, a user interface that is easy for a user to use can be provided, and convenience for the user can be improved.
In the present embodiment, the display control unit displays the information code recognized by the code recognition unit so as to be able to recognize the information code. This can further improve the convenience of the user.
In the present embodiment, the display control unit superimposes and displays information indicating that the information code recognized by the code recognition unit is a recognized information code. This can further improve the convenience of the user.
In the present embodiment, the display control unit displays the information code that the code reading unit successfully read in a recognizable manner. This can further improve the convenience of the user.
In the present embodiment, the display control unit superimposes and displays information indicating readable information codes on the information codes that the code reading unit has successfully read. This can further improve the convenience of the user.
In the present embodiment, the display control unit displays the associated information associated with the information stored in the information code directly above or near the information code. This can further improve the convenience of the user.
In the present embodiment, the related information is information included in a predetermined position of information stored in the information code. Thus, the association information can be provided by a simple structure.
In the present embodiment, the related information is a character string included in the address information stored in the information code. Thus, the association information can be provided by a simple structure.
In the present embodiment, the associated information is information contained in bits that are complemented by padding after the information stored in the information code. Thus, the association information can be provided by a simple structure.
In the present embodiment, the related information is information acquired from an information providing server that can be accessed using address information stored in an information code. Thus, the association information can be provided by a simple structure.
In the present embodiment, the related information is information stored in another information code existing in the vicinity of the information code. Thus, the association information can be provided by a simple structure.
In the present embodiment, the code selecting unit receives a selection instruction of the related information displayed on the display device from the user, and selects the information code corresponding to the instructed related information. This can further improve the convenience of the user.
In the present embodiment, when the state in which only one of the information codes identified by the code identification unit is displayed on the display device continues for a predetermined time or longer, the code reading unit automatically reads the information stored in the information code. This can further improve the convenience of the user.
In the present embodiment, when a predetermined time elapses from a state in which neither the information code identified by the code identification unit nor the information code is displayed on the display device, the display control unit causes the display device to display the information code that is not identified and that times out. This can further improve the convenience of the user.
In the present embodiment, the information acquisition program causes a computer to function as an image acquisition unit, a display control unit, a code identification unit, a code selection unit, and a code reading unit.
The image acquisition unit acquires an image including an information code.
The display control unit displays the image acquired by the image acquisition unit on the display device. The code recognition unit recognizes an information code included in the image acquired by the image acquisition unit. The code selecting unit receives a selection instruction from the user to select an information code to be read from among the information codes recognized by the code recognizing unit displayed on the display device. The code reading section reads information stored in an information code selected by a user.
Thus, a user interface that is easy for a user to use can be provided, and thus convenience for the user can be improved.
(other embodiments)
The above embodiment is an example of the technology of the present invention. The technique of the present invention is not limited thereto. Other embodiments are as follows.
In the above embodiment, the information code 40 is recorded in the menu list 30. In other embodiments, the information code 40 may be displayed on a display device or the like of the home-type bread maker 20. The technique of the present invention can be applied to a terminal device used for information provision, settlement, and the like, and to all home appliances having an information code storing information.
In the above embodiment, the information acquisition device 100 acquires recipe information from the information providing server 200. However, the information acquisition device 100 may acquire recipe information from a database in dedicated application software having the present function. Hereinafter, application software is referred to as an application.
The dedicated application having the present function is not a so-called web application (web application), but a local application that acts offline. When the database of recipe information in the information providing server 200 is updated, the information acquiring apparatus 100 updates the local application in a state where communication with the information providing server 200 is possible.
Thus, the user can view recipe information by the information acquisition device 100 even when not in the network environment. The dedicated application may acquire updated recipe information from the information providing server 200 and store the updated recipe information in a database in the dedicated application.
In this case, the information code includes address information for accessing recipe information in a database of a dedicated application executed in the information acquiring apparatus 100. The address information may be, for example, text information such as "menu1" or text information such as text information written using text information such as "http: "," https: "a character string of a custom URI pattern (custom uniform resource identifier schema) starting from the outside, and the like.
Industrial applicability
The present invention can be used in an information acquisition device for reading an information code.
Description of the reference numerals
10: an information providing system; 12: a communication network; 20: a home bread machine; 21: a user interface; 30: a menu list; 40: an information code; 40a: an information code; 40b: an information code; 40c: an information code; 40d: an information code; 41: a frame; 42: a frame; 43a: association information; 43b: association information; 100: an information acquisition device; 101: a communication device; 102: an image pickup device; 103: an input device; 104: a display device; 105: a storage device; 120: a control device; 121: an image acquisition unit; 122: a code identification unit; 123: a code selecting section; 124: a code reading section; 125: a related information acquisition unit; 126: a recipe information acquisition unit; 127: a display control unit; 150: displaying a picture; 151: a layer; 152: a layer; 200: and an information providing server.
Claims (16)
1. An information acquisition device, wherein the information acquisition device comprises:
a display device;
an image acquisition unit configured to acquire an image including an information code;
a display control unit configured to cause a display device to display the image acquired by the image acquisition unit;
a code identifying unit configured to identify the information code included in the image acquired by the image acquiring unit;
a code selecting unit configured to receive a selection instruction from a user, the selection instruction being for selecting the information code to be read from the information codes identified by the code identifying unit, the information code being displayed on the display device; and
and a code reading unit configured to read information stored in the information code selected by the user.
2. The information acquisition apparatus according to claim 1, wherein,
the display control unit is configured to: the information code recognized by the code recognition unit is displayed so as to be recognizable.
3. The information acquisition apparatus according to claim 2, wherein,
the display control unit is configured to: and displaying information indicating that the information code is recognized by the code recognition unit in an overlapping manner on the information code.
4. The information acquisition apparatus according to any one of claims 1 to 3, wherein,
the display control unit is configured to: the information code that the code reading section successfully reads is displayed in a recognizable manner.
5. The information acquisition apparatus according to claim 4, wherein,
the display control unit is configured to: information indicating that the information code is readable is displayed superimposed on the information code successfully read by the code reading section.
6. The information acquisition apparatus according to any one of claims 1 to 5, wherein,
the display control unit is configured to: associated information associated with information stored in the information code is displayed directly above or near the information code.
7. The information acquisition apparatus according to claim 6, wherein,
the associated information is information contained at a prescribed position of information stored in the information code.
8. The information acquisition apparatus according to claim 7, wherein,
the associated information is a character string contained in address information stored in the information code.
9. The information acquisition apparatus according to claim 7, wherein,
the associated information is information contained in bits that are complemented by padding after the information stored in the information code.
10. The information acquisition apparatus according to claim 6, wherein,
the associated information is information acquired from an information providing server that can be accessed using address information stored in the information code.
11. The information acquisition apparatus according to claim 6, wherein,
the associated information is information stored in other information codes existing in the vicinity of the information code.
12. The information acquisition apparatus according to any one of claims 6 to 11, wherein,
the code selecting unit receives a selection instruction of the associated information displayed on the display device from a user, and selects the information code corresponding to the indicated associated information.
13. The information acquisition apparatus according to any one of claims 1 to 12, wherein,
the code reading section is configured to: when the state in which only one of the information codes identified by the code identification unit is displayed on the display device continues for a predetermined time or longer, information stored in the information code is automatically read.
14. The information acquisition apparatus according to any one of claims 1 to 13, wherein,
the display control unit is configured to: when a predetermined time elapses from a state in which none of the information codes identified by the code identification unit is displayed on the display device, the display device is caused to display an indication that the information code has not been identified and has timed out.
15. An information acquisition program in an information acquisition device provided with a computer and a display device, wherein the information acquisition program causes the computer to function as:
an image acquisition unit configured to acquire an image including an information code;
a display control unit configured to cause the display device to display the image acquired by the image acquisition unit;
a code identifying unit configured to identify the information code included in the image acquired by the image acquiring unit;
a code selecting unit configured to receive a selection instruction from a user, the selection instruction being for selecting the information code to be read from the information codes identified by the code identifying unit, the information code being displayed on the display device; and
and a code reading unit configured to read information stored in the information code selected by the user.
16. An information acquisition method in an information acquisition device provided with a display device, comprising the steps of:
an image acquisition unit that acquires an image including an information code;
a display control unit that causes the display device to display the image acquired by the image acquisition unit;
a code recognition unit that recognizes the information code included in the image acquired by the image acquisition unit;
a code selecting section that receives a selection instruction for selecting the information code as a reading target from the information codes identified by the code identifying section displayed on the display device; and
the code reading section reads information stored in the information code selected by the user.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2020168167 | 2020-10-05 | ||
| JP2020-168167 | 2020-10-05 | ||
| PCT/JP2021/031467 WO2022074955A1 (en) | 2020-10-05 | 2021-08-27 | Information acquisition device, information acquisition program, and information acquisition method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116324797A true CN116324797A (en) | 2023-06-23 |
Family
ID=81125803
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202180066888.7A Pending CN116324797A (en) | 2020-10-05 | 2021-08-27 | Information acquisition device, information acquisition program, and information acquisition method |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JPWO2022074955A1 (en) |
| CN (1) | CN116324797A (en) |
| WO (1) | WO2022074955A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7323901B1 (en) | 2022-11-09 | 2023-08-09 | ソノー電機工業株式会社 | Information processing program and information processing terminal |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006119921A (en) * | 2004-10-21 | 2006-05-11 | Nec Corp | Rental service server and rental service system |
| JP2008299412A (en) * | 2007-05-29 | 2008-12-11 | B-Core Inc | Optical recognition code recognition result display method |
| JP2014071818A (en) * | 2012-10-01 | 2014-04-21 | Sharp Corp | Two-dimensional code reader and two-dimensional code reading method |
-
2021
- 2021-08-27 WO PCT/JP2021/031467 patent/WO2022074955A1/en active Application Filing
- 2021-08-27 JP JP2022555297A patent/JPWO2022074955A1/ja active Pending
- 2021-08-27 CN CN202180066888.7A patent/CN116324797A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022074955A1 (en) | 2022-04-14 |
| JPWO2022074955A1 (en) | 2022-04-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10819905B1 (en) | System and method for temperature sensing in cooking appliance with data fusion | |
| WO2017004999A1 (en) | Cooking system, terminal, server and cooking method | |
| CN104146586A (en) | Intelligent cooking device and working method of intelligent cooking device | |
| CN111580430A (en) | Control method and device of cooking equipment, cooking equipment and cooking system | |
| CN105630525B (en) | Page synchronization method and device | |
| CN111035261B (en) | Cooking control method, device and equipment | |
| WO2020027633A2 (en) | Cooking recipe service providing method for creating and sharing recipe | |
| CN112336208B (en) | Cooking control method, cooking appliance, terminal and readable storage medium | |
| CN108415301B (en) | Cooking parameter changing method and device | |
| CN116324797A (en) | Information acquisition device, information acquisition program, and information acquisition method | |
| CN112017754A (en) | Menu recommendation method and device, range hood and storage medium | |
| JP2017021650A (en) | Cooking recipe creation method and program | |
| CN111131855A (en) | Cooking process sharing method and device | |
| CN108388151A (en) | Cooking device control method, device, computer equipment and storage medium | |
| US9369515B2 (en) | Communication method, communication device, appliance control method, and appliance control device | |
| CN111419096A (en) | Food processing method, controller and food processing equipment | |
| CN112006520A (en) | Cooking processing method, cooking equipment, user terminal and storage device | |
| WO2016009551A1 (en) | Information processing device, information processing method and program | |
| WO2022074948A1 (en) | Cooker and display method in display device of cooker | |
| CN115963742A (en) | Menu generation method and intelligent kitchen power system | |
| JPH11243874A (en) | Cooking system | |
| EP3731131A1 (en) | Apparatus for assisted cooking | |
| CN112099372A (en) | Menu generation method and device, cooking equipment, mobile terminal and storage medium | |
| US20200387536A1 (en) | Information processing device, information processing method, program, and storage medium | |
| CN112330399A (en) | Intelligent cooking method convenient for sharing user-defined dishes, computer-readable storage medium and intelligent cooking equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |