JP2019113887A - Facility identification apparatus and program thereof - Google Patents

Abstract

To provide a facility identification apparatus and a program thereof capable of reducing amount of data regarding an image of a mat of each of facilities to be stored on storage means and identifying the facility with high accuracy when identifying a target facility using the mat.SOLUTION: A facility identification apparatus includes: storage means for storing identification information of a target facility and feature point data of a pattern of a mat that is installed in the target facility and has a different pattern for each target facility in association with each other for each of the plurality of facilities; and second control means for comparing the feature point data generated by first control means from a picked-up image picked up by imaging means and the feature point data of the pattern of each of the mats stored in the storage means to determine whether or not any of the mats is included in the picked-up image, and if it is determined to be included, acquiring the identification information of the target facility in association with the feature point data of the pattern of the mat determined to be included in the picked-up image from the storage means. The feature point data of the pattern of each of the mats stored in the storage means is generated from a design image of the pattern of each of the mats.SELECTED DRAWING: Figure 13

Description

  The present invention relates to a facility specifying apparatus for specifying a target facility using a mat and a program thereof.

  In Patent Document 1, a captured image of a mat (cover) captured by a camera of a portable information terminal is transmitted to a server, and the server receives the captured image received from the portable information terminal and a master image of the mat for each store. It is determined by comparison whether or not any mat is included in the captured image, and when it is determined that it is included, the store associated with the mat determined to be included An information retrieval system is disclosed that transmits related information to a portable information terminal. According to this information search system, it is possible to provide the information related to the store to the portable information terminal even in the information terminal without the GPS function or the environment where the GPS function can not be used.

Patent No. 5735071 gazette

  In patent document 1, although the comparison of an image is performed in a server, it is also considered that the comparison of an image is performed in a portable information terminal. In this case, although it is necessary to store the data of the master image of the mat in the storage means of the portable information terminal, the storage means of the portable information terminal is constituted by a ROM, for example, and compared with a hard disk device etc. Capacity is small. Therefore, when data of mat master images for a large number of stores is stored in the storage unit of the portable information terminal, the remaining capacity of the storage unit may be reduced or storage may not be possible due to lack of capacity. Although it is conceivable to reduce the resolution of the master image and store it in the storage means of the portable information terminal, an erroneous determination may be made in the comparison of the images, and the accuracy of the shop specification may be reduced.

  The present invention enables facility specification with high accuracy while reducing the amount of data related to the image of the mat of each target facility stored in the storage means when specifying a target facility such as a store using a mat. The facility specifying device and its program are provided.

The facility identification device according to the present invention is
Storage means for correlating and storing, for each of a plurality of target facilities, identification information of the target facility and feature point data of a mat pattern installed in the target facility and having a different pattern for each target facility;
Either the feature point data generated by the first control unit from the captured image captured by the imaging unit is compared with the feature point data of the pattern of each mat stored in the storage unit, either of the captured image If it is determined that it is included, it is linked with feature point data of the pattern of the mat determined to be included in the captured image from the storage means. And second control means for acquiring identification information of the target facility.
The feature point data of the pattern of each mat stored in the storage means is generated from the design image of the pattern of each mat.

  A facility identification program according to the present invention causes a computer to function as a first control unit and / or a second control unit in a facility identification apparatus.

  According to the present invention, when specifying a target facility using a mat, the facility specification can be performed with high accuracy while reducing the amount of data related to the image of the mat of each target facility to be stored in the storage means.

FIG. 1 is a configuration diagram of an information search system according to a first embodiment. FIG. 1 is an external view of a portable electronic device. FIG. 2 is a block diagram showing the configuration of a portable electronic device. FIG. 6 is a diagram showing data stored in a ROM of the portable electronic device. It is a block diagram showing composition of a server. It is a figure showing data stored in HDD of a server. It is a figure showing composition of store information DB memorized by HDD of a server. It is a figure showing composition of feature point DB memorized by HDD of a server. It is a figure showing an example of a design image of a pattern of a mat. It is the figure ((a) figure) which showed the structure of the mat | matte typically, and the enlarged view of the X9 part of FIG. 9 ((b) figure). FIG. 10 is a diagram in which feature points extracted by performing feature point extraction processing on the design image of FIG. 9 are superimposed and displayed. It is a figure showing an example of a pattern which is not suitable as a pattern of a mat. It is the flowchart which showed an example of operation | movement of a portable electronic device. It is a figure showing an example of the picture displayed on the indicator of a portable type electronic device. It is the flowchart which showed an example of operation | movement of a server. FIG. 16 is a diagram showing data stored in the ROM of the portable electronic device in Embodiment 2. FIG. 16 is a flowchart showing an example of the operation of the portable electronic device in Embodiment 2. FIG. FIG. 16 is a diagram showing data stored in the ROM of the portable electronic device in the third embodiment. 15 is a flowchart illustrating an example of operation of the portable electronic device in Embodiment 3. 21 is a flowchart showing an example of the operation of the server in the third embodiment. FIG. 16 is a flowchart showing an example of the operation of the portable electronic device in Embodiment 4. FIG. 21 is a flowchart showing an example of the operation of the server in the fourth embodiment.

  A facility specifying device according to an embodiment of the present invention will be described with reference to the drawings.

Embodiment 1
1. Configuration FIG. 1 is a configuration diagram of an information search system according to the first embodiment.

  The information search system of the present embodiment includes a portable electronic device 10 and a server 20. The portable electronic device 10 and the server 20 are connected via a network such as the Internet. In the present embodiment, an example in which the facility specifying device according to the present invention is applied to a portable electronic device 10 will be described.

1-1. Configuration of Portable Electronic Device FIG. 2 is an external view of the portable electronic device 10.

  A display unit 11, a camera 12, and an operation unit 13 are provided on the outer surface of the portable electronic device 10. A touch panel 14 is provided on the surface of the display unit 11. In the present embodiment, as an example, the case where the portable electronic device 10 is a smartphone is shown.

  FIG. 3 is a block diagram showing the configuration of the portable electronic device 10.

  In addition to the display unit 11, the camera 12, the operation unit 13, and the touch panel 14 described above, the portable electronic device 10 has a central processing unit 15 (hereinafter referred to as “CPU 15” as appropriate), a read only memory 16 (hereinafter referred to as “ROM 16 appropriately ), A random access memory 17 (hereinafter referred to as “RAM 17” as appropriate), and a communication interface 18 (hereinafter referred to as “communication I / F 18 as appropriate”).

  The CPU 15 performs arithmetic processing.

  The ROM 16 stores programs to be subjected to arithmetic processing by the CPU 15 and various data.

  The RAM 17 temporarily stores programs, data, and the like when the CPU 15 executes a program.

  The display unit 11 displays an image based on display image data output from the CPU 15. The display unit 11 is, for example, a liquid crystal display panel or an organic EL display panel.

  The operation unit 13 has a plurality of buttons. The button is, for example, a push button type switch, and can perform function selection or function execution instruction.

  The touch panel 14 is a planar pointing device. The touch panel 14 is provided so as to overlap the display surface of the display unit 11, and outputs a signal indicating the position touched by the user.

  The camera 12 captures an object and generates image data.

  The communication I / F 18 is an interface for communicating with an external device such as the server 20. The communication I / F 18 performs communication based on, for example, various communication standards defined by IEEE or the like.

  FIG. 4 is a diagram showing data stored in the ROM 16 of the portable electronic device 10.

  The ROM 16 stores an operating system 31 (hereinafter referred to as “OS 31” as appropriate), an application program 32 and a feature point database 33 (hereinafter referred to as “feature point DB 33” as appropriate) as programs and various data.

1-2. Configuration of Server FIG. 5 is a block diagram showing the configuration of the server 20. As shown in FIG.

  The server 20 includes a central processing unit 21 (hereinafter referred to as “CPU 21” as appropriate), a hard disk drive 22 (hereinafter referred to as “HDD 22” as appropriate), a random access memory 23 (hereinafter referred to as “RAM 23” as appropriate) (Hereinafter referred to as “communication I / F 24” as appropriate).

  The CPU 21 performs arithmetic processing.

  The HDD 22 stores programs and various data that are arithmetically processed by the CPU 21. In place of the hard disk drive, a solid state drive (SSD) may be provided to store the same data.

  The RAM 23 temporarily stores programs, data, and the like when the CPU 21 executes a program.

  FIG. 6 is a diagram showing data stored in the HDD 22 of the server 20. As shown in FIG.

  The HDD 22 includes an operating system 41 (hereinafter referred to as “OS 41” as appropriate), an application program 42, a feature point database 43 (hereinafter referred to as “feature point DB 43” as appropriate), and a store information database 44 (as a program or various data). Hereinafter, "store information DB 44" is appropriately stored. The feature point DB 43 is the master of the feature point DB 33 stored in the ROM 16 of the portable electronic device 10 in the first and second embodiments. The store information DB 44 is a database serving as a master of the store information DB 34 stored in the ROM 16 of the portable electronic device 10 in the second embodiment.

  FIG. 7 is a diagram showing the configuration of the shop information DB 44 stored in the HDD 22 of the server 20. As shown in FIG.

  The store information DB 44 stores (stores) sales promotion information (sales promotion information), position information, and floor number information in association with the name of the store. “Store” is an example of a target facility in the present invention. The name of the store is an example of identification information of a target facility in the present invention. The sales promotion information is, for example, information such as a bargain sale at the store. The position information is, for example, information indicating the latitude, longitude, etc. of the position where the mat M is installed in the store. The floor number information is information on the floor (the number of floors) on which the store exists, when the store exists in a building having a plurality of floors, such as a department store or a shopping mall. These pieces of information are registered by the manager of the information search system.

  FIG. 8 is a diagram showing the configuration of the feature point DB 43 stored in the HDD 22 of the server 20. As shown in FIG.

  The feature point DB 43 stores feature point data of the pattern of the mat disposed at the entrance of the store in association with the name of each store. Feature point data is generated from a design image of a matte pattern. Specifically, the feature point data is data including information such as feature amounts related to a plurality of feature points extracted from the design image of the mat pattern using a predetermined feature point extraction algorithm. The feature point data is generated, for example, by the management entity of the present system, and registered in the feature point DB 43. The predetermined feature point extraction algorithm may be any algorithm and a known algorithm may be used. In addition, it is preferable to make a predetermined | prescribed feature point extraction algorithm into the same algorithm as the feature point extraction algorithm used when extracting a feature point from the captured image of the camera 12 so that it may mention later.

  FIG. 9 is a view showing an example of a design image of a mat pattern. FIG. 10A is a view schematically showing the structure of the mat.

  FIG. 10A shows, as an example of the mat M used in the present embodiment, a pile mat having a plurality of piles Pi which are planted at regular intervals. The plurality of piles Pi are, for example, four per centimeter and sixteen per square centimeter at intervals of 2.5 millimeters. It should be noted that although the planting interval may be an interval other than the above, for example, when the pile becomes thick and the planting interval becomes large, rattling occurs in the pattern and a portion that can be detected as a feature point decreases. It becomes. Further, FIG. 10 (a) shows an example in which a plurality of piles Pi are uniformly planted, but the present invention is also applicable to the case where the pile mat has a tooth-like portion in which the piles are not planted. Applicable Further, FIG. 10A shows an example in which each pile is a loop pile, but the present invention is also applicable to a case where each pile is a cut pile. In addition, in order to reduce the influence by the change of the pattern by the fall etc. of the pile in use, it is preferable to make pile basis weight into 100 g / square meter or more.

  FIG.10 (b) is an enlarged view of X9 part of FIG.

  As shown in FIG. 10B, the design image is a bitmap image having a plurality of dots Do. In the design image, each of the plurality of dots Do is in one-to-one correspondence with each of the plurality of piles Pi. In the design image of the pile mat having the toothed portion as described above, the portion where the pile is not implanted is indicated by, for example, a dot of the same color as the color of the upper surface of the substrate on which the pile is implanted. .

  FIG. 11 is a diagram in which feature points extracted by performing feature point extraction processing on the design image of FIG. 9 are superimposed and displayed.

  In FIG. 11, the feature points extracted using a predetermined feature point extraction algorithm are indicated by ○. FIG. 11 shows an example using an algorithm for extracting, as a feature point, a corner portion, a closed portion, a straight portion and the like of a pattern formed by a difference in color and density as a predetermined feature point extraction algorithm. There are various algorithms for extracting feature points from an image, such as KAZE, ORB, AKAZE, MSER, GFTT, BRISK, FAST and the like. In the present invention, any algorithm may be used as a predetermined feature point extraction algorithm. Note that the feature points to be extracted differ depending on the feature point extraction algorithm to be used, so the algorithm used to extract the feature points from the design image is the same as the algorithm used to extract the feature points from the captured image It is preferable to

  Further, in the present embodiment, a design image of a matte pattern is created on the premise that feature points are extracted using a predetermined feature point extraction algorithm. For example, in the case where the feature point extraction algorithm to be used is an algorithm for extracting corner portions, closed portions, straight portions and the like of a pattern formed by differences in color and density as described above, the mat pattern is , Corners, closures, straight sections, etc. are designed to include at least one or more elements. In addition, the pattern of the mat is designed so as to have a predetermined number or more of the above-described portions extracted as feature points. The predetermined number is, for example, two. If the number is only one, the comparison based on the positional relationship between feature points can not be appropriately performed, and therefore, two or more are used. In the mat included in the captured image, corners and straight portions related to the contour of the mat are detected as feature points, but the predetermined number does not include the number of the characteristic points detected with respect to the contour of the mat. If the predetermined number is increased, feature points used for comparison can be increased and the identification accuracy of the mat can be improved, but the processing time becomes longer.

  The design image of FIG. 9 has a design in which the character “A” is designed in a brush-like manner, but in consideration of extracting feature points using a predetermined feature point extraction algorithm, arrows Ca and Cb We cut off the part of the eyebrow, shown in, and modified the font to form two corners each. Generally, the portion of the weir becomes gradually thinner and the tip becomes rounded, but in this embodiment, the portion of the weir is cut off and the corner is intentionally formed so as to be extracted as a feature point.

  FIG. 12 is a view showing an example of a pattern which is not suitable as a pattern of a mat.

  In FIG. 12, feature points extracted by using an algorithm for extracting corner portions, closed portions, straight portions, and the like of a pattern formed by differences in color and density as a predetermined algorithm are superimposed on a mat pattern as a predetermined algorithm. it's shown. The design image shown in FIG. 12 has a design in which the character "u" is designed in a brush-like manner, but since only one corner is included, the feature points detected by the above algorithm are 1 It is only one. If only one feature point is detected, the comparison based on the positional relationship between the feature points is not taken into consideration, and erroneous determination increases, so the pattern of FIG. 12 is not appropriate. In order to make this an appropriate pattern, for example, as in the case of the letter "A" in FIG. 9, the portion of the glide of the letter "u" is cut off and the font is made so that two corners are formed respectively. It should be corrected. By designing in this manner, two corner portions that can be extracted as feature points are formed.

2. Operation 2-1. Operation of Portable Electronic Device FIG. 13 is a flowchart showing an example of the operation of the portable electronic device 10. The operation based on the flowchart is realized by the application program 32 stored in the ROM 16 of the portable electronic device 10 being activated by the user and executed by the CPU 15, for example.

  When the application program 32 is activated, the CPU 15 of the portable electronic device 10 performs update processing of the feature point DB 33 (S20). Specifically, the CPU 15 of the portable electronic device 10 communicates with the server 20 via the communication I / F 18, and the version of the feature point DB 43 stored in the server 20 and the ROM 16 of the portable electronic device 10 The stored version of feature point DB 33 is compared, and if the version of feature point DB 33 on the side of portable electronic device 10 is older, feature point DB 43 stored in server 20 is downloaded and feature point DB 33 is stored. Update the contents of As a result, the feature point DB 33 on the portable electronic device 10 side is maintained at the latest version.

  The CPU 15 of the portable electronic device 10 determines whether an image has been captured using the camera 12 (S21).

  When an image is not captured using the camera 12 (NO in S21), the CPU 15 of the portable electronic device 10 executes the determination of step S21 again.

  When an image is captured using the camera 12 (YES in S21), the CPU 15 of the portable electronic device 10 performs processing for extracting feature points from the image (captured image) captured by the camera 12 Point data is generated (S22).

  The CPU 15 of the portable electronic device 10 compares feature point data generated from an image (captured image) captured by the camera 12 with each feature point data stored in the feature point DB 33, and each feature point data The degree of coincidence is obtained for (S23). The comparison can be performed, for example, using a known feature-based matching method (SIFT, SURF, ORB, etc.). For example, the CPU 15 of the portable electronic device 10 matches each of the feature point data of the mat pattern of each target facility generated from the design image and stored in the feature point DB 33 with the feature point data generated from the captured image With respect to the feature points included in the feature point data generated from the captured image, the feature point group including the feature point group closest to (in agreement with or similar to) the feature point group included in the feature point data generated from the design image Explore. Then, for each feature point data, the degree of coincidence is obtained by quantitatively evaluating the amount of difference in positional relationship or the amount of difference in color for the feature point group having the closest color or positional relationship as a result of the search. The degree of coincidence is a value indicating the degree of similarity (similarity) between the two, and the higher the degree of similarity, the larger the value.

  The CPU 15 of the portable electronic device 10 determines whether feature point data having a degree of coincidence equal to or higher than a predetermined degree of coincidence (predetermined degree of similarity) is present in the characteristic point data stored in the characteristic point DB 33. (S24). The predetermined degree of coincidence is set, for example, to the degree of coincidence when the two to be compared are substantially the same.

  If there is feature point data having a degree of coincidence equal to or higher than a predetermined degree of coincidence (YES in S24), the CPU 15 of the portable electronic device 10 stores store name information associated with the characteristic point data having the highest degree of coincidence Are read from the feature point DB (S25).

  Here, in steps S22 to S25, the CPU 15 of the portable electronic device 10 stores feature point data generated by the first control unit (CPU 15) from the captured image captured by the imaging unit (camera 12) and storage unit (CPU 15). By comparing the feature point data of the patterns of each mat stored in the ROM 16 (feature point DB 33), it is determined whether or not any mat is included in the captured image, and it is determined that it is included. When the identification information (store name information) of the target facility (store) linked with the feature point data of the pattern of the mat determined to be included in the captured image is obtained from the storage means It should be noted that when feature point data having a degree of coincidence equal to or higher than a predetermined degree of coincidence exists, it can be determined that any captured image is included in the captured image, but it is In this case, in the present embodiment, identification information (store name) of a target facility (store) associated with feature point data having the highest matching degree may be present. Reliability is improved by acquiring information).

  The CPU 15 of the portable electronic device 10 transmits the read store name information to the server 20 via the communication I / F 18 (S26).

  The CPU 15 of the portable electronic device 10 determines whether store information has been received from the server 20 as a response to the transmitted store name information (S27).

  When store information has not been received from the server 20 (NO in S27), the CPU 15 of the portable electronic device 10 executes the determination of step S27 again.

  When store information is received from the server 20 (YES in S27), the CPU 15 of the portable electronic device 10 causes the display unit 11 to display the received store information as shown in FIG. 14, for example (S28).

  FIG. 14 is a view showing an example of an image displayed on the display unit 11 of the portable electronic device 10.

  For example, the CPU 15 of the portable electronic device 10 causes the display unit 11 to display the sales promotion information J included in the store information received from the server 20 on the image G captured by the camera 12. In FIG. 14, for example, an example is shown in which the information J “○ donut today chocolate domino 50 yen discount” is displayed. At this time, the CPU 15 of the portable electronic device 10 may further cause the display unit 11 to superimpose the information (an example of the identification information) of the store name read in step S25. As a technique for superimposing display in this manner, a known augmented reality AR technique can be used. In the example of FIG. 14, the portable electronic device 10 uses the mat M as a marker to display sales promotion information. At this time, the portable electronic device 10 may display a map in the vicinity of the local area and display the position of the shop on the map, based on the position information and the floor number information included in the acquired shop information.

  If there is no feature point data having the degree of coincidence equal to or more than the predetermined degree of coincidence in the determination of step S24 (NO in S24), the CPU 15 of the portable electronic device 10 causes the display unit 11 to display error information (S29). For example, information such as “The recognition could not be made. Please shoot the mat again” is displayed. The reason why it is determined that feature point data having a degree of coincidence equal to or higher than a predetermined degree of coincidence does not exist is, for example, that the image picked up by the camera 12 is unclear, the mat in the picked up image is too small, The mat in a captured image is not registered into feature point DB33, etc. are mentioned.

  After execution of step S28 or S29, the CPU 15 of the portable electronic device 10 determines whether the user has performed an application termination operation (S30).

  If there is no application termination operation (NO in S30), the CPU 15 of the portable electronic device 10 returns to the process of step S21.

  If there is an application termination operation (YES in S30), the CPU 15 of the portable electronic device 10 terminates the execution of the application program 32, and terminates the processing of this flowchart.

2-2. Operation of Server FIG. 15 is a flowchart showing an example of the operation of the server. The operation based on the flowchart is realized by the CPU 21 executing an application program 42 stored in the HDD 22 of the server 20.

  The CPU 21 of the server 20 determines whether the information of the store name has been received from the portable electronic device 10 (S40).

  When the information of the store name is not received from the portable electronic device 10 (NO in S40), the CPU 21 of the server 20 executes the determination of step S40 again.

  When the store name information is received from the portable electronic device 10 (YES in S40), the CPU 21 of the server 20 stores the store information (promotional information, position information, floor number information) linked to the received store name information Are read out from the store information DB 44 (S41).

  The CPU 21 of the server 20 transmits the store information (promotional information, position information, floor number information) read in step S41 to the portable electronic device 10 of the transmission source (S42), and returns to the process of step S40.

3. Function 3-1. Information Retrieval Process According to the server 20 of the information retrieval system of the present embodiment, when any of the plurality of mats M is included in the image captured by the camera 12, the included mat M is included. Information related to the installed store can be displayed on the display unit 11. For example, even when the GPS can not be used, it is possible to provide the user with information related to the store in which the included mat M is installed.

  For example, when the user walks while photographing a landscape with the portable electronic device 10 with the application program 32 activated, the mat M is automatically installed when the mat M is detected in the image. The information related to the shop is displayed superimposed on the image of the scenery. Therefore, the user can easily acquire information such as a shop related to the current position, and the convenience of the user is improved.

  Further, according to the present embodiment, when any of the plurality of mats M is included in the image captured by the camera 12, the installation position of the mat M based on the contained mat M, That is, it is possible to substantially identify the current position of the user. Therefore, even when GPS can not be used, for example, it is possible to provide the user with information indicating the current position based on the information of the installation position of the mat M.

3-2. Store Identification Processing In Patent Document 1, the server stores the master image of the mat of each store, and the server compares the captured image received from the portable electronic device with the master image of the mat of each store. , Identify the store where the mat is located. Since the process of image comparison is a relatively high load for a server using a computer, for example, when a large number of captured images are transmitted from a large number of portable electronic devices to the server at almost the same time, the image comparison The load may increase and the response may decrease.

  In order to reduce the processing load on the server, for example, it is conceivable to perform image comparison on the portable electronic device side. However, in order to perform accurate image comparison, a master image having the highest possible resolution is required, and the data amount of the master image becomes large. If the master image of such a large amount of data is stored in a relatively small capacity storage means (ROM etc.) of the user's portable electronic equipment etc. for many stores, the storage means (ROM etc.) of the portable electronic equipment ) Is not preferable because the volume of Although it is conceivable to reduce the resolution of the master image and store it in the storage means of the portable information terminal, an erroneous determination may be made in the comparison of the images, and the accuracy of the shop specification may be reduced.

  In order to solve this, according to the present invention, the feature point data of the pattern of each mat is stored in the storage means as data for image comparison. Therefore, the volume of data for image comparison can be reduced.

  In addition, in the present invention, feature point data of the pattern of each mat is generated from the design image of the pattern of each mat. Therefore, the accuracy of the feature point data of the comparison reference can be increased. Therefore, it is possible to make a high accuracy comparison. If the data to be stored in the storage means and used as a reference for comparison is, for example, a captured image captured by an administrator of a target facility using an imaging device, the master may be a master depending on focus accuracy, resolution, camera shake etc. The quality of the image may not be sufficient. However, according to the present invention, the feature points are extracted from the design image to generate feature point data, so that the problem with the above-described imaging does not occur. Thus, a comparison with constant quality and accuracy is possible.

  Further, in the present invention, each design image is an image in a bitmap format, whereby, as feature point data of a pattern of each mat, generating feature point data storing information of feature quantities with high accuracy it can. If the image from which feature points are extracted is an image in a compression format such as, for example, JPG format or GIF format, the image feature noise such as block noise accompanying compression may also lower the accuracy of the feature quantity of the feature points obtained. . However, in the present embodiment, each design image is an image in a bitmap format, so the influence of noise and the like is suppressed, and feature point data storing information such as highly accurate feature amounts can be generated. . Therefore, the accuracy of comparison will be improved. In the present invention, it is not excluded that each design image is an image in a compression format such as JPG format or GIF format.

  Further, since each design image is a bitmap format image having a plurality of dots corresponding to each of a plurality of piles in a one-to-one manner, feature points with higher accuracy can be obtained as feature point data of patterns of each mat. Data can be generated. Therefore, the accuracy of the comparison will be further improved.

  Furthermore, in the present invention, each design image is designed so as to have a predetermined number or more of portions extracted as feature points of a pattern, thereby further improving the identification accuracy of the mat and the store associated with the mat be able to.

Second Embodiment
The second embodiment will be described.

1. Configuration In the first embodiment, the server 20 performs a search process of store information, but in the present embodiment, the portable electronic device 10 performs a search process of store information. Further, since the portable electronic device 10 performs a search process of the store information, as shown in FIG. 16, the store information DB 34 is also stored in the ROM 16 of the portable electronic device 10. Similar to the first embodiment, the store information DB 44 (master) is also stored in the HDD 22 of the server 20. Hereinafter, differences from the portable electronic device 10 and the server 20 according to the first embodiment will be mainly described.

2. Operation 2-1. Operation of Portable Electronic Device FIG. 17 is a flowchart showing an example of the operation of the portable electronic device 10 according to the second embodiment.

  In the flowchart in the present embodiment, steps S20B and S26A are provided in place of steps S20, S26 and S27 of the flowchart of FIG. 13 in the first embodiment.

  Specifically, in step S20B, the CPU 15 of the portable electronic device 10 performs update processing of the feature point DB 33 and the store information DB 34. Specifically, the CPU 15 of the portable electronic device 10 communicates with the server 20 via the communication I / F 18, and the versions of the feature point DB 43 and the store information DB 44 stored in the server 20, and the portable electronic device The versions of the feature point DB 33 and the store information DB 34 stored in the ROM 16 of 10 are compared with each other, and when the version of the feature point DB 33 and / or the store information DB 34 on the portable electronic device 10 side is old The stored feature point DB 43 and / or the store information DB 34 are downloaded, and the contents of the feature point DB 43 and / or the store information DB 34 are updated. As a result, the feature point DB 33 on the portable electronic device 10 side and the store information DB 34 are both maintained at the latest version.

  Further, when the information (an example of identification information) of the store name linked to the feature point data having the highest matching degree is read out from the feature point DB in step S25 (S25), the CPU 15 of the portable electronic device 10 The store information (sales promotion information, position information, floor number information) linked to the information of the store name read in step S 25 is read out from the store information DB 34 (S 26 A)

  The CPU 15 of the portable electronic device 10 causes the display unit 11 to display the contents indicated by the store information (promotional information, position information, floor information) read in step 26A (S28), and as in the first embodiment, the determination in step S30. I do.

2-2. Operation of Server When the portable electronic device 10 makes an update request for the feature point DB 33 and the store information DB 34, the server 20 performs transmission processing of update data and the like.

3. According to the present embodiment, when the portable electronic device 10 performs the image comparison process, the pattern data of each mat serving as a comparison reference is stored in the ROM 16 of the portable electronic device 10 as much as possible. , And the identification accuracy of the mat and the store associated with the mat can be further improved.

  Further, according to the present embodiment, processing from the image pickup of a mat by the camera 12 of the portable electronic device 10 to the display of the facility related information on the display unit 11 (display means) is performed only on the portable electronic device 10 side. Thus, the communication can be completed without communicating with the server 20. Therefore, for example, while the search burden of the store information in the server 20 is reduced, the response of the store information display in the portable electronic device 10 can be improved.

Third Embodiment
The third embodiment will be described.

1. Configuration In the first embodiment, the portable electronic device 10 performs both the process of extracting feature points from the captured image and the process of comparing the feature points, but in the present embodiment, the feature points are extracted from the captured image. The portable electronic device 10 performs the process, and the server 20 performs the feature point comparison process. Further, since the feature point comparison process is performed by the server 20, the ROM 16 of the portable electronic device 10 does not store the feature point DB (see FIG. 18). As in the first embodiment, the feature point DB 43 (master) is stored in the HDD 22 of the server 20. Hereinafter, differences from the portable electronic device 10 and the server 20 according to the first embodiment will be mainly described.

2. Operation 2-1. Operation of Portable Electronic Device FIG. 19 is a flowchart showing an example of the operation of the portable electronic device 10 according to the third embodiment.

  In the flowchart in the present embodiment, step S20 of the flowchart in the first embodiment is deleted, and step S27B is provided instead of steps S23, 24, and S25.

  Specifically, in step S22, the CPU 15 of the portable electronic device 10 performs processing for extracting feature points from the image (captured image) captured by the camera 12 and generates feature point data (S22) The generated feature point data is transmitted to the server 20 via the communication I / F 18 (S22A).

  The CPU 15 of the portable electronic device 10 determines whether store information has been received from the server 20 as a response to the transmitted feature point data (S27).

  When store information is received from the server 20 (YES in S27), the CPU 15 of the portable electronic device 10 causes the display unit 11 to display the content indicated by the received store information (S28).

  On the other hand, when store information has not been received from the server 20 (NO in S27), whether the CPU 15 of the portable electronic device 10 has received error information from the server 20 as a response to the transmitted feature point data (S27B).

  If the error information has not been received from the server 20 (NO in S27B), the CPU 15 of the portable electronic device 10 executes the determination of step S27.

  If the error information is received from the server 20 (YES in S27B), the CPU 15 of the portable electronic device 10 causes the display unit 11 to display the content indicated by the received error information (S29).

  After execution of step S28 or S29, the CPU 15 of the portable electronic device 10 performs the determination of step S30 as in the first embodiment.

2-2. Operation of Server FIG. 20 is a flow chart showing an example of the operation of the server 20 according to the third embodiment.

  In the flowchart of the present embodiment, step S40B is provided instead of step S40 of the flowchart of FIG. 15 in the first embodiment. Further, steps S40C, S40D, S40E, and S42B are provided instead of step S41.

  Specifically, the CPU 21 of the server 20 determines whether feature point data has been received from the portable electronic device 10 (S40B).

  If feature point data has not been received from the portable electronic device 10 (NO in S40B), the CPU 21 of the server 20 executes the determination of step 30B again.

  When feature point data is received from the portable electronic device 10 (YES in S40B), feature point data received from the portable electronic device 10, that is, feature point data of an image (captured image) captured by the camera 12, and features Each feature point data stored in the point DB 43 is compared, and the degree of coincidence is obtained for each feature point data (S40C). The process of step S40C is similar to the process performed by the portable electronic device 10 in step S23 of FIG. 13 of the first embodiment. Further, as in the first embodiment, the coincidence is a value indicating the degree of similarity between the two, and feature points can be compared using, for example, a known feature-based matching method.

  The CPU 21 of the server 20 determines whether feature point data having a degree of coincidence equal to or more than a predetermined degree of coincidence exists in the characteristic point data stored in the characteristic point DB 43 (S40D). The process of step S40D is similar to the process performed by the portable electronic device 10 in step S24 of FIG. 13 of the first embodiment. Further, as in the first embodiment, the predetermined degree of coincidence is set, for example, to the degree of coincidence when the two to be compared are substantially the same.

  When feature point data having a degree of coincidence equal to or higher than a predetermined degree of coincidence exists (YES in S40D), the CPU 21 of the server 20 stores the store name associated with the characteristic point data having the highest degree of coincidence from the feature point DB. Information is read out (S40E).

  The CPU 21 of the server 20 reads out from the store information DB 44 the store information (promotional information, position information, floor number information) linked to the information of the store name read in step S40E from the store information DB 44 (S41).

  The CPU 21 of the server 20 transmits the store information (promotional information, position information, floor information) read in step S41 to the transmission source portable electronic device 10 (S42), and returns to the process of step S40B.

  In step S40D, when there is no feature point data having a matching degree equal to or higher than a predetermined matching degree (NO in S40D), the CPU 21 of the server 20 transmits error information to the portable electronic device 10 of the transmission source (S42B) It returns to the process of step S40B.

3. According to the present embodiment, when the server 20 performs the comparison process, the mat, the mat and the string are stored while minimizing the volume of the pattern data of each mat as the reference of the comparison, which is stored in the HDD 22 of the server 20. The identification accuracy of the attached store can be further improved.

Embodiment 4
The fourth embodiment will be described.

1. Configuration In the first embodiment, the portable electronic device 10 performs both the feature point extraction process from the captured image and the feature point comparison process. However, in the present embodiment, the server 20 performs both of these processes. Do. Further, since the server 20 performs feature point comparison processing, the feature point DB is not stored in the ROM 16 of the portable electronic device 10 as in the third embodiment. As in the first to third embodiments, the feature point DB 43 (master) is stored in the HDD 22 of the server 20. Hereinafter, differences from the portable electronic device 10 and the server 20 in the third embodiment will be mainly described.

2. Operation 2-1. Operation of Portable Electronic Device FIG. 21 is a flowchart showing an example of the operation of the portable electronic device 10 according to the fourth embodiment.

  In the flowchart in the present embodiment, step S22 in the flowchart of FIG. 19 in the third embodiment is deleted, and step S22C is provided instead of steps S22 and S22B.

  Specifically, when an image is captured using the camera 12 (YES in S21), the CPU 15 of the portable electronic device 10 transmits the captured image of the camera 12 to the server 20 via the communication I / F 18. (S22C). Then, the same processing as that of the third embodiment is performed after step S27.

2-2. Operation of Server FIG. 22 is a flowchart showing an example of the operation of the server 20 in the fourth embodiment.

  In the flowchart of the present embodiment, steps S40F and S40G are provided instead of step S40B of the flowchart of FIG. 20 in the third embodiment.

  Specifically, the CPU 21 of the server 20 determines whether captured image data has been received from the portable electronic device 10 (S40F).

  If the captured image data has not been received from the portable electronic device 10 (NO in S40F), the CPU 21 of the server 20 executes the determination of step S40F again.

  When captured image data is received from the portable electronic device 10 (YES in S40F), the CPU 21 of the server 20 performs processing of extracting a feature point from the captured image data to generate feature point data (S40G). Then, the same processing as that of the third embodiment is performed after step S40C. The CPU 21 of the server 20 compares the feature point data generated in step S40G, that is, the feature point data generated from the image (captured image) captured by the camera 12 with the feature point data stored in the feature point DB 43. Then, processing such as (S40C) is performed to obtain the degree of coincidence for each feature point data, and thereafter, the same processing as that of the third embodiment is performed.

3. According to the present embodiment, when the server 20 performs the comparison process, the mat, the mat and the string are stored while minimizing the volume of the pattern data of each mat as the reference of the comparison, which is stored in the HDD 22 of the server 20. The identification accuracy of the attached store can be further improved.

  In addition, since extraction processing of feature points from a captured image is unnecessary in the portable electronic device 10, a constant response can be obtained regardless of the level of the computing capacity of the CPU 15.

(Summary)
As described above, in the first and second embodiments, the facility identification apparatus according to the present invention is applied to the portable electronic device 10, and in the third and fourth embodiments, the application is applied to the server 20. Hereinafter, the configuration of each embodiment described above will be described in a form in comparison with the scope of the claims. Note that this comparison is for the purpose of facilitating the understanding of the invention according to the claims described in the claims, and does not limit the invention. Other aspects will be described in other embodiments.

(1) A facility specifying device (the portable electronic device 10 in the first and second embodiments or the server 20 in the third and fourth embodiments) is
For each of a plurality of target facilities (stores (one example)), identification information of the target facilities (store name (one example)) and feature point data of a mat pattern installed in the target facilities and having a different pattern for each target facility And storage means for associating and storing (the ROM 16 in the first and second embodiments or the HDD 22 in the third and fourth embodiments);
The feature point data generated by the first control means (CPU 15 in Embodiments 1, 2 or 4 or CPU 21 in Embodiment 3) from the image captured by the imaging means (camera 12), and storage means When it is determined whether or not any of a plurality of mats is included in the captured image by comparing each of the stored feature point data of patterns of a plurality of mats, and it is determined that it is included. Is a second control means for acquiring the identification information (name of a store) of the target facility, which is linked with the feature point data of the pattern of the mat determined to be included in the captured image, from the storage means And the CPU 15 in the first and second embodiments or the CPU 21 in the third and fourth embodiments.
The feature point data of the pattern of each mat stored in the storage means is generated from the design image of the pattern of each mat.

  As a result, when specifying the target facility using the mat, it is possible to specify the facility with high accuracy while reducing the amount of data regarding the image of the mat of each target facility to be stored in the storage means. In particular, in portable electronic devices whose storage means are generally ROM, the capacity of the storage means is limited, but the facility specifying apparatus of the present invention can be suitably applied even to such portable electronic devices. . Further, since the feature point data of the pattern of each mat is generated from the design image of the pattern of each mat, the accuracy of the feature point data of each target facility serving as the reference of comparison stored in the storage means can be enhanced. Therefore, it is possible to make a high accuracy comparison.

(2) The facility specifying device (the portable electronic device 10 in the first, second, or fourth embodiment, or the server 20 in the third embodiment) is
It further includes first control means (CPU 15 in Embodiments 1, 2, 4 or CPU 21 in Embodiment 3) for extracting feature points from the captured image and generating feature point data.

  Thus, the facility identification apparatus itself can generate feature point data from the captured image.

(3) The facility identification device (the portable electronic device 10 in the first and second embodiments)
It further includes an imaging means (camera 12).

  Thus, the facility identification device itself can capture an image and obtain a captured image.

(4) The facility specifying device (the portable electronic device 10 in the second embodiment or the server 20 in the third and fourth embodiments) is
A second storage unit (the ROM 16 in the second embodiment or the embodiment stores the identification information of the target facility and the facility related information (store information) related to the target facility in association with each of a plurality of target facilities. HDD 22) in modes 1, 3 and 4;
Third control means (the CPU 15 in the second embodiment or the CPU 21 in the first, third and fourth embodiments) for reading out the facility related information linked with the identification information acquired by the second control means; Further include.

  Thereby, the facility related information on the target facility where the mat is installed can be acquired.

(5) The facility specifying device (the portable electronic device 10 in the first and second embodiments) is
First display means (display unit 11) for displaying an image;
Fourth control means for causing the first display means to display contents indicated by facility related information read by the third control means (the CPU 15 in the second embodiment or the CPU 21 in the first, third and fourth embodiments) And (CPU 15 in the first and second embodiments).

  Thus, the facility related information can be presented to the user of the facility specifying device (the portable electronic device 10 in the first and second embodiments) by the first display means.

(6) The facility specifying device (the portable electronic device 10 in the first and second embodiments) is
Second display means (display unit 11) for displaying an image;
Fifth control means (implementation for causing the second display means to display the content indicated by the identification information acquired by the second control means (CPU 15 in Embodiments 1 and 2 or CPU 21 in Embodiments 3 and 4) And the CPU 15) in the first and second embodiments.

  Thereby, the second display means can present the identification information of the target facility to the user of the facility specifying device (the portable electronic device 10 in the first and second embodiments).

(7) In the facility specifying device (the portable electronic device 10 in the first and second embodiments or the server 20 in the third and fourth embodiments),
Each design image is an image in bitmap format,

  Thus, it is possible to generate feature point data storing information such as highly accurate feature amounts as the feature point data of the pattern of each mat. Specifically, if the image from which feature points are extracted is an image in a compression format such as JPG format or GIF format, for example, the accuracy of the feature quantity of the feature points obtained may also decrease due to image noise accompanying compression. is there. However, in the present embodiment, each design image is an image in a bitmap format, so the influence of noise and the like is suppressed, and feature point data storing information such as highly accurate feature amounts can be generated. . Therefore, the accuracy of comparison will be improved.

(8) In the facility specifying device (the portable electronic device 10 in the first and second embodiments or the server 20 in the third and fourth embodiments),
Each mat is a pile mat having a plurality of piles,
Each design image is an image showing a pattern of each mat, and is a bitmap image having a plurality of dots corresponding to each of a plurality of piles one to one.

  As a result, feature point data with higher accuracy can be generated as feature point data of the pattern of each mat. Therefore, the accuracy of the comparison will be further improved.

(9) In the facility specifying device (the portable electronic device 10 in the first and second embodiments or the server 20 in the third and fourth embodiments),
The mat relating to the design image is designed to have a predetermined number or more of portions to be extracted as feature points when the extraction of feature points by the first control means is performed using a predetermined feature point extraction algorithm There is.

  This can further improve the identification accuracy.

(10) In the facility specifying device in the embodiment,
The facility related information is information indicating the position of the target facility where the mat is installed.

  Thereby, the display means can display the position of the target facility where the mat is installed.

(11) In the facility specifying device in the embodiment,
Facility related information is sales promotion information in a target facility where a mat is installed.

  As a result, the sales promotion information in the target facility where the mat is installed can be displayed on the display means.

(12) In the facility specifying device in the embodiment,
The second control means compares the feature point data generated by the first control means with the feature point data of the pattern of each mat stored in the storage means to obtain the degree of coincidence, and the predetermined degree of coincidence The identification information of the target facility associated with the feature point data having the highest matching degree among the feature point data having the matching degree is acquired.

  This makes it possible to identify the target facility with higher accuracy.

(13) The facility identification program in the embodiment (the application program 32 in the embodiments 1 and 2 or the application program 42 in the embodiments 3 and 4)
A computer (the CPU 15 in Embodiments 1 and 2 or the CPU 21 in Embodiments 3 and 4) is a facility specifying device (the portable electronic device 10 in Embodiments 1 and 2 or the server 20 in Embodiments 3 and 4). Function as the first control means and / or the second control means in the above.

(Other embodiments)
Although the case where mat | matte was pile mat was illustrated in said each embodiment, mat | matte other than pile mat may be sufficient as the mat | matte by the plant | facility identification apparatus which concerns on this invention. For example, the mat may be a rubber mat in which a pattern is formed on the surface of a rubber material by printing. Moreover, the mat | matte which formed the pattern by printing using the inkjet printer etc. may be sufficient on the surface of a plain pile mat. When a pattern is formed on the surface of a plain pile mat by printing using an inkjet printer or the like, even if piles and dots correspond one-to-one on the design image, there are a plurality of piles in the finished mat. Although the color of the ink may adhere, this is as assumed in the present invention and does not affect the effect of the present invention. The present invention is characterized in that feature point data of mat patterns serving as a reference for comparison are generated from design images of patterns for each mat. This feature makes it possible to use feature points for the mat pattern serving as a reference for comparison. The accuracy of feature point data as a reference of comparison can be made higher than in the case where data is created from an image obtained by photographing a real mat. And the comparison with the mat | matte contained in the captured image imaged with the portable electronic device of the user can be performed accurately.

  In each of the above embodiments, the design image of the matte pattern is a bitmap image, and dots and piles of the design image correspond to each other on a one-to-one basis. However, in the design image of the mat pattern in the present invention, for example, a plurality of dots may correspond to one pile, or one dot may correspond to n piles.

  In the first and second embodiments, the facility specifying device according to the present invention is applied to a portable electronic device, and the case is exemplified where the portable electronic device is a smartphone. However, the portable electronic device as the facility specifying device in the present invention may be, for example, a foldable mobile phone, a tablet computer, a notebook computer, a scouter tool, a compact digital camera, a digital single-lens camera, etc. Good.

  In the third and fourth embodiments, the facility specifying device according to the present invention is applied to a server, and an example in which the number of servers is one has been described. However, the server as the facility specifying device in the present invention may be configured by a plurality of computers connected via the Internet or a dedicated network. That is, the storage means, the second storage means, and the first to third control means in the present invention may be distributed and disposed one by one or in any combination. In the case of distributed arrangement, the data stored in the storage means, the second storage means, the data generated by the first to third control means, or the data indicating the processing result among the distributedly arranged computers, are transmitted to the Internet. You may send and receive via a dedicated network. An arbitrary protocol may be used to exchange data via the network.

  Moreover, although the said each embodiment demonstrated the case where the object plant | facility in which the mat | matte was installed was a shop, it is not limited to this. The present invention can target various facilities having information that may be notified.

  For example, the target facility may be a prefectural office, a city office, a town office, or any other public office facility. Also, the target facilities may be elementary schools, junior high schools, high schools, universities, vocational schools, and other educational facilities. Alternatively, the target facilities may be facilities such as nursing homes and hospitals. In the case of a target facility other than a store, a database (target facility information database) regarding the target facility may be provided instead of the store information DB in each of the above embodiments. The target facility information database may store at least predetermined information (target facility information) to be notified about the target facility in correspondence with the target facility. Further, the target facility information database may store position information and floor number information of the target facility. When target facilities of a plurality of or all categories of target facilities of various categories as described above are targeted, the target facility information database includes target facility information on all target facilities to be targeted. It should be configured.

  As an example, the case where the target facility is a government office facility will be described. In this case, a mat is installed in front of the entrance of a government office facility, and, for example, local character images and tourist guidance information are stored in the target facility information database as target facility information, and the mat is included in the captured image. When it is determined, the target facility information may be output from the server 20, and the local character image or the tourist guidance information may be displayed on the display unit 11 of the portable electronic device 10.

  In the above embodiment, the store information DB (target facility information DB) stores the information on the position where the mat is installed in the store as the position information, but instead of the position information on the mat, the store The position information of the (target facility) (information such as the latitude and longitude of the position where the target facility is located) may be stored. Also in this case, it is possible to notify the user of a position substantially equal to the current position of the user.

  Furthermore, in the present invention, not only buildings but also tenant facilities in buildings, passages in buildings, passages between multiple buildings, temporary facilities such as tenants, etc. are used as target facilities on which mats are installed. It can be set. For example, the passage in the store may be set as the target facility, and in this case, a mat is installed on the passage in the store, and a product displayed in the vicinity of the passage as target facility information in the target facility information DB. The information on the item may be stored, and when it is determined that the mat is included in the captured image, the information on the product displayed in the vicinity of the passage may be displayed. In addition, a passage such as a large-scale commercial facility such as a shopping mall or a department store in which a plurality of tenants move may be set as the target facility. In this case, when it is determined that the target facility information DB stores information on the entire shopping mall, information on a tenant existing in the vicinity of the passage, and the like as target facility information, and it is determined that a mat is included in the captured image The target facility information may be output from the server 20, and the display unit 11 of the portable electronic device 10 may display information on the entire shopping mall, information on a tenant present in the vicinity of the passage, and the like.

  Further, the target facility may be various facilities installed inside or outside a building or the like. For example, the equipment as the target facility may be a commodity display shelf disposed in a store. In this case, a mat is installed in front of the product display rack, and information on the product displayed on the product display rack is stored as the target facility information in the target facility information DB, for example, and the mat is included in the captured image. When it is determined, the information on the product displayed on the product display rack may be output from the server 20 and displayed on the display unit 11 of the portable electronic device 10.

  The equipment as the target facility may be, for example, a vending machine. In this case, a mat is installed in front of the vending machine, and, for example, information of products sold by the vending machine is stored in the target facility information DB as target facility information, and the mat is included in the captured image. When it is determined, the information on the product sold by the vending machine may be output from the server 20 and displayed on the display unit 11 of the portable electronic device 10.

  Moreover, although the example which superimposes and displays the information J and the frame on the imaged image G was demonstrated in this Embodiment, it does not restrict to this. For example, only characters relating to the information J may be displayed. Further, the information may be transmitted by voice together with the display of the information. In this case, sound may be generated from a speaker that is generally mounted on a portable electronic device such as a smartphone. Furthermore, even if the character of the clerk is displayed as if the clerk is present on the mat M, the information J is displayed or the voice is generated as if the character is singing. Good. In the store, since the mat M is usually arranged at the entrance of the store, displaying the store clerk on the mat M as described above also guides the entrance of the store.

10 Portable Electronic Device 11 Display Unit 12 Camera 13 Operation Unit 14 Touch Panel 15 CPU
16 ROM
17 RAM
18 Communication Interface 20 Server 21 CPU
22 HDD
23 RAM
24 Communication Interface 30 Network

Claims (13)

Storage means for correlating and storing, for each of a plurality of target facilities, identification information of the target facility and feature point data of a mat pattern installed in the target facility and having a different pattern for each target facility;
The feature point data generated by the first control unit from the captured image captured by the imaging unit is compared with the feature point data of the pattern of each mat stored in the storage unit to obtain the captured image. It is determined whether any mat is included, and when it is determined that it is included, feature point data of the pattern of the mat determined to be included in the captured image from the storage means And second control means for acquiring identification information of a target facility, which is linked;
The feature point data of the pattern of each mat stored in the storage means is generated from the design image of the pattern of each mat,
Facility identification device. It further includes the first control means for extracting feature points from the captured image to generate feature point data.
The facility identification device according to claim 1. Further comprising the imaging means;
The facility specifying device according to claim 1. A second storage unit that associates identification information of a target facility with facility-related information related to the target facility for each of the plurality of target facilities;
And third control means for reading out the facility related information associated with the identification information acquired by the second control means.
The facility specifying device according to any one of claims 1 to 3. First display means for displaying an image;
And fourth control means for causing the first display means to display contents indicated by the facility related information read out by the third control means.
The facility identification device according to claim 4. Second display means for displaying an image;
And fifth control means for causing the second display means to display the content indicated by the identification information acquired by the second control means.
The facility identification device according to any one of claims 1 to 4. Each design image is an image in bitmap format,
The facility identification device according to any one of claims 1 to 6. Each mat is a pile mat having a plurality of piles,
Each design image is a bitmap image having a plurality of dots corresponding to each of the plurality of piles in a one-to-one manner.
The facility identification device according to claim 7. Each design image is designed to have a predetermined number or more of portions to be extracted as feature points when the extraction of feature points by the first control means is performed using a predetermined feature point extraction algorithm ,
The facility specifying device according to any one of claims 1 to 8. Each facility related information is information indicating the position of the target facility where the mat is installed,
The facility specifying device according to claim 4 or 5. Each facility related information is sales promotion information in the target facility where the mat is installed,
The facility specifying device according to claim 4 or 5. The second control means compares the feature point data generated by the first control means with the feature point data of the pattern of each mat stored in the storage means, and determines the degree of coincidence. Acquiring identification information of a target facility associated with feature point data having the highest matching degree among feature point data having a matching degree equal to or higher than a predetermined matching degree;
The facility identification device according to any one of claims 1 to 11.   A facility identification program that causes a computer to function as a first control unit and / or a second control unit in the facility identification device according to any one of claims 1 to 12.

Images