TWI421785B - A system and a method for real-time recognizing signboard and displaying shop information - Google Patents

Description

System and method for instantly identifying signboards and displaying store information

The present invention relates to a system and method for instantly recognizing a signboard and displaying store information, and more particularly to an instant identification signboard and display store for a user to use the portable electronic device to instantly obtain the store information of the store in which the user is traveling. Information systems and methods.

As is well known, the Global Positioning System (GPS) technology has been widely used in portable electronic devices (such as navigation machines, mobile phones, etc.), and the portable electronic devices have global positioning functions.

In addition, the above-mentioned GPS-enabled mobile phones usually also have a camera function. At present, when a user carries such a mobile phone with both GPS function and camera function, when the signboard stands on the outdoor street, the two functions are usually used independently, that is, the user only uses the GPS function of the mobile phone to locate the location. The geographic coordinates, or only the camera function of the mobile phone to capture the scene to be photographed, and because of the functional limitations of the mobile phone, the GPS function and the camera function cannot be combined at the same time, so that the mobile phone can provide further services, such as utilization. Mobile phone GPS function and camera function to get special information about the store. Therefore, it is necessary to seek a solution.

Accordingly, it is an object of the present invention to provide a system for instantly identifying signboards and displaying store information.

Therefore, the system for instantly identifying the signboard and displaying the store information of the present invention comprises a database and a portable electronic device. The database has a sample of signature image features and its corresponding GPS geographic coordinates and store information. The portable electronic device includes a positioning module, a processing module, an image capturing module, and a display module. The positioning module is configured to obtain a global positioning system geographic coordinate of the location of the portable electronic device. The processing module is configured to obtain the signature image feature sample corresponding to the global coordinate system geographic coordinate in the database and the store information. The image capturing module is configured to capture a scene including at least one signboard and display the same in the display module. The processing module further identifies the image in the identification frame as the global coordinate system geographic coordinate by using a signature image feature sample corresponding to a predetermined size of the in-frame image and the global positioning system geographic coordinate in the display image. Corresponding one of the signature image feature samples, and displaying the corresponding store information of the identified signature image feature sample in the vicinity of the signboard in the display screen of the display module.

Another object of the present invention is to provide a method for instantly recognizing signboards and displaying store information.

Therefore, the method for instantly identifying the signboard and displaying the store information of the present invention comprises: (A) providing a database of signature image feature samples and corresponding global positioning system geographic coordinates and store information; (B) utilizing a portable type The electronic device obtains a global positioning system geographic coordinate of the location thereof; (C) the portable electronic device obtains the signature image feature sample corresponding to the global coordinate system geographic coordinate in the database and the store information thereof; (D) utilizes the The portable electronic device captures a scene including at least one sign and displays it in the display screen; and (E) the portable electronic device compares the in-frame image and the global positioning by a predetermined size in the display image A signature image feature sample corresponding to the geographic coordinates of the system, the image in the identification frame is identified as one of the signature image feature samples corresponding to the global coordinate system geographic coordinates, and the identified signature image feature sample is The corresponding store information is instantly displayed near the signboard in the display screen.

The utility model has the advantages that the user can use the portable electronic device to expand the real-life manner to instantly obtain the store information of the store (such as the store name, special event information, etc.).

The above and other technical contents, features and advantages of the present invention will be apparent from the following detailed description of the preferred embodiments.

Before the present invention is described in detail, it is noted that in the following description, similar elements are denoted by the same reference numerals.

Referring to FIG. 1, a preferred embodiment of the present invention for instantly identifying a signboard and displaying store information includes a portable electronic device 11 and a database 12. The system can combine the GPS function and the camera function of the portable electronic device 11 (such as a mobile phone), so that the portable electronic device 11 can display the store information 123 of the store that the user has performed in an augmented reality manner (such as the store name). , special event information, etc.).

The database 12 is pre-built by the system operator and can be used to provide various materials related to the service of the store information 123 corresponding to the display signboard of the present invention, including the pre-established signature image feature samples 122 of each store sign and the signboards. The image feature samples 122 correspond to GPS geographic coordinates 121 and store information 123, respectively.

The portable electronic device 11 includes a positioning module 111, a processing module 112, an image capturing module 113, and a display module 114.

The positioning module 111 is configured to acquire the GPS geographic coordinates of the location of the portable electronic device 11 by positioning the satellite 8.

The image capturing module 113 is configured to capture a scene including at least one signboard.

The display module 114 can be, for example, a touch panel for displaying a scene captured by the image capturing module 113.

The processing module 112 is configured to wirelessly connect to the database 12 through a mobile communication network 9 to obtain the signature image feature sample 122 and the store information 123 corresponding to the acquired GPS geographic coordinates in the database 12. In addition, the processing module 112 further compares the image in the identification frame 115 (see FIG. 3) and the acquired GPS geographic coordinates by a predetermined size (for example, 128 pixels×128 pixels) in the display screen of the display module 114. The corresponding signature image feature sample 122 identifies the image in the identification frame 115 as the signature image feature sample 122 corresponding to the acquired GPS geographic coordinate, and associates the identified signature image feature sample 122 with the corresponding store. The information 123 is instantly displayed near the signboard in the display screen of the display module 114.

In the present specification, a preferred embodiment of the method for instantly recognizing a signboard and displaying store information of the present invention will be described in detail below with reference to Figs. First, as shown in step 21 of FIG. 2, as described above, the system operator must establish the database 12 in advance to provide a store for the portable electronic device 11 to display the user's experience in an augmented reality manner. The function of the information 123, wherein the store information 123 can be, for example, a store name, special event information, and the like.

Then, as shown in step 22, the user uses the positioning module 111 of the portable electronic device 11 to obtain the GPS geographic coordinates of the location.

Then, as shown in step 23, the portable electronic device 11 is wirelessly connected to the database 12 through the mobile communication network 9 to obtain the signature image feature sample 122 corresponding to the acquired GPS geographic coordinate in the database 12. And its store information 123.

Then, as shown in step 24, since the user wants to use his portable electronic device 11 to display the store information 123 of the merchant near his location, the user first switches the portable electronic device 11 from the navigation mode. In the shooting mode, the scene having the at least one sign is displayed in the display screen of the display module 114.

Then, as shown in step 25 and FIG. 3, the user can first display the identification frame 115 of the predetermined size in the display screen of the display module 114 by operating the portable electronic device 11 to enable the portable electronic device. 11 switches to the recognition mode. As shown in FIG. 3, in the preferred embodiment, when the signboard of a certain store (such as the 〝7 convenience store 约) appears approximately in the center of the display screen of the display module 114 of the portable electronic device 11, the user The identification panel 115 is displayed in the center of the touch panel by pressing the specific function option on the touch panel of the portable electronic device 11 to enable the portable electronic device 11 to enter the recognition mode, wherein the identification frame 115 The size may be, for example, 128 pixels x 128 pixels.

As shown in FIG. 4 , the processing module 112 of the portable electronic device 11 compares the actual image in the identification frame 115 in the display screen of the display module 114 with the signature image corresponding to the acquired GPS geographic coordinate. The feature sample 122 identifies the actual image in the identification frame 115 as the signature image feature sample 122 corresponding to the acquired GPS geographic coordinate, and displays the corresponding store information 123 of the identified signature image feature sample 122 in real time. In the vicinity of the signboard in the display screen of the display module 114, as shown in FIG.

In the preferred embodiment, the identification process of step 25 is that the processing module 112 of the portable electronic device 11 first calculates the difference between the brightness of each pixel of the actual image in the identification frame 115 and the surrounding pixels. Value, then count the distribution of all luminance differences as a feature of the alignment. Then, the processing module 112 of the portable electronic device 11 compares the features of the image 5 in the identification frame 115 with the features of the signature image feature samples 122 obtained from the database 12. If the feature similarity of the comparison result is less than a predetermined threshold, the identification is successful, and the processing module 112 of the portable electronic device 11 corresponds to the identified signature image feature sample 122 as shown in FIG. 4 . The store information 123 is instantly displayed in the vicinity of the signboard in the display screen of the display module 114. On the other hand, if the feature similarity of the comparison result is not less than the predetermined threshold, as shown in FIG. 3, the identification frame 115 is continuously displayed in the display screen of the display module 114, and the processing module 112 continues the comparison process.

As shown in FIG. 5, in addition, when the portable electronic device 11 moves the position, the corresponding store information 123 of the recognized signboard is displayed on the display screen of the portable electronic device and the image of the signboard. The relative position remains unchanged. For example, the store information 123 of the 〝7 convenience store in the display screen of the portable electronic device 11 in FIG. 5 has moved to the left in an augmented reality manner along with its signboard. In the preferred embodiment, the processing module 112 calculates the moving distance according to the difference between the screens before and after the movement of the display module 114 caused by the movement of the portable electronic device 11, and then updates the store information 123 according to the moving distance. The display position is such that the user can use the portable electronic device 11 to augment the real-world manner to instantly obtain the store information 123 (such as the store name, special event information, etc.) of the store that the user has traveled.

In summary, the system and method for instantly recognizing the signboard and displaying the store information of the present invention combines the GPS function and the camera function of the portable electronic device 11 of the user, and combines the GPS geographic coordinates 121 and the signature image in the remote database 12. The sample feature sample 122 and the store information 123 allow the user to instantly obtain the store information 123 (such as the store name, special event information, etc.) of the store that the user has traveled in an augmented reality manner, so that the object of the present invention can be achieved.

The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent.

11. . . Portable electronic device

111. . . Positioning module

112. . . Processing module

113. . . Image capture module

114. . . Display module

115. . . Identification box

12. . . database

121. . . GPS geographic coordinates

122. . . Signature image feature sample

123. . . Store information

21~25. . . step

8. . . Positioning satellite

9. . . Mobile communication network

1 is a system block diagram showing a preferred embodiment of the system for instantly identifying a signboard and displaying store information of the present invention;

2 is a flow chart showing a preferred embodiment of the method for instantly identifying a signboard and displaying store information of the present invention;

3 is a schematic diagram showing a scene captured by the portable electronic device and an identification frame displayed on the display screen of the portable electronic device in the preferred embodiment;

4 is a schematic diagram showing the scene captured by the portable electronic device and the corresponding store information of the recognized signboard in the display screen of the portable electronic device in the preferred embodiment;

FIG. 5 is a schematic diagram showing the display position of the corresponding store information in the display screen of the portable electronic device and the signboard when the portable electronic device moves in the preferred embodiment. The relative position of the image remains the same.

11. . . Portable electronic device

111. . . Positioning module

112. . . Processing module

113. . . Image capture module

114. . . Display module

12. . . database

121. . . GPS geographic coordinates

122. . . Signature image feature sample

123. . . Store information

8. . . Positioning satellite

9. . . Mobile communication network

Claims (9)

A system for instantly identifying a signboard and displaying store information, comprising: a database having a signature image feature sample and corresponding global positioning system geographic coordinates and store information; and a portable electronic device including a positioning module, a processing module, an image capturing module, and a display module, wherein the positioning module is configured to obtain a global positioning system geographic coordinate of a location of the portable electronic device, and the processing module is configured to obtain the database The icon of the signature image corresponding to the geographic coordinates of the global positioning system and the store information thereof, the image capturing module is configured to capture a scene including at least one signboard, and display the image in the display module, wherein the processing module further The image in the identification frame is identified as the signature image corresponding to the geographic coordinates of the global positioning system by comparing the image of the in-frame image of the predetermined size in the display screen with the signature image feature sample corresponding to the geographic coordinates of the global positioning system. One of the feature samples, and the corresponding store information of the identified signature image feature sample is expanded Territory near real-time display mode the display screen of the display module of the signs. The system for instantly recognizing a signboard and displaying store information according to the first aspect of the patent application, wherein the display module is a touch panel. The system for instantly recognizing a signboard and displaying store information according to claim 1, wherein when the portable electronic device moves, the corresponding store information of the recognized signboard is displayed on the portable electronic device. The relative position of the display position in the module and the image of the sign remains unchanged. A system for instantly recognizing a signboard and displaying store information as described in claim 1 wherein the processing module of the portable electronic device is wirelessly connected to the database through a mobile communication network to obtain the database. The signature image feature sample corresponding to the global coordinate system geographic coordinates and its store information. According to the system for instantly recognizing a signboard and displaying store information according to the first aspect of the patent application, the store information displayed in the vicinity of the signboard displayed on the display screen of the display module is the store name and the special event information. A method for instantly recognizing a signboard and displaying store information includes the following steps: (A) providing a database of signature image feature samples and corresponding global positioning system geographic coordinates and store information; (B) utilizing a portable type The electronic device obtains a global positioning system geographic coordinate of the location thereof; (C) the portable electronic device obtains the signature image feature sample corresponding to the global coordinate system geographic coordinate in the database and the store information thereof; (D) utilizes the The portable electronic device captures a scene including at least one sign and displays it in the display screen; and (E) the portable electronic device compares the in-frame image and the global positioning by a predetermined size in the display image A signature image feature sample corresponding to the geographic coordinates of the system, the image in the identification frame is identified as one of the signature image feature samples corresponding to the global coordinate system geographic coordinates, and the identified signature image feature sample is Corresponding store The information is instantly displayed in the vicinity of the signboard in the display screen in an augmented reality manner. The method for instantly recognizing a signboard and displaying store information according to claim 6 of the patent application, wherein in the step (C), the portable electronic device is wirelessly connected to the database through a mobile communication network to obtain The database of signature image features corresponding to the global coordinates of the global positioning system and its store information. The method for instantly recognizing a signboard and displaying store information according to item 6 of the patent application scope, wherein in the step (E), when the portable electronic device moves, the corresponding store information of the recognized signboard is The display position in the display screen of the portable electronic device remains unchanged from the relative position of the image of the signboard. The method for instantly recognizing a signboard and displaying store information according to item 6 of the patent application scope, wherein in the step (E), the store information immediately displayed in the display screen of the portable electronic device is a store Name and special event information.