TWI530895B - A system and method for collecting preferential information using the R & D technology - Google Patents

Description

System and method for collecting preferential information by using augmented reality technology

The present invention relates to a system and method for collecting preferential information, and more particularly to a system and method for collecting preferential information using augmented reality technology.

Augmented Reality (AR) technology is a technique for instantly calculating the position and angle of a camera image and adding corresponding images. In recent years, due to the rapid development of mobile communication technology, smart mobile devices are constantly being introduced. Most of the smart mobile devices currently on the market have the hardware environment needed to augment the reality technology, such as the computing power and accelerator of the computer. Accelerometer), gyroscope and digital compass.

The Fiducial Marker is an icon that can be reliably referenced. The image is overlaid by constantly tracking the position of the icon in the lens image. The reference icon needs to be pre-marked in the system which icon to display when the icon appears. Different versions of the benchmark icon system have appeared. QR (Quick Response, QR) code is a two-dimensional space bar code, which can store more data than one-dimensional bar code, and has been widely used in data acquisition of mobile devices. From the example of obtaining the preferential information, the user can obtain a website by taking a 2D barcode (Quick Response, QR code) through the mobile device, and the mobile device connects to the website to display the preferential information.

At present, there are many LBS (Location Based Service) application services that can obtain preferential information in the mobile software market. These services use the AGPS (Assisted Global Positioning System) built in the smart mobile device to obtain the approximate location of the user. Nearby offers are available to users.

The invention is characterized in that the image is presented by the image, and the user enhances the impression and understanding of the product through the interaction with the image on the lens of the mobile device, thereby allowing the user who holds the preferential information to go to the designated store or the store for shopping. Enjoy shopping discounts.

To achieve the above object, the present invention provides a system and method for collecting preferential information by using augmented reality technology, including a two-dimensional barcode (Quick Response, QR code), a smart mobile device using augmented reality technology, and providing images. Backend server with offer information.

The QR code is a two-dimensional bar code widely used for information acquisition. The present invention utilizes the characteristics of the QR code open standard, the positioning pattern and the fault-tolerant design as a medium for obtaining preferential information, and augmenting the QR code with the augmented reality technology. life.

The smart mobile device of the system of the present invention recognizes the image generated by the camera lens to obtain two pieces of information. The first part is a global resource locator (URL) stored in a two-dimensional barcode (Quick Response, QR code). The URL can be downloaded to the backend server including the image, the preferential information and the positioning information representing the location of the QR code, and the smart mobile device calculates whether the distance between the current location and the positioning information is within a certain range, such as the distance. It must be less than one kilometer to pass the inspection to avoid the geographically restricted QR code being copied; the second part is where the QR code is located on the lens screen, and the smart mobile device folds the downloaded image over the QR code, and Provides the user to interact with the image by touching the screen with a finger, speaking a specified language statement or shaking device. Once the specified interactive conditions are completed, the offer information will be displayed on the screen.

A system and method for collecting preferential information by using augmented reality technology, using a mobile device of augmented reality technology and a back-end server providing image and preferential information, including a two-dimensional barcode (Quick Response, QR code), a location of the Uniform Resource Locator (URL) for storing the image, the preferential information and the location information of the 2D barcode (Quick Response, QR code); and a remote information system for storing the image data and the offer The information material includes a server for storing the image and the preferential information; and a mobile device for presenting the characteristics of the product in an image.

The user loads the two-dimensional barcode through the mobile device, transmits the barcode to the remote information system, analyzes the content of the product, and further loads the preferential information and goes to the designated store.

The mobile device further includes a data transmission module for transmitting the image data, the preferential information material or the interactive behavior definition data, and providing the data to the image overlay module and the image interaction module; the camera module, The image information of the two-dimensional barcode (Quick Response, QR code) is captured through the camera lens and provided to the two-dimensional barcode (Quick Response, QR code) identification module; the positioning module detects the current location and will The positioning information is provided to the position checking module; the display module displays the operation screen or the lens screen of the camera module, and the display content is provided by the image nesting module and the image interaction module; and the input module is configured to receive the interactive behavior. Defining the user's operation behavior event of the data, the received event is processed by the image interaction module; the output module is used to output the effect of the interactive behavior definition data, and the output content is provided by the image interaction module; the two-dimensional barcode (Quick Response) , QR code) identification module, receiving the image information of the two-dimensional barcode (Quick Response, QR code) transmitted by the camera module, and identifying the two-dimensional barcode (Quick) The response, the QR code is located in the display module, and the location of the global resource locator (URL) representing the image data and the preferential information; the location check module receives the two-dimensional barcode ( Quick Response, QR code) the positioning information of the two-dimensional barcode (Quick Response, QR code) parsed by the identification module and the position of the smart mobile device transmitted by the positioning module, and the distance between the two is detected; the image nesting The module is configured to receive the image data loaded by the data transmission module, and stack the image data in a two-dimensional barcode (Quick Response, QR code) in the lens screen of the display module; and an image interaction module Receiving the interactive behavior definition data loaded by the data transmission module, performing detection according to the data definition, inputting the user operation behavior, and displaying the preferential information in accordance with the definition of the interaction behavior data.

The location information of the two-dimensional barcode (Quick Response, QR code) is latitude and longitude information.

The image object is a flat image, a stereo image, a still image or a motion image.

The promotional information is presented in the form of text, images or multimedia.

The interactive behavior definition data is an output input event definition file for the mobile device.

When the output module is a screen, the display module displays the interactive behavior definition data as an image effect.

When the output module is a screen, it is the same module as the display module.

When the input module is a touch screen, the interactive behavior defining data is required to touch a specified touch screen position, and the input module is configured to detect a specified position of the touch screen.

When the input module is a touch screen, the output module is the same module.

When the output module is a speaker device, the interactive behavior defining data is to play a sound effect through the speaker.

When the input module is a microphone device, the interactive behavior defining data is required to issue a specified sound effect for providing the input module to detect the specified sound effect. Wherein, the specified sound effect is a specified language or statement.

When the input module is a gyroscope, the interactive behavior defining data is required to perform a specific action on the mobile device to provide the input module to detect the specified action.

When the input module is a gravity accelerator, the interactive behavior defining data is required to perform a specific action on the mobile device to provide the input module to detect the specified action.

The embodiment of the present invention takes the preferential information of the bear doll as an example. Please refer to FIG. 1 together with respect to the system architecture diagram of the present invention.

The system 10 for collecting preferential information by using the augmented reality technology of the present invention comprises three parts, the first part is a QR code 70; the second part is a remote information system 50 for providing images and preferential information; the third part is a smart mobile device. 30, in this embodiment, please refer to FIG. 2 together, which includes a camera module 301, a positioning module 302, a display module 303, an input module 304, an output module 305, a QR code identification module 306, and a position check. The module 307, the data transmission module 308, the image nesting module 309 and the image interaction module 310 are 10 modules. The remote information system 50 includes an image server 50a and a discount information server 50b. In this embodiment, the image server 50a provides a stereo image of the bear doll and a data file defining an interactive behavior, and the preferential information server 50b provides the bear doll. Offers.

The embodiment of the present invention allows the user 20 to hold the smart mobile device 30. When the QR code 70 is aligned with the camera lens, the stereo image 60 provided by the image server 50a appears above the QR code 70 in the screen, such as The schematic diagram of FIG. 5; then the user 20 grabs the stereoscopic image 60 by touching the screen with a finger.

As shown in the schematic diagram of FIG. 6, finally, the preferential information corresponding to the stereoscopic image 60 is provided by the preferential information server 50b, as shown in FIG.

Please refer to FIG. 3 and FIG. 4 to understand the operation process between the software modules of the smart mobile device 30:

Step 3001: The two-dimensional barcode (Quick Response, QR code) identification module 306 obtains two pieces of information by using the instant image recognition QR code 70 obtained by the camera module 301, and the first part is the positioning information of the QR code 70 in the lens image. That is, the equation of the line between the four vertices and the vertices of the quadrilateral. This information can be calculated from the three positioning patterns of the QR code 70. Since the above technique is a known technique, it will not be described in detail; The share is a URL position for obtaining the stereoscopic image 60 and the offer information.

Step 3002: The image overlay module 309 checks whether the stereo image 60 is present in the smart mobile device by the stereo image 60 acquired by 3001. If there is a jump to 3004, the next step is performed.

Step 3003: The data transmission module 308 captures the QR code 70 positioning information and the file required for displaying the stereo image 60 via the Internet 40 to the image server 50a according to the position of the stereo image 60 obtained by 3001, wherein the required image of the stereo image 60 is displayed. The file also includes a definition file that generates an interactive behavior through which the image interaction module 310 determines the interaction between the stereo image 60 and the user 20.

Step 3004: The location check module 307 checks whether the distance between the location information of the QR code 70 and the location information obtained by the location module 302 in the smart mobile device 30 is within an allowable range, for example, within 1 km. If it is established, proceed to the next step, otherwise return to 3001.

Step 3005: The image nesting module 309 obtains the positioning information of the QR code 70 in the lens image according to 3001, and stacks the stereo image 60 over the QR code 70 in the screen and waits to interact with the user 20, as shown in FIG. .

Step 4001: The image interaction module 310 provides the user 20 to interact with the stereo image 60 through the input module 304 and the output module 305. The user 20 must perform the zooming action on the stereo image 60 by two fingers to achieve interaction. The conditions for the completion of the behavior are shown in the schematic diagram of Figure 6. In the embodiment, the output module 305 is equivalent to the display module 303.

Step 4002: The data transmission module 308 captures and displays the preferential information via the Internet 40 to the preferential information server 50b according to the preferential information location obtained by 3001.

Step 4003: The display module 303 displays the preferential information on the smart mobile device screen, as shown in FIG. 7; the preferential information may be presented by text, image or multimedia.

It should be noted that the above is merely an embodiment and is not limited to the embodiment. Without departing from the basic structure of the invention, the scope of the claims claimed in this patent should be the scope of the patent application.

For example, the stereoscopic image 60 already exists in the smart mobile device 30, and does not need to be obtained through the Internet; or the user 20 interacts with the stereoscopic image 60 in a question and answer manner, and can obtain the preferential information after touching the screen to answer the question.

The detailed description of the present invention is intended to be illustrative of a preferred embodiment of the invention, and is not intended to limit the scope of the invention. The patent scope of this case.

In summary, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the conventional device of the conventional use. It has fully complied with the statutory invention patent requirements of novelty and progressiveness, and applied for it according to law. Approved this invention patent application, in order to invent invention, to the sense of virtue.

10. . . System for collecting preferential information using augmented reality technology

20. . . System user

30. . . Smart mobile device

301. . . Camera module

302. . . Positioning module

303. . . Display module

304. . . Input module

305. . . Output module

306. . . 2D barcode (Quick Response, QR code) identification module

307. . . Position check module

308. . . Data transmission module

309. . . Image nesting module

310. . . Image interaction module

40. . . Internet

50. . . Remote information system

50a. . . Image server

50b. . . Offer server

60. . . Stereoscopic image

61. . . Smart mobile device lens image

62. . . 2D barcode on paper (Quick Response, QR code)

63. . . a stereo image that is stacked over the lens image

64‧‧‧Smart mobile device screen

65‧‧‧3D imagery interacting with users

66‧‧‧User's hand

70‧‧‧Two-dimensional barcode (Quick Response, QR code)

80‧‧‧Global Positioning System

Please refer to the following drawings for the present invention, and the technical contents of the present invention and the effects thereof can be further understood:

FIG. 1 is a system architecture diagram of the present invention.

2 is a block diagram of a system smart mobile device according to the present invention.

FIG. 3 is one of the operational flowcharts of the system smart mobile device module of the present invention.

4 is a second flow chart of the operation of the system smart mobile device module of the present invention.

FIG. 5 is a schematic diagram of the system stereoscopic image of the system over the QR code.

FIG. 6 is a schematic diagram of interaction between a system user and a stereoscopic image according to the present invention.

FIG. 7 is a schematic diagram of the system displaying preferential information according to the present invention.

10. . . System for collecting preferential information using augmented reality technology

20. . . System user

30. . . Smart mobile device

40. . . Internet

50. . . Remote information system

50a. . . Image server

50b. . . Offer server

60. . . Stereoscopic image

70. . . 2D barcode (Quick Response, QR code)

80. . . Global Positioning System

Claims (16)

A system for collecting preferential information by using augmented reality technology, comprising: a two-dimensional barcode (Quick Response, QR code), storing a global resource locator (URL), obtained through the global resource locator Multimedia, preferential information and location information of the 2D barcode. The location information of the 2D barcode location refers to the location information of the 2D barcode placement point, including the location of the 2D barcode placement point; and a remote information system for storing multimedia The location information and the preferential information of the 2D barcode, including the server for storing the multimedia, the location information of the 2D barcode and the preferential information; and a mobile device having the scanning and identifying the 2D barcode and the Internet through the Internet The information system downloads the data, obtains the location of the device through the global positioning system, and displays the feature of the product through multimedia. The mobile device scans and recognizes the two-dimensional barcode to obtain a global resource locator, and according to the locator to the remote information System, get multimedia, preferential information and 2D barcode location Information, then, the mobile device checks whether the distance between the device location and the position of the two-dimensional bar code placement point is within a certain range, and if it is within the range, displays the multimedia and displays the preferential information. The system system for collecting preferential information by using augmented reality technology, as described in claim 1, wherein the mobile device further comprises: a data transmission module for transmitting the image data, the preferential information material or the interactive behavior definition data, and providing the data to the image overlay module and the image interaction module; a camera module capturing the image through the camera lens 2D barcode (Quick Response, QR code) image information, and is provided to the 2D barcode (Quick Response, QR code) identification module; a positioning module detects the current location and provides positioning information to the location a display module; a display module, displaying an operation screen or a lens image of the camera module, the display content being provided by the image nesting module and the image interaction module; and an input module for receiving the interactive behavior definition data The user operates the behavior event, and the received event is processed by the image interaction module; an output module is configured to output the effect of the interactive behavior definition data, and the output content is provided by the image interaction module; a two-dimensional barcode (Quick Response, The QR code recognition module receives the image information of the two-dimensional barcode (Quick Response, QR code) transmitted from the camera module, and identifies the two-dimensional barcode (Quick Response, QR code) bit. a location in the display module, and a location of a global resource locator (URL) representing the image data and the preferential information; a location checking module receiving the two-dimensional barcode (Quick Response, QR code) The identification module parses the location information of the two-dimensional barcode (Quick Response, QR code) and the location of the smart mobile device by the positioning module, and checks the distance between the two; An image nesting module is configured to receive the image data loaded by the data transmission module, and stack the image data in a two-dimensional barcode (Quick Response, QR code) in the lens screen of the display module; An image interaction module receives the interactive behavior definition data loaded by the data transmission module, performs detection according to the data definition, inputs the user operation behavior, and displays the preferential information in accordance with the definition of the interaction behavior. The system for collecting preferential information by using augmented reality technology as described in claim 2, wherein the location information of the two-dimensional barcode (Quick Response, QR code) is latitude and longitude information. A system for collecting preferential information by using augmented reality technology as described in claim 2, wherein the image object is a planar image or a stereoscopic image. A system for collecting preferential information by using augmented reality technology as described in claim 2, wherein the image object is a still image or a moving image. A system for collecting preferential information by using augmented reality technology as described in claim 2, wherein the preferential information material is presented in the form of text, image or multimedia. The system for collecting preferential information by using augmented reality technology as described in claim 2, wherein the interactive behavior definition data is an output input event definition file of the mobile device. The system for collecting preferential information by using the augmented reality technology as described in claim 2, wherein when the output module is a screen, the display module displays the interactive behavior definition data as an image effect. Augmented Reality Technology as described in item 8 of the patent application scope The system for collecting the preferential information is the same module as the display module when the output module is a screen. The system for collecting preferential information by using the augmented reality technology as described in claim 2, when the input module is a touch screen, wherein the interactive behavior definition data is a touch screen specified to be touched. The position is used to provide the input module to detect a specified position of touching the touch screen. The system for collecting preferential information by using the augmented reality technology as described in claim 10, when the input module is a touch screen, is the same module as the output module. The system for collecting preferential information by using the augmented reality technology as described in claim 2, when the output module is a speaker device, the interactive behavior defining data is to play a sound effect through the speaker. The system for collecting preferential information by using augmented reality technology as described in claim 2, when the input module is a microphone device, the interactive behavior defining data is required to issue a specified sound effect for providing The input module detects the specified sound effect. A system for collecting preferential information by using augmented reality technology as described in claim 13 wherein the specified sound effect is a specified language or sentence. The system for collecting preferential information by using augmented reality technology as described in claim 2, wherein when the input module is a gyroscope, the interactive behavior definition data is required to perform a specific action on the mobile device. The input module is configured to detect the specified action. A system for collecting preferential information by using augmented reality technology as described in claim 2, when the input module is a gravity plus In the case of a speedometer, the interactive behavior definition data is required to perform a specific action on the mobile device to provide the input module to detect the specified action.