TW202001740A - Augmented reality interactive transaction system and method thereof allowing product transaction information to be obtained in real time and actual transactions be completed at the scene or be guided to merchants - Google Patents

Abstract

The present invention relates to an augmented reality interactive transaction system and a method thereof, and more specifically relates to an augmented reality interactive transaction system and a method thereof that use augmented reality to conduct transactions in the real world. The system includes a platform vendor's servo device and electronic devices held by at least one or more consumers, and further includes service terminal devices held by at least one or more merchants, wherein the servo device and the electronic devices or the service terminal devices can be connected through wireless or wired technology in order to transmit information in a two-way manner, allowing the consumers to search for products in real time in the real world through a virtual world, and to complete transactions interactively. As a result, the product transaction information can be obtained in real time and actual transactions can be completed at the scene or be guided to the merchants, allowing the consumers and the merchants to interact in a more diversified manner to increase willingness of consumption.

Description

Augmented reality interactive trading system and method

The present invention belongs to the technical field of online transactions, and specifically refers to an augmented reality interactive transaction system and method using augmented reality technology for consumers to conduct commodity transactions in real time and improve transactions Diversity and interactivity.

In recent years, affected by the rise of Internet technology, various methods of selling goods through the Internet have become more and more popular, and they have also attracted people’s attention. There is even the establishment of a so-called online shopping mall that allows consumers to use computers Complete shopping without going out, but this online shopping can only see photos or brief descriptions, consumers can’t actually touch the goods, and can’t make real-time consultations and selections. There is still a gap between the actual shopping fun and Therefore, I heard that there is a gap between goods and online information, which has led to many disputes. In order to improve this problem, in addition to using more photos or pictures to display the product, there are also videos or animations. The seller takes the product as a short video so that the buyer can observe the object more fully, or Create a small interactive animation that allows buyers to interact with products in a virtual way on the website, but in today's society where action efficiency is important, this service is more widely used, and the above is used in transaction methods. When using the technology, there are still some problems and deficiencies that need to be improved.

Augmented reality (Augmented Reality, AR) technology refers to the technology that uses the actuarial calculation of the position and angle of the camera image and adds image analysis technology, so that the virtual world on the screen can be combined and interacted with the real world scene. At present, most augmented reality technologies are currently used in the game industry to attract the attention of consumers, but in fact, it has another application potential, which is at the level of enterprise or commercial application services such as medical treatment, teaching, tourism and factories. At present, the augmented reality identification method is applied to the display and sales of commodities. It mainly uses the text, patterns or barcodes in the commodity picture card as the identification medium. When the recognition device recognizes the picture card, it will appear with the The virtual object corresponding to the graphics card. However, for products without recognized text, patterns, or barcodes, consumers still have difficulty in obtaining the product information, and consumers cannot accurately understand whether the product is suitable for themselves, such as the size, color, or style of clothing when they are actually worn.

In other words, there are still limitations to the use of existing augmented reality: for example, one cannot directly try on or try on clothing products. Second, consumers cannot have a more detailed understanding and interaction with the products. 3. It is impossible to search for the product information in real time for the target product temporarily discovered during shopping. Fourth, it is impossible to quickly purchase with the seller. Therefore, how to solve the above-mentioned conventional problems and deficiencies is where the inventors of the present invention and related manufacturers engaged in this industry are desperate to study the direction of improvement.

In view of this, the present inventors have conducted in-depth discussions on the problems faced by the existing augmented reality technology in trading, and through years of experience in R&D and manufacturing in related industries, through continuous improvement and trial work, they have finally successfully developed An augmented reality interactive trading system and method to overcome the shortcomings and inconveniences of existing ones.

Therefore, the main objective of the present invention is to provide an augmented reality interactive transaction system and method, so that consumers can obtain virtual goods corresponding to real-world commodities in the real world in real time for consumers to conduct transaction interaction.

In addition, the main purpose of the present invention is to provide an augmented reality interactive transaction system and method, which can facilitate consumers to directly match virtual goods with virtual consumers, and break through the limitations of existing transactions to improve their interactive transaction effects , At the same time can reduce transaction disputes.

Based on this, the present invention mainly achieves the foregoing objectives and effects through the following technical means, which includes: the system includes a platform vendor's servo equipment and at least one electronic device held by consumers; The electronic device includes at least a processing module, a connection module, a positioning module, a reality acquisition module, and a display module, wherein the processing module with a built-in interactive transaction program includes a control The man-machine interface used, and the connection module connected to the processing module can be used to transfer data and instructions to the servo device, and the positioning module connected to the processing module can provide the geographic positioning data of the servo device, and the processing module The group-connected reality acquisition module is used to obtain real-world images, and the display module connected to the processing module can be used to display images; and the servo device includes a processing module and a connection interface module Group, a member management module, a commodity management module, a merchant management module, a model superposition module and a transaction management module, the processing module with a built-in real-world transaction program at least includes There is a man-machine interface, and the connection interface module of the connection processing module can be used to transfer data and instructions to these electronic devices, and the member management module of the connection processing module is used to process including but not limited to corresponding The basic identification data of the member, and the member management module is further connected to a virtual application model generation unit for generating a virtual application model, and the product management module of the connection processing module is used to process the products including but not limited to corresponding products Basic data, and the commodity management module is connected to an actual commodity marking unit for identifying marked products, and the commodity management module is connected to a virtual commodity model generating unit for generating a virtual commodity model, and the commodity management The module further has a search engine unit that can search in real time according to the marked products. As for the model superposition module of the connection processing module, the virtual product model is superimposed on the virtual application model, and the virtual application model is superimposed on In the real-world image captured by the electronic device, the transaction management module of the connected processing module is used to process, store, record, and track the history data of interactions and transactions between members and merchants.

The method of transaction at least includes: entering an actual transaction program of a servo device through an electronic device; using the electronic device to capture the actual image; marking an identifiable real product from the actual image; Select a pre-ordered product among the real products, and generate a virtual product model after searching; superimpose the virtual product model on the real image to generate an expanded real image; enter the transaction interactive mode; and perform transaction event management.

In order to enable your reviewing committee to further understand the structure, features and other purposes of the present invention, the following is a preferred embodiment of the present invention, which is described in detail in conjunction with the drawings as follows, while allowing those skilled in the technical field to implement it in detail.

(100)‧‧‧ system

(10)‧‧‧Servo equipment

(11)‧‧‧Processing module

(12)‧‧‧Connect interface module

(121)‧‧‧Member interface

(122)‧‧‧Business interface

(123)‧‧‧ Cloud interface

(13)‧‧‧Member Management Module

(131)‧‧‧ virtual application model generation unit

(14)‧‧‧Commodity management module

(141)‧‧‧Reality Product Marking Unit

(142)‧‧‧ virtual product model generation unit

(143)‧‧‧Search Engine Unit

(15)‧‧‧Business management module

(151)‧‧‧ virtual business model generation unit

(16)‧‧‧Model Overlay Module

(17)‧‧‧Transaction Management Module

(18)‧‧‧Gold Flow Management Module

(19)‧‧‧Map generation module

(20)‧‧‧Electronic device

(21)‧‧‧Processing module

(22)‧‧‧Connect module

(23)‧‧‧positioning module

(24)‧‧‧Reality Capture Module

(25)‧‧‧Display module

(40)‧‧‧Service terminal device

(41)‧‧‧Processing module

(42)‧‧‧Transmission connection module

(43)‧‧‧Commodity Information Module

(45)‧‧‧Display module

(50)‧‧‧Cloud Data Module

(200)‧‧‧Real World

(210)‧‧‧Consumer

(211)‧‧‧Virtual application model

(220)‧‧‧Business

(221)‧‧‧Virtual Merchant Model

(500)‧‧‧Reality video

(600) ‧‧‧ Augmented reality image

(700)‧‧‧ virtual commodity model

The first figure: the schematic diagram of the system architecture of the augmented reality interactive transaction system of the present invention, for illustrating the relative relationship between the devices.

Second figure: Schematic diagram of the configuration of the servo device in the augmented reality interactive transaction system of the present invention.

Third figure: Schematic diagram of the configuration of the electronic device in the augmented reality interactive transaction system of the present invention.

Fourth figure: Schematic diagram of the terminal device configuration in the augmented reality interactive transaction system of the present invention.

Fifth figure: schematic flow chart of the augmented reality interactive transaction method of the present invention.

Figure 6: The schematic diagram of the superimposed screen of the real-world image and the virtual-world image obtained by the electronic device in the system of the present invention.

Figure 7: A schematic diagram of the screen where other consumers or businesses join in the system of the present invention.

Figure 8: A schematic view of a screen of a virtual commodity model corresponding to a real-world commodity obtained from a designated image of an electronic device in the system of the present invention.

Figure 9: Schematic diagram of the screen for obtaining virtual commodity information separately in the system of the present invention.

Fig. 10: A schematic diagram of the virtual product model superimposed on the virtual application model in the system of the present invention.

Figure 11: Schematic diagram of the system of the present invention entering the transaction mode.

Figure 12: A schematic diagram of the screen of the system of the present invention entering the transaction mode to provide matching suggestions.

Figure 13: Schematic diagram of the system of the present invention entering the navigation mode.

The present invention is an augmented reality interactive trading system and its method. The technical content of the present invention will be described below with specific specific implementation forms, so that those skilled in the art can easily understand the advantages of the present invention from the content disclosed in this specification With efficacy. However, the present invention can also be implemented or applied by other specific embodiments. Therefore, in the specific embodiment of the present invention and its components accompanying the legend, all references to front and rear, left and right, top and bottom, upper and lower, and horizontal and vertical references are for convenience of description, not limitation. The present invention does not limit its components to any position or spatial direction. The dimensions specified in the drawings and specifications can be changed according to the design and requirements of the specific embodiments of the present invention without departing from the scope of the present invention.

The augmented reality interactive transaction system of the present invention is shown in the first figure. The system (100) includes a platform service device (10) and at least one electronic device (20) held by a consumer. In some embodiments, the system (100) further has at least one service terminal device (40) held by more than one manufacturer. The servo device (10) and the electronic device (20) or the service terminal device (40) can communicate wirelessly. Or wired technology to connect to pass information in two directions, so that consumers can search for goods in the real world through the virtual world in real time, and complete transactions interactively; as for the detailed composition of the augmented reality interactive transaction system of the present invention, it is as the first Figure 2 shows that the servo device (10) includes a processing module (11), a connection interface module (12), a member management module (13), and a commodity management module (14 ), a merchant management module (15), a model superposition module (16) and a transaction management module (17), the processing module (11) can be connected to the above-mentioned modules (12~17), And has a built-in real-world trading program, the processing module (11) can be used to process the data (data) and information of the modules (12-17) in the system (100), such as consumer membership information , Business information, real images, virtual models, augmented reality, location positioning data or transaction data, etc., and the connection interface module (12) has at least a member interface (121) for wireless or wired connection The consumer's electronic device (20) for the servo device (10) to send instructions or information to the electronic device (20) or to receive instructions and information generated by the electronic device (20), and in some embodiments the connection interface The module (12) also has a merchant interface (122) for receiving or transmitting various data and instructions to the merchant's service terminal device (40). In some embodiments, the connection interface module (12) further has a cloud interface (123) for the servo device (10) to further connect to at least one cloud data device (50) for further searching and storing in the cloud Product information of the member, and the member management module (13) is used to process and store the basic identification data, level authority data and gold flow account data including but not limited to corresponding members, and the member management module (13) further A virtual application model generating unit (131) is connected for creating and generating a corresponding virtual application model based on the actual images or patterns of the member's characters, objects, vehicles, or rooms. The virtual application model may be a simulation action Three-dimensional image, and the commodity management module (14) is used to process and store the basic data including but not limited to the corresponding commodity, corresponding merchant data, price data and storage account data, etc., and the commodity management module ( 14) A real-life commodity marking unit (141) is connected to mark at least one real-world commodity in the real-world image captured and transferred by the electronic device (20), and the commodity management module (14) and A virtual commodity model generating unit (142) is connected for generating a pair of virtual commodity models corresponding to the real commodity according to the real commodity. The virtual commodity model may be a stereoscopic image with simulated motion, and the commodity management module ( 14) A search engine unit (143) is further provided. The search engine unit (143) can be connected to the cloud data device (50) through the cloud interface (123) of the connection interface module (12), which can be used to search for products in real time. In addition, the merchant management module (15) can be used to store the merchant's basic identification data, location data, merchandise data, and gold account data, etc., and the merchant management module (15) is further connected to a virtual merchant model generation unit (151) ) To create a corresponding virtual business model based on the actual image or pattern of the service staff of the business. The virtual business model can be a three-dimensional image with simulated motion. As for the model superposition module (16), it is The virtual commodity model generated by the commodity management module (14) is superimposed on the virtual application model generated by the member management module (13), and the virtual application model is superimposed on the real world reality captured by the electronic device (20) In the image, the transaction management module (17) is used to process, store, record and track the history data of the interaction and transactions between members and merchants; in some embodiments, the servo device (10) includes a connection The gold flow management module (18) of the processing module (11), and the gold flow management module (18) is based on the calculation of the amount of the transaction completed by the member and the merchant and the transfer of the amount between the accounts, the gold flow management module (18) 18) The transaction amount available from the club’s account can be withheld to a secured account to ensure that the member has sufficient amount to pay for the transaction fee, and the member and the merchant will confirm the completion of the delivery and acceptance of the transaction commodity by the guarantee The account transfers the transaction amount withheld by the member into the corresponding merchant account; and in some embodiments, the servo device (10) further The step includes a map generation module (19) with a connection processing module (11). The map generation module (19) can be used for geographic location information [GPS] of a member’s electronic device (20) or a merchant, and a submap Generate a map indicating the geographic location of the member and the merchant, so that the member can find and navigate to the merchant that provides the transaction commodity through the electronic device (20) with the function of displaying the electronic map, so that the member can directly purchase the commodity; As also shown in the first, second and third figures, the electronic device (20) may be a portable device such as a smart phone, tablet computer, head mounted device, glasses, etc. capable of displaying augmented reality. The device (20) at least includes a processing module (21), a connection module (22), a positioning module (23), a reality acquisition module (24) and a display module (25), The processing module (21) includes a built-in real-world transaction interactive program [APP] and a human-machine interface for transmitting data through the servo device (10) of the system (100), and through the human-machine interface Processing of data and instructions such as setting, editing, registration and transaction interaction, and the electronic device (20) can be connected to the servo device (10) through the connection module (22) connected to the processing module (21) The interface module (12) is connected to the member interface (121) for two-way transfer of data and instructions, and the positioning module (23) connected to the processing module (21) can be a global positioning system [GPS], which can be used in conjunction with the processing module The group (21) guide will search for the target or indicated location, and provide the servo device (10) the geolocation data of the member through the connection module (22); in addition, the reality acquisition module (24) is also connected to the processing module (21), the electronic device (20) can obtain the real-world image of the real world (200), and the display module (25) can display the real-world (200) obtained by the real-time capturing module (24) ) Reality image (500), augmented reality image (600) of the virtual application model (211) and virtual commodity model (700) superimposed on the reality image (500) by the servo device (10) . In some embodiments, the electronic device (20) may be a fixed display device such as a terminal, a desktop computer, or a notebook computer, for members at a fixed location to watch other mobile members at the fixed location Augmented reality images can be used to participate in interactions and transactions; as shown in the first, second and fourth figures, the service terminal device (40) can be a merchant's terminal, a desktop computer or a laptop computer, etc. , Which has at least a processing module (41), a transmission connection module (42), a commodity data module (43) and a display module (45), wherein the processing module (41) includes a built-in Real-world transaction service program and man-machine interface for setting, modifying and registering the servo device (10), and the transmission connection module (42) the aforementioned processing module (41) is connected, and can be used to connect with the servo device (10) The merchant interface (122) of the connection interface module (12) connects to transmit data and instructions, and the commodity data module (43) connected to the processing module (41) can be used to store the corresponding of the merchant's merchandise Information and inventory, as for the display module (45), it can be used to display the augmented reality images returned by the servo device (10); thereby, a virtual commodity model is created by searching for commodities through real-world reality images And an augmented reality interactive trading system that can be superimposed on a virtual application model to generate augmented reality mirror images for trading.

When the present invention is actually used, as shown in the first, second, fifth and sixth figures, a member of a real world (200) is captured by the member portable electronic device (20) of the system (100) described above Reality image (500), after the real-time product (450) on the reality target (400) of the reality image (500) is marked by the servo device (10), a virtual product model is searched and generated, and superimposed on the member's virtual application In the model and the reality image, the expanded reality image is generated for the consumer member to interact with the merchant or other members through the electronic device (20) and complete the transaction. The augmented reality interactive transaction method of the system (100) can be It is applied to the purchase of consumers' apparel, apparel and accessories, vehicles or room interiors and accessories, and further cooperates with reference to the fifth figure. The process steps of the augmented reality interactive transaction method include at least: The electronic device enters the real-time transaction program of the servo device, one uses the electronic device to capture the real-world image, one is the identifiable real-world product marked by the real-world image, one selects the pre-purchase product from the marked real-life product, The selected real-world commodities are searched to generate virtual commodity models, one is superimposed to generate expanded real-world images, one enters the transaction interactive mode and one executes transaction event management. In the following, the present invention is described in terms of a preferred embodiment in which a consumer purchases a garment while shopping; step (S11), an electronic device enters a real-time transaction program of a servo device: and each consumer (210) opens its The real-world transaction interactive program of the system (100) built in the processing module (21) in the electronic device (20), and connected to the member interface (121) of the connection interface module (12) of the servo device (10) ), after the identity verification of the member management module (13) of the servo device (10), enter the real-time transaction program of the processing module (11) of the servo device (10) for the electronic device (20) and the servo device (10) Connect and transfer data and instructions, and further use the virtual application model generation unit (131) of the member management module (13) to generate a virtual application model (211), such as the personal image of the consumer (210), The image of the beast. According to some embodiments, when the system (100) opens a merchant connection, each merchant (220) can also open the real-time transaction service program of the processing module (41) of its service terminal device (40) as needed. The merchant interface (122) of the connection interface module (12) connected to the servo device (10), enters the processing mode of the servo device (10) after the identity verification of the merchant management module (15) of the servo device (10) Group (11) real-world transaction program for the service terminal device (40) and the servo device (10) to communicate data and instructions, and further use the virtual merchant model generation unit of the merchant management module (15) ( 151) Generate a virtual merchant model (221), such as the service staff image of the merchant (220); Step (S12), use the electronic device to capture the live image: as shown in the sixth figure, each consumer (210) Use the reality capture module (24) of the electronic device (20) to obtain a reality image (500) of a real world (200), and locate the geographic location through the positioning module (23) The environment image (500) and the geographic location are sent to the servo device (10), and the virtual model generated by the virtual application model generation unit (131) of the member management module (13) can be generated using the model superposition module (16) The application model (211) is superimposed on the reality image (500) and returned to the electronic device (20) of the consumer (210), so that a display module (25) of the electronic device (20) shows Augmented reality image (600) of virtual application model (211) and reality image (500). According to some embodiments, as shown in the seventh figure, when the other consumers or merchants who are not in the transaction location want to join the transaction event, they can request consent through their respective electronic devices (20) or service terminal devices (40) Then, receive the augmented reality image (600) of the servo device (10), and use the model overlay module (16) to generate the virtual application model generation unit (131) or merchant management of the member management module (13) The virtual application model (211A) or virtual business model (221A) generated by the virtual business model generating unit (131) of the module (15) is superimposed on the augmented reality image (600) for participating in transaction interaction; steps (S13). Identify the real-world products that can be identified by the real-world images: As shown in the eighth figure, the real-life product marking unit (141) in the product management module (14) of the servo device (10) can be The outline of the actual product (450) [such as clothing] on the actual subject (400) in the environmental image (500) identifies the actual product (450), and marks the actual product (450) one by one, for example, the The outline of the apparel is circled with colored lines for easy selection; Step (S14), the pre-ordered product is selected from the marked real products, and a virtual product model is generated by searching: when the identification and marking of the real product (450) is completed After that, the consumer (210) can select the commodity to be purchased from the display module (25) of the electronic device (20), and the search engine unit (143) of the commodity management module (14) searches for the item Relevant transaction data of real-life products (450), such as the specifications of the apparel, merchants or transaction conditions, etc., and as shown in the ninth figure, the virtual product model generation unit (142) of the product management module (14) is further utilized Generate a virtual product model (700) of the real-world product, such as a stereoscopic image of the apparel, and send it to the display module (25, 45) of the electronic device (20) or service terminal device (40) to facilitate further Understand the status of the reality product (450); Step (S15), superimpose to generate an augmented reality image: as shown in the tenth figure, the servo device (10) can use the model superposition module (16) The virtual commodity model (700) is further superimposed on the virtual application model (211) to form an augmented reality image (600) including the virtual commodity model (700) and the virtual application model (211), for example, the virtual The costumes are worn on virtual characters, and displayed on the display module (25, 45) of the electronic device (20) or the service terminal device (40), and the reality can be felt through the augmented reality image (600) The state in which the product is actually worn on the consumer for reference as a purchase of real-life products; Step (S16), enter the transaction interactive mode: as shown in the eleventh figure, when the consumer (210) is controlled by the electronic device (20) When it is confirmed in the augmented reality image (600) displayed by the display module (25) that the virtual commodity model (700) on the virtual application model (211) is to be purchased , You can directly operate the electronic device (20) and click to confirm. For example, the touch-type display module (25) directly clicks the corresponding position of the virtual product model (700) on the screen, then the display module (25) of the electronic device (20) can enter The transaction interactive screen of the virtual commodity model (700), the transaction interactive screen may display transaction conditions including price, shipping method, payment method and the like. According to some embodiments, the transaction interaction screen may also include a virtual merchant model (221) of the merchant (220) for transaction interaction with the consumer (210). According to some embodiments, the transaction interaction screen may further include at least another consumer (210) for other consumers (210) to participate in the transaction together, such as group purchase transaction interaction. As also shown in the twelfth figure, the transaction interactive screen further includes a selection of suggested collocations. When the consumer (210) selects the virtual application model (211) in the virtual application model (211) of the display module (25) of the electronic device (20) After the merchandise model (700), the merchandise management module (14) of the servo device (10) can provide suggestions for matching commodities through data statistics. For example, consumers (210) can buy clothes or multiple people can buy or Suits or pants recommended by the merchant (220), and the model superposition module (16) is used to superimpose the virtual product model (700A) of the pants on the virtual application model (211) and return it to the consumer (210) On the display module (25) of the electronic device (20) for consumers (210) to refer to and purchase; step (S17), perform transaction event management: when the consumer (210 is on the display module of the electronic device (20) ( 25) After clicking to complete the transaction, the servo device (10) can process, store, record and track the transaction and transaction history data through the transaction management module (17) to facilitate transaction management and facilitate future management Statistics, comparison or analysis to complete the transaction event.

Through the above process steps, consumers (210) in the real world (200) can use the reality capture module (24) of the electronic device (20) to obtain the reality image (500), and then the servo device (10) ) The augmented reality image (600) is generated through the model superposition module (16), and the marked reality product can be directly identified from the augmented reality image (600) for consumers (210) to use the electronic device (20) Carrying out purchase transactions, and being able to immediately purchase goods that are of interest when moving, can also increase the flow of commodities and greatly increase their trading effectiveness.

As also shown in the fifth figure, the process step of the augmented reality interactive transaction method further includes a step (S18) in step (S16), performing online payment: after completing the interactive transaction, the consumer (210) can Online payment is made by connecting the gold flow management module (18) of the servo device (10) through the electronic device (20). Among them, the gold flow management module (18) is based on the calculation of the amount of transaction completed by the member and the merchant and the transfer of the amount between the accounts. The gold flow management module (18) can be used to withhold the transaction amount from the account of the meeting to a guarantee account In order to ensure that the member has sufficient amount to pay for the transaction fee, and after the member and the merchant confirm the completion of the delivery and acceptance of the transaction commodity, the guarantee account will transfer the transaction amount withheld by the member to the corresponding merchant account .

Furthermore, as shown in the fifth figure, the process steps of the augmented reality interactive transaction method can further extend a step (S19) on the step (S14) to guide the consumer to the physical merchant: when the servo device (10) merchandise The search engine unit (143) of the management module (14) searches and obtains the relevant transaction data of the real-world product, if the real-world product is in the physical storefront of the merchant (220) nearby, as shown in Figure 13 , Further use the map generation module (19) of the servo device (10) to generate a navigation map and return it to the electronic device (20) for the consumer (210) to use the display module (25) of the electronic device (20) Navigate so that the consumer (210) can directly reach the physical storefront of the merchant (220) for transactions.

In this way, it can be understood that the present invention is an excellent creative creation, in addition to effectively solving the problems faced by the learners, and greatly improving the efficiency, and no identical or similar product creation or public use in the same technical field At the same time, it has the improvement of efficacy. Therefore, the present invention has met the requirements of "novelty" and "progressiveness" of the invention patent, and the invention patent is filed in accordance with the law.

(100)‧‧‧ system

(10)‧‧‧Servo equipment

(11)‧‧‧Processing module

(12)‧‧‧Connect interface module

(121)‧‧‧Member interface

(122)‧‧‧Business interface

(123)‧‧‧ Cloud interface

(13)‧‧‧Member Management Module

(131)‧‧‧ virtual application model generation unit

(14)‧‧‧Commodity management module

(141)‧‧‧Reality Product Marking Unit

(142)‧‧‧ virtual product model generation unit

(143)‧‧‧Search Engine Unit

(15)‧‧‧Business management module

(151)‧‧‧ virtual business model generation unit

(16)‧‧‧Model Overlay Module

(17)‧‧‧Transaction Management Module

(18)‧‧‧Gold Flow Management Module

(19)‧‧‧Map generation module

(20)‧‧‧Electronic device

(40)‧‧‧Service terminal device

(50)‧‧‧Cloud Data Module

Claims (9)

An augmented reality interactive transaction system, which includes a platform vendor's servo equipment and at least one electronic device held by consumers; wherein the electronic devices at least include a processing module, a connection module, and a positioning Module, a real-time capture module and a display module, wherein the processing module with a built-in real-world transaction interactive program includes a man-machine interface for control and a connection module connected to the processing module It can be used to connect to the servo device to transfer data and commands. The positioning module connected to the processing module can provide the geolocation data of the servo device. The reality acquisition module connected to the processing module is used to obtain the real world reality. Image, as for the display module connected to the processing module, it can be used to display the image; and the servo device includes a processing module, a connection interface module, a member management module, a commodity management module, a merchant management Module, a model superposition module and a transaction management module, the processing module with a built-in real-world transaction program at least includes a man-machine interface, and the connection interface module connected to the processing module It can be used to transfer data and instructions to these electronic devices, and the member management module of the connection processing module is used to process basic identification data including but not limited to corresponding members, and the member management module is further connected to a generation A virtual application model generating unit of a virtual application model, and the product management module of the connection processing module is used to process basic data including but not limited to corresponding products, and the product management module is connected to a product for identification and marking Real-life commodity marking unit, and the commodity management module is connected to a virtual commodity model generating unit for generating a virtual commodity model, and the commodity management module further has a search engine unit that can search in real time according to the marked commodity, as The model superposition module of the connection processing module is used to superimpose the virtual commodity model on the virtual application model, and superimpose the virtual application model on the real-world image captured by the electronic device, as for the connection processing The transaction management module of the module is used to process, store, record and track the history data of the interaction and transactions between members and merchants; by this, a virtual commodity model is created by acquiring commodities by obtaining real-world real-world images, and An augmented reality interactive trading system that can superimpose virtual application models to generate augmented reality mirror images for trading. The augmented reality interactive transaction system as described in item 1 of the patent scope, wherein the system further has at least one service terminal device held by the manufacturer, and the connection interface module of the servo device has a merchant interface for Receive or send various data and instructions to the service terminal device of the merchant, and the service terminal device has at least a processing module, a transmission connection module, a commodity data module and a display module, in which a The processing module of the real-world transaction service program at least includes a man-machine interface for control, and the transmission connection module connected to the servo device is connected to the aforementioned processing module, and the commodity data module connected to the processing module It can be used to store the corresponding information and inventory of merchant merchandise, and the display module connected to the processing module can be used to display the augmented reality image returned by the servo device. The augmented reality interactive transaction system as described in item 2 of the patent application scope, wherein the merchant management module is further connected to a virtual merchant model generation unit for generating a corresponding one based on the actual image or pattern creation of the merchant's service personnel Virtual business model. The augmented reality interactive transaction system as described in item 1 of the patent scope, wherein the system further has at least one cloud data device, and the connection interface module of the servo device has a cloud interface for further searching Product information stored in the cloud. The augmented reality interactive transaction system as described in item 1 of the patent application scope, wherein the servo device includes a gold flow management module connected to the processing module, and the gold flow management module is based on the completion of the transaction between the member and the merchant Amount calculation and transfer between accounts. The augmented reality interactive transaction system as described in item 1 of the patent application scope, wherein the servo device further includes a map generation module connected to the processing module. The map generation module can be used for the geographic location of the member's electronic device or merchant Location targeting information. An augmented reality interactive transaction method, which at least includes: a reality transaction program that enters a servo device through an electronic device; uses the above electronic device to capture a reality image; and marks an identifiable reality from the reality image Commodities; select a pre-ordered product from the marked real products, and generate a virtual product model after searching; superimpose the virtual product model on the real image to generate an expanded real image; enter the transaction interactive mode; and execute the transaction Event management. The augmented reality interactive transaction method as described in item 7 of the patent application scope, wherein the step of performing transaction event management further includes a step of performing online payment. The augmented reality interactive transaction method as described in item 7 of the patent application scope, in which the virtual commodity model is superimposed on the reality image to generate an augmented reality image and extend a guide consumer to a physical merchant.

Images