TW202123025A - System and method for content control in augmented reality and computer readable storage medium - Google Patents

Abstract

The invention discloses a system and method for content control in augmented reality and computer readable storage medium. First, an augmented reality content design tool module is provided for loading material, and a command is added from a user interface. The augmented reality content design tool module binds both the command and content of the material; so that a binding result of the both is stored in an augmented reality setting data to upload to a cloud. Then, a first and a second electronic device respectively download the augmented reality setting data from the cloud. When the first and second electronic devices are connected, the first or second electronic device obtains input information to recognize another command. If the another command is the same or corresponds to the command in the augmented reality setting data, the first or second electronic device uses the content of the material according to the binding result of the command and the content to show augmented reality effect.

Description

Augmented reality content control system, method and computer readable storage medium

The present invention relates to a control technology for augmented reality, and in particular to a content control system, method and computer-readable storage medium for augmented reality.

"Amplified reality", as its name implies, is to augment some information in reality, and the methods of augmentation or the content of augmentation will be ever-changing due to different needs. Therefore, in order to meet the needs of different augmented reality, existing technologies include Wikitude Studio of Wikitude GmbH, ThingWorx IoT platform of PTC, Camera Effects of Facebook and other augmented reality content design tool modules, allowing users to make their own Design and produce various augmented reality applications.

In terms of technical literature, there are also some technologies related to the application of augmented reality. Among them, the existing technologies have different functions, but none of them pointed out how to customize them in the augmented reality content design tool module. Bind the content of the material with the command, and use the command to manipulate the material or meet the synchronization requirements of multiple electronic devices in the augmented reality application of the electronic device.

Therefore, how to provide a novel or innovative augmented reality control technology has actually become a major research topic for those skilled in the art.

The present invention provides a novel or innovative augmented reality content control system, method, and computer-readable storage medium, for example, allowing users to customize augmented reality content commands through an augmented reality content design tool module Customize the control method of augmented reality content, or provide users with commands to manipulate augmented reality content to reduce the control complexity of augmented reality content.

The augmented reality content control system of the present invention includes: an augmented reality content design tool module for loading materials, and the augmented reality content design tool module has a user interface to communicate with the user At least one command is added to the interface, where the augmented reality content design tool module binds both the command and at least a part of the content of the material to store the binding result of the command and at least a part of the content of the material to An augmented reality setting data, and then placing or uploading the augmented reality setting data to the cloud; and a first electronic device and at least one second electronic device, respectively receiving or downloading the augmented reality setting data from the cloud , Wherein when the first electronic device is connected to the second electronic device, the first electronic device or the second electronic device obtains input information to identify another command from the input information, if the other command is the same or corresponds to For the command stored in the augmented reality setting data, the first electronic device or the second electronic device uses the bound part of the content of the material to present the augmentation according to the binding result of the command and at least a part of the content of the material Realistic effect.

The augmented reality content control method of the present invention includes: providing an augmented reality content design tool module to load materials, and the augmented reality content design tool module has a user interface to update through the user interface Add at least one command, among which, the augmented reality content design tool model The group binds both the command and at least a part of the content of the material, so as to store the binding result of the command and at least a part of the content of the material in an augmented reality setting data, and then set the augmented reality setting data Upload or upload to the cloud; and receive or download the augmented reality setting data from the cloud by a first electronic device and at least one second electronic device, so that when the first electronic device and the second electronic device are connected, the first electronic device An electronic device or a second electronic device obtains an input information to identify another command from the input information. If the other command is the same or corresponds to the command stored in the augmented reality configuration data, the first electronic device or the second electronic device 2. The electronic device uses the bound part of the content of the material to present the augmented reality effect according to the binding result of both the command and at least a part of the content of the material.

Furthermore, the present invention also provides a computer-readable storage medium, which is used in a computer and stores instructions to execute the above-mentioned augmented reality content control method.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, embodiments are specifically described below in conjunction with the accompanying drawings. In the following description, the additional features and advantages of the present invention will be partially explained, and these features and advantages will be partly known from the description, or can be learned by practicing the present invention. The features and advantages of the present invention are realized and achieved by means of the elements and combinations specifically pointed out in the scope of the patent application. It should be understood that both the foregoing general description and the following detailed description are only illustrative and explanatory, and are not intended to limit the scope of the present invention.

1. A content control system for augmented reality

10‧‧‧Amplified reality content design tool module

11‧‧‧User Interface

12‧‧‧Resource File

13‧‧‧Materials

14‧‧‧Configuration File

15‧‧‧Command

16‧‧‧Command identifier

20‧‧‧The first electronic device

21‧‧‧Augmented Reality Application

22‧‧‧Web browser components

30‧‧‧Second electronic device

A‧‧‧Three-dimensional space

B‧‧‧ button

B1‧‧‧Save button

C‧‧‧Cloud

D‧‧‧Amplified reality setting data

E‧‧‧Edit area

F‧‧‧Amplified reality content

H‧‧‧Control

L1‧‧‧Dropdown list

L2‧‧‧Component List

M1‧‧‧Voice recognition module

M2‧‧‧Image recognition module

P‧‧‧Picture

R‧‧‧Identification subject

Steps S1 to S6‧‧‧

U‧‧‧User

Figure 1 is a schematic diagram of the architecture of the augmented reality content control system in the present invention;

Figure 2 is a schematic flow diagram of the content control method of augmented reality in the present invention;

Figure 3 is a layout diagram of the content elements of the augmented reality in the present invention;

Figure 4 is a schematic diagram of the augmented reality content design tool module of the present invention;

Fig. 5 is a schematic diagram of the model file and input commands for loading materials (resource files) in the electronic device according to the present invention; and

Figure 6 is a schematic diagram of the augmented reality (AR) video connection between two electronic devices in the present invention.

The following describes the implementation of the present invention with specific specific embodiments. Those familiar with this technology can understand the other advantages and effects of the present invention from the contents disclosed in this specification, and can also implement other different specific equivalent embodiments. Or apply.

Figure 1 is a schematic diagram of the architecture of the augmented reality content control system 1 in the present invention, and the main content of the augmented reality content control system 1 is as follows, and the rest of the content is the same as the content in Figures 2 to 6, in This will not repeat the description. As shown in Figure 1, the augmented reality content control system 1 may include an augmented reality content design tool module 10, a first electronic device 20, at least one second electronic device 30, and a voice recognition module M1 and image recognition module M2.

The augmented reality content design tool module 10 can load materials 13, and the augmented reality content design tool module 10 has a user interface 11 to add at least one command 15 through the user interface 11, where the augmented reality content design tool module 10 The reality content design tool module 10 binds both the command 15 and at least a part of the content of the material 13 to store the binding result of the command 15 and at least a part of the content of the material 13 to an augmented reality setting Data D, then the augmented reality setting data D is placed or uploaded to the cloud C. The first electronic device 20 and the second electronic device 30 can respectively receive or download the augmented reality setting data D from the cloud C to connect the first electronic device 20 and the second electronic device 30 (that is, they are in a connected state). ), the first electronic device 20 or the second electronic device 30 is made to obtain an input information to identify another command from the input information, if the other command is the same or corresponds to the command stored in the augmented reality setting data D 15. The first electronic device 20 or the second electronic device 30 uses the bound part of the content of the material 13 to present the augmented reality effect according to the binding result of both the command 15 and at least a part of the content of the material 13.

For example, the augmented reality content design tool module 10 may be an application program (APP) having a user interface 11 and capable of running on an Internet browser. The first electronic device 20 or the second electronic device 30 may be a mobile device (such as a smart phone), a computer (such as a laptop/tablet/desktop computer), smart glasses, etc. The voice recognition module M1 can be a hardware voice recognition device, a software voice recognition program, a voice recognition module with artificial intelligence (AI), etc. The image recognition module M2 can be a hardware image recognition device, a software image recognition program, an image recognition module with artificial intelligence (AI), etc. However, the present invention is not limited to this.

The augmented reality content control system 1 can upload an augmented reality content F (see Figure 4) through the augmented reality content design tool module 10 and bind the augmented reality content F command 15 (such as Control command) for the user U (see Figures 5 to 6) to control the first electronic device 20 or the second electronic device 20 or the second electronic device 20 through at least one command 15 during, for example, an augmented reality (AR) video call The augmented reality content F on the electronic device 30 even further synchronizes the manipulated augmented reality content F on the first electronic device 20 and the second electronic device 30 that are in a video call with each other.

The present invention provides a binding interface between the content of the material 13 and the command 15 (such as a control command) in the augmented reality content design tool module 10, so that the user U can display the augmented reality content The design tool module 10 designs the relationship between the command 15 and the content of the material 13 according to different needs, and can import the command 15 (such as control command) of the user U's self-customized augmented reality content F into the first electronic device 20 or in the augmented reality application of the second electronic device 30.

Figure 2 is a schematic flow diagram of the content control method of the augmented reality of the present invention, Figure 3 is the location layout diagram of the content elements of the augmented reality of the present invention, and Figure 4 is the augmented reality content of the present invention A schematic diagram of the design tool module 10, Fig. 5 is a schematic diagram of the model file and input command 15 loaded in the first electronic device 20 of the material 13 (or resource file 12) in the present invention, and Fig. 6 is the second embodiment of the present invention A schematic diagram of an augmented reality (AR) video connection between two electronic devices (such as the first electronic device 20 and the second electronic device 30).

At the same time, the augmented reality content control method shown in Fig. 2 may include the following steps S1 to S6, which are described with reference to Figs. 1 and 3 to 6.

In step S1 in Figure 2, an augmented reality content design tool module 10 with a user interface 11 is provided (see Figure 1 or Figure 4), for example, with a user interface 11 (such as a graphical user interface) And can run on the application program (APP) on the Internet browser. After the user U (see Figure 5) logs in the augmented reality content design tool module 10 through, for example, the first electronic device 20, he can upload a resource file 12 through the upload interface of the augmented reality content design tool module 10 (For example: .mp3-audio file, .jpg-picture file, .fbx-3D model file, etc.) are uploaded to the cloud C for storage, and the augmented reality content design tool module 10 loads the content of the resource file 12 for use User U preview. The user U can use command 15 to control the playback behavior of the resource file 12, such as fast forwarding of the audio file in the resource file 12, skipping to a specified time point to play the audio file, rotation of the picture file, model action or posture switching of the 3D model file, etc. . In addition, the user U can also use the resource link function of the augmented reality content design tool module 10 to load the augmented reality content design tool module 10 from the Internet. Source file 12.

The augmented reality content design tool module 10 can edit the position layout of each augmented reality content element. For example, in the three-dimensional space A in Figure 3, R is an identification target that can be recognized by the image, a button is placed at B, a picture is placed at P, and the augmented reality content design tool module 10 The design result of the location layout can be stored in the cloud C, so that the design result of the location layout can be loaded into the augmented reality content design tool module 10 for editing later.

The present invention can provide an augmented reality application (APP) 21 embedded with a web browser component (Web View) 22 on the first electronic device 20 (such as a mobile device), and load it through the web browser component 22 The design result of the position layout of the augmented reality content design tool module 10 is transferred to the first electronic device 20. Furthermore, according to the position information of the location layout designed by the augmented reality content design tool module 10, when the augmented reality application 21 recognizes that there is R in the screen of the first electronic device 20 (such as a mobile device), that is Place a button at B and a picture at P, and set the web page background to be transparent, and then overlay the identification target R, button B, picture P, and web page background settings in the augmented reality application 21 on the camera view component (Camera View), so as to achieve the effect of augmented reality, and also achieve the same visual effect during the design period and the execution period.

In step S2 in Figure 2, the user U can customize or add at least one command 15 (such as a control command) through the user interface 11 of the augmented reality content design tool module 10, such as jump, spin 90 Commands such as degrees, 1 minute and 30 seconds, and right shift. Usually, you can simply use text fields to obtain user U’s input information, and use text types or files (such as audio track files or image files) to save user U’s input information, for example, you can use a file (such as audio track) File) record the input information of user U as voice "right shift", and then upload the file (such as audio track file) to the augmented reality content design tool module 10, so that the augmented reality content design tool model Group 10 through a voice The recognition module M1 (such as a voice recognition module with artificial intelligence) recognizes that the command represented by the file (such as the audio track file) is "shift right". In the same way, you can also upload a file (such as an image file) with the "gesture to the right" recorded to the augmented reality content design tool module 10, and then the augmented reality content design tool module 10 will save the file (Such as an image file) connect an image recognition module M2 (such as an image recognition module with artificial intelligence) in series to use the image recognition module M2 to recognize that the file (such as an image file) represents the command 15 as "shift right" . In addition, the augmented reality content design tool module 10 can provide a command modification function for the user U to adjust or modify the command 15, and can also provide the function of manually marking the command 15 represented by the command 15 when the command 15 cannot be recognized.

In step S3 in Figure 2, the user U can define at least a part of the content of the material 13 on the augmented reality content design tool module 10, and find the content position of the part of the material 13 through the user interface 11 , And the augmented reality content design tool module 10 can bind the above-mentioned command 15 and at least a part of the content of the material 13, and then bind the result of the binding between the command 15 and at least a part of the content of the material 13 (or Binding information) is stored in an augmented reality setting data D (configuration file 14) for the augmented reality application 21 of the first electronic device 20 (such as a mobile device) to load the augmented reality setting data D ( Profile 14) and execute command 15.

The present invention can classify the material 13 or the resource file 12 into categories such as audiovisual files, picture files, model files and the like. For the video and audio files of material 13 or resource file 12, the "part of the material" can be defined by the playback time point of the file, such as "1 minute 30 seconds". With the binding relationship, the augmented reality application 21 can be directly jumped The content is played until the playing time. For image files of material 13 or resource file 12, the augmented reality content design tool module 10 can provide all sorting or frame selection tools, and the user U can select a part of the picture content through the segmentation or frame selection tools. To define "part of the material", for example, for a picture containing a butterfly, "enlarge the butterfly "Butterfly" uses the binding relationship to enable the augmented reality application 21 to find the part of the butterfly and enlarge the picture content of the part of the butterfly. For the model file of material 13 or resource file 12 (for example, a 3D model file in FBX format), because the model file can include the poses or actions of multiple models, the "part of the material" can be defined by the poses or actions of at least one model For example, for a gorilla model that includes a punching action, the command 15 of "punch punching" can be bound to enable the augmented reality application 21 to play the gorilla punching after loading the model of the model file.

In step S4 in Figure 2, the first electronic device 20 with a camera (such as a mobile device) and the second electronic device 30 with a camera (such as a notebook computer) download or receive amplification from the cloud C via the network, respectively. After the reality setting data D (profile 14), the augmented reality application 21 installed on the first electronic device 20 is used to load the augmented reality setting data D (profile 14) to provide augmented reality. The function of the environment.

In step S5 of Figure 2, when the first electronic device 20 is connected to the second electronic device 30 (for example, a video connection that can be augmented reality or a voice call connection that can be augmented reality), the first The electronic device 20 or the second electronic device 30 can receive input information such as voice (sound), gesture images, etc., for example, the input information is (1) a voice spoken by the user's U mouth, (2) receiving the first electronic device 20 through a microphone Or a segment of sound around the second electronic device 30, (3) the camera of the first electronic device 20 or the second electronic device 30 captures the gesture image of the user U, etc.

In step S6 in Figure 2, after the augmented reality application 21 of the first electronic device 20 obtains the input information, it can further identify the commands included in the input information, and combine the commands with the augmented reality setting data D( The command 15 recorded in the profile 14) is compared. If the command matches the command 15 recorded in the augmented reality setting data D (profile 14), the content of the bound material 13 will be loaded according to the command 15, and the content of the material 13 will be overlapped on the real scene. As above, the content of the material 13 can be executed or played to provide the user U with augmented reality information based on the content of the part of the material 13. The recognition method of the augmented reality application 21 of the first electronic device 20 may include: using a voice recognition module M1 (such as a voice recognition module with artificial intelligence) to recognize whether a voice file contains a voice command, and use the voice feature Way to identify whether an audio file contains a specific sound or the environmental state when the audio file was recorded, so as to use a command identifier 16 corresponding to the specific sound or environmental state as the command 15; or, use the image recognition module M2 (if manual The intelligent image recognition module) recognizes whether the image data obtained from the camera of the first electronic device 20 or the second electronic device 30 contains a gesture, and uses a command recognizer 16 corresponding to the gesture as the command 15.

The present invention can also build an image recognition module M2 (such as an image recognition module with artificial intelligence) to process the part of recognizing gesture commands from image data, that is, the image recognition module M2 (such as an image recognition module with artificial intelligence). The module can output a command identifier 16 as a result according to the incoming image data. Therefore, after the augmented reality application 21 obtains the input information, it can pass the input information to the image recognition module M2 (such as an image recognition module with artificial intelligence), and from the image recognition module M2 (such as artificial intelligence) The image recognition module) retrieves a command identifier 16, and then compares the command identifier 16 with the command 15 recorded in the augmented reality setting data D (profile 14), and then continues the remaining work.

The present invention can find out the content of the part of the material 13 that is bound based on the augmented reality setting data D (configuration file 14), and then present the content of the part of the material 13 (such as images or sounds) in the first place where the input information can be received. On an electronic device 20 (such as a mobile device), the content of the part of the material 13 can even be presented simultaneously on the first electronic device 20 and other second electronic devices 30 participating in the connection. For example, the synchronization method may include: both the first electronic device 20 and the second electronic device 30 participating in the connection recognize the command 15 and execute the command 15, so as to synchronously present the part of the element. The content of the material 13; or one of the first electronic device 20 and the second electronic device 30 first presents the content of the bound material 13 according to the command 15, and then synchronizes the changed part of the content formed before and after the presentation to the participant The other one of the connected first electronic device 20 and the second electronic device 30 presents the content of the part of the material 13 synchronously to satisfy the synchronization effect.

If an artificial intelligence recognition module (such as a voice recognition module M1 or an image recognition module M2 with artificial intelligence) is used to handle the recognition problem of the command 15, whether it is an image or a sound, the present invention can be expanded in the above step S2 The augmented reality content design tool module 10 interfaces with an artificial intelligence recognition module (such as a voice recognition module M1 or an image recognition module M2 with artificial intelligence), and transmits one of the data input by the user U containing command information to An artificial intelligence recognition module (such as a voice recognition module M1 or an image recognition module M2 with artificial intelligence) to recognize and retrieve a command identifier 16, so that the user U can design the tool module 10 in the augmented reality content The above binds the content of the command identifier 16 and the material 13, and saves the binding result of the two in the augmented reality setting data D (profile 14), so that the augmented reality setting can be set in step S6 Data D (setting file 14) can be followed.

For example, on the first electronic device 20 (such as a mobile device), according to a self-defined command 15 (such as a voice command), after a chimpanzee model is displayed in the augmented reality, the command 15 is used to control the chimpanzee model. For example, as described below.

As shown in Figures 4 and 5, first load a chimpanzee model file (that is, material 13) in FBX format (.fbx) into the web-based augmented reality content design tool module 10. In the exclusive property window of the reality content design tool module 10, there is a drop-down list L1 (select animation) that lists the animation states that this model file can present, and there is a chimpanzee running animation state in the drop-down list L1 Style (gorillishArmature|gorrillishRUN), so you can select this animation style and place it in the text field below the drop-down list L1 (that is, the field of command 15) Enter the command "Run" to represent the binding of the command "Run" to this animation pattern. Then, on the first electronic device 20 (such as a mobile device), the chimpanzee's FBX model file is loaded through the augmented reality application 21, and it can be imagined that the chimpanzee is when the augmented reality application 21 recognizes a certain target After that, it is displayed on the label. Then, when the user U says "Run" to the first electronic device 20, he can see the chimpanzee running on the first electronic device 20.

In detail, in Figure 4, the user U can first select and drag a control H of a model component from the component list L2 of the augmented reality content design tool module 10 to the editing area E, and load it. The model is placed in the editing area E of the augmented reality content design tool module 10, so that the augmented reality content design tool module 10 binds the model and the control H of the model element to generate a binding result, and then use it The user U presses the save button B1 to save the binding result in the form of augmented reality setting data D or to the cloud C.

As shown in Figure 6, the present invention can download the augmented reality setting data D from the cloud C through the augmented reality application 21 (see Figure 1) on the first electronic device 20 (such as a mobile device), and start it The connection of augmented reality (AR) video, so that the first electronic device 20 captures the real scene to the second electronic device 30 (such as a notebook computer), and the second electronic device 30 sets the data D according to the augmented reality Draw the augmented reality content F. Then, the command 15 (such as a voice command) is received through the microphone (Mic) of the second electronic device 30, and when the second electronic device 30 recognizes that the command 15 is "Run", the second electronic device 30 draws the expansion of the orangutan running Realistic animation. Finally, the second electronic device 30 transmits the command "Run" to the first electronic device 20, so that the first electronic device 20 recognizes and draws the same augmented reality animation.

In addition to the above technical content, the present invention can also provide the following related technologies, such as [1] voice recognition, [2] synchronization mode of augmented reality content, [3] gesture commands, etc.

[1] Voice recognition: A voice recorder (not shown) can be set in the first electronic device 20 or the second electronic device 30 to record the first electronic device 20 and the second electronic device through the voice recorder 30. The voice in the augmented reality video call can also be converted into text, and the text can be recognized by the following methods. For example, first recognize the wake-up words in the text, and then compare the following text with command 15; or, without recognizing the wake-up words in the text, directly compare command 15 in the text stream.

[2] The synchronization method of the augmented reality content F: make the first electronic device 20 and the second electronic device 30 both recognize the command 15 and execute the command 15 to achieve the synchronization effect of the two; or, the first electronic device One of the device 20 and the second electronic device 30 uses a microphone to receive the command 15 (such as a voice command) and changes the augmented reality content F according to the command 15, and then synchronizes the changed part of the augmented reality content F to The other one of the first electronic device 20 and the second electronic device 30 adjusts the abnormal part to achieve the synchronization effect between the first electronic device 20 and the second electronic device 30.

[3] Gesture commands: In an augmented reality video call, each of the first electronic device 20 and the second electronic device 30 participating in the connection basically has a microphone, so voice commands can be implemented to operate the augmented reality Content F. Moreover, if gesture commands are to be implemented to operate the augmented reality content F, only the first electronic device 20 or the second electronic device 30 with a camera can use the gesture commands, and those without a camera cannot use the gesture commands to operate the augmented reality. Content F.

The present invention also provides a computer-readable storage medium, which is used in a computer or computing device with a processor and/or memory. The computer or computing device stores instructions through the processor (for example, CPU, GPU, etc.) and/ Or the memory executes the above-mentioned augmented reality content control method through commands.

In summary, the augmented reality content control system, method, and computer-readable storage medium of the present invention have at least the following characteristics, advantages, or technical effects.

1. The present invention can allow the user to customize the command of the augmented reality content through the augmented reality content design tool module, so that the user can customize the control method of the augmented reality content.

2. The present invention can combine artificial intelligence recognition technology (such as a voice recognition module or an image recognition module with artificial intelligence) to make commands more flexible.

3. The present invention can provide users with commands (such as voice commands or gesture commands) to operate augmented reality content, so as to reduce the control complexity of augmented reality content.

4. The control method of the present invention can use voice commands (voice control methods), gesture commands, text commands, etc., to increase the selectivity or convenience of the control methods.

5. The present invention can be used in the connection mode of multiple (such as at least two) electronic devices, and can also satisfy the synchronization effect after content manipulation of multiple electronic devices.

6. The possible applications of the present invention are, for example, augmented reality (AR) application industries, Internet of Things (IOT), etc., and possible applications of products are, for example, mobile devices (such as smart phones), computers (such as laptops) Tablet PC), smart glasses and other electronic devices.

The above embodiments are only illustrative of the principles, features and effects of the present invention, and are not intended to limit the scope of implementation of the present invention. Anyone familiar with the art can comment on the above without departing from the spirit and scope of the present invention. Modifications and changes to the implementation form. Any equivalent changes and modifications made using the content disclosed in the present invention should still be covered by the scope of the patent application. Therefore, the protection scope of the present invention should be as listed in the scope of the patent application.

1. A content control system for augmented reality

10‧‧‧Amplified reality content design tool module

11‧‧‧User Interface

12‧‧‧Resource File

13‧‧‧Materials

14‧‧‧Configuration File

15‧‧‧Command

16‧‧‧Command identifier

20‧‧‧The first electronic device

21‧‧‧Augmented Reality Application

22‧‧‧Web browser components

30‧‧‧Second electronic device

C‧‧‧Cloud

D‧‧‧Amplified reality setting data

M1‧‧‧Voice recognition module

M2‧‧‧Image recognition module

Claims (21)

An augmented reality content control system, including: An augmented reality content design tool module is used to load materials, and the augmented reality content design tool module has a user interface to add at least one command through the user interface, wherein the expansion The augmented reality content design tool module binds the command and at least a part of the content of the material to store the binding result of the command and at least a part of the content of the material to an augmented reality setting Data, and then place or upload the augmented reality configuration data to the cloud; and A first electronic device and at least one second electronic device respectively receive or download the augmented reality configuration data from the cloud. When the first electronic device is connected to the second electronic device, the first electronic device is connected to the second electronic device. The electronic device or the second electronic device obtains an input information to identify another command from the input information. If the other command is the same or corresponds to the command stored in the augmented reality setting data, the first An electronic device or the second electronic device uses the bound part of the content of the material to present the augmented reality effect according to the binding result of the command and at least a part of the content of the material. For example, the augmented reality content control system described in item 1 of the scope of patent application, wherein the user logs in the augmented reality content design tool module through the first electronic device to use the augmented reality The upload interface of the content design tool module uploads a resource file to the cloud for storage, and the augmented reality content design tool module loads the content of the resource file for the user to preview. The augmented reality content control system described in item 2 of the scope of patent application, wherein the user uses the command to control the playback behavior of the resource file, and the augmented reality content design tool module has a resource link Function to load the resource file from the Internet. For example, the augmented reality content control system described in claim 1, wherein the first electronic device provides an augmented reality application with a web browser component to load through the web browser component Import the design result of the location layout of the augmented reality content design tool module to the first electronic device. The augmented reality content control system described in item 1 of the scope of patent application, wherein the binding result of the command and at least a part of the content of the material is further stored in a configuration file for the first electronic The augmented reality application of the device loads the configuration file and executes the command. For example, the augmented reality content control system described in item 1 of the scope of patent application, wherein the input information is input by the user and saved using audio track files or image files, and the augmented reality content design tool model The group recognizes the command represented by the audio track file through a voice recognition module, or recognizes the command represented by the image file through an image recognition module. For example, the augmented reality content control system described in item 1 of the scope of patent application, wherein the identification method of the augmented reality application of the first electronic device includes: Use the voice recognition module to recognize whether an audio file contains voice commands, and identify whether the audio file contains a specific sound or the environmental state when the audio file is recorded in a voice feature mode, so as to correspond to the specific sound or the environmental state The command identifier of the command as the command; or The image recognition module is used to recognize whether the image data obtained from the camera of the first electronic device or the second electronic device contains a gesture, so that the command identifier corresponding to the gesture is used as the command. For example, the augmented reality content control system described in item 6 or item 7 of the scope of patent application, wherein the voice recognition module is a voice recognition module with artificial intelligence, and the image recognition module is artificial intelligence The image recognition module. Such as the augmented reality content control system described in item 1 of the scope of patent application, wherein both the first electronic device and the second electronic device participating in the connection recognize the command and execute the command to synchronize Present the content of the material; or, one of the first electronic device and the second electronic device first presents the content of the material according to the command, and then synchronizes the changed part of the content of the material formed before and after the presentation to the participating connection The other of the first electronic device and the second electronic device can present the content of the material synchronously. The augmented reality content control system described in item 1 of the scope of patent application, wherein the augmented reality content design tool module has a component list and an editing area for users to select from the component list And drag the control of the model element to the editing area, and load a model in the editing area, so that the augmented reality content design tool module binds the model and the control of the model element to generate a binding result. For example, the augmented reality content control system described in claim 1, wherein the first electronic device or the second electronic device is provided with a voice recorder to record the voice recorder through the voice recorder Voice in an augmented reality video call between the first electronic device and the second electronic device. A content control method for augmented reality, including: An augmented reality content design tool module is provided to load materials, and the augmented reality content design tool module has a user interface to add at least one command through the user interface, wherein the augmented reality content design tool module Environment content design tool module both the command and at least part of the content of the material Binding, to store the binding result of the command and at least a part of the content of the material to an augmented reality configuration data, and then place or upload the augmented reality configuration data to the cloud; and A first electronic device and at least one second electronic device respectively receive or download the augmented reality setting data from the cloud, so that when the first electronic device and the second electronic device are connected, the first electronic device The device or the second electronic device obtains an input information to identify another command from the input information. If the other command is the same or corresponds to the command stored in the augmented reality configuration data, the first The electronic device or the second electronic device uses the bound part of the content of the material to present the augmented reality effect according to the binding result of both the command and at least a part of the content of the material. As described in item 12 of the scope of patent application, the augmented reality content control method further includes the user logging in the augmented reality content design tool module through the first electronic device to use the augmented reality The upload interface of the content design tool module uploads a resource file to the cloud for storage, and the augmented reality content design tool module loads the content of the resource file for the user to preview. As described in item 12 of the scope of patent application, the augmented reality content control method further includes providing an augmented reality application with a web browser component provided by the first electronic device for loading through the web browser component Import the design result of the location layout of the augmented reality content design tool module to the first electronic device. The augmented reality content control method described in item 12 of the scope of patent application further includes storing the binding result of the command and at least a part of the content of the material to a configuration file for the first electronic The augmented reality application of the device loads the configuration file and executes the command. As described in item 12 of the scope of patent application, the augmented reality content control method further includes the use of audio track files or image files to save the user’s input information, and the augmented reality content design tool module passes A voice recognition module recognizes the command represented by the audio track file, or an image recognition module recognizes the command represented by the image file. As described in item 12 of the scope of patent application, the augmented reality content control method, wherein the identification method of the augmented reality application of the first electronic device includes: Use the voice recognition module to recognize whether an audio file contains voice commands, and identify whether the audio file contains a specific sound or the environmental state when the audio file is recorded in a voice feature mode, so as to correspond to the specific sound or the environmental state The command identifier of the command as the command; or The image recognition module is used to recognize whether the image data obtained from the camera of the first electronic device or the second electronic device contains a gesture, so that the command identifier corresponding to the gesture is used as the command. As described in item 12 of the scope of patent application, the augmented reality content control method includes: Both the first electronic device and the second electronic device participating in the connection recognize the command and execute the command to synchronously present the content of the material; or One of the first electronic device and the second electronic device first presents the content of the material according to the command, and then synchronizes the changed part of the content of the material formed before and after the presentation to the first electronic device and the connected first electronic device The other one of the second electronic devices simultaneously presents the content of the material. As described in item 12 of the scope of patent application, the augmented reality content control method further includes selection and dragging by the user in the component list of the augmented reality content design tool module The control of the model component is transferred to the editing area of the augmented reality content design tool module, and a model is loaded into the editing area, so that the augmented reality content design tool module can connect the model and the model component The control is bound to produce the binding result. As described in item 12 of the scope of patent application, the augmented reality content control method further includes setting a voice recorder on the first electronic device or the second electronic device to record the voice recorder through the voice recorder. Voice in an augmented reality video call between the first electronic device and the second electronic device. A computer-readable storage medium, used in a computer, stores instructions to execute the augmented reality content control method described in item 12 of the scope of the patent application.

Images