CN113312041A

CN113312041A - AR authoring platform and authoring method thereof

Info

Publication number: CN113312041A
Application number: CN202110244437.XA
Authority: CN
Inventors: 李晋芳; 蔡嘉鸿; 何汉武; 吴悦明
Original assignee: Guangdong University of Technology
Current assignee: Guangdong University of Technology
Priority date: 2021-03-05
Filing date: 2021-03-05
Publication date: 2021-08-27

Abstract

The invention discloses an AR authoring platform and an authoring method thereof, relating to the technical field related to AR authoring, wherein the AR authoring method comprises the following steps: carrying out initialization setting, model registration method setting in the real world and model posture editing on the imported data; scanning a logo or plane; converting basic data modules in conventional text programming into statement modules of different types, and constructing a graphic programming statement module; selecting a corresponding graphic programming statement module for splicing and filling to obtain an AR work; carrying out posture debugging, front-end UI debugging and rear-end event debugging on the AR works; and exporting the platform file after debugging is correct, and displaying the platform file on a screen for interaction. The method for graphical splicing programming is applied to the AR works, the AR development difficulty is reduced, the development efficiency is improved, convenient creation of the AR works is not limited to model display or animation design, and cross-terminal design and browsing can be achieved.

Description

AR authoring platform and authoring method thereof

Technical Field

The invention relates to the technical field related to AR authoring, in particular to an AR authoring platform and an authoring method thereof.

Background

Augmented Reality (AR) is a technology for calculating the position and angle of a camera image in real time and adding a corresponding image, and the technology aims to sleeve a virtual world on a screen in the real world and perform interaction. This technique was proposed by 1990. With the improvement of the computing power of portable electronic products, the application of augmented reality is expected to be wider and wider. The conventional augmented reality works need professional engineers to develop, certain programming capability and professional knowledge are needed, ordinary users have no programming development experience, and it is very difficult to create own works from own ideas through simple AR design. As a potential new man-machine interaction mode, the AR technology needs abundant AR works, the conventional development of the AR works has the problems of long development period and high development difficulty, a plurality of development contents such as interaction design and interface display are repetitive work, and the convenient creation requirement of the AR works is self-evident.

Current AR Portable authoring platforms are apple's Reality Composer and Adobe's Aero. These two kinds of APP all are the AR creation of no programming process, and the use is all very similar: after a user finds a responding model on the cloud, downloads the model to the local, selects an AR registration method (namely a virtual-real fusion method, an image tracking method based on a logo and a non-mark tracking method based on a plane detection method), designs an animation flow for a virtual object, generally including general animations of translation, rotation, jumping, display, hiding and the like, and then opens a terminal camera to perform AR preview. Based on the AR authoring method in the prior art, the authoring process is single, the more complicated AR work design cannot be realized, and the interaction is lacked; the existing AR work creation platform lacks the logical and algorithmic relationship between the constructed AR virtual models, and limits the richness of the AR works in the interaction aspect, so that the research and development of a simple, quick, virtual and real combined AR creation method is a problem which needs to be solved urgently by technical personnel in the field.

Disclosure of Invention

In view of this, the invention provides an AR authoring platform and an AR authoring method thereof, which not only reduce the authoring threshold of AR works, enable persons without programming experience to participate in the development of the AR works, but also enrich the designability in the AR work rapid authoring platform, and enable the rapid authoring of the AR works not to be limited to the display of the AR works or the animation design of the AR works.

In order to achieve the above purpose, the invention provides the following technical scheme:

an AR authoring method comprising the steps of:

data import: analyzing the obtained model and/or picture or the designed work and then importing the analyzed model and/or picture into an AR work creation platform;

editing basic element model: carrying out initialization setting on the imported data, setting a model in a real world registration method, editing a model posture, and setting a model parameter as a variable;

AR registration: scanning a logo or plane;

constructing a graphic programming statement module: converting variables, statements and functions in the conventional text into a graphical programming statement module according to types;

graphical programming: splicing and filling the corresponding graphic programming statement modules according to the received instruction to obtain a programming event;

debugging the work: carrying out posture and/or effect debugging on the obtained programming event;

and (3) storing works: and saving and exporting the platform file after debugging is correct, and displaying the platform file on a screen for interaction.

As an improvement, the graphical programming further comprises a trigger method design, and the trigger method comprises the steps of importing picture materials, constructing a front-end interface, and binding a trigger instruction with a corresponding programming event.

The method has the advantages that the front-end event button and the corresponding programming event are bound through the design of the triggering method, the contact between the front-end design module and the rear-end design module is completed, and more interaction methods are provided for browsing the AR works.

As an improvement, the model pose editing includes editing of position, rotation, scale and animation content design aspects.

As an improvement, the work commissioning includes:

front end UI debugging: comparing whether the constructed effect of the AR basic elements reaches the expected setting or not;

and (3) posture debugging: comparing whether the model pose and the scaling of the AR basic elements reach the expected setting or not, if not, triggering a pose adjustment instruction to debug the pose and the scaling;

debugging a back-end event: and comparing whether the works designed by the graphic programming module reach the expected setting, if not, triggering an event adjusting instruction, and rechecking whether the splicing process of the graphic programming module is correct.

An AR authoring platform comprises an AR file parser, an AR work editor, an AR debugger and an AR browser; the AR file analyzer is connected with the AR work editor; the AR work editor is connected with the AR debugger; the AR debugger is connected with the AR browser; wherein the content of the first and second substances,

the AR file analyzer analyzes an input model and/or picture or a designed work;

the AR work editor establishes a basic element model, edits the basic element model and initializes model variables; converting variables, sentences and functions in the conventional text into different types of graphic programming sentence modules according to types, splicing and filling the graphic programming sentence modules according to instructions, and constructing programming events;

the AR debugger debugs the posture and/or the effect of the obtained programming event;

and the AR browser previews debugging-error-free works.

As an improvement, the AR work editor also comprises a front-end interface, a picture is imported, the triggering instruction is bound with the corresponding programming event, and the design of the triggering method is completed.

As an improvement, the AR work editor comprises an AR basic element modeling module, a rear end design module and a front end design module, wherein the AR basic element modeling module and the front end design module are connected with the rear end design module; the back end design module is connected with the AR debugger; the AR basic element modeling module is connected with the AR file parser.

As an improvement, the AR base element modeling comprises: the system comprises a model preprocessing unit, an interface unit, a model posture design unit and an animation design unit; the model preprocessing unit is connected with the AR file analyzer; the model preprocessing unit, the interface unit and the model posture design unit are all connected with the animation design unit; the animation design unit is connected with the rear end design module.

As an improvement, the back-end design module comprises a function design unit, a variable design unit and a graph programming splicing unit, wherein the function design unit and the variable design unit are both connected with the graph programming splicing unit, and the graph programming splicing unit is connected with the AR debugger; and the graphic programming splicing unit is connected with the front end design module.

As an improvement, in the back-end design module,

the function design unit converts basic data modules in conventional text programming into different types of function blocks;

the variable design unit sets the model parameters of the AR basic element modeling module as variables and converts the variables into variable blocks;

and the graphic programming splicing unit splices and fills the corresponding function blocks and the variable blocks according to the received instruction.

Compared with the prior art, the AR creation platform and the creation method thereof have the advantages that the graphical splicing programming method is applied to the AR works, the AR development difficulty is reduced, the development efficiency is improved, the AR works can be conveniently created without model display or animation design, and cross-terminal design and browsing can be realized.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

FIG. 1 is a functional block diagram of an authoring platform of the present invention;

FIG. 2 is a flow chart of the design of the AR work of the present invention;

FIG. 3 is a detailed design flow diagram of a cross-sectional view of an AR valve body of the present invention;

FIG. 4 is a schematic diagram of graphical programming events designed by the AR valve triggering method of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention discloses an AR work display of a cross section of a valve body model, which comprises an AR creation method and an AR creation platform, wherein the AR creation method is shown in figure 1, and the module function of the AR creation platform is shown in figure 2;

the AR authoring steps for the valve body model are shown in fig. 3 and include the following steps:

s1, file analysis: importing the obtained model into an AR file analyzer to analyze the file;

s2, registration method: importing the analyzed model into an AR work editor, and setting a registration method of the AR model in the real world by adopting an image tracking method based on a marker graph;

s3, extracting variables: the model parameters are set to variables such as: the display state of the part A of the valve body, the display state of the part B of the valve body, the display state of the part C of the valve body, the display state of the part D of the valve body, the position of the part A of the valve body, the position of the part B of the valve body, the position of the part C of the valve body and the position of the part D of the valve body;

s4, constructing a graphic programming statement module: initializing received model variables, and converting basic modules of a conventional process-oriented text programming language, such as main functions, trigger methods, conditional statements, judgment statements, cycle statements, assignment statements, variables and the like, into statement modules;

s5, graphical programming: selecting corresponding statement modules for splicing and filling according to different effects required by the events, wherein the embodiment comprises four events, as shown in fig. 4, which are respectively a single section view display effect, a rotary section view display effect, a model resetting state display effect and an explosion view effect, and the statement modules are adopted for splicing and filling one by one;

s6, design of a triggering method: the front-end interface is provided with a text button 1, a button 2, a button 3 and a button 4 which are respectively bound with an AR valve body model, a single section diagram display, a rotary section diagram display, a reset model state display and an explosion diagram effect event in graphical programming, and the names of the corresponding button AR valve body model, the single section diagram, the rotary section diagram, the reset model and the explosion diagram are given according to the effect achieved by the bound event;

wherein the trigger button 1 displays an AR valve body model; the trigger button 2 shows a single cross-sectional view of the model; the trigger button 3 restores the four parts in the model to the previous positions; the trigger button 4 displays the explosion effect map of the model.

S7, preview debugging: after the method is designed, a camera of a terminal is opened in an AR creation platform for debugging, (1) whether the effect of constructing the AR basic elements reaches the expected effect is checked, and the main possible problems are as follows: the registration method based on the marker graph and the registration method based on the plane detection method are not properly designed (if the characteristic points of the defined marker graph are too few, such as a completely black picture, image tracking cannot be realized); (2) checking whether the model pose and the scaling of the AR basic elements achieve the expected effect or not, and if the model pose and the scaling need to be adjusted, debugging the pose and the scaling by an AR debugger; (3) checking whether the method designed by the graphic programming module achieves the expected effect or not, and if not, returning to the graphic programming module to check which part of graphic programming splicing has a problem;

s8, export and storage: after the design and debugging are finished without errors, the platform file is exported.

In another embodiment, the model in S1 is a picture or a platform file that can be parsed.

In another embodiment, the step S5 adopts a real-time design method, and selects corresponding statement modules for splicing and filling according to the effect required by the event, and then jumps to the step S7 after completion.

The authoring platform comprises: the system comprises an AR file analyzer, an AR work editor, an AR debugger and an AR browser; the AR file analyzer is connected with the AR work editor; the AR work editor is connected with the AR debugger; the AR debugger is connected with the AR browser, and functions of all parts of the AR debugger are shown in figure 1; wherein:

the AR file analyzer can complete model analysis, picture analysis and platform file analysis, and the valve body is introduced into the AR work editor after being analyzed by the AR file analyzer;

the AR work editor comprises an AR basic element modeling module, a rear end design module and a front end design module; the AR basic element modeling module and the front end design module are both connected with the rear end design module; wherein the content of the first and second substances,

the AR base element modeling module includes: the system comprises a model preprocessing unit, an interface unit, a model posture design unit and an animation design unit;

the interface unit, the model posture design unit and the model preprocessing unit are all connected with the animation design unit, and the animation design unit is connected with the rear-end design module; for the imported model, setting a registration method of the AR model in the real world (an image tracking method based on a logo and a label-free volume method based on plane detection); editing the pose of the model, including position, rotation, scale, and design animation content (including move, spin, show, hide, and rotate); after the basic element modeling is completed, the AR platform can realize simple preview of the model in the real world (a camera of the terminal is opened, a logo or a plane is scanned, and AR registration is realized).

A rear end design module: the AR work behavior control system comprises a function design unit, a variable design unit and a graph programming splicing unit, wherein the function design unit and the variable design unit are connected with the graph programming splicing unit, a rear end design module realizes the connection of a plurality of models in an AR work by adopting a method based on graphical splicing programming, basic data modules such as variables, statements, function blocks and the like in conventional text programming are firstly converted into building blocks of different types, as shown in a table 1, then simple programming effects are realized through simple building block splicing, filling and other operations, and the modules are combined with the basic data modules to construct lightweight graphical programming for behavior control of the AR work.

TABLE 1 graphical programming statement module

The method comprises the steps that a front-end design module carries out UI design, the UI design comprises the steps of adding the front-end module, importing a front-end text and a front-end picture, constructing a front-end interface, constructing a trigger instruction button according to an instruction on the interface, binding the trigger instruction button with an event in a rear-end design module, and endowing a corresponding name of the corresponding trigger instruction button according to the effect achieved by the event; the front-end design module and the rear-end design module are connected together through the trigger instruction button, and therefore more interaction methods are provided when the AR works are browsed.

The AR debugger module comprises posture debugging, front-end UI debugging and back-end event debugging; the camera that needs open the terminal in the AR creation platform debugs, accomplishes: (1) the main possible problems of checking whether the effect of the constructed AR basic elements achieves the expected effect are that the registration based on the logo and the registration method based on the plane detection method are not properly designed (if the number of feature points of the defined logo is too small, for example, a completely black picture, image tracking cannot be achieved). (2) And checking whether the model pose and the scaling of the AR basic elements achieve the expected effect or not, and if the model pose and the scaling of the AR basic elements need to be adjusted, directly debugging the pose and the scaling in an AR debugger. (3) And checking whether the method designed by the graphic programming module achieves the expected effect, and returning to the graphic programming module to check which part of the graphic programming splicing has a problem if the method does not achieve the expected effect.

After the AR browser finishes design and debugging without errors, the platform file can be exported, so that preview of AR works can be realized on different terminals. The platform file can realize previewing on different terminals because the same resolution protocol is designed, and an exported file name suffix and a data storage style are set in the protocol. The binary file is a data type which can be identified by all terminal equipment, and the problem of file data breakage or overlapping does not exist, so that the cross-platform design can be realized.

The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An AR authoring method, comprising the steps of:

AR registration: scanning a logo or plane;

constructing a graphic programming statement module: converting variables, sentences and functions in the conventional text into different graphic programming sentence modules according to types;

2. The AR authoring method according to claim 1, further comprising trigger method design, wherein the trigger method comprises importing picture material, constructing a front-end interface, and binding trigger instructions with corresponding programming events.

3. The AR authoring method of claim 1 wherein said model pose editing comprises editing of position, rotation, scale and animation content design aspects.

4. The AR authoring method of any one of claims 1-3 wherein work debugging comprises:

5. An AR authoring platform is characterized by comprising an AR file analyzer, an AR work editor, an AR debugger and an AR browser; the AR file analyzer is connected with the AR work editor; the AR work editor is connected with the AR debugger; the AR debugger is connected with the AR browser; wherein the content of the first and second substances,

the AR file analyzer analyzes an input model and/or picture or a designed work;

and the AR browser previews debugging-error-free works.

6. The AR authoring platform of claim 5, wherein the AR composition editor further comprises a front end interface to be built, to import pictures, to bind trigger instructions with corresponding programming events, to complete trigger methodology design.

7. The AR authoring platform of any one of claims 5 to 6, the AR work editor comprising an AR base element modeling module, a back end design module, a front end design module, the AR base element modeling module and the front end design module both connected to the back end design module; the back end design module is connected with the AR debugger; the AR basic element modeling module is connected with the AR file parser.

8. The AR authoring platform of claim 7, wherein the AR base element modeling comprises: the system comprises a model preprocessing unit, an interface unit, a model posture design unit and an animation design unit; the model preprocessing unit is connected with the AR file analyzer; the model preprocessing unit, the interface unit and the model posture design unit are all connected with the animation design unit; the animation design unit is connected with the rear end design module.

9. The AR authoring platform of claim 7, wherein the back-end design module comprises a function design unit, a variable design unit, and a graphical programming splice unit, wherein the function design unit and the variable design unit are connected to the graphical programming splice unit, and the graphical programming splice unit is connected to the AR debugger; and the graphic programming splicing unit is connected with the front end design module.

10. The AR authoring platform of claim 9, wherein in the back-end design module,