WO2021088161A1

WO2021088161A1 - Ar-based description method and description system

Info

Publication number: WO2021088161A1
Application number: PCT/CN2019/121459
Authority: WO
Inventors: 刘石坚; 潘正祥; 邹峥; 廖律超; 张国基; 许锐; 范宜凯
Original assignee: 福建工程学院
Priority date: 2019-11-08
Filing date: 2019-11-28
Publication date: 2021-05-14
Also published as: CN110889337A

Abstract

The present application relates to the field of data processing, and provides an AR-based description method and description system. The description method comprises: a server side constructs a three-dimensional digital model of equal proportion according to a physical object to be described and physical shapes and sizes of parts constituting said physical object; the server side obtains a description scheme for the three-dimensional digital model, adds the description scheme into the three-dimensional digital model, and generates the three-dimensional digital model comprising the description scheme into an application; the server side sends the application to a client; the client installs the application, aligns the three-dimensional digital model with said physical object when said physical object is identified, and runs the description scheme when a user selects said physical object. In the present invention, the user can know the structure of a commodity in an immersive way, and understands functions and parameters of the commodity by means of various explanation ways.

Description

A description method and description system based on AR

Technical field

This application belongs to the field of data processing, and in particular relates to an AR-based description method and description system.

Background technique

When merchants sell products, they usually provide consumers with a product manual to show the parameters, functions, usage methods, and precautions of the products. Since flat paper manuals are not intuitive enough to display the operation process of three-dimensional physical goods, and their content cannot be changed once printed, merchants sometimes use digital video methods for functional demonstrations, but observe how others do and consumers do There may still be deviations in understanding.

Augmented reality AR technology is a cutting-edge computer-aided technology that can intuitively display the multimedia information of target objects in three-dimensional space in various forms such as text, pictures, videos, and three-dimensional animations, and can interact with users in real time. Therefore, the use of AR technology to produce product display programs can replace the existing paper product manuals and accelerate the paperless process.

The prior art AR manuals usually associate auxiliary description information based on a specific picture texture in the manual, and users cannot associate the auxiliary description information with the entity to be described, so it is difficult to understand the product immersively. Secondly, the prior art AR instructions still depend on paper materials.

Summary of the invention

technical problem

The solution to the problem

Technical solutions

The main purpose of the embodiments of the present invention is to provide an AR-based description method and description system. Through the solutions of the embodiments of the present invention, users can understand the structure of the product immersively, and learn about the product through various interpretation methods. Function parameter.

In the first aspect, an AR-based description method is provided, including:

The server-side constructs an equal-scale three-dimensional digital model according to the physical shape and size of the physical object to be described and the parts constituting the physical object to be described;

The server side obtains an explanation plan for the three-dimensional digital model, adds the explanation plan to the three-dimensional digital model, and generates a three-dimensional digital model containing the explanation plan as an application program;

The server sends the application to the client;

The client installs the application, and when the object to be explained is identified, the three-dimensional digital model is aligned to the object to be explained, and when the user selects the object to be explained, the explanation scheme is run.

In a possible implementation manner, the description solution includes: determining the description object, the description content, and the description expression form.

In another possible implementation manner, the description object includes: the whole object and/or the parts constituting the object, and the description expression form includes: text, audio, video, and animation.

In another possible implementation manner, the description content includes: parameters, functions, assembly methods, usage methods, and precautions of the physical object and its parts.

In yet another possible implementation manner, the client recognizes the object to be described through the geometric shape and/or image texture of the object to be described.

In the second aspect, an AR-based explanation system is provided, and the explanation system includes:

The server side is used to construct a three-dimensional digital model of equal proportions according to the physical shape and size of the physical object to be explained and the parts constituting the physical object to be explained, obtain an explanation plan for the three-dimensional digital model, and add the explanation plan to In the three-dimensional digital model, the three-dimensional digital model containing the description scheme is generated as an application program, and the application program is sent to the client;

The client is used to install the application program sent by the server, when the object to be explained is identified, the three-dimensional digital model is aligned to the object to be explained, and when the user selects the object to be explained, run the Explain the plan.

In yet another possible implementation manner, the description object includes: the whole physical object and/or the parts constituting the physical object, and the form of the description expression includes: text, audio, video, and animation.

In yet another possible implementation manner, the client recognizes the actual object to be described through the geometric shape and/or the texture of the image of the object to be described.

The beneficial effects of the invention

Beneficial effect

The technical solution provided by this application has the beneficial effect that it can enable users to understand the structure of the product immersively, and understand the functions and parameters of the product through various explanation methods.

Brief description of the drawings

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present application.

FIG. 1 is a flowchart of an AR-based description method provided by an embodiment of the present invention;

Fig. 2 is a structural diagram of an AR-based description system provided by an embodiment of the present invention.

Invention embodiment

Embodiments of the present invention

The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals indicate the same or similar modules or modules with the same or similar functions. The embodiments described below with reference to the drawings are exemplary, and are only used to explain the present application, and cannot be construed as limiting the present invention.

Those skilled in the art can understand that, unless specifically stated otherwise, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of this application refers to the presence of the described features, integers, steps, operations, modules and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, modules, components, and/or groups of them. It should be understood that when we refer to a module as being “connected” or “coupled” to another module, it can be directly connected or coupled to the other module, or an intermediate module may also be present. In addition, “connected” or “coupled” used herein may include wireless connection or wireless coupling. The term "and/or" as used herein includes all or any unit and all combinations of one or more associated listed items.

In order to make the objectives, technical solutions, and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below with reference to the accompanying drawings.

In the following, specific embodiments are used to describe in detail the technical solutions of the present application and the technical solutions of the present application and solving the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

Example one

Fig. 1 is a flowchart of an AR-based description method provided by an embodiment of the present invention, including:

In step S101, the server side constructs an equal-scale three-dimensional digital model according to the physical shape and size of the object to be described and the parts constituting the object to be described.

In the embodiment of the present invention, the server of the product manufacturer stores the data of all the physical objects and their parts. These data include the physical shape and size of the physical objects and their parts. The above data can be directly called from the database of the server. The data can construct a three-dimensional digital model of the real object and its parts in equal proportions.

Step S102: The server side obtains an explanation plan for the three-dimensional digital model, adds the explanation plan to the three-dimensional digital model, and generates a three-dimensional digital model containing the explanation plan as an application program.

In the embodiment of the present invention, the description scheme for the three-dimensional digital model includes: determining the description object, the content of the description, and the description expression form, where the description object refers to the entire physical object or the parts and components, and the expression form is specified. That is, the description is in the form of text, audio, video, or animation. Adding the explanation scheme to the three-dimensional digital model means that when the user clicks on the object or component to be explained, the corresponding explanation content is displayed. The tool for adding the explanation scheme to the three-dimensional digital model is the existing technology, and the present invention is not limited, and it is preferred It can be achieved through Unity 3D.

Among them, the description includes, but is not limited to: the parameters, functions, assembly methods, usage methods, and precautions of the physical objects and their parts.

For adding the description scheme to the three-dimensional digital model, the content includes: making a three-dimensional text box, a three-dimensional audio trigger button, a three-dimensional video display box, and a three-dimensional animation.

Step S103: The server sends the application to the client.

In step S104, the client installs the application, and when the object to be explained is recognized, the three-dimensional digital model is aligned to the object to be explained, and when the user selects the object to be explained, the explanation scheme is run.

In the embodiment of the present invention, the client receives the application sent by the server and installs the application locally. The client scans the physical object through the camera. When the corresponding physical object is identified, the three-dimensional digital model and the physical object in the client For alignment, when the user selects the real object, the corresponding part of the three-dimensional digital model in the client will display the explanation plan.

Among them, the client recognizes the object to be explained through the geometric shape and/or image texture of the object to be explained.

Among them, the interaction between the physical object and the three-dimensional digital model to be explained can be realized by the ray method. Preferably, when the interaction between the to-be-explained physical object and the three-dimensional digital model is successful, the client can give a feedback, and the user is prompted through the feedback that the interaction is successful.

In the embodiment of the present invention, the server locally integrates the constructed three-dimensional digital model and the description solution of the actual object to be explained into an application program, sends the application program to the client, and the client installs the application program. When the actual object to be explained is identified Align the three-dimensional digital model to the object to be explained, and run the explanation plan when the user selects the object to be explained. Allows users to understand the structure and purpose of the physical object through AR.

As an optional embodiment of the present invention, the description method further includes:

The server sends an update program for the application to the client.

Example two

Fig. 2 is a structural diagram of an AR-based explanation system provided by an embodiment of the present invention, and the explanation system includes:

The server 201 is configured to construct a three-dimensional digital model of equal proportions according to the physical shape and size of the physical object to be described and the parts that constitute the physical object to be described, to obtain an explanatory plan for the three-dimensional digital model, and to add the explanatory plan Into the three-dimensional digital model, and generate the three-dimensional digital model containing the description scheme as an application program, and send the application program to the client.

The client 202 is configured to install the application program sent by the server, and when the physical object to be explained is identified, the three-dimensional digital model is aligned to the physical object to be explained, and when the user selects the physical object to be explained, runs the Describe the program.

The description plan for the three-dimensional digital model includes: determining the description object, the content of the description, and the form of the description. Among them, the description object is the description of the whole object or the part, and the description of the form of expression is whether it is text, audio or Explain in the form of video and animation. Adding the explanation scheme to the three-dimensional digital model means that when the user clicks on the object or component to be explained, the corresponding explanation content is displayed. The tool for adding the explanation scheme to the three-dimensional digital model is the existing technology, and the present invention is not limited, and it is preferred It can be achieved through Unity 3D.

The client receives the application sent by the server and installs the application locally. The client scans the physical object through the camera. When the corresponding physical object is recognized, the three-dimensional digital model in the client is aligned with the physical object. When the user selects When it is a real object, the corresponding part of the 3D digital model in the client will display the explanation plan.

As an optional embodiment of the present invention, the server is further configured to send an update program for the application to the client.

It should be understood that although the various steps in the flowchart of the drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least part of the steps in the flowchart of the drawings may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution is also It is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

The above are only part of the embodiments of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and modifications can be made, and these improvements and modifications are also It should be regarded as the protection scope of the present invention.

Claims

A description method based on AR, which is characterized in that it includes:

The server-side constructs an equal-scale three-dimensional digital model according to the physical shape and size of the physical object to be described and the parts constituting the physical object to be described;

The server side obtains an explanation plan for the three-dimensional digital model, adds the explanation plan to the three-dimensional digital model, and generates a three-dimensional digital model containing the explanation plan as an application program;

The server sends the application to the client;

The client installs the application, and when the object to be explained is identified, the three-dimensional digital model is aligned to the object to be explained, and when the user selects the object to be explained, the explanation scheme is run.
The description method according to claim 1, wherein the description scheme comprises:

Determine the description object, the content of the description, and the form of the description.
The description method according to claim 2, wherein the description object comprises:

The physical object as a whole and/or the parts constituting the physical object, and the form of the description expression includes: text, audio, video, and animation.
The description method according to claim 2, wherein the description content comprises:

The parameters, functions, assembly methods, usage methods and precautions of the physical objects and their parts.
The description method according to any one of claims 1 to 4, wherein the client recognizes the object to be described through the geometric shape and/or image texture of the object to be described.
An AR-based explanation system, characterized in that, the explanation system includes:

The server side is used to construct a three-dimensional digital model of equal proportions according to the physical shape and size of the physical object to be described and the parts constituting the physical object to be described, obtain the description plan for the three-dimensional digital model, and add the description plan to In the three-dimensional digital model, the three-dimensional digital model containing the description scheme is generated as an application program, and the application program is sent to the client;

The client is used to install the application program sent by the server, when the object to be explained is identified, the three-dimensional digital model is aligned to the object to be explained, and when the user selects the object to be explained, run the Explain the plan.
The description system according to claim 6, wherein the description scheme comprises:

Determine the description object, the content of the description, and the form of the description.
The description system according to claim 7, wherein the description object includes:

The physical object as a whole and/or the parts constituting the physical object, and the form of the description expression includes: text, audio, video, and animation.
The description system according to claim 7, wherein the description content includes:

The parameters, functions, assembly methods, usage methods and precautions of the physical objects and their parts.
The description system according to any one of claims 6 to 9, wherein the client recognizes the object to be described by the geometric shape and/or image texture of the object to be described.