CN111161423A - MR-based specification implementation system and implementation method - Google Patents
MR-based specification implementation system and implementation method Download PDFInfo
- Publication number
- CN111161423A CN111161423A CN201911391826.4A CN201911391826A CN111161423A CN 111161423 A CN111161423 A CN 111161423A CN 201911391826 A CN201911391826 A CN 201911391826A CN 111161423 A CN111161423 A CN 111161423A
- Authority
- CN
- China
- Prior art keywords
- product
- information
- display
- color
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000000694 effects Effects 0.000 claims abstract description 89
- 230000009471 action Effects 0.000 claims abstract description 60
- 239000000463 material Substances 0.000 claims abstract description 58
- 239000007787 solid Substances 0.000 claims abstract description 40
- 239000000203 mixture Substances 0.000 claims abstract description 18
- 230000003993 interaction Effects 0.000 claims abstract description 17
- 238000005516 engineering process Methods 0.000 claims abstract description 16
- 238000004519 manufacturing process Methods 0.000 claims abstract description 6
- 230000007613 environmental effect Effects 0.000 claims abstract description 4
- 238000010276 construction Methods 0.000 claims description 32
- 230000002452 interceptive effect Effects 0.000 claims description 18
- 239000011521 glass Substances 0.000 claims description 10
- 230000001680 brushing effect Effects 0.000 claims description 6
- 239000004973 liquid crystal related substance Substances 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 230000001960 triggered effect Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- -1 internal structure Substances 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Architecture (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a system and a method for realizing a specification based on an MR (magnetic resonance), belongs to the field of mixed reality application, and aims to solve the technical problem of how to realize the display of the specification based on the MR technology. The system comprises: the scanning module is used for collecting the environmental ground; the environment identification module is used for identifying and optimizing the environment ground based on a plane scanning technology; the 3D model building module is used for extracting configuration information based on the overall appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, an action and a special effect required by the MR by combining a 3D model manufacturing tool with art resources; the virtual-real combination module is used for obtaining an instantiated 3D solid model; and the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying the corresponding instantiated 3D entity model. The implementation method comprises the step of performing instantiation display on the specification through the system.
Description
Technical Field
The invention relates to the field of mixed reality application, in particular to a specification implementation system and a specification implementation method based on MR.
Background
At present, specifications on the market are complicated and difficult to understand, most people need to continuously read and search, and some places are obscure and difficult to understand, so that the convenience is very poor.
At present, the AR technology is usually adopted for specification display, but the AR technology is mainly used in the aspects of simpler contents and uncomplicated interaction such as AR sand tables, AR games and the like, has the advantages of simplicity, smallness and certain dependence, can achieve the enhancement effect only by means of specific identification objects, and has slight deficiency in convenience.
How to realize the demonstration of the specification based on the MR technology is a technical problem to be solved.
Disclosure of Invention
The technical task of the invention is to provide a system and a method for realizing the specification based on the MR, aiming at the defects, so as to solve the problem of how to realize the display of the specification based on the MR technology.
In a first aspect, the present invention provides an MR-based instruction realization system for MR exhibition of instructions of a power transportation vehicle including but not limited to automobiles, trains, and airplanes, the realization system comprising:
the scanning module is used for collecting the environmental ground;
the environment recognition module is used for acquiring the environment ground, recognizing and optimizing the environment ground based on a plane scanning technology and obtaining a flat environment ground;
the 3D model building module is used for extracting configuration information based on the integral appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model manufacturing tool with art resources;
the virtual-real combination module is used for superposing the 3D solid model on the flat environment ground to obtain an instantiated 3D solid model;
the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying a corresponding instantiated 3D solid model, a plurality of interaction buttons are configured in the display interface, and example display of the whole appearance, the product color, the product material, the internal structure and the part composition of the product related in the specification is triggered through the related interaction buttons in the instantiated 3D solid model, wherein the example display mode comprises but is not limited to character display, picture display, video display, special effect display and action display.
Preferably, the environment identification module identifies and optimizes the environment floor based on SDK planar scanning technology.
Preferably, the 3D model building module is a sub-module having the following functions:
the product overall shape construction submodule is used for extracting the shape configuration information according to the overall shape of each product related in the specification;
the product color construction sub-module is used for extracting color configuration information according to the color of each product related in the specification, wherein the color configuration information comprises but is not limited to product body color information and color information of each part;
the product material construction submodule is used for extracting material information according to the material of each product related in the specification, and the material information comprises but is not limited to the material of a product body and the material information of each part;
the internal structure construction submodule is used for extracting internal structure information according to the internal structure of each product related in the specification;
the part construction submodule is used for extracting part information according to parts corresponding to each product related to the specification;
the action construction module is used for constructing action information of each part in the product display process, wherein the action information comprises but is not limited to automobile door opening and closing and wiper brushing for an automobile, the action information comprises but is not limited to ship door opening and closing for a ship, and the action information comprises but is not limited to fan door opening and closing for an airplane;
the special effect construction submodule is used for extracting special effect information according to the function and special effect corresponding to each product related to the specification, and the special effect information for the automobile comprises but is not limited to a car lamp lighting effect, a horn sounding effect, a vehicle state effect corresponding to an instrument panel chart, an in-automobile liquid crystal display effect, a door glass lifting effect and a lock state effect;
and the instantiation sub-module is used for combining the appearance configuration information, the color configuration information, the material information, the internal construction information, the part information and the action information to construct a 3D materialization model and form characters, pictures, videos, special effects and actions.
Preferably, the interactive button is a stereo button or a 3D solid model.
In a second aspect, the present invention provides an MR-based automobile specification implementation method, wherein the specification is instantiated and displayed by an MR-based automobile specification implementation system according to any one of the first aspect, and the implementation method includes the following steps:
extracting configuration information based on the overall appearance, the color, the material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
scanning the environment ground, and identifying and optimizing the environment ground based on a plane scanning technology to obtain a flat environment ground;
superposing the 3D solid model corresponding to the selected product on the flat environment ground to obtain an instantiated 3D solid model;
and displaying the instantiated 3D solid model through a display interface, and triggering example display of the whole appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification through related interactive buttons in the instantiated 3D solid model, wherein example display forms include but are not limited to character display, picture display, video display, special effect display and action display.
Preferably, the environmental floor is identified and optimized based on SDK planar scanning techniques.
Preferably, configuration information is extracted based on the overall appearance, the product color, the product material, the internal structure and the component composition of the product, and a 3D solid model, an action and a special effect required by the MR are realized by a 3D model making tool in combination with art resources, and the method comprises the following steps:
extracting configuration information of the appearance according to the overall appearance of each product related in the specification;
extracting color configuration information according to the color of each product related in the specification, wherein the color configuration information comprises but is not limited to product body color information and color information of each part;
extracting material information according to the material of each product related in the specification, wherein the material information comprises but is not limited to the material of a product body and the material information of each part;
extracting internal construction information according to the internal construction of each product related in the specification;
extracting part information according to parts corresponding to each product related to the specification;
according to the action information of each part in the product display process, for an automobile, the action information comprises but is not limited to automobile door opening and closing and wiper brushing, for a ship, the action information comprises but is not limited to ship door opening and closing, and for an airplane, the action information comprises but is not limited to fan door opening and closing;
extracting special effect information according to the function and special effects corresponding to each product related in the specification, wherein the special effect information comprises but is not limited to a car lamp lighting effect, a horn sounding effect, a vehicle state effect corresponding to an instrument panel chart, a liquid crystal display effect in the car, a car door glass lifting effect and a car lock state effect;
and combining the appearance configuration information, the color configuration information, the material information, the internal structure information, the part information and the action information to construct a 3D materialized model, and forming characters, pictures, videos, special effects and actions.
Preferably, the interactive button is a stereo button or a 3D solid model.
The MR-based specification implementation system and the implementation method have the following advantages:
1. the instantiation display of the specification is realized through the MR technology, so that a user can know the product structure and configuration information in a three-dimensional and visual manner;
2. the instantiated 3D solid model can be identified by scanning the environment plane, the operation is simple, the requirement on the external environment is low, and the dependency on the environment is reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
The invention is further described below with reference to the accompanying drawings.
FIG. 1 is a flow chart of an implementation method of an MR-based automobile specification in embodiment 2.
Detailed Description
The present invention is further described in the following with reference to the drawings and the specific embodiments so that those skilled in the art can better understand the present invention and can implement the present invention, but the embodiments are not to be construed as limiting the present invention, and the embodiments and the technical features of the embodiments can be combined with each other without conflict.
The term "and/or" in the embodiment of the present invention is only an association relationship describing an associated object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, B exists alone, and A and B exist at the same time. In addition, the character "/" herein generally indicates that the former and latter associated objects are in an "or" relationship.
The embodiment of the invention provides an instruction book implementation system and an instruction book implementation method based on an MR (magnetic resonance), which are used for solving the technical problem of how to implement instruction book display based on an MR technology.
Example 1:
an MR-based instruction implementation system of the present invention is used for MR presentation of instructions for a powered vehicle, including but not limited to automobiles, trains, airplanes and the like. The realization system comprises a scanning module, an environment recognition module, a virtual-real combination module and an interaction module, wherein the environment recognition module is used for acquiring an environment ground and recognizing and optimizing the environment ground based on a plane scanning technology to obtain a smooth environment ground; the 3D model building module is used for extracting configuration information based on the integral appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model manufacturing tool with art resources; the virtual-real combination module is used for superposing the 3D solid model on the flat environment ground to obtain an instantiated 3D solid model; the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying a corresponding instantiated 3D solid model, a plurality of interaction buttons are configured in the display interface, and example display of the whole appearance, the product color, the product material, the internal structure and the part composition of the product related in the specification is triggered through the related interaction buttons in the instantiated 3D solid model, wherein the example display mode comprises but is not limited to character display, picture display, video display, special effect display and action display.
The system can be realized based on a mobile phone terminal and a remote server, a mobile phone camera is selected as a scanning module, an environment recognition module, a 3D model building module, a virtual-real combination module and an interaction module are packaged into a software system, the software system is installed on the mobile phone terminal, the environment recognition module can use the camera to read the environment ground, the virtual-real combination module can use the environment recognition module and the 3D model building module to superpose the 3D solid model and the smooth environment ground to obtain an instantiated 3D solid model, and the interaction module can use the virtual-real combination module to display the instantiated 3D solid model.
Wherein, the camera is chooseed for use to the scanning module, is convenient for expand the field of vision, optional wide angle high definition digtal camera that uses.
The environment recognition module is based on a software function module built by the SDK, the scheme of Google Arcore + Unity engine is adopted for realizing, the development is carried out by means of Unity engine, Arcore plane recognition SDK is accessed, the environment bottom surface is recognized and optimized based on the plane scanning technology, the smooth environment ground is obtained, the algorithm adopts the existing environment recognition algorithm, and partial parameters are adjusted according to specific environment requirements.
The 3D model building module is a built software function module, extracts configuration information based on the overall appearance, product color, product material, internal structure and part composition of a product related to the specification, is externally connected with an existing 3D model making tool through an interface, and is combined with art resources through the 3D model making tool to realize 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR.
The 3D model building module comprises a following submodule product overall appearance building submodule, a product color building submodule, a product material building submodule, an internal construction building submodule, a part building submodule, an action building module, a special effect building submodule and an instantiation submodule, wherein the product overall appearance building submodule is used for extracting appearance configuration information according to the overall appearance of each product related in the specification; the product color construction sub-module is used for extracting color configuration information according to the color of each product related in the specification, wherein the color configuration information comprises but is not limited to product body color information and color information of each part; the product material construction submodule is used for extracting material information according to the material of each product related in the specification, and the material information comprises but is not limited to the material of a product body and the material information of each part; the internal structure construction submodule is used for extracting internal structure information according to the internal structure of each product related in the specification; the part construction submodule is used for extracting part information according to parts corresponding to each product related to the specification; the action construction module is used for constructing action information of each part in the product display process, wherein the action information comprises but is not limited to automobile door opening and closing and wiper brushing for an automobile, the action information comprises but is not limited to ship door opening and closing for a ship, and the action information comprises but is not limited to fan door opening and closing for an airplane; the special effect construction submodule is used for extracting special effect information according to the function and special effect corresponding to each product related to the specification, and the special effect information for the automobile comprises but is not limited to a car lamp lighting effect, a horn sounding effect, a vehicle state effect corresponding to an instrument panel chart, an in-automobile liquid crystal display effect, a door glass lifting effect and a lock state effect; the instantiation sub-module is used for combining the appearance configuration information, the color configuration information, the material information, the internal construction information, the part information and the action information to construct a 3D materialization model and form characters, pictures, videos, special effects and actions.
In this embodiment, the 3D model building module obtains the 3D materialized model by means of 3dMax production and baking production.
And the virtual-real combination module instantiates the 3D solid model to the virtual scene on the basis of Arcore plane identification, sets the rendering level of the model to be the highest, and renders the model before the real scene.
The interaction module controls the UGUI through the code by means of the Unity self-contained UGUI. In this embodiment, the interactive buttons are stereo buttons. In practical application, a 3D solid model can be selected.
The MR-based specification implementation system can instantiate and display information related to the specification on the ground in a product instantiation environment. Taking an automobile specification as an example, the using method comprises the following steps:
(1) in the early stage, configuration information is extracted according to the overall appearance, color, material, internal structure and part composition of the automobile related to the specification, and a 3D entity model, action and special effect required by the MR are realized by combining a 3D model making tool with art resources;
(2) in the using stage, after the environment ground is scanned and optimized to obtain a flat environment ground, the vehicle type is selected on the display interface to obtain an instantiated 3D solid model, the information such as the appearance, the color and the like of the automobile can be visually observed through the 3D instantiated solid model, and the internal construction and the part information of the automobile can be viewed through the related interactive buttons.
The demonstration of the instructions in (2) use phase comprises:
triggering an interactive button on the vehicle door, displaying the vehicle door opening animation, and entering the vehicle for displaying;
triggering interactive buttons of an internal structure and parts of the automobile, displaying relevant information, for example, triggering interactive prompts at the front row door, an instrument panel, a multimedia function key, a steering wheel key, a gear, an armrest box, a rear row door and the like of the automobile, clicking corresponding interaction, displaying configuration information corresponding to the interactive buttons at the position, and introducing the configuration information in a display mode of characters, pictures, audio and video;
trigger the mutual button of car upper portion, move or special effect show, for example, trigger the steering wheel and draw mutual button, vehicle horn sounds, trigger the mutual button of wiper, the wiper action triggers the mutual button of car light, the car light lights, trigger the mutual button of panel board icon, the vehicle state that the panel board icon corresponds is shown with the form of special effect, trigger the mutual button of multi-media, the LCD screen show triggers door glass mutual button, door glass goes up and down, trigger the mutual button of lock, can not open through special effect show door shutting.
The characters, the pictures, the audio, the videos, the animations and the like are manufactured in advance according to the content related to the specification and are matched with products of all models, so that when a user views a relevant vehicle type, the vehicle type can be displayed through a display interface in time.
Example 2:
the invention discloses an MR-based automobile specification implementation method, which is used for showing the specification in an instantiation mode through an MR-based automobile specification implementation system disclosed in embodiment 1.
The implementation method comprises the following steps:
s100, extracting configuration information based on the overall appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
s200, scanning the environment ground, and identifying and optimizing the environment ground based on a plane scanning technology to obtain a flat environment ground;
s300, superposing the 3D solid model corresponding to the selected product on the flat environment ground to obtain an instantiated 3D solid model;
s400, displaying the instantiated 3D solid model through a display interface, and triggering example display of the whole appearance, the product color, the product material, the internal structure and the component composition of a product related in the specification through related interactive buttons in the instantiated 3D solid model, wherein example display forms include but are not limited to character display, picture display, video display, special effect display and action display.
In step S100, configuration information is extracted based on the overall shape, color, material, internal structure, and component composition of the product, and 3D solid models, actions, and special effects required by the MR are realized by a 3D model making tool in combination with art resources, which includes the following steps:
s110, extracting configuration information of the appearance according to the overall appearance of each product related in the specification;
extracting color configuration information according to the color of each product related in the specification, wherein the color configuration information comprises but is not limited to product body color information and color information of each part;
extracting material information according to the material of each product related in the specification, wherein the material information comprises but is not limited to the material of a product body and the material information of each part;
extracting internal construction information according to the internal construction of each product related in the specification;
extracting part information according to parts corresponding to each product related to the specification;
according to the action information of each part in the product display process, for an automobile, the action information comprises but is not limited to automobile door opening and closing and wiper brushing, for a ship, the action information comprises but is not limited to ship door opening and closing, and for an airplane, the action information comprises but is not limited to fan door opening and closing;
extracting special effect information according to the function and special effects corresponding to each product related in the specification, wherein the special effect information comprises but is not limited to a car lamp lighting effect, a horn sounding effect, a vehicle state effect corresponding to an instrument panel chart, a liquid crystal display effect in the car, a car door glass lifting effect and a car lock state effect;
and S120, combining the appearance configuration information, the color configuration information, the material information, the internal structure information, the part information and the action information to construct a 3D materialized model, and forming characters, pictures, videos, special effects and actions.
The interactive button is a three-dimensional button or a 3D solid model.
In step S200, the environment floor is identified and optimized based on the SDK planar scanning technique.
In step S400, displaying the display interface includes:
triggering an interactive button on the vehicle door, displaying the vehicle door opening animation, and entering the vehicle for displaying;
triggering interactive buttons of an internal structure and parts of the automobile, displaying relevant information, for example, triggering interactive prompts at the front row door, an instrument panel, a multimedia function key, a steering wheel key, a gear, an armrest box, a rear row door and the like of the automobile, clicking corresponding interaction, displaying configuration information corresponding to the interactive buttons at the position, and introducing the configuration information in a display mode of characters, pictures, audio and video;
trigger the mutual button of car upper portion, move or special effect show, for example, trigger the steering wheel and draw mutual button, vehicle horn reminds, trigger the mutual button of wiper, the wiper action triggers the mutual button of car light, the car light lights, trigger the mutual button of panel board icon, the vehicle state that the panel board icon corresponds is shown with the form of special effect, trigger the mutual button of multi-media, the LCD screen show triggers door glass mutual button, door glass goes up and down, trigger the mutual button of lock, can not open through special effect show door shutting.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (8)
1. An MR-based instruction realization system for MR exhibition of instructions of a power transportation means including but not limited to automobiles, trains, airplanes, comprising:
the scanning module is used for collecting the environmental ground;
the environment recognition module is used for acquiring the environment ground, recognizing and optimizing the environment ground based on a plane scanning technology and obtaining a flat environment ground;
the 3D model building module is used for extracting configuration information based on the integral appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model manufacturing tool with art resources;
the virtual-real combination module is used for superposing the 3D solid model on the flat environment ground to obtain an instantiated 3D solid model;
the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying a corresponding instantiated 3D solid model, a plurality of interaction buttons are configured in the display interface, and example display of the whole appearance, the product color, the product material, the internal structure and the part composition of the product related in the specification is triggered through the related interaction buttons in the instantiated 3D solid model, wherein the example display mode comprises but is not limited to character display, picture display, video display, special effect display and action display.
2. The MR-based instruction realization system of claim 1 wherein said environment identification module identifies and optimizes the environment floor based on SDK planar scanning technique.
3. An MR-based instruction realization system according to claim 1, characterized in that said 3D model construction module is a sub-module with the following functions:
the product overall shape construction submodule is used for extracting the shape configuration information according to the overall shape of each product related in the specification;
the product color construction sub-module is used for extracting color configuration information according to the color of each product related in the specification, wherein the color configuration information comprises but is not limited to product body color information and color information of each part;
the product material construction submodule is used for extracting material information according to the material of each product related in the specification, and the material information comprises but is not limited to the material of a product body and the material information of each part;
the internal structure construction submodule is used for extracting internal structure information according to the internal structure of each product related in the specification;
the part construction submodule is used for extracting part information according to parts corresponding to each product related to the specification;
the action construction module is used for constructing action information of each part in the product display process, wherein the action information comprises but is not limited to automobile door opening and closing and wiper brushing for an automobile, the action information comprises but is not limited to ship door opening and closing for a ship, and the action information comprises but is not limited to fan door opening and closing for an airplane;
the special effect construction submodule is used for extracting special effect information according to the function and special effect corresponding to each product related to the specification, and the special effect information for the automobile comprises but is not limited to a car lamp lighting effect, a horn sounding effect, a vehicle state effect corresponding to an instrument panel chart, an in-automobile liquid crystal display effect, a door glass lifting effect and a lock state effect;
and the instantiation sub-module is used for combining the appearance configuration information, the color configuration information, the material information, the internal construction information, the part information and the action information to construct a 3D materialization model and form characters, pictures, videos, special effects and actions.
4. An MR based instruction realization system according to claim 1, 2 or 3 characterized in that said interactive buttons are stereo buttons or 3D solid models.
5. An MR-based specification implementation method, characterized in that a specification is instantiated and shown by an MR-based specification implementation system according to any one of claims 1 to 4, and the implementation method comprises the following steps:
extracting configuration information based on the overall appearance, the color, the material, the internal structure and the component composition of the product related in the specification, and realizing a 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
scanning the environment ground, and identifying and optimizing the environment ground based on a plane scanning technology to obtain a flat environment ground;
superposing the 3D solid model corresponding to the selected product on the flat environment ground to obtain an instantiated 3D solid model;
and displaying the instantiated 3D solid model through a display interface, and triggering example display of the whole appearance, the product color, the product material, the internal structure and the component composition of the product related in the specification through related interactive buttons in the instantiated 3D solid model, wherein example display forms include but are not limited to character display, picture display, video display, special effect display and action display.
6. The MR-based implementation method of automotive specifications of claim 5, characterized in that the ambient floor is identified and optimized based on SDK planar scanning technique.
7. The method for realizing the MR-based automobile specification according to claim 5, wherein the configuration information is extracted based on the overall appearance, color, material, internal structure and component composition of the product related to the specification, and the 3D entity model, action and special effect required by the MR are realized by combining a 3D model making tool and art resources, and the method comprises the following steps:
extracting configuration information of the appearance according to the overall appearance of each product related in the specification;
extracting color configuration information according to the color of each product related in the specification, wherein the color configuration information comprises but is not limited to product body color information and color information of each part;
extracting material information according to the material of each product related in the specification, wherein the material information comprises but is not limited to the material of a product body and the material information of each part;
extracting internal construction information according to the internal construction of each product related in the specification;
extracting part information according to parts corresponding to each product related to the specification;
according to the action information of each part in the product display process, for an automobile, the action information comprises but is not limited to automobile door opening and closing and wiper brushing, for a ship, the action information comprises but is not limited to ship door opening and closing, and for an airplane, the action information comprises but is not limited to fan door opening and closing;
extracting special effect information according to the function and special effects corresponding to each product related in the specification, wherein the special effect information comprises but is not limited to a car lamp lighting effect, a horn sounding effect, a vehicle state effect corresponding to an instrument panel chart, a liquid crystal display effect in the car, a car door glass lifting effect and a car lock state effect;
and combining the appearance configuration information, the color configuration information, the material information, the internal structure information, the part information and the action information to construct a 3D materialized model, and forming characters, pictures, videos, special effects and actions.
8. The MR-based automobile specification implementation method of claim 5, wherein the interactive button is a stereo button or a 3D solid model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911391826.4A CN111161423A (en) | 2019-12-30 | 2019-12-30 | MR-based specification implementation system and implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911391826.4A CN111161423A (en) | 2019-12-30 | 2019-12-30 | MR-based specification implementation system and implementation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111161423A true CN111161423A (en) | 2020-05-15 |
Family
ID=70558991
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911391826.4A Pending CN111161423A (en) | 2019-12-30 | 2019-12-30 | MR-based specification implementation system and implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111161423A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107870673A (en) * | 2017-11-28 | 2018-04-03 | 深圳市蓝游网络科技有限公司 | Specification implementation method based on AR technologies |
| CN108803876A (en) * | 2018-06-08 | 2018-11-13 | 华北水利水电大学 | Hydraulic engineering displaying exchange method based on augmented reality and system |
| CN110427132A (en) * | 2019-07-27 | 2019-11-08 | 厦门城市职业学院（厦门市广播电视大学） | A kind of 3D specification and its method for pushing |
| CN110488979A (en) * | 2019-08-23 | 2019-11-22 | 北京枭龙科技有限公司 | A kind of automobile showing system based on augmented reality |
-
2019
- 2019-12-30 CN CN201911391826.4A patent/CN111161423A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107870673A (en) * | 2017-11-28 | 2018-04-03 | 深圳市蓝游网络科技有限公司 | Specification implementation method based on AR technologies |
| CN108803876A (en) * | 2018-06-08 | 2018-11-13 | 华北水利水电大学 | Hydraulic engineering displaying exchange method based on augmented reality and system |
| CN110427132A (en) * | 2019-07-27 | 2019-11-08 | 厦门城市职业学院（厦门市广播电视大学） | A kind of 3D specification and its method for pushing |
| CN110488979A (en) * | 2019-08-23 | 2019-11-22 | 北京枭龙科技有限公司 | A kind of automobile showing system based on augmented reality |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111134496B (en) | MR-based product display implementation system and implementation method | |
| US11348316B2 (en) | Location-based virtual element modality in three-dimensional content | |
| Tamura et al. | Mixed reality: Future dreams seen at the border between real and virtual worlds | |
| CN115016642A (en) | Reality mixer for mixed reality | |
| CN107861714B (en) | Development method and system of automobile display application based on Intel RealSense | |
| CN111815780A (en) | Display method, display device, equipment and computer readable storage medium | |
| WO2020151431A1 (en) | Data processing method and system for intelligent vehicle viewing | |
| CN105844714A (en) | Augmented reality based scenario display method and system | |
| CN112684894A (en) | Interaction method and device for augmented reality scene, electronic equipment and storage medium | |
| CN202600354U (en) | Interactive virtual real scene holographic imaging system | |
| CN111124119B (en) | Building model presentation and interaction method based on virtual reality technology | |
| CN107564108A (en) | The vehicle method of commerce and device of a kind of virtual reality | |
| CN111899325A (en) | Rendering method and device of crystal stone model, electronic equipment and storage medium | |
| CN110488979A (en) | A kind of automobile showing system based on augmented reality | |
| CN111815785A (en) | Method and device for presenting reality model, electronic equipment and storage medium | |
| Sinenko et al. | Automation of visualization process for organizational and technological design solutions | |
| CN110806844A (en) | Multi-subject and multi-theme display method based on multimedia exhibition hall | |
| CN111161423A (en) | MR-based specification implementation system and implementation method | |
| CN216411876U (en) | Intelligent home scene and hardware equipment display device | |
| CN112684893A (en) | Information display method and device, electronic equipment and storage medium | |
| WO2020151240A1 (en) | Ar automobile marketing system and method | |
| CN116310041A (en) | Rendering method and device of internal structure effect, electronic equipment and storage medium | |
| CN114185279A (en) | Intelligent household scene and hardware equipment display device and display method thereof | |
| Liu | The virtual reality technology in art design | |
| Aydoğan | From" Advertising Architecture” to “Media Façade": communication through digital display skin |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200515 |