CN111134496A - MR-based product display implementation system and implementation method - Google Patents
MR-based product display implementation system and implementation method Download PDFInfo
- Publication number
- CN111134496A CN111134496A CN201911391820.7A CN201911391820A CN111134496A CN 111134496 A CN111134496 A CN 111134496A CN 201911391820 A CN201911391820 A CN 201911391820A CN 111134496 A CN111134496 A CN 111134496A
- Authority
- CN
- China
- Prior art keywords
- product
- display
- configuration
- price
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47F—SPECIAL FURNITURE, FITTINGS, OR ACCESSORIES FOR SHOPS, STOREHOUSES, BARS, RESTAURANTS OR THE LIKE; PAYING COUNTERS
- A47F7/00—Show stands, hangers, or shelves, adapted for particular articles or materials
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F15/00—Boards, hoardings, pillars, or like structures for notices, placards, posters, or the like
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F25/00—Audible advertising
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
Abstract
The invention discloses a product display implementation system and method based on MR, belongs to the field of mixed reality application, and aims to solve the technical problem of how to implement product display based on MR technology. The system comprises: the scanning module is used for collecting the environmental ground; the environment identification module is used for identifying and optimizing the environment ground based on a plane scanning technology; the 3D model building module is used for extracting display information based on product configuration, product characteristics and product price related to display requirements and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources; the virtual-real combination module is used for obtaining an instantiated 3D solid model; and the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying the corresponding instantiated 3D entity model. The implementation method comprises the step of performing instantiation display on the product through the system.
Description
Technical Field
The invention relates to the field of mixed reality application, in particular to a product display implementation system and method based on MR.
Background
At present, product display on the market is mainly known through an brochure or a physical store, the brochure is complicated and is difficult to understand, most people need to continuously read and search, some places are obscure and difficult to understand, and convenience is very poor; going to a brick and mortar store for product and watch wastes time.
At present, the AR technology is generally adopted for product display, but the AR technology is mainly used in the aspects of simpler contents and uncomplicated interaction such as AR sand tables, AR games and the like, has the advantages of simplicity, smallness and certain dependence, can achieve the enhancement effect only by means of specific identification objects, and has little shortage of convenience.
How to realize the exhibition of products based on the MR technology is a technical problem to be solved.
Disclosure of Invention
The technical task of the invention is to provide a system and a method for realizing the exhibition of products based on MR, aiming at the defects, so as to solve the problem of how to realize the exhibition of the specification based on the MR technology.
In a first aspect, the present invention provides an MR-based product display implementation system for instantiated display of a powered transportation vehicle, including but not limited to a car, a train, and an airplane, the implementation system comprising:
the scanning module is used for collecting the environmental ground;
the environment recognition module is used for acquiring the environment ground, recognizing and optimizing the environment ground based on a plane scanning technology and obtaining a flat environment ground;
the 3D model building module is used for extracting display information based on product configuration, product characteristics and product price related to display requirements and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
the virtual-real combination module is used for superposing the 3D solid model on the flat environment ground to obtain an instantiated 3D solid model;
the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying a corresponding instantiated 3D solid model, the display interface is provided with a plurality of interaction buttons, and example display of product configuration, product characteristics and product price related to display requirements is triggered through related interaction buttons in the instantiated 3D solid model, wherein the example display mode comprises but is not limited to character display, picture display, audio display, video display, special effect display and action display.
Furthermore, the interaction module further comprises a configuration sub-module, a plurality of configuration interaction buttons are configured on the display interface, the configuration interaction buttons call the 3D model building module through the configuration sub-module, and the configuration interaction buttons are used for realizing replacement configuration of the instantiated 3D solid model, and the replacement configuration includes, but is not limited to, color of a replacement product, material of the replacement product, and parts of a replacement vehicle.
Preferably, the configuration interaction button includes, but is not limited to, a drop down button that triggers a drop down options menu.
Preferably, the environment identification module identifies and optimizes the environment floor based on SDK planar scanning technology.
Preferably, the 3D model building module is a sub-module having the following functions:
the configuration submodule is used for extracting configuration information according to product configuration related to the display requirement, and the configuration information comprises but is not limited to product appearance, color, material and part composition;
the characteristic submodule is used for extracting characteristic information according to the characteristics of the product related to the display demand, and the characteristic information comprises but is not limited to efficacy and energy consumption;
the price submodule is used for extracting price information according to the price of the product related to the display demand, and the price information comprises but is not limited to the total price of the product, the price of each part and the price of the part plus the matched price;
the action construction sub-module is used for extracting corresponding action information according to the function of each part, and for the automobile, the action information comprises but is not limited to opening and closing of an automobile door, brushing of a wiper and running of the automobile on the environmental ground;
the special effect construction submodule is used for extracting corresponding special effect obtaining information according to the function of each part, wherein the special effect information comprises but is not limited to a lighting effect, a loudspeaker sounding effect, a product state effect corresponding to an instrument panel chart, a liquid crystal display effect, a door glass lifting effect and a vehicle lock state effect;
and the instantiation sub-module is used for combining the configuration information, the characteristic information, the price information, the action information and the special effect information to construct a 3D materialization model and form characters, pictures, audios, videos, special effects and actions.
Preferably, the interactive button is a stereo button or a 3D solid model.
In a second aspect, the present invention provides an MR-based product display implementation method, which is characterized in that a product is instantiated and displayed by an MR-based product display implementation system according to any one of the first aspects, and the implementation method includes the following steps:
extracting display information based on product configuration, product characteristics and product price related in the display demand, and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
scanning the environment ground, and identifying and optimizing the environment ground based on a plane scanning technology to obtain a flat environment ground;
superposing the 3D solid model corresponding to the selected product on the flat environment ground to obtain an instantiated 3D solid model;
selecting a product through a display interface and displaying a corresponding instantiated 3D solid model, wherein a plurality of interaction buttons are configured in the display interface, and example display of product configuration, product characteristics and product price related to display requirements is triggered through related interaction buttons in the instantiated 3D solid model, and the example display forms include but are not limited to character display, picture display, audio display, video display, special effect display and action display.
Preferably, the method further comprises the step of triggering a corresponding configuration interaction button on the display interface, and the configuration interaction button calls the 3D model building module through the configuration sub-module to perform replacement configuration on the instantiated 3D solid model, wherein the replacement configuration includes but is not limited to color of a replacement product, material of the replacement product and parts of the replacement product.
Preferably, the environmental floor is identified and optimized based on SDK planar scanning techniques.
Preferably, the method comprises the following steps of extracting display information based on product configuration, product characteristics and product price related in display requirements, and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by an MR (magnetic resonance) by combining a 3D model making tool with art resources, wherein the method comprises the following steps:
extracting configuration information according to product configuration related to display requirements, wherein the configuration information comprises but is not limited to product appearance, color, material and part composition;
extracting characteristic information according to product characteristics related to display requirements, wherein the characteristic information comprises but is not limited to efficacy and energy consumption;
extracting price information according to prices of products involved in the display demand, wherein the price information comprises but is not limited to total price of the products, price of each part and price of the part plus a match;
extracting corresponding action information according to the function of each part, wherein for the automobile, the action information comprises opening and closing of an automobile door, brushing of a wiper and running of the automobile on the environmental ground;
extracting corresponding special effect obtaining information according to the function of each part, wherein the special effect information comprises but is not limited to a lighting effect, a loudspeaker sounding effect, a product state effect corresponding to an instrument panel chart, a liquid crystal display effect, a door glass lifting effect and a vehicle lock state effect;
and combining the configuration information, the characteristic information, the price information, the action information and the special effect information to construct a 3D materialized model, and forming characters, pictures, audios, videos, special effects and actions.
The MR-based product display implementation system and the implementation method have the following advantages:
1. instantiation display of the product is realized through the MR technology, so that a user can know product construction and configuration information in a three-dimensional and visual manner;
2. the instantiated 3D solid model can be identified and obtained by scanning the environment plane, the operation is simple, the requirement on the external environment is low, and the dependency on the environment is reduced;
3. and the user is supported to replace and configure the product, and the functional range is expanded.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
The invention is further described below with reference to the accompanying drawings.
Fig. 1 is a flow chart of an MR-based product exhibition implementation method according to embodiment 2.
Detailed Description
The present invention is further described in the following with reference to the drawings and the specific embodiments so that those skilled in the art can better understand the present invention and can implement the present invention, but the embodiments are not to be construed as limiting the present invention, and the embodiments and the technical features of the embodiments can be combined with each other without conflict.
The embodiment of the invention provides an instruction book implementation system and an instruction book implementation method based on an MR (magnetic resonance), which are used for solving the technical problem of how to implement instruction book display based on an MR technology.
Example 1:
an MR-based instruction implementation system of the present invention is used for MR presentation of instructions for a powered vehicle, including but not limited to automobiles, trains, airplanes and the like.
The realization system comprises a scanning module, an environment recognition module, a virtual-real combination module and an interaction module, wherein the environment recognition module is used for acquiring an environment ground and recognizing and optimizing the environment ground based on a plane scanning technology to obtain a smooth environment ground; the 3D model building module is used for extracting display information based on product configuration, product characteristics and product price related to display requirements, and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources; the virtual-real combination module is used for superposing the 3D solid model on the flat environment ground to obtain an instantiated 3D solid model; the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying a corresponding instantiated 3D solid model, the display interface is provided with a plurality of interaction buttons, and example display of product configuration, product characteristics and product price related to display requirements is triggered through related interaction buttons in the instantiated 3D solid model, wherein the example display mode comprises but is not limited to character display, picture display, audio display, video display, special effect display and action display.
The system can be realized based on a mobile phone terminal and a remote server, a mobile phone camera is selected as a scanning module, an environment recognition module, a 3D model building module, a virtual-real combination module and an interaction module are packaged into a software system, the software system is installed on the mobile phone terminal, the environment recognition module can use the camera to read the environment ground, the virtual-real combination module can use the environment recognition module and the 3D model building module to superpose the 3D solid model and the smooth environment ground to obtain an instantiated 3D solid model, and the interaction module can use the virtual-real combination module to display the instantiated 3D solid model.
Wherein, camera module is chooseed for use to the scanning module, is convenient for expand the field of vision, optional wide angle high definition digtal camera that uses.
The environment recognition module is based on a software function module built by the SDK, realizes ground recognition by means of an Arcore plug-in, recognizes and optimizes the bottom surface of the environment based on a plane scanning technology to obtain a smooth environment ground, adopts the existing environment recognition algorithm, and adjusts partial parameters according to specific environment requirements.
The 3D model building module is a built software function module, and the function module extracts display information based on product configuration, product characteristics and product price related in display requirements, is externally connected with an existing 3D model making tool through an interface, and realizes 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining with art resources through the 3D model making tool.
The 3D model building module comprises a configuration submodule, a characteristic submodule, a price submodule, an action building submodule, a special effect building submodule and an instantiation submodule, wherein the configuration submodule is used for extracting configuration information according to product configuration related to display requirements, and the configuration information comprises but is not limited to product appearance, color, material and part composition; the characteristic submodule is used for extracting characteristic information according to the characteristics of the product related to the display requirement, and the characteristic information comprises but is not limited to efficacy and energy consumption; the price submodule is used for extracting price information according to the price of a product related to the display demand, and the price information comprises but is not limited to the total price of the product, the price of each part and a price adding and matching grid of the part; the action construction sub-module is used for extracting corresponding action information according to the function of each part, and for the automobile, the action information comprises but is not limited to opening and closing of an automobile door, brushing of a wiper and running of the automobile on the environmental ground; the special effect construction submodule is used for extracting corresponding special effect obtaining information according to the function of each part, wherein the special effect information comprises but is not limited to a lighting effect, a loudspeaker sounding effect, a product state effect corresponding to an instrument panel chart, a liquid crystal display effect, a door glass lifting effect and a vehicle lock state effect; the instantiation sub-module is used for combining the configuration information, the characteristic information, the price information, the action information and the special effect information to construct a 3D materialization model and form characters, pictures, audios, videos, special effects and actions.
In this embodiment, the 3D model building module obtains the 3D materialized model by means of 3dMax production and baking production.
And the virtual-real combination module instantiates the 3D solid model to the virtual scene on the basis of Arcore plane identification, sets the rendering level of the model to be the highest, and renders the model before the real scene.
The interaction module controls the UGUI through the code by means of the Unity self-contained UGUI. In this embodiment, the interactive buttons are stereo buttons. In practical application, a 3D solid model can be selected.
In this embodiment, the interactive button is a stereo button. In practical application, a 3D solid model can be selected.
The MR-based product display implementation system can instantiate and display products on the ground in a product instantiation environment. Taking an automobile as an example, the using method comprises the following steps:
(1) in the early stage, the display information is extracted according to the product configuration, product characteristics and product price related to the display requirement, and the 3D entity model, characters, pictures, videos, audios, actions and special effects required by the MR are realized by combining a 3D model making tool with art resources;
(2) in the using stage, after the environment ground is scanned and optimized to obtain a flat environment ground, the vehicle type is selected on the display interface to obtain an instantiated 3D solid model, the information such as the appearance, the color and the like of the automobile can be visually observed through the 3D instantiated solid model, and the internal structure and the parts of the automobile can be checked through the related interactive buttons.
The display of the automobile in the (2) use stage comprises the following steps:
triggering an interactive button on the vehicle door, displaying the vehicle door opening animation, and entering the vehicle for displaying;
triggering interactive buttons of an internal structure and parts of the automobile, displaying relevant information, for example, triggering interactive prompts at the front row door, an instrument panel, a multimedia function key, a steering wheel key, a gear, an armrest box, a rear row door and the like of the automobile, clicking corresponding interaction, presenting configuration information corresponding to the interactive buttons at the position, and introducing the configuration information in a display mode of characters, pictures, audio and video, wherein the characters or pictures support a user to slide and view;
triggering a price interaction button, and displaying the whole price of the automobile, the price of each part and the additional price, wherein the prices are displayed in a text form and support sliding display;
the characteristics of the automobile can be displayed by triggering the characteristic interaction button, and the characteristics are displayed in a character form and support sliding viewing;
triggering an interactive button on the upper part of the automobile to perform action or special effect display, for example, triggering a steering wheel to pull the interactive button, a vehicle horn to recall, triggering a wiper interactive button, triggering a wiper action, triggering a vehicle lamp interactive button, lighting a vehicle lamp, triggering a dashboard icon interactive button, displaying a vehicle state corresponding to the dashboard icon in a special effect mode, triggering a multimedia interactive button, displaying a liquid crystal screen, triggering a door glass interactive button, lifting a door glass, triggering a lock interactive button, and locking the vehicle door to be not opened through special effect display;
and triggering an automobile advancing interaction button, and carrying out forward and backward actions and the like on the environment ground by the instantiated 3D solid model, wherein when the model is built through the 3D model for modeling, the driving mode of the automobile is back driving.
The characters, the pictures, the audio, the videos, the animations and the like are manufactured in advance according to the content related to the display requirements and are matched with products of all models, so that when a user views related vehicle types, the vehicle types can be displayed through a display interface in time.
As a further improvement of this embodiment, the interactive module further includes a configuration sub-module, a plurality of configuration interactive buttons are configured on the display interface, and the configuration interactive buttons invoke the 3D model building module through the configuration sub-module, so as to implement a replacement configuration for the instantiated 3D solid model, where the replacement configuration includes, but is not limited to, a color of a replacement product, a material of the replacement product, and a part of a replacement vehicle.
In this embodiment, the interactive button is a pull-down button, and the pull-down button triggers a pull-down option menu.
Taking the color of an automobile as an example, configuring a color configuration interactive key on a display interface, wherein the color configuration interactive key is a pull-down button, selecting a color from a pull-down color option menu after triggering the pull-down button, calling a 3D model building module through a configuration sub-module, obtaining a 3D solid model with a corresponding color according to the selected color by the 3D model building module, superposing the 3D solid model into a smooth environment ground through a virtual-real combination module to obtain an instantiated 3D solid model, and displaying the instantiated 3D solid model through the display interface.
As an improvement of the above embodiment, after the virtual-real combination module obtains the 3D solid model, a coordinate system is defined for the 3D solid model, and the 3D solid model is superimposed on the flat environmental ground in combination with the coordinate system to obtain an instantiated 3D solid model, where the instantiated 3D solid model shows a product and a real scene around the product.
Taking an automobile as an example, defining a coordinate system of the 3D entity model corresponding to the automobile, superposing the automobile on a flat environment ground, superposing the coordinate 3D model on the environment ground and fusing peripheral real scenes, and seeing the scenes in the automobile and behind the automobile through automobile glass and the real scenes outside the automobile door when the automobile door is opened.
In this embodiment, the implementation method is as follows: when the 3D solid model is loaded into the Unity engine, the Unity automatically allocates a self coordinate system and a world coordinate system to the 3D solid model, when the model is rendered through a program, the model shading condition is rendered according to a rendering level set in a code, when the 3D solid model is called through the set program, the self coordinate of the 3D solid model is called, then the model is instantiated to a plane according to the world coordinate of the plane identified by the Arcore, the instantiation process is carried out, the 3D solid model can automatically convert the coordinate to the identification plane according to the affiliated relationship, when a door is opened, the program does not have the model needing to be rendered, the environment shot by the camera is displayed at the moment, and therefore the opposite scene can be seen through the vehicle.
Example 2:
the MR-based product display implementation method performs instantiation display on a product through the MR-based product display implementation system disclosed in embodiment 1.
The implementation method comprises the following steps:
s100, extracting display information based on product configuration, product characteristics and product price related to display requirements, and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by an MR (magnetic resonance) through a 3D model making tool in combination with art resources;
s200, scanning the environment ground, and identifying and optimizing the environment ground based on a plane scanning technology to obtain a flat environment ground;
s300, superposing the 3D solid model corresponding to the selected product on the flat environment ground to obtain an instantiated 3D solid model;
s400, selecting a product through a display interface and displaying a corresponding instantiated 3D solid model, wherein a plurality of interaction buttons are configured in the display interface, and example display of product configuration, product characteristics and product price related to display requirements is triggered through related interaction buttons in the instantiated 3D solid model, and the example display forms include but are not limited to character display, picture display, audio display, video display, special effect display and action display.
In step S100, display information is extracted based on product configuration, product characteristics, and product price related to the display demand, and a 3D solid model, text, picture, video, audio, motion, and special effect required by the MR are realized by combining a 3D model making tool with art resources, including the following steps:
s110, extracting configuration information according to product configuration related to display requirements, wherein the configuration information comprises but is not limited to product appearance, color, material and part composition;
extracting characteristic information according to the product characteristics related to the display requirements, wherein the characteristic information comprises but is not limited to efficacy and energy consumption;
extracting price information according to prices of products involved in the display demand, wherein the price information comprises but is not limited to total price of the products, price of each part and price of the part plus a match;
extracting corresponding action information according to the function of each part, wherein for the automobile, the action information comprises opening and closing of an automobile door, brushing of a wiper and running of the automobile on the environmental ground;
extracting corresponding special effect obtaining information according to the function of each part, wherein the special effect information comprises but is not limited to a lighting effect, a loudspeaker sounding effect, a product state effect corresponding to an instrument panel chart, a liquid crystal display effect, a door glass lifting effect and a vehicle lock state effect;
and S120, combining the configuration information, the characteristic information, the price information, the action information and the special effect information to construct a 3D materialized model, and forming characters, pictures, audios, videos, special effects and actions.
The interactive button is a three-dimensional button or a 3D solid model.
In step S200, the environment floor is identified and optimized based on the SDK planar scanning technique.
In step S300, the displayed content includes:
triggering an interactive button on the vehicle door, displaying the vehicle door opening animation, and entering the vehicle for displaying;
triggering interactive buttons of an internal structure and parts of the automobile, displaying relevant information, for example, triggering interactive prompts at the front row door, an instrument panel, a multimedia function key, a steering wheel key, a gear, an armrest box, a rear row door and the like of the automobile, clicking corresponding interaction, presenting configuration information corresponding to the interactive buttons at the position, and introducing the configuration information in a display mode of characters, pictures, audio and video, wherein the characters or pictures support a user to slide and view;
triggering a price interaction button, and displaying the whole price of the automobile, the price of each part and the additional price, wherein the prices are displayed in a text form and support sliding display;
the characteristics of the automobile can be displayed by triggering the characteristic interaction button, and the characteristics are displayed in a character form and support sliding viewing;
triggering an interactive button on the upper part of the automobile to perform action or special effect display, for example, triggering a steering wheel to pull the interactive button, a vehicle horn to recall, triggering a wiper interactive button, triggering a wiper action, triggering a vehicle lamp interactive button, lighting a vehicle lamp, triggering a dashboard icon interactive button, displaying a vehicle state corresponding to the dashboard icon in a special effect mode, triggering a multimedia interactive button, displaying a liquid crystal screen, triggering a door glass interactive button, lifting a door glass, triggering a lock interactive button, and locking the vehicle door to be not opened through special effect display;
and triggering an automobile advancing interaction button, and carrying out forward and backward actions and the like on the environment ground by the instantiated 3D solid model, wherein when the model is built through the 3D model for modeling, the driving mode of the automobile is back driving.
As an improvement to the above embodiment, the method further includes implementing a replacement configuration for the instantiated 3D solid model on the display interface by triggering the configuration interaction button, where the replacement configuration includes, but is not limited to, replacing a color of a product, replacing a material of the product, and replacing a part of the vehicle.
In this embodiment, the interactive button is a pull-down button, and the pull-down button triggers a pull-down option menu.
Taking the color of an automobile as an example, configuring a color configuration interactive key on a display interface, wherein the color configuration interactive key is a pull-down button, selecting a color from a pull-down color option menu after triggering the pull-down button, calling a 3D model building module through a configuration sub-module, obtaining a 3D solid model with a corresponding color according to the selected color by the 3D model building module, superposing the 3D solid model into a smooth environment ground through a virtual-real combination module to obtain an instantiated 3D solid model, and displaying the instantiated 3D solid model through the display interface.
As a further improvement of the embodiment, the product and the real scene around the product can be displayed through the display interface.
Taking an automobile as an example, defining a coordinate system of the 3D entity model corresponding to the automobile, superposing the automobile on a flat environment ground, superposing the coordinate 3D model on the environment ground and fusing peripheral real scenes, and seeing the scenes in the automobile and behind the automobile through automobile glass and the real scenes outside the automobile door when the automobile door is opened.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.
Claims (10)
1. An MR-based product display implementation system for instantiated display of a powered vehicle including but not limited to a car, train, airplane, the implementation system comprising:
the scanning module is used for collecting the environmental ground;
the environment recognition module is used for acquiring the environment ground, recognizing and optimizing the environment ground based on a plane scanning technology and obtaining a flat environment ground;
the 3D model building module is used for extracting display information based on product configuration, product characteristics and product price related to display requirements and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
the virtual-real combination module is used for superposing the 3D solid model on the flat environment ground to obtain an instantiated 3D solid model;
the interaction module is used for interacting with a user in a display interface mode, selecting a product through the display interface and displaying a corresponding instantiated 3D solid model, the display interface is provided with a plurality of interaction buttons, and example display of product configuration, product characteristics and product price related to display requirements is triggered through related interaction buttons in the instantiated 3D solid model, wherein the example display mode comprises but is not limited to character display, picture display, audio display, video display, special effect display and action display.
2. The MR-based product display implementation system according to claim 1, wherein the interaction module further includes a configuration sub-module, a plurality of configuration interaction buttons are configured on the display interface, the configuration interaction buttons invoke the 3D model building module through the configuration sub-module for implementing a replacement configuration of the instantiated 3D solid model, the replacement configuration includes but is not limited to a color of a replacement product, a material of the replacement product, and a part of a replacement vehicle.
3. The MR-based product display implementation system according to claim 1, wherein the virtual-real combination module is configured to obtain a 3D solid model and define a coordinate system for the 3D solid model, and combine the coordinate system to superimpose the 3D solid model on a flat environment ground to obtain an instantiated 3D solid model, where the instantiated 3D solid model displays a product and a real scene around the product.
4. The MR-based product display implementation system of claim 2 wherein said configuration interactive buttons include, but are not limited to, a drop down button which triggers a drop down options menu.
5. The MR-based product display implementation system according to claim 1, 2, 3 or 4, characterized in that the environment identification module identifies and optimizes the environment floor based on SDK planar scanning technique.
6. The MR-based product display implementing system according to claim 1, 2, 3 or 4, wherein the 3D model building module is a sub-module having the following functions:
the configuration submodule is used for extracting configuration information according to product configuration related to the display requirement, and the configuration information comprises but is not limited to product appearance, color, material and part composition;
the characteristic submodule is used for extracting characteristic information according to the characteristics of the product related to the display demand, and the characteristic information comprises but is not limited to efficacy and energy consumption;
the price submodule is used for extracting price information according to the price of the product related to the display demand, and the price information comprises but is not limited to the total price of the product, the price of each part and the price of the part plus the matched price;
the action construction sub-module is used for extracting corresponding action information according to the function of each part, and for the automobile, the action information comprises but is not limited to opening and closing of an automobile door, brushing of a wiper and running of the automobile on the environmental ground;
the special effect construction submodule is used for extracting corresponding special effect obtaining information according to the function of each part, wherein the special effect information comprises but is not limited to a lighting effect, a loudspeaker sounding effect, a product state effect corresponding to an instrument panel chart, a liquid crystal display effect, a door glass lifting effect and a vehicle lock state effect;
and the instantiation sub-module is used for combining the configuration information, the characteristic information, the price information, the action information and the special effect information to construct a 3D materialization model and form characters, pictures, audios, videos, special effects and actions.
7. An MR-based product display implementation system according to claim 1, 2, 3 or 4, characterized in that the interactive buttons are stereo buttons or 3D solid models.
8. An MR-based product display implementation method, characterized in that a product is instantiated and displayed by an MR-based product display implementation system as claimed in any one of claims 1-7, the implementation method includes the following steps:
extracting display information based on product configuration, product characteristics and product price related in the display demand, and realizing 3D entity models, characters, pictures, videos, audios, actions and special effects required by the MR by combining a 3D model making tool with art resources;
scanning the environment ground, and identifying and optimizing the environment ground based on a plane scanning technology to obtain a flat environment ground;
superposing the 3D solid model corresponding to the selected product on the flat environment ground to obtain an instantiated 3D solid model;
selecting a product through a display interface and displaying a corresponding instantiated 3D solid model, wherein a plurality of interaction buttons are configured in the display interface, and example display of product configuration, product characteristics and product price related to display requirements is triggered through related interaction buttons in the instantiated 3D solid model, and the example display forms include but are not limited to character display, picture display, audio display, video display, special effect display and action display.
9. The MR-based product display implementation method according to claim 7, further comprising triggering a corresponding configuration interaction button on the display interface, wherein the configuration interaction button calls the 3D model building module through the configuration sub-module to perform replacement configuration on the instantiated 3D solid model, and the replacement configuration includes but is not limited to color of the replacement product, material of the replacement product, and parts of the replacement product.
10. The method for realizing MR-based product exhibition according to claim 7 or 8, wherein the exhibition information is extracted based on product configuration, product characteristics and product price involved in exhibition requirements, and 3D entity models, texts, pictures, videos, audios, actions and special effects required by MR are realized by 3D model making tools in combination with art resources, comprising the following steps:
extracting configuration information according to product configuration related to display requirements, wherein the configuration information comprises but is not limited to product appearance, color, material and part composition;
extracting characteristic information according to product characteristics related to display requirements, wherein the characteristic information comprises but is not limited to efficacy and energy consumption;
extracting price information according to prices of products involved in the display demand, wherein the price information comprises but is not limited to total price of the products, price of each part and price of the part plus a match;
extracting corresponding action information according to the function of each part, wherein for the automobile, the action information comprises opening and closing of an automobile door, brushing of a wiper and running of the automobile on the environmental ground;
extracting corresponding special effect obtaining information according to the function of each part, wherein the special effect information comprises but is not limited to a lighting effect, a loudspeaker sounding effect, a product state effect corresponding to an instrument panel chart, a liquid crystal display effect, a door glass lifting effect and a vehicle lock state effect;
and combining the configuration information, the characteristic information, the price information, the action information and the special effect information to construct a 3D materialized model, and forming characters, pictures, audios, videos, special effects and actions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911391820.7A CN111134496B (en) | 2019-12-30 | 2019-12-30 | MR-based product display implementation system and implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911391820.7A CN111134496B (en) | 2019-12-30 | 2019-12-30 | MR-based product display implementation system and implementation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111134496A true CN111134496A (en) | 2020-05-12 |
| CN111134496B CN111134496B (en) | 2021-05-11 |
Family
ID=70521657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911391820.7A Active CN111134496B (en) | 2019-12-30 | 2019-12-30 | MR-based product display implementation system and implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111134496B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113298598A (en) * | 2020-09-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing shop object information and electronic equipment |
| CN113298588A (en) * | 2020-06-19 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing object information and electronic equipment |
| CN113744585A (en) * | 2020-05-28 | 2021-12-03 | 中国石油化工股份有限公司 | Fire accident emergency treatment drilling system and method |
| WO2022060873A1 (en) * | 2020-09-16 | 2022-03-24 | Wayfair Llc | Techniques for virtual visualization of a product in a physical scene |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013048146A2 (en) * | 2011-09-28 | 2013-04-04 | (주)바이널 | Showcase having a transparent display |
| CN108805648A (en) * | 2017-04-19 | 2018-11-13 | 苏州宝时得电动工具有限公司 | Virtual reality system and its control method |
| CN109448128A (en) * | 2018-09-26 | 2019-03-08 | 罗源县源林海产品贸易有限公司 | Three-dimensional marine product methods of exhibiting based on wear-type MR equipment |
| CN109636919A (en) * | 2018-11-29 | 2019-04-16 | 武汉中地地科传媒文化有限责任公司 | A kind of virtual museum's construction method, system and storage medium based on holographic technique |
| CN110136265A (en) * | 2018-02-02 | 2019-08-16 | 北京京东尚科信息技术有限公司 | Merchandise display method, apparatus, terminal device and retail trade system |
-
2019
- 2019-12-30 CN CN201911391820.7A patent/CN111134496B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013048146A2 (en) * | 2011-09-28 | 2013-04-04 | (주)바이널 | Showcase having a transparent display |
| CN108805648A (en) * | 2017-04-19 | 2018-11-13 | 苏州宝时得电动工具有限公司 | Virtual reality system and its control method |
| CN110136265A (en) * | 2018-02-02 | 2019-08-16 | 北京京东尚科信息技术有限公司 | Merchandise display method, apparatus, terminal device and retail trade system |
| CN109448128A (en) * | 2018-09-26 | 2019-03-08 | 罗源县源林海产品贸易有限公司 | Three-dimensional marine product methods of exhibiting based on wear-type MR equipment |
| CN109636919A (en) * | 2018-11-29 | 2019-04-16 | 武汉中地地科传媒文化有限责任公司 | A kind of virtual museum's construction method, system and storage medium based on holographic technique |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113744585A (en) * | 2020-05-28 | 2021-12-03 | 中国石油化工股份有限公司 | Fire accident emergency treatment drilling system and method |
| CN113744585B (en) * | 2020-05-28 | 2024-03-29 | 中国石油化工股份有限公司 | Fire accident emergency treatment drilling system and treatment method |
| CN113298588A (en) * | 2020-06-19 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing object information and electronic equipment |
| CN113298598A (en) * | 2020-09-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing shop object information and electronic equipment |
| WO2022060873A1 (en) * | 2020-09-16 | 2022-03-24 | Wayfair Llc | Techniques for virtual visualization of a product in a physical scene |
| US11836867B2 (en) | 2020-09-16 | 2023-12-05 | Wayfair Llc | Techniques for virtual visualization of a product in a physical scene |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111134496B (en) | 2021-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111134496B (en) | MR-based product display implementation system and implementation method | |
| CN107735816B (en) | Enhancing color fill in a display environment | |
| CN107153978B (en) | Vehicle type display method and system | |
| CN110888567A (en) | Location-based virtual element modality in three-dimensional content | |
| CN106791778A (en) | A kind of interior decoration design system based on AR virtual reality technologies | |
| US20170124770A1 (en) | Self-demonstrating object features and/or operations in interactive 3d-model of real object for understanding object's functionality | |
| CN108369457A (en) | Real mixer for mixed reality | |
| CN104915979A (en) | System capable of realizing immersive virtual reality across mobile platforms | |
| WO2020151431A1 (en) | Data processing method and system for intelligent vehicle viewing | |
| CN111124119B (en) | Building model presentation and interaction method based on virtual reality technology | |
| CN106157363A (en) | A kind of photographic method based on augmented reality, device and mobile terminal | |
| CN102540464A (en) | Head-mounted display device which provides surround video | |
| CN111815780A (en) | Display method, display device, equipment and computer readable storage medium | |
| CN112711458B (en) | Method and device for displaying prop resources in virtual scene | |
| CN107564108A (en) | The vehicle method of commerce and device of a kind of virtual reality | |
| CN110488979A (en) | A kind of automobile showing system based on augmented reality | |
| CN109725956A (en) | A kind of method and relevant apparatus of scene rendering | |
| CN111611647A (en) | Virtual-real interactive vehicle display system and use method thereof | |
| US11238657B2 (en) | Augmented video prototyping | |
| CN112783316A (en) | Augmented reality-based control method and apparatus, electronic device, and storage medium | |
| CN116958344A (en) | Animation generation method and device for virtual image, computer equipment and storage medium | |
| CN111161423A (en) | MR-based specification implementation system and implementation method | |
| CN114185279A (en) | Intelligent household scene and hardware equipment display device and display method thereof | |
| CN116310041A (en) | Rendering method and device of internal structure effect, electronic equipment and storage medium | |
| Shen et al. | A low-cost mobile vr walkthrough system for displaying multimedia works based on unity3d |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |