CN114445171A

CN114445171A - Product display method, device, medium and VR equipment

Info

Publication number: CN114445171A
Application number: CN202111586324.4A
Authority: CN
Inventors: 谢泽铨; 林永吉; 黎清顾
Original assignee: Gree Electric Appliances Inc of Zhuhai; Zhuhai Lianyun Technology Co Ltd
Current assignee: Gree Electric Appliances Inc of Zhuhai; Zhuhai Lianyun Technology Co Ltd
Priority date: 2021-12-23
Filing date: 2021-12-23
Publication date: 2022-05-06

Abstract

The invention discloses a product display method, a product display device, a product display medium and VR equipment. The method comprises the following steps: collecting multi-angle pictures of each sold product; generating a 3D model corresponding to a sold product according to the multi-angle picture of the sold product; adding interfaces to the 3D models of each product sold; when a VR display instruction is received, determining a to-be-displayed sales product; and performing VR display on the corresponding 3D model based on the interface of the sales product to be displayed. By adopting the invention, the product can be displayed at multiple angles, the sense of reality is better, and the displayed information is more comprehensive.

Description

Product display method, device, medium and VR equipment

Technical Field

The invention relates to the technical field of virtual reality, in particular to a product display method, a product display device, a product display medium and VR equipment.

Background

For the sale of products, the traditional offline promotion mode is basically to promote and sell products by using leaflets or product documents displayed by a mobile terminal through store shopping guide or professional salesperson visiting services. The product popularization mode is based on a plane for displaying the product, and has limited display content, insufficient information display and weak attraction.

Along with the development of VR (virtual reality) technique, the application VR technique demonstrates that three-dimensional nature, the variety of product can be better demonstrated to the product, makes the customer have deeper understanding to the product. However, at present, the VR display mode for products mostly adopts traditional pictures or barreled panoramas to collect and render pictures for barreled display, and the problem that the displayed information is not comprehensive enough still exists.

Disclosure of Invention

The technical problem to be solved by the invention is as follows: the product display information in the prior art is not comprehensive.

In order to solve the technical problems, the invention provides a product display method, a product display device, a product display medium and VR equipment.

A product display method, comprising:

collecting multi-angle pictures of each sold product;

generating a 3D model corresponding to the sold product according to the multi-angle pictures of the sold product;

adding interfaces to the 3D models of each product sold;

when a VR display instruction is received, determining a to-be-displayed sales product;

and performing VR display on the corresponding 3D model based on the interface of the to-be-displayed sales product.

In one embodiment, the multi-angle pictures of the sales product comprise pictures collected at 360 degrees of all angles of the sales product.

In one embodiment, the generating a 3D model of a corresponding sales product from the multi-angle pictures of the sales product includes:

searching characteristic points for pictures of the sold product at all angles;

generating a point cloud picture based on the picture after the characteristic points are searched;

generating a triangular grid through the point cloud picture to obtain a grid picture;

and carrying out texture mapping on the grid map to obtain a 3D model of the sold product.

In one embodiment, the searching for feature points for the pictures of the sold product at various angles includes:

and searching feature points of the pictures of the sold products at all angles by utilizing an SIFT algorithm.

In one embodiment, the determining the sales product to be displayed when receiving the VR display instruction includes:

acquiring input purchasing demand information;

and when a VR display instruction is received, carrying out big data analysis according to the purchase demand information, and determining a recommended product corresponding to the purchase demand information as a to-be-displayed sales product.

A product display device, comprising:

the picture acquisition module is used for acquiring multi-angle pictures of each sold product;

the model generation module is used for generating a 3D model corresponding to the sold product according to the multi-angle pictures of the sold product;

the interface adding module is used for adding interfaces to the 3D models of the various sold products;

the product determining module is used for determining a to-be-displayed sales product when the VR displaying instruction is received;

and the VR display module is used for carrying out VR display on the corresponding 3D model based on the interface of the to-be-displayed sales product.

In one embodiment, the model generation module comprises:

the characteristic point searching unit is used for searching characteristic points for pictures of the sold product at various angles;

the point cloud picture generating unit is used for generating a point cloud picture based on the picture after the characteristic points are searched;

the grid map generating unit is used for generating a triangular grid through the point cloud map to obtain a grid map;

and the 3D model generating unit is used for carrying out texture mapping on the grid map to obtain the 3D model of the sold product.

In one embodiment, the product determination module is configured to: acquiring input purchasing demand information; and when a VR display instruction is received, carrying out big data analysis according to the purchase demand information, and determining a recommended product corresponding to the purchase demand information as a to-be-displayed sales product.

A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:

collecting multi-angle pictures of each sold product;

adding interfaces to the 3D models of each product sold;

and performing VR display on the corresponding 3D model based on the interface of the sales product to be displayed.

A VR device comprising a memory and a processor, the memory storing a computer program, the processor when executing the computer program implementing the steps of:

collecting multi-angle pictures of each sold product;

adding interfaces to the 3D models of each product sold;

Compared with the prior art, one or more embodiments in the above scheme can have the following advantages or beneficial effects:

generating a 3D model corresponding to a sold product according to a multi-angle picture of the sold product, adding an interface to the 3D model, and performing VR display on the corresponding 3D model based on the interface of the sold product to be displayed after the sold product to be displayed is determined; because the picture that adopts the multi-angle generates the 3D model, the 3D model can the multi-angle show product when carrying out the VR show, and the sense of reality is better, and the show information is more comprehensive.

Drawings

The scope of the present disclosure may be better understood by reading the following detailed description of exemplary embodiments in conjunction with the accompanying drawings. Wherein the included drawings are:

FIG. 1 is a schematic flow chart diagram of a product display method in one embodiment;

FIG. 2 is a schematic diagram of a process for generating a 3D model of a product for sale according to a multi-angle picture of the product for sale in one embodiment;

FIG. 3 is a flow chart of the operation of a VR device door shopping guide using an application product display method;

FIG. 4 is a block diagram of a product display device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the following will describe in detail an implementation method of the present invention with reference to the accompanying drawings and embodiments, so that how to apply technical means to solve the technical problems and achieve the technical effects can be fully understood and implemented.

In one embodiment, a product display method is provided; as shown in fig. 1, the method includes:

s110: and collecting multi-angle pictures of each sold product.

The sales product refers to a product to be promoted, and can be various types of air conditioners, electric fans and the like. The multi-angle pictures of the sold products can be collected from the image shooting device, and the image shooting device shoots the multi-direction angle images of the sold products.

S130: and generating a 3D model corresponding to the sold product according to the multi-angle pictures of the sold product.

S150: an interface is added to the 3D model of each product sold.

And adding an interface on the 3D model, calling data through the interface when VR display is required subsequently, and displaying according to data information returned by the given interface.

S170: and when a VR display instruction is received, determining the sales product to be displayed.

The VR display instructions instruct VR display of a specified product for sale. Specifically, by parsing the VR display instruction, it is determined that the VR display instruction indicates a specified product for sale.

S190: and performing VR display on the corresponding 3D model based on the interface of the sales product to be displayed.

Specifically, the 3D model is displayed by adopting VR display technology.

Because the traditional VR show is still laggard owing to the network restriction form, the method that most adopted is that traditional picture or barreled panorama carry out the collection of picture, render, the bandwagon effect is very big with real product, environment gap to can't be free, the product is looked over to the multi-angle, can only show the 3D effect from an angle.

According to the product display method, the 3D model corresponding to the sold product is generated according to the multi-angle picture of the sold product, the interface is added to the 3D model, after the sold product to be displayed is determined, VR display is carried out on the corresponding 3D model based on the interface of the sold product to be displayed; because the picture that adopts the multi-angle generates the 3D model, the 3D model can the multi-angle show product when carrying out the VR show, and the sense of reality is better, and the show information is more comprehensive.

For example, a Kinect method can be used for collecting multi-angle pictures of a sold product, processing the pictures by using a computer graphic image technology to form a 3D model, and calling the 3D model through an interface for displaying during displaying. The invention can be applied to the scene of sale at home, and the shopping guide personnel at home carries the VR equipment to carry out sale at home according to the reservation information and carries out VR display on the sold product according to the system guide operation; with VR technique and off-line shopping guide combine, with the help of virtual information's space-time ductility, form variety, high-efficient interactive, compensate the shortcoming that present stage off-line on-line marketing exists, help the more comprehensive, the deep understanding product of consumer when promoting consumption experience, and then improve the purchase rate.

In one embodiment, the multi-angle pictures of the sold product comprise pictures collected at 360 degrees of all angles of the sold product. The picture of 360 all-round angle collection can provide the information of selling each angle of product comprehensively to the 3D model based on picture generation of 360 all-round angle can show the product of selling comprehensively three-dimensionally.

In one embodiment, as shown in fig. 2, step S130 includes steps S131 to S137.

S131: and searching characteristic points of the pictures of the sold products at all angles.

And searching for the characteristic points, wherein the characteristic points can be used as references for identifying the object.

S133: and generating a point cloud picture based on the picture after the characteristic points are searched.

S135: and generating a triangular grid through the point cloud picture to obtain a grid picture.

The grid map may be a point cloud map comprising a triangular grid. A triangular mesh is generated through the point cloud image, adjacent points are connected, and the depth of field of the object can be obtained through triangulation calculation.

S137: and carrying out texture mapping on the grid map to obtain a 3D model of the sold product.

Based on the triangular mesh, the corresponding texture in the picture information can be cut according to the corresponding proportion and attached to the surface of the point cloud picture, and thus the 3D model is generated. By searching for feature points, generating point cloud pictures, generating triangular meshes and texture maps, a 3D model for comprehensively displaying information of the products for sale can be generated.

In one embodiment, step S131 includes: and searching feature points of the pictures of the sold products at all angles by utilizing an SIFT (Scale-invariant feature transform) algorithm.

The SIFT algorithm can be adopted to accurately search the feature points.

For example, firstly, a person collecting data will collect picture information of a product sold, and the collection requires 360-degree all-directional angle collection for any product. And searching the collected picture for characteristic points, and taking the characteristic points as references for identifying the object. Specifically, the SIFT algorithm can be used for searching for feature points, and the feature points are determined so that each picture has independent identity information and is correspondingly connected with background product data. Wherein, the background data refers to the corresponding price, parameter, size, etc. of each sale product in the database. After the characteristic points are established, a point cloud picture is generated, a camera matrix can be calculated through the characteristic points, and then the 360-degree point cloud picture is derived. An important step in the point cloud picture manufacturing is to remove noise; the noise point is an interference point, which is generally a point far away from the main point set, and if the noise point cannot be eliminated, the generated 3D model cannot be normally displayed. Specifically, the elimination and generation may be performed using the open source image processing library OpenCV. After the point cloud image is manufactured, triangular meshes are manufactured, namely adjacent points are connected, the depth of field of an object can be obtained through triangulation calculation, and the triangular meshes can be realized by utilizing a Delaunay triangulation algorithm. And finally, the texture mapping is provided with a triangular mesh, namely, the corresponding texture in the picture information can be cut according to the corresponding proportion and is pasted on the surface of the point cloud picture, and thus, a 3D model is generated.

In one embodiment, step S170 includes: acquiring input purchasing demand information; and when a VR display instruction is received, big data analysis is carried out according to the purchase demand information, and a recommended product corresponding to the purchase demand information is determined to be used as a to-be-displayed sales product.

The purchase demand information is information representing the purchase demand of the user, and may include information of the product user type, the installation location, the price requirement, and the like, for example. For example, the user may input purchase demand information on the interface, and then click on a "VR show" virtual button, which corresponds to inputting a VR show instruction. For example, the air conditioner electric appliance counts the air conditioner purchasing sales volume of different age levels according to the installed house type area and the installation position, and the air conditioner type is obtained by analyzing the data by adopting a big data analysis technology for recommendation.

In the invention, for the construction of a VR environment, a Unity3D engine can be adopted, and a plurality of virtual reality technologies are mainly applied for development, wherein the virtual reality technologies comprise a wide-view stereoscopic display technology, a head rotation sensing technology and an image stereoscopic generation technology. And combining a virtual reality head display and a sensor to perform real object simulation on the imported and modeled 3D model in a ratio of 1: 1. If the house type 3D simulation diagram is transmitted in advance, the multi-azimuth photo of the appointed place is shot, the product serial number can be automatically generated by the background, the real scene simulation is generated, the virtual 3D simulation effect of the product can be observed, and therefore the customer can experience the product effect more intuitively.

When the method is applied to the scene of sale, as shown in fig. 3, technicians model and fill product information into a database in advance and store a 3D model of each sale product; sales personnel carry VR equipment and sell the popularization according to reservation information going on the door, and customer guides the operation according to the system and carries out the VR show to selling the product. Combine VR technique and online shopping guide, help the more comprehensive, deep understanding product of consumer when promoting consumption experience, and then improve the purchase rate.

The VR equipment that the user used can include a show helmet and handheld grab handle, and the user uses handheld grab handle to carry out the effect that the interface moved, rotated, clicked according to the guide of show to this realizes the interactive operation of product. First, VR devices do mainly three things: 1 expansion of visual field, 2 sensing of head rotation, and 3 generation of stereoscopic impression of image. Wherein, the visual range of human eyes is enlarged by the convex lens. VR glasses currently generally extend the user's field of view to between 90-120 degrees because the maximum viewing angle at which the eyes of a person coincide is approximately 120 degrees, which is sufficient to create the user with a sense of being personally on the scene, i.e., create an immersive visual environment. Wherein, the head rotation of the user is sensed through the gyroscope; and refreshing the picture in real time according to the rotation angle and the direction of the head of the user, so that the user generates 360-degree three-dimensional space feeling.

It should be understood that although the various steps in the flowcharts of fig. 1-2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1-2 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps or stages.

In one embodiment, as shown in fig. 4, there is provided a product display device comprising: a picture taking module 310, a model generating module 330, an interface adding module 350, a product determining module 370, and a VR presentation module 390.

The picture collecting module 310 is used for collecting multi-angle pictures of each sold product; the model generation module 330 is used for generating a 3D model corresponding to a sold product according to the multi-angle pictures of the sold product; the interface adding module 350 is used for adding interfaces to the 3D models of the respective sales products; the product determination module 370 is configured to determine a sales product to be displayed when receiving the VR display instruction; the VR display module 390 is configured to perform VR display on the corresponding 3D model based on an interface of a product to be displayed.

According to the product display device, the 3D model corresponding to the sold product is generated according to the multi-angle picture of the sold product, the interface is added to the 3D model, after the sold product to be displayed is determined, VR display is carried out on the corresponding 3D model based on the interface of the sold product to be displayed; because the picture that adopts the multi-angle generates the 3D model, the 3D model can the multi-angle show product when carrying out the VR show, and the sense of reality is better, and the show information is more comprehensive.

In one embodiment, the model generation module 330 includes: the characteristic point searching unit is used for searching characteristic points for pictures of various angles of the sold product; the point cloud picture generating unit is used for generating a point cloud picture based on the picture after the characteristic points are searched; the grid map generating unit is used for generating a triangular grid through the point cloud map to obtain a grid map; and the 3D model generating unit is used for carrying out texture mapping on the grid map to obtain a 3D model of the sold product.

In one embodiment, the feature point searching unit searches feature points of pictures of various angles of the sold product by using a SIFT algorithm.

In one embodiment, the product determination module 370 is configured to: acquiring input purchasing demand information; and when a VR display instruction is received, big data analysis is carried out according to the purchase demand information, and a recommended product corresponding to the purchase demand information is determined to be used as a to-be-displayed sales product.

For the specific definition of the product display device, reference may be made to the definition of the product display method above, and details are not repeated here. The various modules in the product display apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent of a processor in the VR device, or can be stored in a memory in the VR device in a software form, so that the processor can call and execute operations corresponding to the modules. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

In one embodiment, there is provided a VR device comprising a memory and a processor, the memory having stored therein a computer program, the processor implementing the steps of the method in the embodiments described above when executing the computer program.

The VR equipment can display products at multiple angles, has better reality and more comprehensive display information due to the realization of the steps of the method in each embodiment.

In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method in the embodiments described above.

The computer readable storage medium can realize the steps of the method in the embodiments, and similarly, the product can be displayed at multiple angles, so that the reality sense is better, and the displayed information is more comprehensive.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A method of product display, comprising:

collecting multi-angle pictures of each sold product;

adding interfaces to the 3D models of each product sold;

2. The method of claim 1, wherein the pictures of the marketing product from multiple angles comprise pictures taken from a 360 ° omni-directional angle of the marketing product.

3. The method of claim 1, wherein generating the 3D model of the corresponding product for sale from the picture of the multiple angles of the product for sale comprises:

searching characteristic points for pictures of the sold product at all angles;

4. The method of claim 3, wherein the searching for feature points for the pictures of the sold product from different angles comprises:

5. The method of claim 1, wherein determining the sales product to be displayed upon receiving the VR display instruction comprises:

acquiring input purchasing demand information;

6. A product display device, comprising:

7. The apparatus of claim 6, wherein the model generation module comprises:

8. The apparatus of claim 6, wherein the product determination module is configured to: acquiring input purchasing demand information; and when a VR display instruction is received, carrying out big data analysis according to the purchase demand information, and determining a recommended product corresponding to the purchase demand information as a to-be-displayed sales product.

9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.

10. A VR device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any of claims 1 to 5 when executing the computer program.