CN108198011B

CN108198011B - Method, system and terminal equipment for generating order

Info

Publication number: CN108198011B
Application number: CN201611122638.8A
Authority: CN
Inventors: 潘益
Original assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Jingdong Shangke Information Technology Co Ltd
Current assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Jingdong Shangke Information Technology Co Ltd
Priority date: 2016-12-08
Filing date: 2016-12-08
Publication date: 2021-03-30
Anticipated expiration: 2036-12-08
Also published as: CN108198011A

Abstract

The application discloses a method, a system and a terminal device for generating orders. The method comprises the following steps: responding to the operation of a user on a shopping website, and displaying a first VR home scene; responding to the operation of the user on the first VR home scene, and constructing a second VR home scene by using a home commodity model corresponding to the home commodity selected by the user; according to the order is generated in the second VR home scene, the actual matching effect of the home commodities and the home scene can be simulated by utilizing the VR technology, and the user experience is improved.

Description

Method, system and terminal equipment for generating order

Technical Field

The invention relates to the technical field of virtual reality, in particular to a method, a system and a terminal device for generating an order.

Background

With the development of internet technology, a new shopping mode of online shopping is more popular with people, even the past shopping mode is overturned, online shopping is realized by 'shopping at home', ordering is not limited by time and place, a large amount of commodity information is obtained, and commodities which are not available in the local area can be bought.

Currently, when a user selects home commodities on a shopping website, information such as the size of a home scene needs to be measured on line, then appropriate home commodities are selected according to the size information of the home commodities provided by the shopping website, and the home commodities are placed in a shopping cart to generate an order.

However, the user cannot know the actual matching effect of the household goods and the household scene only according to the size information of the household goods provided by the shopping website, which easily causes the problem that the purchased household goods are not matched with the household scene, and the user experience is poor.

Therefore, a new method, system and terminal device for generating orders are needed.

The above information disclosed in this background section is only for enhancement of understanding of the background of the invention and therefore it may contain information that does not constitute prior art that is already known to a person of ordinary skill in the art.

Disclosure of Invention

In view of this, the present invention provides a method, a system and a terminal device for generating an order, which can simulate an actual matching effect of a home commodity and a home scene by using a VR technology.

Additional features and advantages of the invention will be set forth in the detailed description which follows, or may be learned by practice of the invention.

According to an aspect of the invention, there is provided a method for generating an order, the method comprising:

responding to the operation of a user on a shopping website, and displaying a first VR home scene;

responding to the operation of the user on the first VR home scene, and constructing a second VR home scene by using a home commodity model corresponding to the home commodity selected by the user;

and generating an order according to the second VR home scene.

In an exemplary embodiment of the present disclosure, the displaying the first VR home scene includes:

and displaying the first VR home scene according to the home scene information selected by the user from the home scene library.

In an exemplary embodiment of the disclosure, the building a second VR household scene using the household commodity model includes at least one of the following operations:

removing the household commodity model to construct a second VR household scene;

modifying the household commodity model to construct a second VR household scene;

and adding the household commodity model to the first VR household scene to construct a second VR household scene.

In an exemplary embodiment of the present disclosure, the adding, according to a home product selected by a user, a model corresponding to the home product to the first VR home scene to construct a second VR home scene includes:

according to the home goods selected by the user from the shopping website, finding home goods models corresponding to the home goods from a home goods model library;

and constructing a second VR home scene by using the first VR home scene and the home commodity model.

In an exemplary embodiment of the present disclosure, the adding, according to a home commodity selected by a user, a home commodity model corresponding to the home commodity in the first VR home scene to construct a second VR home scene includes:

according to the home goods selected by the user in the first VR home scene, a home goods model corresponding to the home goods is found in a home goods model base;

In an exemplary embodiment of the present disclosure, the method further comprises:

building a home commodity model library;

the building of the household commodity model library comprises the following steps:

acquiring standard attribute information of a plurality of household commodities;

performing attribute standardization operation and model standardization operation according to the standard attribute information of each household commodity to obtain a plurality of household commodity models;

and constructing a household commodity model library by using the plurality of household commodity models.

In an exemplary embodiment of the present disclosure, performing an attribute standardization operation and a model standardization operation according to standard attribute information of each household commodity to obtain a plurality of household commodity models includes:

constructing a plurality of standard VR models of the household goods according to the standard attribute information of each household goods;

and setting a standard VR model corresponding to the display proportion and/or the home size of various home scenes to obtain a plurality of home commodity models.

According to another aspect of the present invention, there is provided a system for generating an order, the system comprising:

the display module responds to the operation of a user on a shopping website and displays a first VR home scene;

the construction module is used for responding to the operation of the user on the first VR home scene and constructing a second VR home scene by using the home commodity model corresponding to the home commodity selected by the user;

and the generating module is used for generating an order according to the second VR home scene.

In an exemplary embodiment of the disclosure, the building module is configured to perform at least one of the following operations:

According to another aspect of the present invention, there is provided a terminal device including: a memory and one or more controllers, wherein the memory stores instructions for the one or more controller calls, and the one or more controllers are configured to call the instructions in the memory to perform:

and generating an order according to the second VR home scene.

According to the method for generating the shopping order, provided by the embodiment of the invention, the operation of a user on a shopping website is responded, and a first VR home scene is displayed; responding to the operation of the user on the first VR home scene, and constructing a second VR home scene by using a home commodity model corresponding to the home commodity selected by the user; according to the order is generated in the second VR home scene, the actual matching effect of the home commodities and the home scene can be simulated by utilizing the VR technology, and the user experience is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.

Drawings

The above and other objects, features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.

FIG. 1 is a flow diagram illustrating a method for generating an order in accordance with an exemplary embodiment;

FIG. 2 is a schematic diagram illustrating a search interface of a home scene library, according to an example embodiment;

FIG. 3 is a schematic diagram illustrating picture stitching according to an exemplary embodiment;

FIG. 4 is a flow diagram illustrating a method of constructing a second VR home scenario in accordance with an exemplary embodiment;

fig. 5 is a flowchart illustrating a method of constructing a second VR home scenario in accordance with another example embodiment;

FIG. 6 is a schematic diagram illustrating selection of household items in a first VR household scene in accordance with an exemplary embodiment;

FIG. 7 is a block diagram illustrating a system for generating an order in accordance with an exemplary embodiment;

fig. 8 is a block diagram illustrating a terminal device according to an exemplary embodiment.

DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus, a repetitive description thereof will be omitted.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, implementations or operations have not been shown or described in detail to avoid obscuring aspects of the invention.

The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.

The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.

It should be understood that although the terms first, second, etc. may be employed to describe VR home scenarios in embodiments of the present invention, these VR home scenarios should not be limited to these terms. These terms are only used to distinguish VR home scenes from each other.

FIG. 1 is a flow diagram illustrating a method for generating an order according to an exemplary embodiment.

As shown in fig. 1, in S102, a first VR home scene is displayed in response to a user operation at a shopping site.

According to an example embodiment, a client initializes and displays a first VR home scene according to home scene information selected by a user from a home scene library when the first VR home scene is displayed. The home scene information may include, but is not limited to, at least one of a home household type, a home size, and a home style. Home housing types such as living room, bedroom, kitchen, home housing sizes such as length, width, height, area, etc., home housing styles such as rural, simple, modern, european, chinese, etc.

According to an example embodiment, a user may construct a blank VR home scene according to the home scene information, or may select a VR home scene including home commodities from a home scene library according to the home scene information. For a VR home scene containing home commodities, each home commodity is superposed on the base map as a layer of non-transparent picture, so that modularization of the home commodities in the VR home scene is realized.

It should be noted that superposition fusion is realized through the picture superposition technology between the VR home scene and the home goods, pictures on different layers are superposed according to the spatial coordinate point and the spatial direction sequence, and the layer in front of the sequence can shield the layer in back of the sequence. The part is realized by a picture rendering engine, and the engine is realized by packaging local development libraries of different platforms (iOS and Android). The realization of the household commodity space interaction is realized by packaging local development library modes of different platforms (iOS and Android). And projecting the processed and rendered picture through a picture rendering engine, and realizing an event-driven user interaction mode through a device gesture recognition API.

Fig. 2 is a schematic diagram illustrating a search interface of a home scene library according to an example embodiment.

As shown in fig. 2, taking a home type as a living room as an example, a user may select a space size and a design style, so as to select a corresponding home scene as a first VR home scene.

According to an example embodiment, the client needs to build a home scene library in advance. The home scene library may be constructed in the following manner or in other manners.

Step 1, obtaining scene pictures

The center of the shooting position of the selected scene is ensured to be unchanged, and meanwhile, the horizontal position is kept unchanged by using a tripod or other fixing equipment capable of fixing the shooting equipment. In the shooting process, the superposition position of each two accounts is ensured, so that the whole home scene looks continuous. In the shooting process, the photographic equipment is ensured to keep the same setting parameter, so that the whole scene is uniform.

Step 2, preprocessing the picture

And adjusting the pictures to be uniform in size, and naming the pictures according to the shooting sequence. The photographs may be subjected to compression processing in consideration of performance and aging. The parts of the photographs that were duplicated were marked.

In order to improve the software performance, the picture is compressed by using WebP, the WebP format is open source by Google, and the picture format aims at accelerating the picture loading speed. The picture compression volume is only about 2/3 of JPEG, and a large amount of server bandwidth resources and data space can be saved. This can greatly reduce mobile device traffic problems.

The picture preprocessing engine is an independent program and is realized through Python, and a program running environment needs to install WebP, Python and Pillow (a branch of PIL) on a corresponding operating system.

Step 3, splicing the pictures

An automated stitching method may be used to stitch the groups of photographs taken. Illumination compensation, image fusion and uniform space coordinates can be completed in the automatic splicing process.

Fig. 3 is a schematic diagram illustrating picture stitching according to an exemplary embodiment.

In the aspect of picture splicing, a picture macro frame is based on region splicing, and microscopic details are based on a fusion algorithm of feature matching calibration.

The region-based registration method is that starting from the gray value of an image to be spliced, the difference of the gray value of a region in the image to be registered and a region with the same size in a reference image is calculated by using a least square method or other mathematical methods, and the similarity degree of the overlapping region of the image to be spliced is judged after the difference is compared, so that the range and the position of the overlapping region of the image to be spliced are obtained, and the image splicing is realized. The images can also be transformed from the time domain to the frequency domain by FFT transformation and then registered. For the image with larger displacement, the rotation of the image can be corrected first, and then the mapping relation between the two images is established.

When the difference of the gray values of the pixel points in the two areas is used as a discrimination standard, the simplest method is to directly accumulate the difference of the gray values of the points. This approach is not very effective and often results in stitching failures due to variations in brightness, contrast, and other reasons. The other method is to calculate the correlation coefficient of the gray values of the corresponding pixels of the two areas, and the larger the correlation coefficient is, the higher the matching degree of the two images is. The method has better splicing effect and improved success rate.

The feature-based registration method does not directly utilize pixel values of an image, derives features of the image through pixels, then searches and matches corresponding feature regions of image overlapping parts by taking the image features as a standard, and the type of stitching algorithm has high robustness and robustness.

The feature-based registration method has two processes: feature extraction and feature registration. Firstly, extracting the points, lines, areas and other features with obvious gray level change from two images to form a feature set. And then selecting the feature pairs with corresponding relations as much as possible in the feature sets corresponding to the two images by using a feature matching algorithm. A number of image segmentation techniques are used for feature extraction and boundary detection. Such as Canny operator, laplacian gaussian operator, region growing. The extracted spatial features include closed boundaries, open boundaries, intersecting lines, and other features. The algorithm of feature matching is as follows: cross correlation, distance transformation, dynamic programming, structure matching, chain code correlation and other algorithms.

In S104, responding to the operation of the user on the first VR home scene, and constructing a second VR home scene by using the home commodity model corresponding to the home commodity selected by the user.

According to an example embodiment, constructing the second VR home scenario may be by at least one of the following operations.

The first operation is carried out, the household commodity model is removed, and a second VR household scene is constructed.

For the home commodity model corresponding to the home commodity selected by the user and contained in the first VR home scene, the home commodity model can be removed, and a second VR home scene is constructed.

For example, by clicking a home commodity model corresponding to a home commodity selected by a user in a first VR home scene, the home commodity model is selected and deleted in a floating toolbar.

It should be noted that each household commodity model in the first VR household scene is manufactured as a layer of non-transparent picture to be superimposed on the base map, and when the household commodity model in the first VR household scene is removed, a layer of the household commodity model can be removed, so that the effect of the base map of the household scene is displayed.

And operation II, modifying the household commodity model to construct a second VR household scene.

For the home commodity model corresponding to the home commodity selected by the user and contained in the first VR home scene, the home commodity model can be modified to construct a second VR home scene.

It should be noted that, modifying the home product model in the first VR home scene may include, but is not limited to, modifying a position of the home product model in the first VR home scene, and replacing the size, and color of the home product corresponding to the home product model and the home product.

For example, a home merchandise model corresponding to a home merchandise selected by a user in a first VR home scene may enter an editing state by double-clicking. The user can move the household commodity model, and perform operations such as size change and remarking of the household commodity corresponding to the household commodity model.

It should be noted that when the position of the home commodity model in the first VR home scene is modified, the following effect of the home commodity model in the VR home scene is to map and bind the current spatial coordinate position of the home commodity model and the VR home scene coordinate system, so that when the position of the home commodity model in the first VR home scene is modified, the spatial coordinate position of the modified home commodity model and the VR home scene coordinate system are mapped and bound again, and the home commodity model and the VR home scene are overlaid and fused into a whole after the position is modified.

It should be noted that, when the size, the dimension, the color, and the home goods corresponding to the home goods model are replaced, each home goods model in the first VR home scene is manufactured as a layer of non-transparent picture to be superimposed on the base map, so that one layer of the home goods model can be removed, and a layer of the home goods model corresponding to the modified home goods model is inserted into the current spatial coordinate position of the home goods model, and the effect of superimposing the modified layer of the home goods model is displayed.

And thirdly, adding the household commodity model to the first VR household scene, and constructing a second VR household scene.

According to an example embodiment, a home commodity model corresponding to a home commodity can be found from a home commodity model library according to the home commodity selected by a user from a shopping website, and the model is added to the first VR home scene to construct a second VR home scene.

It should be noted that, when the home product model corresponding to the home product selected by the user is added to the first VR home scene and the second VR home scene is constructed, a layer of the home product model corresponding to the home product selected by the user may be inserted into the spatial coordinate position of the position selected by the user, and an effect obtained by superimposing the added layer of the home product is displayed.

According to an example embodiment, the home commodity model base needs to be constructed in advance, and when the home commodity model base is constructed, the following method can be used: the method comprises the steps of firstly obtaining standard attribute information of a plurality of household commodities, obtaining the standard attribute information of the household commodities from a shopping website, or obtaining the standard attribute information of the household commodities from any network, for example, crawling can be performed through a directional planning task. Furthermore, attribute standardization operation and model standardization operation are carried out according to the standard attribute information of each household commodity to obtain a plurality of household commodity models, and a household commodity model library is built by utilizing the plurality of household commodity models.

According to an example embodiment, the standard attribute information includes, but is not limited to, the size, dimensions, and angle of the household goods. According to the standard attribute information of each household commodity, standard VR models of a plurality of household commodities can be constructed, and the standard VR models corresponding to the display proportions and/or the household sizes of a plurality of household scenes are further set so as to obtain a plurality of household commodity models.

After attribute standardization operation and model standardization operation are carried out, when a first VR home scene is displayed, a standard VR model corresponding to home commodities with the same display proportion as the first VR home scene can be displayed according to the display proportion of the first VR home scene, the arrangement of the display proportion enables the matching effect of the home scene and the home commodity model to be obvious, and user experience is improved.

After the size of the standard VR model corresponding to each household commodity corresponding to the multiple household sizes is set, household commodities which are obviously inconsistent with the household size of the first VR household scene are excluded, for example, if the length of a living room in the household size of the first VR household scene is 5 meters, a sofa model of which the length of a sofa exceeds 5 meters in the household commodities is excluded. Therefore, home commodities which are not matched with actual matching are automatically removed according to the home size of the first VR home scene, the situation that a user purchases home commodities which are not matched is avoided, and user experience is improved.

The method for adding the home commodity model to the first VR home scene and constructing the second VR home scene is described in detail below with reference to specific application scenes.

Fig. 4 is a flowchart illustrating a method for constructing a second VR home scenario, which may be applied to an application scenario in which a user has selected home goods from a shopping website according to an exemplary embodiment.

As shown in fig. 4, in S402, the home goods selected by the user from the shopping website are acquired from the shopping cart.

According to an example embodiment, home goods may be selected from a shopping website according to home goods attribute information input by a user. The home goods attribute information may include, but is not limited to: category, name, brand, model, unit, and price of the household goods. According to the home commodity attribute information input by the user, the corresponding home commodities are screened out, the home commodities are quickly searched, and the user experience is improved.

Further, the home goods selected by the user from the shopping website are added into the shopping cart, and when a second VR home scene is constructed, the home goods selected by the user from the shopping website are obtained from the shopping cart.

In S404, a first VR home scene is displayed.

See S102, which is not described herein.

In S406, according to the home goods selected by the user from the shopping website, the home goods model corresponding to the home goods is found from the home goods model library.

In S408, a second VR home scene is constructed by using the first VR home scene and the home commodity model.

And constructing a second VR home scene by using the interface model information of the first VR home scene and the home commodity model corresponding to the home commodity selected by the user.

The interface model information may include, but is not limited to, at least one of a display scale and a home size of the home scene. And displaying the interface model information which accords with the first VR home scene and the home commodity model which corresponds to the home commodity selected by the user according to the interface model information of the first VR home scene and the home commodity model which corresponds to the home commodity selected by the user.

For example, if the display ratio of the first VR home scene is 500:1, a home furnishing commodity model with the display ratio of 500:1 can be displayed, and if the length of a living room in the home furnishing size of the first VR home furnishing scene is 5 meters, the length of the middle sofa corresponding to the displayed home furnishing commodity model is not more than 5 meters.

Fig. 5 is a flowchart illustrating a method for constructing a second VR home scenario according to another exemplary embodiment, which may be applied to an application scenario of a home commodity selected by a user from a first VR home scenario.

As shown in fig. 5, in S502, a first VR home scene is displayed.

See S102, which is not described herein.

In S504, according to the home goods selected by the user in the first VR home scene, the home goods model corresponding to the home goods is found in the home goods model base.

And displaying a home commodity information search page according to the operation of the user on the first VR home scene, searching according to at least one home commodity attribute information which can be input by the user, and selecting a home commodity. And further, the home commodity model corresponding to the home commodity is searched from the home commodity model library.

For example, when the home goods information search page is displayed, home goods may be displayed in a list page form, and a user may select home goods on the list page.

Fig. 6 is a schematic diagram illustrating selection of home commodities in a first VR home scene according to an exemplary embodiment, where as shown in fig. 6, a user selects to add home commodities in a living room (a first VR home scene), and a search page allowing the user to select a home commodity type is displayed on the right side of an interface. Furthermore, according to the type of the household goods selected by the user, a search page of the type of the household goods can be entered.

In S506, a second VR home scene is constructed by using the first VR home scene and the home commodity model.

See S408, which is not described herein.

According to an example embodiment, after the second VR home scene is constructed, the client may save the second VR home scene as a static picture for the user to share, for example, share to a social media. Meanwhile, the address code of the second VR home scene can be shared, and then the second VR home scene is edited after other users open the address code.

In S106, an order is generated according to the second VR home scene.

According to an example embodiment, the order may be generated according to home goods corresponding to a part of the home goods models in the second VR home scene, or the order may be generated according to home goods corresponding to all the home goods models in the second VR home scene.

It should be noted that each household commodity in the shopping website is provided with a serial number, and when an order is generated, the client generates a serial number for each household commodity in the order.

According to an example embodiment, the order includes a number, category, name, make, model, unit, quantity, and price for each household item.

It should be noted that, when an order is generated for home goods such as wallpaper and floor, the number in the second VR home scene may be automatically calculated according to the area of a single home good and the area of the use position of the model corresponding to the home good in the second VR home scene (for example, the area of the wall surface and the ground after the area of the door and the window is deducted), and the calculation result is equal to the number of the home goods placed at the position.

For example, table 1 provides an order according to an embodiment of the present invention.

Serial number

Numbering

Claims

1. A method for generating an order, the method comprising:

generating an order according to the second VR home scene;

wherein, the building of the second VR home scene by using the home commodity model comprises at least one of the following operations:

when the household commodity models in the first VR household scene are removed, removing one layer of the household commodity models;

when the position of the household commodity model in the first VR household scene is modified, the space coordinate position of the modified household commodity model is mapped and bound with the VR household scene coordinate system again; when the size, the dimension and the color of the household goods corresponding to the household goods model and the household goods are replaced, removing one layer of the household goods model, and inserting the modified one layer of the household goods model corresponding to the household goods into the current space coordinate position of the household goods model.

2. The method of claim 1, wherein the displaying the first VR home scene comprises:

3. The method of claim 1, wherein the building a second VR home scene using the home merchandise model further comprises:

4. The method of claim 3, wherein the adding, according to the household goods selected by the user, the model corresponding to the household goods in the first VR household scene to construct a second VR household scene includes:

5. The method of claim 3, wherein the adding a model corresponding to the household goods in the first VR household scene according to the household goods selected by the user to construct a second VR household scene comprises:

6. The method of claim 4 or 5, wherein the method further comprises:

the method for constructing the household commodity model library comprises the following steps:

7. The method of claim 6, wherein performing attribute standardization and model standardization operations according to standard attribute information of each household commodity to obtain a plurality of household commodity models comprises:

8. A system for generating an order, the system comprising:

the display module is used for responding to the operation of a user on a shopping website and displaying a first VR home scene;

the generating module is used for generating an order according to the second VR home scene;

the building module is configured to perform at least one of the following operations:

9. The system of claim 8, wherein the build module is configured to perform operations comprising:

10. A terminal device, characterized in that the terminal device comprises: a memory and one or more controllers, wherein the memory stores instructions for the one or more controller calls, and the one or more controllers are configured to call the instructions in the memory to perform:

generating an order according to the second VR home scene;

11. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 7.