WO2019237501A1

WO2019237501A1 - Article display system and method

Info

Publication number: WO2019237501A1
Application number: PCT/CN2018/101070
Authority: WO
Inventors: 李新福
Original assignee: 广东康云多维视觉智能科技有限公司
Priority date: 2018-06-15
Filing date: 2018-08-17
Publication date: 2019-12-19
Also published as: CN108985878A

Abstract

Disclosed is an article display system, mainly comprising a scanning system, a data system and a terminal system. Also disclosed is an article display method, mainly comprising: obtain first three-dimensional data of an article; store and process the first three-dimensional data to form second three-dimensional data; the terminal system displays a virtual three-dimensional graph of the article. The present invention displays the physical article in the terminal after three-dimensional graphics and data processing. The present invention solves the technical problems of fewer types of offline shopping articles and high human cost, and also solves the technical problems that the display of the online shopping articles is not intuitive and the shopping experience is affected. Moreover, the article display system of the present invention also combines an artificial intelligence voice system and a VR system to provide the interactive article explanation and the immersive three-dimensional scene experience.

Description

Article display system and method Ranch

Technical field

The invention relates to the field of image display, and in particular to an article display system and method.

Background technique

With the development of information technology, shopping methods have been diversified. There are traditional offline physical store shopping methods, as well as emerging online e-commerce shopping methods. In today's society, people not only pay more and more attention to the quality of the products they buy, but also pay more and more attention to the shopping experience, that is, the feeling that the entire process of buying a product brings to buyers. No matter which shopping method is inseparable from the product display link. At the same time, the way in which goods are displayed also directly affects the buyer ’s judgment of the quality of the goods, and is more closely related to the shopping experience.

With the improvement of the quality of life, people's requirements for shopping have gradually increased. Offline brick-and-mortar shopping, limited display items in the store, and unable to provide consumers with rich choices as online shopping. At the same time, in the purchase of digital products, automobiles and other products, shopping guides often need to provide product explanations for buyers. However, there are many product models, which will easily increase the burden on shopping guides, and also potentially explain errors and mislead consumers. At the same time, the shopping experience is also very susceptible to the influence of shopping guides. Offline offline store shopping often causes problems caused by unpleasant purchases caused by shopping guides.

New unmanned retail outlets are also emerging in the market. Although unmanned retail stores have saved labor costs, the items they provide are also limited. At the same time, because of unmanned retail, when customers have questions about the purchase of goods, they cannot provide corresponding services. Therefore, the current unmanned retail stores are not suitable for digital products, automobiles and other products.

Online shopping, although it provides a more convenient way for buyers to purchase, but also provides a wealth of item choices. However, the current display of online shopping items is usually in the form of two-dimensional pictures, and buyers cannot make intuitive judgments about the quality of the items they want to buy. When you need to buy valuables such as cars, people often choose offline physical stores to buy because of the limitations of online shopping.

Summary of the Invention

In order to solve the above-mentioned problems, the present invention provides an article display system and method, which can more intuitively and effectively display the articles and improve the shopping experience.

In order to achieve the above object, the present invention provides an article display system including a scanning system for scanning a target article to obtain first three-dimensional data of the article; a data system that receives and stores the first three-dimensional data sent by the scanning system, and The three-dimensional data is processed to form second three-dimensional data; the terminal system receives the second three-dimensional data sent by the data system, and displays a virtual three-dimensional graphic of the item based on the second three-dimensional data.

Further, the scanning system not only scans the three-dimensional data of the outer area of the article, but also the three-dimensional data of the inner area of the article; or scans each part of the article according to the actual situation of the article to generate multiple scan data.

Further, the data system includes a storage module for storing the data received from the scanning system; it may further include a processing module for performing calculation processing, compression processing, or rendering processing on the received data to form the second three-dimensional data; The two-dimensional and three-dimensional data is suitable for displaying various three-dimensional shapes of articles by the terminal system.

In order to further enrich the item display information, the item display system of the present invention may further include an artificial intelligence speech system, which stores the item introduction information in advance. At the same time, it is also equipped with a voice recognition module to enable human-machine communication.

When the displayed item is a car or other items that can be felt indoors by the user (such as indoor architecture, decoration, etc.), the article display system of the present invention may further include a VR (Virtual Reality). The VR system is used to simulate the scene of articles and provide users with the feeling of using articles. For example, when simulating a car scene, the user is provided with the scene experience in the car; when the indoor architectural scene is simulated, the user is provided with the scene experience in the building interior.

The present invention provides an article display method, including the following steps:

Using a scanning device to scan the target item and obtain the first three-dimensional data of the item;

Sending the first three-dimensional data to the data system;

The data system receives and stores the first three-dimensional data and performs arithmetic processing on the first three-dimensional data to form a second three-dimensional data;

Sending the second three-dimensional data to the terminal system;

The terminal system receives the second three-dimensional data and displays a virtual three-dimensional graphic of the item based on the second three-dimensional data.

The present invention provides a computer device including a memory, a processor, and a computer program stored on the memory and capable of running on the processor, wherein the processor implements the following steps when the program is executed:

Scan the item to obtain the first three-dimensional data of the item;

Sending the first three-dimensional data to the data system;

Storing and processing the first three-dimensional data to form a second three-dimensional data;

Sending the second three-dimensional data to the terminal system;

The terminal system displays a virtual three-dimensional graphic of the item.

The present invention provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

Scan the item to obtain the first three-dimensional data of the item;

Sending the first three-dimensional data to the data system;

Sending the second three-dimensional data to the terminal system;

The terminal system displays a virtual three-dimensional graphic of the item.

In the present invention, the physical object is three-dimensionally graphically processed and displayed on a terminal after data processing. Not only can it solve the technical problems of fewer types of offline shopping and high labor costs, but also the technical problems of unintuitive display of online shopping items and affecting the shopping experience. At the same time, the article display system of the present invention also incorporates an artificial intelligence voice system to provide interactive article explanations, solve potential human errors of offline article display, and solve technical problems of inconvenient consultation of online article display. The present invention further uses a VR system to greatly enrich the display information of items and provide a more comprehensive shopping experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an article display system according to the first embodiment of the present invention.

FIG. 2 shows an article display system according to a second embodiment of the present invention.

FIG. 3 shows an article display system according to a third embodiment of the present invention.

FIG. 4 shows an exemplary flowchart of a method for displaying articles according to the present invention.

5 and 6 are schematic diagrams of application scenarios according to a preferred embodiment of the present invention.

Reference signs:

1-scan system; 11-image acquisition module; 2-data system; 21-data storage module; 22-data processing module; 3-terminal system; 31-display module; 32-human-computer interaction module; 33-display conversion module ; 4-voice system; 41-audio storage module; 42-audio playback module; 43-artificial intelligence module; 5-VR system; 51-information receiving module; 52-scene generation module; 53-scene display module; 6-target article.

detailed description

In the following, the concept, specific system, method, and technical effects of the present invention will be clearly and completely described in combination with the embodiments and the drawings to fully understand the objects, features, and effects of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, other embodiments obtained by those skilled in the art without creative efforts belong to The scope of the invention.

It should be noted that, unless otherwise specified, the singular forms "a", "the" and "the" used in the embodiments are also intended to include the plural forms unless the context clearly indicates other meanings. In addition, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one skilled in the art. The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. The term "and / or" as used herein includes any combination of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in the embodiments to describe various systems, data, these systems, data should not be limited to these terms. These terms are only used to distinguish the same type of system and data from each other. For example, without departing from the scope of the embodiment, the first data may also be referred to as the second data, and similarly, the second data may also be referred to as the first data. The use of any and all examples or exemplary languages ("eg," "such as," etc. provided herein is intended merely to better illuminate embodiments of the invention and does not impose a limitation on the scope of the invention unless otherwise required .

Example 1

Referring to FIG. 1, this embodiment provides an article display system, which mainly includes three parts: a scanning system 1, a data system 2, and a terminal system 3.

The scanning system 1 is configured to scan the target article 6 and acquire three-dimensional data of the target article 6. The scanning system 1 includes an image acquisition module 11; the image acquisition module 11 is configured to acquire a scanned image sequence of a target item. Each image sequence is subjected to calculation processing to construct the first three-dimensional data of the target article.

Different items can be scanned in different ways. When it is necessary to display the overall appearance of the article, the scanning system 1 scans the entire external area of the target article to obtain the external scan image sequence of the article; the external scan image sequence is calculated and processed to construct the external three-dimensional data of the article. The above scanning method can be used to realize 360 ° display of articles, and is particularly suitable for articles with ornamental value such as jewelry. When the internal structure of the item needs to be displayed, the scanning system 1 scans the internal area of the target product to obtain the internal scanned image sequence of the item; the internal image sequence is calculated and processed to construct the internal three-dimensional data of the item. By adopting the above method, the internal structure of the product can be displayed intuitively, and it is particularly suitable for the display of items such as automobiles, interior buildings, and decoration. When displaying multiple-part items, such as mechanical devices connected by multiple parts, the scanning system 1 can also scan Local component appearance area, showing specific connected components in three dimensions. The scanning system can scan the item according to the actual situation of the item to generate the actual three-dimensional data required. The scanning system 1 can select various scanning devices with image acquisition functions, including various handheld scanners, drones with aerial scanning functions, and the like. The first three-dimensional data may be composed of multiple groups of three-dimensional data formed by different scanning methods.

The data system 2 includes a data storage module 21 and a data processing module 22. The data system 2 receives the first three-dimensional data from the scanning system 1 and stores it in the data storage module 21. The data processing module 22 may perform compression processing on the first three-dimensional data; it may further be used to generate a rendering identifier based on the rendering parameters of the first three-dimensional data of the item; and then process the rendering data through the rendering identifier pair to form second three-dimensional data. In order to display various three-dimensional shapes of the article, the data processing module 22 can also perform calculation and integration processing on each group of three-dimensional data in the first three-dimensional data, and create various different forms of second three-dimensional data, such as a 360 ° panoramic three-dimensional image, three-dimensional Exploded views, 3D perspectives, and various 3D deformations of variable objects.

The terminal system 3 is configured to receive the second three-dimensional data sent by the data system 2 and display the virtual three-dimensional graphics of the item. The terminal system 3 includes a display module 31, and the display module can reduce or enlarge the virtual three-dimensional graphics of the items in proportion. The terminal system 3 further includes a human-machine interaction module 32 and a display conversion module 33. The human-computer interaction module 32 may be used to recognize user instructions through multiple interaction modes such as body sensation, gesture, touch, or eyeball. For example, the movement trajectory of a human hand in a three-dimensional space is collected to determine a static or dynamic gesture of the human hand, and the collected information is recognized with a pre-stored gesture motion control instruction, thereby realizing human-computer interaction. The display conversion module 33 changes the displayed virtual three-dimensional graphics according to the identified user instruction. Such as switching from the virtual 3D graphics of the overall appearance of the car to the virtual 3D graphics of the car interior; or switching from one architectural scene to another architectural scene, and so on.

The terminal system 3 may be a PC terminal, a mobile phone terminal, a program terminal (such as an app terminal) and the like used online. Compared with the existing online item display method, the present embodiment adopts a virtual three-dimensional display of items instead of the existing two-dimensional (planar) display, which can provide customers with more comprehensive and intuitive item information. The terminal system 3 may also be a smart item display terminal used offline, a Displair terminal, and the like. Compared with the existing offline item display method, this embodiment adopts the form of virtual goods, which provides customers with rich shopping options. Whether used online or offline, the article display system of this embodiment can not only realize the three-dimensional display of the appearance of the article, but also the three-dimensional display of the interior of the article (such as car interior display, interior architecture, decoration display), and can also be Instructions to achieve other different three-dimensional information display, such as three-dimensional display of local parts of items, three-dimensional information display of item explosion, is no longer an indoor scene, exhibition scene switching display, and so on.

Example 2

Referring to FIG. 2, this embodiment provides another article display system, which mainly includes three parts: a scanning system 1, a data system 2, a terminal system 3, and a voice system 4. Embodiment 2 is a further improvement on the basis of Embodiment 1. All the contents described in Embodiment 1 are applicable to this embodiment. Since the contents of the scanning system 1, the data system 2, and the terminal system 3 in this embodiment are the same as those in Embodiment 1, they are not described again here.

The voice system 4 is used in conjunction with the terminal system 3 and can be used to display the introduction of item information, human-machine interactive dialogue, and other processing related to voice and audio data. The speech system 4 may be an artificial intelligence to speech system, and includes an audio storage module 41 and an audio playback module 42. The audio storage module 41 is used to store related audio data such as item introduction and commentary. The audio playing module 42 is used to play the contents of the article introduction and explanation. The audio storage module 41 may store introductory audio information of a corresponding item in advance, and may also store other instructions for speech recognition in advance. The speech system 4 may further include an artificial intelligence module 43. The artificial intelligence module 43 can analyze and recognize the voice issued by the user, and transmit the analyzed instructions to the audio playback module 42 to play and output the corresponding content to realize human-machine voice interaction.

The voice system 4 can also be used in conjunction with the terminal system 3. For example, after the artificial intelligence module 43 analyzes and recognizes the voice issued by the user, it can also transmit the analyzed instructions to the display conversion module 33 of the terminal system 3 to realize the conversion of the virtual three-dimensional graphics. The terminal system 3 can also display a display interface that matches the audio data played by the voice system 4, such as displaying a virtual three-dimensional shopping guide introducer, or subtitles of item information.

The article display system of this embodiment is further configured with a voice system 4, which can not only realize the voice introduction of the article information at the same time as the article display, but also the human-machine voice interaction. At the same time, it can also provide users with virtual shopping guides, which solves the technical problem of labor cost of offline item display and solves the technical problem of inconvenient consultation of online item display.

Example 3

Referring to FIG. 3, this embodiment also provides another article display system, which mainly includes three parts: a scanning system 1, a data system 2, a terminal system 3, and a VR system 5. Embodiment 3 is a further improvement on the basis of Embodiment 1. All the contents described in Embodiment 1 are applicable to this embodiment. Since the contents of the scanning system 1, the data system 2, and the terminal system 3 in this embodiment are the same as those in Embodiment 1, they are not described again here.

The VR system 5 can be used in conjunction with the system 3 to simulate the scene of items and increase the user's experience of using items. The VR system 5 may include an information receiving module 51, a scene generation module 52, and a scene display module 53. The information receiving module 51 may be used to receive target scene information provided by the scanning system 1 or other image acquisition equipment; the scene generation module 52 may construct a VR scene based on the analysis of position information, depth of field information, etc. based on the scene information; the scene display module 53 is Yu Wei is used to display immersive 3D virtual scenes.

The article display system of this embodiment is configured with a VR system, and is particularly suitable for display of other articles that can be experienced by users indoors, such as cars or indoor buildings and exhibition halls. The article display system of this embodiment can not only present the three-dimensional information of the article to the user, but also further construct an immersive three-dimensional virtual scene for the user, simulate the use experience, and further enrich the display information of the article.

The VR system 5 can also be used in conjunction with the terminal system 3 and / or the voice system 4. For example, the VR system 5 may display different three-dimensional virtual scenes according to user instructions provided by the interaction module 32 and / or the artificial intelligence module 43 to provide users with different scene experiences. Those skilled in the art may know that all the contents of Embodiment 2 can be combined with the contents of this embodiment to form a new article display system, that is, the article display system of this embodiment may further include a scanning system 1, a data system 2, and a terminal. System 3, voice system 4 and VR system 5. For details, refer to Embodiments 1 and 2 and the contents described in this embodiment. Those skilled in the art know that the contents of Embodiments 1 and 2 are also applicable to Embodiment 3.

Example 4

Referring to FIG. 4, this embodiment provides an article display method, including:

S1: scan the target item to obtain the first three-dimensional data of the target item;

S2: sending the first three-dimensional data to the data system 2;

S3: The data system 2 receives and stores the first three-dimensional data;

S4: The data system 2 calculates and processes the first three-dimensional data to form a second three-dimensional data;

S5: Send the second three-dimensional data to the terminal system 3.

S6: The terminal system 3 receives the second three-dimensional data;

S7: The terminal system 3 displays the virtual three-dimensional graphics of the article based on the second three-dimensional data.

Scanning the target product further includes scanning the outer area of the article to obtain the external 3D data of the article; and / or scanning the inner area of the article to obtain the internal 3D data;

The data system 1 calculates and processes the first three-dimensional data, and further includes compressing and rendering the first three-dimensional data to form the second three-dimensional data. You can also calculate and integrate the first three-dimensional data according to the actual item display needs to form the required second three-dimensional data, such as panoramic three-dimensional maps, three-dimensional exploded views, three-dimensional perspective views, and various three-dimensional deformation map data of variable objects and many more.

After receiving the second three-dimensional data, the terminal system 3 can display the second three-dimensional data on the terminal system 3, such as the PC terminal, mobile phone terminal, program terminal (such as app terminal), smart item display terminal, and air screen (Displair) terminal. Virtual 3D graphics.

Steps S6 and S7 may further include step S61: storing the audio information of the corresponding item to the speech system 4; the above steps enable the display of the item while outputting the introduction information of the corresponding item.

Steps S61 and S7 may further include step S62: storing the item scene information in the VR system 5; the above steps can implement an item immersive three-dimensional virtual scene.

5 and 6 are schematic diagrams of application scenarios according to a preferred embodiment of the present invention. In this embodiment, the target article may be a complete vehicle.

As shown in FIG. 5, the scanning system 1 can be constructed as a three-dimensional scanning studio. A 3D scanner can be used to scan the entire external area of the car to obtain a sequence of externally scanned images of the car, and then calculate and process the sequence of externally scanned images to construct three-dimensional data outside the car. The scanning system 1 can also finely scan the vehicle surface according to the actual situation of the vehicle, and generate accurate three-dimensional data with better visual effects. After processing by the data system 2, a plurality of sets of data files of the automobile are synthesized, showing details of each configuration information of the automobile.

As shown in FIG. 6, the terminal system 3 may be implemented as a friendly sales display stand. This display stand uses the virtual three-dimensional display of items instead of the existing two-dimensional display, which can provide customers with more comprehensive and intuitive car display information. The terminal system 3 of this embodiment can not only realize the three-dimensional display of the appearance of the article, but also display the car interior, wheel configuration information, vehicle exterior installation configuration information, etc., and can also realize other three-dimensional information display in different details according to user instructions. Such as the explosion of three-dimensional information display of cars. The terminal system 3 shown in FIG. 6 can also cooperate with the voice system 4 and the VR system 5 to provide users with a more comprehensive visual experience.

It should be recognized that embodiments of the present invention may be implemented or implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory. The method can be implemented in a computer program using standard programming techniques, including non-transitory computer-readable storage media configured with a computer program, where the storage media so configured enable the computer to operate in a specific and predefined manner-- Methods and drawings described in the examples. Each program can be implemented in a high-level process or an object-oriented programming language to communicate with a computer system. However, if required, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. In addition, the program can be run on a programmed application specific integrated circuit for this purpose.

Furthermore, the operations of the processes described herein may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes (or variations and / or combinations thereof) described herein may be executed under the control of one or more computer systems configured with executable instructions and may be executed as code (e.g., , Executable instructions, one or more computer programs or one or more applications), implemented by hardware or a combination thereof. The computer program includes a plurality of instructions executable by one or more processors.

Further, the method can be implemented in any type of computing platform operably connected to, including but not limited to a personal computer, minicomputer, mainframe, workstation, network or distributed computing environment, separate or integrated computer Platform, or communicating with a charged particle tool or other imaging device, etc. Aspects of the invention may be implemented in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optical read and / or write storage medium, RAM, ROM, etc., so that it can be read by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein. In addition, the machine-readable code, or portions thereof, may be transmitted over a wired or wireless network. When such media includes instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor, the invention described herein includes these and other different types of non-transitory computer-readable storage media. When programmed according to the methods and techniques of the present invention, the invention also includes the computer itself.

A computer program can be applied to the input data to perform the functions described herein, thereby transforming the input data to generate output data stored in a non-volatile memory. The output information can also be applied to one or more output devices such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on a display.

The above description is only the preferred embodiments of the present invention, and the present invention is not limited to the above embodiments, as long as it achieves the technical effects of the present invention by the same means, what is done within the spirit and principle of the present invention Any modification, equivalent replacement, improvement, etc. should be included in the protection scope of the present invention. Various technical modifications and changes can be made to the technical solutions and / or implementations within the protection scope of the present invention.

Claims

An article display system, comprising:

A scanning system (1) for acquiring first three-dimensional data of an item;

A data system (2) for storing and processing the first three-dimensional data and forming a second three-dimensional data;

A terminal system (3) is configured to receive the second three-dimensional data and display a virtual three-dimensional graphic of the item.
The article display system according to claim 1, characterized in that the scanning system (1) comprises an image acquisition module (11) for acquiring a sequence of scanned images of the article. Ranch
The article display system according to claim 1, wherein the data system (2) comprises a data storage module (21) for storing the first three-dimensional data. Ranch
The article display system according to claim 1, wherein the terminal system (3) comprises a display module (31), and the display module (31) is used to display a virtual three-dimensional graphic of the article. Ranch
The article display system according to claim 1, wherein the article display system further comprises a voice system (4), and the voice system (4) is used for voice recognition and playback. Ranch
The article display system according to claim 1, wherein the article display system further comprises a VR system (5), and the VR system (5) is used to display an immersive three-dimensional virtual scene. Ranch
An article display method, comprising:

Scan the item to obtain the first three-dimensional data of the item;

Sending the first three-dimensional data to the data system (2);

Storing and processing the first three-dimensional data to form a second three-dimensional data;

Sending the second three-dimensional data to the terminal system (3);

The terminal system (3) displays a virtual three-dimensional graphic of the item.
The article display method according to claim 12, further comprising between the step of sending the second three-dimensional data to the terminal system (3) and the terminal system (3) displaying the virtual three-dimensional graphics of the article : Store the audio information of the corresponding item to the voice system (4). Ranch
A computer device includes a memory, a processor, and a computer program stored on the memory and capable of running on the processor, wherein the processor implements the following steps when the program is executed:

Scan the item to obtain the first three-dimensional data of the item;

Sending the first three-dimensional data to the data system (2);

Storing and processing the first three-dimensional data to form a second three-dimensional data;

Sending the second three-dimensional data to the terminal system (3);

The terminal system (3) displays a virtual three-dimensional graphic of the item.
A computer-readable storage medium stores a computer program thereon. When the computer program is executed by a processor, the following steps are implemented:

Scan the item to obtain the first three-dimensional data of the item;

Sending the first three-dimensional data to the data system (2);

Storing and processing the first three-dimensional data to form a second three-dimensional data;

Sending the second three-dimensional data to the terminal system (3);

The terminal system (3) displays a virtual three-dimensional graphic of the item.