CN109085966B - Three-dimensional display system and method based on cloud computing - Google Patents
Three-dimensional display system and method based on cloud computing Download PDFInfo
- Publication number
- CN109085966B CN109085966B CN201810621603.1A CN201810621603A CN109085966B CN 109085966 B CN109085966 B CN 109085966B CN 201810621603 A CN201810621603 A CN 201810621603A CN 109085966 B CN109085966 B CN 109085966B
- Authority
- CN
- China
- Prior art keywords
- dimensional
- displayed
- user
- display
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
Abstract
The invention discloses a cloud computing-based three-dimensional display system and method. The three-dimensional data of the object to be displayed is intelligently processed based on the cloud computing service, the original three-dimensional model and the corresponding link of the object to be displayed are obtained, the rendering and the compression optimization are carried out, then the interactive display is carried out according to the obtained link or the three-dimensional model after the compression optimization of the object to be displayed, the interaction with a user can be carried out, and the interactive experience is good; the cross-platform display can be realized by interactively displaying the three-dimensional model after the linkage or the compression optimization of the object to be displayed, and meanwhile, the multi-screen interaction and the air imaging are supported, so that the functions are richer; the behavior of the user when watching the interactive display content can be analyzed and counted, so that interest points of different viewers are obtained to facilitate utilization of merchants, and the method is more comprehensive. The invention can be widely applied to the technical field of display.
Description
Technical Field
The invention relates to the technical field of display, in particular to a cloud computing-based three-dimensional display system and method.
Background
In a shopping mall, an exhibition or a hall, a display article (such as a commodity, a cultural relic or a specimen) with full contents of linens is generally placed in a display device (such as a show window), and the displayed commodity is introduced and explained by combining a video and/or a text mode and the like. However, this display method has the following disadvantages:
1. only preset and pre-stored videos and/or characters can be played, interaction with a viewer cannot be performed, and interaction experience is poor;
2. the display of the cross-platform can not be realized, multi-screen interaction and air imaging are not supported, and the functions are not rich enough.
3. The behavior and the action (especially eyeball action and facial expression) of different viewers when watching the commodity cannot be analyzed, and the interest points of the different viewers cannot be analyzed so as to be conveniently used by merchants, so that the commodity is not comprehensive enough.
Disclosure of Invention
To solve the above technical problems, the present invention aims to: the cloud computing-based three-dimensional display system and method are good in interaction experience, rich in functions and comprehensive.
The first aspect of the technical scheme of the invention is a three-dimensional display system based on cloud computing, which comprises:
the three-dimensional data acquisition module is used for acquiring three-dimensional data of an object to be displayed;
the three-dimensional cloud model library is used for performing intelligent processing on three-dimensional data of an object to be displayed to obtain an original three-dimensional model of the object to be displayed and a corresponding link, wherein the intelligent processing comprises model repairing, clipping, cutting, surface reduction, model reduction, compression, material processing, mapping processing and lamplight processing;
the rendering and compression optimization module is used for rendering and compression optimizing an original three-dimensional model of the object to be displayed to obtain a three-dimensional model after the object to be displayed is compressed and optimized;
the interactive display module is used for interactively displaying the three-dimensional model after compression optimization of the object to be displayed or the original three-dimensional model of the object to be displayed in at least one of an intelligent display screen, an AR device, a VR device and a browser according to interaction with a user, the intelligent display screen comprises at least one of an air imaging device, a transparent screen, a PC screen, a tablet computer screen and a smart phone screen, and the interaction with the user comprises at least one of somatosensory control, eyeball tracking, gesture control, voice recognition, brain wave control, touch control, picture switching control and face recognition;
and the big data analysis background is used for analyzing and counting the behavior of the user when the user watches the interactive display content.
Further, the three-dimensional data acquisition module includes:
the aerial photography scanner is used for scanning three-dimensional data of a region range and performing local preprocessing;
the indoor scanner is used for scanning the three-dimensional data of the indoor environment and carrying out local preprocessing;
the outdoor scanning module instrument is used for scanning three-dimensional data of an outdoor environment and carrying out local preprocessing;
the object scanner is used for scanning three-dimensional data of an object and performing local preprocessing;
the human body scanner is used for scanning the three-dimensional data of the human body and carrying out local preprocessing;
and the third-party three-dimensional data acquisition module is used for acquiring the three-dimensional data of the object to be displayed from a third party.
Further, the three-dimensional cloud model library comprises:
the access management unit is used for authorizing the corresponding access authority of the user according to the effective login credential of the user;
the intelligent processing unit is used for performing model repair, clipping, cutting, surface reduction, model reduction, compression, material processing, mapping processing and lamplight processing to obtain an original three-dimensional model of an object to be displayed;
the link generation unit is used for generating a corresponding link according to the original three-dimensional model of the object to be displayed;
and the database is used for storing behavior data when the user watches the interactive display content, effective login credentials of the user, the original three-dimensional model of the object to be displayed and the corresponding link.
The display cabinet is characterized by further comprising a display cabinet, wherein the transparent screen is arranged on one surface of the display cabinet, and a display stand for placing an object or a real model of the object is arranged in the display cabinet.
Furthermore, be equipped with body sensor, gesture sensor, eyeball tracker, camera, touch-sensitive screen, pronunciation collection module, brain wave collection system, ultrasonic sensor and infrared sensor on the transparent screen.
Further, still include communication system, communication system includes:
the voice message unit is used for providing voice message service;
the telephone customer service unit is used for providing telephone customer service;
the robot customer service unit is used for providing robot voice customer service;
and the video real person customer service unit is used for providing video real person customer service.
Further, the big data analysis background comprises:
a newly added user counting unit for counting the number of newly added users;
the user remaining counting unit is used for counting the number of the remaining users;
the activity degree analysis unit is used for analyzing the activity degree of the user;
a user information analysis unit for analyzing the gender, age, registration information and IP distribution of the user;
the hotspot analysis unit is used for analyzing the watching hotspots of the users and generating corresponding heatmaps;
the user watching behavior analysis unit is used for analyzing the user watching behavior, and the user watching behavior analysis comprises at least one of eyeball tracking, facial expression analysis, somatosensory motion analysis, mouse browsing track analysis and video recording, gesture analysis and brain wave analysis;
and the information sharing unit is used for sharing and releasing the analysis result of the big data analysis background.
Further, the interactive display module comprises a multi-dimensional visual live-action purchasing module, and the multi-dimensional visual live-action purchasing module specifically comprises:
the three-dimensional scene display unit is used for providing automatic navigation service, scene switching service, three-dimensional live-action service, space roaming service, free-walking service, two-dimensional plane diagram service and three-dimensional house diagram service;
the AI intelligent voice shopping guide service is used for providing multinational voice explanation service, three-dimensional product display service, three-dimensional buyer guide service, AI intelligent voice answer service and three-dimensional robot explanation service.
Further, still include:
the transparent screen remote control module is used for remotely controlling the display content of the transparent screen, and the remote control comprises the making and playing of advertisements, the updating of the display content, the typesetting of the display content and the scheduling of the display content.
The second aspect of the technical scheme of the invention is a three-dimensional display method based on cloud computing, which comprises the following steps:
acquiring three-dimensional data of an object to be displayed;
carrying out intelligent processing on the three-dimensional data of the object to be displayed to obtain an original three-dimensional model of the object to be displayed and a corresponding link, wherein the intelligent processing comprises model repairing, clipping, cutting, face reducing, model reducing, compressing, material processing, map processing and lamplight processing;
rendering and compressing and optimizing an original three-dimensional model of an object to be displayed to obtain a compressed and optimized three-dimensional model of the object to be displayed;
performing interactive display according to the obtained link or the three-dimensional model after compression optimization of the object to be displayed, wherein the interactive display comprises displaying the three-dimensional model after compression optimization of the object to be displayed or the original three-dimensional model of the object to be displayed in at least one of an intelligent display screen, an AR device, a VR device and a browser according to interaction with a user, the intelligent display screen comprises at least one of an air imaging device, a transparent screen, a PC screen, a tablet computer screen and a smart phone screen, and the interaction with the user comprises somatosensory control, eyeball tracking, gesture control, voice recognition, brain wave control, touch control, picture switching control and face recognition;
and analyzing and counting the behaviors of the user when the user watches the interactive display content.
The invention has the beneficial effects that: the invention relates to a cloud computing-based three-dimensional display system and method, which are characterized in that three-dimensional data of an object to be displayed is intelligently processed based on cloud computing service to obtain an original three-dimensional model and a corresponding link of the object to be displayed, and interactive display is carried out according to the obtained link or the three-dimensional model after the object to be displayed is compressed and optimized after rendering and compression optimization, so that interaction with a user can be realized, and the interactive experience is good; the cross-platform display can be realized by interactively displaying the three-dimensional model after the linkage or the compression optimization of the object to be displayed, and meanwhile, the multi-screen interaction and the air imaging are supported, so that the functions are richer; the behavior of the user when watching the interactive display content can be analyzed and counted, so that interest points of different viewers are obtained to facilitate utilization of merchants, and the method is more comprehensive.
Drawings
FIG. 1 is a block diagram of the overall structure of a cloud computing-based three-dimensional display system according to the present invention;
FIG. 2 is a block diagram of a preferred embodiment of the three-dimensional display system of the present invention;
FIG. 3 is a flow chart of a preferred embodiment of the three-dimensional display method of the present invention.
Detailed Description
The conception, the specific structure and the technical effects of the present invention will be clearly and completely described in conjunction with the embodiments and the accompanying drawings to fully understand the objects, the schemes and the effects of the present invention.
It should be noted that, unless otherwise specified, when a feature is referred to as being "fixed" or "connected" to another feature, it may be directly fixed or connected to the other feature or indirectly fixed or connected to the other feature. Furthermore, the descriptions of upper, lower, left, right, etc. used in the present disclosure are only relative to the mutual positional relationship of the constituent parts of the present disclosure in the drawings. As used in this disclosure, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Furthermore, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in the description herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any combination of one or more of the associated listed items.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element of the same type from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of the present disclosure. The use of any and all examples, or exemplary language ("e.g.," such as "or the like") provided herein, is intended merely to better illuminate embodiments of the invention and does not pose a limitation on the scope of the invention unless otherwise claimed.
Referring to fig. 1, the invention relates to a cloud computing-based three-dimensional display system, which comprises:
the three-dimensional data acquisition module 10 is used for acquiring three-dimensional data of an object to be displayed;
the three-dimensional cloud model library 11 is used for performing intelligent processing on three-dimensional data of an object to be displayed to obtain an original three-dimensional model of the object to be displayed and a corresponding link, wherein the intelligent processing comprises model repairing, clipping, cutting, surface reduction, model reduction, compression, material processing, mapping processing and lamplight processing;
the rendering and compression optimization module 12 is configured to render and compress and optimize an original three-dimensional model of an object to be displayed to obtain a compressed and optimized three-dimensional model of the object to be displayed;
the interactive display module 13 is configured to perform interactive display according to the obtained link or the three-dimensional model after compression optimization of the object to be displayed, where the interactive display includes displaying the three-dimensional model after compression optimization of the object to be displayed or an original three-dimensional model of the object to be displayed in at least one of an intelligent display screen, an AR device, a VR device, and a browser according to interaction with a user, the intelligent display screen includes at least one of an air imaging device, a transparent screen, a PC screen, a tablet PC screen, and a smartphone screen, and the interaction with the user includes at least one of somatosensory control, eye tracking, gesture control, voice recognition, brain wave control, touch control, picture switching control, and face recognition;
and the big data analysis background 14 is used for analyzing and counting the behavior of the user when the user watches the interactive display content.
Specifically, the object includes an article (such as a commodity) and an environment (such as an indoor environment of a museum), and the like. The three-dimensional data of the object may be a two-dimensional image, point cloud data of the object, and the like, and may be collected by each manual or automatic scanning device (such as a camera, an aerial unmanned aerial vehicle, an automatic scanning robot, and the like), or may be directly imported through a third-party interface (such as an internet interface and the like).
The invention comprises at least 2 compression processes: the three-dimensional cloud model library 11 at least includes a compression process, and the rendering compression optimization module 12 can generate a three-dimensional model after compression optimization of the object to be displayed through compression.
Wherein, treat that the original three-dimensional model of show object demonstrates on PC screen, panel computer (like IPAD) screen and smart mobile phone screen or browser to through carrying out mutual demonstration of realization with the user, the user only need through corresponding link (like URL link) visit can, saved the process of loading APP, efficiency is higher and more convenient. And the transparent screen displays the three-dimensional model after the object to be displayed is compressed and optimized through interaction with a user. In addition, the method also supports the display of the three-dimensional model after the compression optimization of the object to be displayed in an air imaging mode (namely, through an air imaging device), so that the functions are richer, and the visual effect is more shocking.
Preferably, the three-dimensional model of the object is a virtual model, so that a user can browse or watch the object in 360 degrees without dead angles, and the model can be amplified, reduced, changed in color and switched visually through interaction between the intelligent display screen, the AR device, the VR device and the browser and the user, so that personalized requirements of different viewers are met. The invention supports different intelligent terminals and devices such as AR equipment, VR equipment, PC computer screen, tablet computer (such as IPAD) screen, smart phone screen, air imaging device, transparent screen and the like to access and display the three-dimensional model, and has more abundant functions.
Referring to fig. 2, further as a preferred embodiment, the three-dimensional data acquisition module includes:
the aerial photography scanner 101 is used for scanning three-dimensional data of an area range (such as a certain city) and performing local preprocessing;
an indoor scanner 102 for scanning three-dimensional data of an indoor environment (such as the interior of a museum) and performing local preprocessing;
an outdoor scanning module 103 for scanning three-dimensional data of an outdoor environment (such as an outdoor exhibition) and performing local preprocessing;
an object scanner 104 for scanning three-dimensional data of an object (e.g., a sneaker, a pen, etc.) and performing local preprocessing;
a human body scanner 105 for scanning three-dimensional data of a human body and performing local preprocessing;
a third-party three-dimensional data obtaining module 106, configured to obtain three-dimensional data of the object to be displayed from a third party (e.g., a scan model provider).
Specifically, the aerial scanner 101 may employ a drone with a camera or other aerial scanning device, which can acquire scanning data of a specific area (e.g., a city) by means of aerial scanning.
The indoor scanner 102 may be a hand-held scanning device (e.g., a camera with a support) or other automatic scanning device (e.g., an automatic scanning robot).
The outdoor scanner 103 may be a handheld scanning device (e.g., a camera with a support) or other automatic scanning device (e.g., an automatic scanning robot).
The object scanner 104 may be a handheld scanning device (e.g., an RGB-D camera with a support stand, etc.).
The body scanner 105 may be an existing body scanner specifically for human body modeling.
All integrated with the GPU chip in aerial photography scanner 101, indoor scanner 102, outdoor scanning model appearance 103, object scanner 104 and the human scanner 105, can carry out preliminary processing (if carry out preliminary concatenation etc. with the two-dimensional picture according to depth information with data such as the two-dimensional picture of gathering in the local, alleviateed the processing burden in high in the clouds.
Referring to fig. 2, further as a preferred embodiment, the three-dimensional cloud model library 11 includes:
the access management unit 111 is used for authorizing the corresponding access authority of the user according to the valid login credential of the user;
the intelligent processing unit 112 is used for performing model repair, clipping, cutting, surface reduction, mold reduction, compression, material processing, mapping processing and lamplight processing to obtain an original three-dimensional model of an object to be displayed;
the link generation unit 113 is used for generating a corresponding link according to the original three-dimensional model of the object to be displayed;
and the database 114 is used for storing behavior data when the user watches the interactive display content, effective login credentials of the user, an original three-dimensional model of the object to be displayed and a corresponding link.
Specifically, the effective login credentials of the user can be obtained by matching with a camera to perform face recognition. The user may also register by entering one or more personal details (e.g., name, age, location, gender, etc.) on the smart processing unit 112. The user may be any user that possesses valid login credentials that may be obtained by paying for the corresponding rights.
The intelligent processing unit 112 integrates an AI algorithm, can automatically perform model restoration, clipping, face reduction, model reduction, compression, material processing, charting processing, lighting processing and the like on the three-dimensional data of the object to be displayed, and has high intelligent degree.
The intelligent processing unit 112 may be an application provided on a computing device. Preferably, the computing device may be, but is not limited to, a smartphone, tablet, laptop, smart watch, smart television, computer, or the like.
Further as a preferred embodiment, the display cabinet further comprises a display cabinet, wherein the transparent screen is installed on one surface of the display cabinet, and a display stand for placing an object or a real model of the object is arranged in the display cabinet.
Preferably, the display case is composed of a plurality of planes and/or curved surfaces, and in some embodiments, the display case may be a rectangular parallelepiped, composed of six planes. In other embodiments, the display case may be a variation of a rectangular parallelepiped, for example, in which one face is formed by a curved surface. Alternatively, the display case may be in the shape of other polyhedrons. In some embodiments, the space enclosed by the plurality of surfaces of the display case may be a closed space, or may be an open space, such as a rectangular parallelepiped with an open top. The exhibition stand for placing articles or real models of the articles is arranged in the exhibition cabinet.
The transparent screen is arranged on one surface of the display cabinet, and the transparent screen can be a transparent liquid crystal touch screen and the like. The transparent screen may be a flat screen or a curved screen. In some embodiments, the transparent screen can also be used to display two-dimensional images or text. In some embodiments, the display case has multiple sides that are transparent screens that display a three-dimensional model of the item in different orientations. In other embodiments, the partially transparent screen may display information other than three-dimensional models, such as two-dimensional images, text descriptions, product LOGO, and the like. In addition, the transparent screen can also provide corresponding software buttons on the display interface for the user to select, such as a two-dimensional code payment button, a color switching button, a visual angle switching button and the like.
Referring to fig. 2, as a further preferred embodiment, a motion sensing sensor 131, a gesture sensor 132, an eyeball tracker 133, a camera 134, a touch screen 135, a voice acquisition module 136, a brain wave acquisition device 137, an ultrasonic sensor 138, and an infrared sensor 139 are disposed on the transparent screen 13.
Specifically, the motion sensing sensor 131 is configured to capture a motion sensing signal of the user (e.g., a limb motion signal of the user during the simulated driving of the automobile).
The gesture sensor 132 is configured to capture a gesture signal of the user (e.g., a signal indicating that the user grips a certain commodity with the thumb of the palm to switch the viewing angle).
An eye tracker 133 for capturing eye movements of the user. The eye tracking aims are 2: 1, switching display contents automatically according to the attention point of an eyeball, for example, if the eyeball of a user stays or stares at one of a plurality of three-dimensional display models for a plurality of seconds, the transparent screen can be automatically switched to a scene of the three-dimensional model for further detail display; 2. and monitoring the eyeball action of the user in real time.
A camera 134 for capturing images of the user. Preferably, the camera may adopt an RGB-D camera capable of simultaneously acquiring two-dimensional face image information and depth information to obtain a more accurate user image.
And a touch screen 135 for a user to input a touch instruction by touch. Preferably, the touch screen can be attached to the transparent screen or integrated with the transparent screen.
And the voice acquisition module 136 is used for acquiring a voice signal of the user. Taking the display as an automobile shopping guide display as an example, the voice signal of the user may be a voice instruction signal of the user such as "open a vehicle door", "open an air conditioner in the vehicle", "change the color of the vehicle body to black", and the like. Preferably, the voice acquisition module can be a sound pickup, a microphone and other voice acquisition devices.
And the brain wave acquisition device 137 is used for acquiring brain wave signals of the user so as to identify the idea or thought of the user, and accordingly, the three-dimensional model of the object displayed on the transparent screen is subjected to corresponding operations, such as color switching, visual switching and the like.
The ultrasonic sensor 138 is used for sensing whether a person approaches the display screen or not through ultrasonic waves, so that when the person approaches the display screen, the standby screen is switched to a three-dimensional model real-time display screen (namely, the transparent screen is called out), and the intelligent degree is higher.
And the infrared sensor 139 is used for sensing whether a person approaches the display screen through infrared rays, so that when the person approaches the display screen, the standby screen is switched to a three-dimensional model real-time display screen (namely, the transparent screen is called out), and the intelligent degree is higher.
Referring to fig. 2, further as a preferred embodiment, the method further includes a communication system 15, where the communication system 15 includes:
a voice message unit 151 for providing a voice message service;
a telephone customer service unit 152 for providing a telephone customer service;
a robot customer service unit 153 for providing a robot voice customer service;
and a video real person customer service unit 154 for providing video real person customer service.
The invention not only provides traditional voice message and telephone customer service, but also provides robot voice customer service (model pre-trained by self-learning mode) and video real person customer service (model obtained by scanning and modeling real person, and can be customized), and the mode is more flexible.
Referring to fig. 2, further as a preferred embodiment, the big data analysis background 14 includes:
a newly added user counting unit 141 for counting the number of newly added users;
a user remaining counting unit 142 for counting the number of remaining users;
an activity analysis unit 143 for analyzing the activity of the user;
a user information analyzing unit 144 for analyzing the gender, age, registration information, and IP distribution of the user;
the hotspot analysis unit 145 is configured to analyze the viewing hotspots of the users and generate corresponding heatmaps;
a user watching behavior analysis unit 146, configured to perform user watching behavior analysis, where the user watching behavior analysis includes at least one of eyeball tracking, facial expression analysis, somatosensory motion analysis, mouse browsing trajectory analysis and video recording, gesture analysis, and brain wave analysis;
and the information sharing unit 147 is used for sharing and publishing the analysis result of the big data analysis background.
Specifically, tracking the eyeball motion of the viewer mainly identifies the focus focused by the viewer (when the focused part is seen, the eyeball of the user is different from the condition that the focused part is not seen, such as the time for which the eyeball stays), so that the transparent screen directly switches the three-dimensional model of the object to the focus or the detail focused by the viewer (if the user is identified to focus on the body of the automobile, the three-dimensional model of the body is directly switched).
The facial expression recognition of the user is mainly used for recognizing the current mood (such as happiness, disincentiveness and the like) of the viewer.
The information sharing unit 147 may share and publish the result of the big data analysis to the existing general social media, such as WeChat, microblog, blog, and the like.
Referring to fig. 2, further as a preferred embodiment, the method further includes:
and the transparent screen remote control module 16 is used for remotely controlling the display content of the transparent screen, wherein the remote control comprises the making and playing of advertisements, the updating of the display content, the typesetting of the display content and the scheduling of the display content.
The invention is also additionally provided with a transparent screen remote control module 16 which can remotely control the display content of the transparent screen, meet the personalized customization requirements of different users, remotely operate the transparent screen at any time and any place, realize the cross-space sharing of data and is more convenient.
Referring to fig. 2, as a further preferred embodiment, the interactive display module includes a multidimensional visual live-action purchasing module 17, where the multidimensional visual live-action purchasing module 17 specifically includes:
a three-dimensional scene display unit 171 for providing an automatic navigation service, a scene switching service, a three-dimensional live-action service, a spatial roaming service, a free-travel service, a two-dimensional plan view service, and a three-dimensional house view service;
the AI intelligent voice shopping guide service 172 is used for providing a multinational voice commentary service, a three-dimensional product display service, a three-dimensional shopping guide (obtained after scanning a real person and customized), an AI intelligent voice answering service and a three-dimensional robot commentary (pre-trained model) service.
Referring to fig. 3, taking an interactive display module as a transparent screen as an example, by applying the system of fig. 2, the embodiment of the three-dimensional display method based on cloud computing includes the following steps:
s1, acquiring three-dimensional data of the object to be displayed through a three-dimensional data acquisition module;
s2, the three-dimensional cloud model library 11 carries out intelligent processing on the three-dimensional data of the object to be displayed to obtain an original three-dimensional model of the object to be displayed and a corresponding link, wherein the intelligent processing comprises model repairing, clipping, cutting, face reduction, model reduction, compression, material processing, mapping processing and lamplight processing;
s3, rendering and compressing the original three-dimensional model of the object to be displayed by the rendering and compressing optimization module 12 to obtain a compressed and optimized three-dimensional model of the object to be displayed;
s4, interacting the transparent screen 13 with a user, and interactively displaying the three-dimensional model after object compression and optimization according to the interaction result; the specific display content of the transparent screen 13 can also be controlled by the transparent screen remote control module 16;
s5, the big data analysis background 14 analyzes and counts the behavior of the user when watching the interactive display content;
s6, the three-dimensional cloud model library 11 sends the link corresponding to the original three-dimensional model of the object to be displayed to the intelligent display screen or the AR/VR equipment, so that the user can access the original three-dimensional model of the object to be displayed in a link opening mode.
It should be recognized that embodiments of the present invention can be realized and implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer readable memory. The methods may be implemented in a computer program using standard programming techniques, including a non-transitory computer-readable storage medium configured with the computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner, according to the methods and figures described in the detailed description. Each program may be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
Further, the operations of processes described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes described herein (or variations and/or combinations thereof) may be performed under the control of one or more computer systems configured with executable instructions, and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) collectively executed on one or more processors, by hardware, or combinations thereof. The computer program includes a plurality of instructions executable by one or more processors.
Further, the method may be implemented in any type of computing platform operatively connected to a suitable interface, including but not limited to a personal computer, mini computer, mainframe, workstation, networked or distributed computing environment, separate or integrated computer platform, or in communication with a charged particle tool or other imaging device, and the like. Aspects of the invention may be embodied in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, optically read and/or write storage medium, RAM, ROM, or the like, such that it may be read by a programmable computer, which when read by the storage medium or device, is operative to configure and operate the computer to perform the procedures described herein. Further, the machine-readable code, or portions thereof, may be transmitted over a wired or wireless network. The invention described herein includes these and other different types of non-transitory computer-readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The invention also includes the computer itself when programmed according to the methods and techniques described herein.
A computer program can be applied to input data to perform the functions described herein to transform the input data to generate output data that is stored to non-volatile memory. The output information may also be applied to one or more output devices, such as a display. In a preferred embodiment of the invention, the transformed data represents physical and tangible objects, including particular visual depictions of physical and tangible objects produced on a display.
The above description is only a preferred embodiment of the present invention, and the present invention is not limited to the above embodiment, and any modifications, equivalent substitutions, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention as long as the technical effects of the present invention are achieved by the same means. The invention is capable of other modifications and variations in its technical solution and/or its implementation, within the scope of protection of the invention.
Claims (10)
1. A three-dimensional display system based on cloud computing is characterized in that: the method comprises the following steps:
the three-dimensional data acquisition module is used for acquiring three-dimensional data of an object to be displayed;
the three-dimensional cloud model library is used for performing intelligent processing on three-dimensional data of an object to be displayed to obtain an original three-dimensional model of the object to be displayed and a corresponding link, wherein the intelligent processing comprises model repairing, clipping, cutting, surface reduction, model reduction, compression, material processing, mapping processing and lamplight processing;
the rendering and compression optimization module is used for rendering and compression optimizing an original three-dimensional model of the object to be displayed to obtain a three-dimensional model after the object to be displayed is compressed and optimized;
the interactive display module is used for interactively displaying the three-dimensional model after compression optimization of the object to be displayed or the original three-dimensional model of the object to be displayed in at least one of an intelligent display screen, an AR device, a VR device and a browser according to interaction with a user, the intelligent display screen comprises at least one of an air imaging device, a transparent screen, a PC screen, a tablet computer screen and a smart phone screen, and the interaction with the user comprises at least one of somatosensory control, eyeball tracking, gesture control, voice recognition, brain wave control, touch control, picture switching control and face recognition;
and the big data analysis background is used for analyzing and counting the behavior of the user when the user watches the interactive display content.
2. The cloud-computing-based three-dimensional display system of claim 1, wherein: the three-dimensional data acquisition module comprises:
the aerial photography scanner is used for scanning three-dimensional data of a region range and performing local preprocessing;
the indoor scanner is used for scanning the three-dimensional data of the indoor environment and carrying out local preprocessing;
the outdoor scanning module instrument is used for scanning three-dimensional data of an outdoor environment and carrying out local preprocessing;
the object scanner is used for scanning three-dimensional data of an object and performing local preprocessing;
the human body scanner is used for scanning the three-dimensional data of the human body and carrying out local preprocessing;
and the third-party three-dimensional data acquisition module is used for acquiring the three-dimensional data of the object to be displayed from a third party.
3. The cloud-computing-based three-dimensional display system of claim 1, wherein: the three-dimensional cloud model library comprises:
the access management unit is used for authorizing the corresponding access authority of the user according to the effective login credential of the user;
the intelligent processing unit is used for performing model repair, clipping, cutting, surface reduction, model reduction, compression, material processing, mapping processing and lamplight processing to obtain an original three-dimensional model of an object to be displayed;
the link generation unit is used for generating a corresponding link according to the original three-dimensional model of the object to be displayed;
and the database is used for storing behavior data when the user watches the interactive display content, effective login credentials of the user, the original three-dimensional model of the object to be displayed and the corresponding link.
4. The cloud-computing-based three-dimensional display system of claim 1, wherein: the transparent screen is arranged on one surface of the display cabinet, and a display stand for placing an object or a real model of the object is arranged in the display cabinet.
5. The cloud-computing-based three-dimensional display system of claim 1, wherein: and the transparent screen is provided with a body feeling sensor, a gesture sensor, an eyeball tracker, a camera, a touch screen, a voice acquisition module, a brain wave acquisition device, an ultrasonic sensor and an infrared sensor.
6. The cloud-computing-based three-dimensional display system of claim 1, wherein: still include communication system, communication system includes:
the voice message unit is used for providing voice message service;
the telephone customer service unit is used for providing telephone customer service;
the robot customer service unit is used for providing robot voice customer service;
and the video real person customer service unit is used for providing video real person customer service.
7. The cloud-computing-based three-dimensional display system of claim 5, wherein: the big data analysis background comprises:
a newly added user counting unit for counting the number of newly added users;
the user remaining counting unit is used for counting the number of the remaining users;
the activity degree analysis unit is used for analyzing the activity degree of the user;
a user information analysis unit for analyzing the gender, age, registration information and IP distribution of the user;
the hotspot analysis unit is used for analyzing the watching hotspots of the users and generating corresponding heatmaps;
the user watching behavior analysis unit is used for analyzing the user watching behavior, and the user watching behavior analysis comprises at least one of eyeball tracking, facial expression analysis, somatosensory motion analysis, mouse browsing track analysis and video recording, gesture analysis and brain wave analysis;
and the information sharing unit is used for sharing and releasing the analysis result of the big data analysis background.
8. The cloud-computing-based three-dimensional display system of claim 1, wherein: the interactive display module comprises a multidimensional visual live-action purchasing module, and the multidimensional visual live-action purchasing module specifically comprises:
the three-dimensional scene display unit is used for providing automatic navigation service, scene switching service, three-dimensional live-action service, space roaming service, free-walking service, two-dimensional plane diagram service and three-dimensional house diagram service;
the AI intelligent voice shopping guide service is used for providing multinational voice explanation service, three-dimensional product display service, three-dimensional buyer guide service, AI intelligent voice answer service and three-dimensional robot explanation service.
9. The cloud-computing-based three-dimensional display system of claim 1, wherein: further comprising:
the transparent screen remote control module is used for remotely controlling the display content of the transparent screen, and the remote control comprises the making and playing of advertisements, the updating of the display content, the typesetting of the display content and the scheduling of the display content.
10. A three-dimensional display method based on cloud computing is characterized in that: the method comprises the following steps:
acquiring three-dimensional data of an object to be displayed;
carrying out intelligent processing on the three-dimensional data of the object to be displayed to obtain an original three-dimensional model of the object to be displayed and a corresponding link, wherein the intelligent processing comprises model repairing, clipping, cutting, face reducing, model reducing, compressing, material processing, map processing and lamplight processing;
rendering and compressing and optimizing an original three-dimensional model of an object to be displayed to obtain a compressed and optimized three-dimensional model of the object to be displayed;
performing interactive display according to the obtained link or the three-dimensional model after compression optimization of the object to be displayed, wherein the interactive display comprises displaying the three-dimensional model after compression optimization of the object to be displayed or the original three-dimensional model of the object to be displayed in at least one of an intelligent display screen, an AR device, a VR device and a browser according to interaction with a user, the intelligent display screen comprises at least one of an air imaging device, a transparent screen, a PC screen, a tablet computer screen and a smart phone screen, and the interaction with the user comprises somatosensory control, eyeball tracking, gesture control, voice recognition, brain wave control, touch control, picture switching control and face recognition;
and analyzing and counting the behaviors of the user when the user watches the interactive display content.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810621603.1A CN109085966B (en) | 2018-06-15 | 2018-06-15 | Three-dimensional display system and method based on cloud computing |
| PCT/CN2018/101069 WO2019237500A1 (en) | 2018-06-15 | 2018-08-17 | Three-dimensional display system and method based on cloud computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810621603.1A CN109085966B (en) | 2018-06-15 | 2018-06-15 | Three-dimensional display system and method based on cloud computing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109085966A CN109085966A (en) | 2018-12-25 |
| CN109085966B true CN109085966B (en) | 2020-09-08 |
Family
ID=64839692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810621603.1A Active CN109085966B (en) | 2018-06-15 | 2018-06-15 | Three-dimensional display system and method based on cloud computing |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109085966B (en) |
| WO (1) | WO2019237500A1 (en) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109085966B (en) * | 2018-06-15 | 2020-09-08 | 广东康云多维视觉智能科技有限公司 | Three-dimensional display system and method based on cloud computing |
| CN109815559A (en) * | 2019-01-05 | 2019-05-28 | 上海红星美凯龙设计云信息科技有限公司 | A kind of intelligence house ornamentation model automated processing system |
| CN109949121A (en) * | 2019-01-21 | 2019-06-28 | 广东康云科技有限公司 | A kind of intelligence sees the data processing method and system of vehicle |
| CN109702747A (en) * | 2019-01-21 | 2019-05-03 | 广东康云科技有限公司 | A kind of robot dog system and its implementation |
| CN109918005A (en) * | 2019-01-21 | 2019-06-21 | 广东康云科技有限公司 | A kind of displaying control system and method based on mobile terminal |
| CN109905664A (en) * | 2019-01-23 | 2019-06-18 | 广东康云科技有限公司 | Outdoor scene 3D intelligent visual surveillance system and method |
| CN109947239A (en) * | 2019-01-23 | 2019-06-28 | 广东康云科技有限公司 | A kind of air imaging system and its implementation |
| CN109889777A (en) * | 2019-01-23 | 2019-06-14 | 广东康云科技有限公司 | The switching methods of exhibiting and system of 3D outdoor scene vision monitoring |
| CN109917918A (en) * | 2019-03-07 | 2019-06-21 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment based on augmented reality |
| CN110225296A (en) * | 2019-04-15 | 2019-09-10 | 广东康云科技有限公司 | Garden three-dimensional live intelligent control method, system and device |
| CN110223297A (en) * | 2019-04-16 | 2019-09-10 | 广东康云科技有限公司 | Segmentation and recognition methods, system and storage medium based on scanning point cloud data |
| CN110232731A (en) * | 2019-04-16 | 2019-09-13 | 广东康云科技有限公司 | A kind of smart city system and its implementation |
| CN110956688A (en) * | 2019-04-17 | 2020-04-03 | 古流浪 | Three-dimensional free display interaction method for commodities |
| CN110213534A (en) * | 2019-05-14 | 2019-09-06 | 广东康云科技有限公司 | A kind of 3D outdoor scene inspection method, system and storage medium based on substation |
| CN110335300A (en) * | 2019-05-14 | 2019-10-15 | 广东康云科技有限公司 | Scene dynamics analogy method, system and storage medium based on video fusion |
| CN110310306A (en) * | 2019-05-14 | 2019-10-08 | 广东康云科技有限公司 | Method for tracking target, system and medium based on outdoor scene modeling and intelligent recognition |
| CN110308887A (en) * | 2019-05-14 | 2019-10-08 | 广东康云科技有限公司 | AI robot implementation method, system and storage medium based on browser |
| CN110312121A (en) * | 2019-05-14 | 2019-10-08 | 广东康云科技有限公司 | A kind of 3D intellectual education monitoring method, system and storage medium |
| CN110309470A (en) * | 2019-05-14 | 2019-10-08 | 广东康云科技有限公司 | A kind of virtual news main broadcaster system and its implementation based on air imaging |
| CN110288703A (en) * | 2019-06-28 | 2019-09-27 | 斑马网络技术有限公司 | Image processing method, device, equipment and storage medium |
| CN112835304B (en) * | 2019-11-25 | 2023-06-27 | 京东方科技集团股份有限公司 | Exhibition hall control method and system, control terminal, background server and central control host |
| CN111930231B (en) * | 2020-07-27 | 2022-02-25 | 歌尔光学科技有限公司 | Interaction control method, terminal device and storage medium |
| CN112417398B (en) * | 2020-11-17 | 2021-12-14 | 广州技象科技有限公司 | Internet of things exhibition hall navigation method and device based on user permission |
| CN112951088A (en) * | 2021-02-06 | 2021-06-11 | 四川省农业科学院农业信息与农村经济研究所 | Intelligent interaction terminal for scientific and technological achievement display |
| CN113160394A (en) * | 2021-05-17 | 2021-07-23 | 广西科技大学 | Digital intelligent indoor design display system |
| IT202100015050A1 (en) * | 2021-06-09 | 2022-12-09 | Texi S R L | INTELLIGENT INTERACTIVE DISPLAY |
| CN113572845A (en) * | 2021-07-28 | 2021-10-29 | 江苏龙冠影视文化科技有限公司 | Interactive three-dimensional display cloud platform |
| CN114419231B (en) * | 2022-03-14 | 2022-07-19 | 幂元科技有限公司 | Traffic facility vector identification, extraction and analysis system based on point cloud data and AI technology |
| CN114895819B (en) * | 2022-07-13 | 2022-09-13 | 麒砺创新技术(深圳)有限公司 | Three-dimensional model intelligent display optimization method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103077239A (en) * | 2013-01-10 | 2013-05-01 | 上海电力学院 | IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering |
| CN105263050A (en) * | 2015-11-04 | 2016-01-20 | 山东大学 | Mobile terminal real-time rendering system and method based on cloud platform |
| CN105353582A (en) * | 2015-12-01 | 2016-02-24 | 浙江优创信息技术有限公司 | Holographic projection display system and operation method based on the same |
| CN107507274A (en) * | 2017-08-30 | 2017-12-22 | 北京图航科技有限公司 | A kind of quick restoring method of public security criminal-scene three-dimensional live based on cloud computing |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8427473B2 (en) * | 2008-09-28 | 2013-04-23 | Rdv Systems Ltd. | Pseudo-realistic rendering of BIM data responsive to positional indicator |
| CN102789348A (en) * | 2011-05-18 | 2012-11-21 | 北京东方艾迪普科技发展有限公司 | Interactive three dimensional graphic video visualization system |
| US20130278600A1 (en) * | 2012-04-18 | 2013-10-24 | Per Bloksgaard Christensen | Rendering interactive photorealistic 3d model representations |
| CN106991590A (en) * | 2017-03-17 | 2017-07-28 | 北京杰出东方文化传媒有限公司 | A kind of VR sales of automobile system |
| CN109085966B (en) * | 2018-06-15 | 2020-09-08 | 广东康云多维视觉智能科技有限公司 | Three-dimensional display system and method based on cloud computing |
-
2018
- 2018-06-15 CN CN201810621603.1A patent/CN109085966B/en active Active
- 2018-08-17 WO PCT/CN2018/101069 patent/WO2019237500A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103077239A (en) * | 2013-01-10 | 2013-05-01 | 上海电力学院 | IFrame embedded Web3D (Web three-dimensional) system based on cloud rendering |
| CN105263050A (en) * | 2015-11-04 | 2016-01-20 | 山东大学 | Mobile terminal real-time rendering system and method based on cloud platform |
| CN105353582A (en) * | 2015-12-01 | 2016-02-24 | 浙江优创信息技术有限公司 | Holographic projection display system and operation method based on the same |
| CN107507274A (en) * | 2017-08-30 | 2017-12-22 | 北京图航科技有限公司 | A kind of quick restoring method of public security criminal-scene three-dimensional live based on cloud computing |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019237500A1 (en) | 2019-12-19 |
| CN109085966A (en) | 2018-12-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109085966B (en) | Three-dimensional display system and method based on cloud computing | |
| CN112771472B (en) | System and method for providing real-time product interactive assistance | |
| US10474336B2 (en) | Providing a user experience with virtual reality content and user-selected, real world objects | |
| US9658695B2 (en) | Systems and methods for alternative control of touch-based devices | |
| WO2020151255A1 (en) | Display control system and method based on mobile terminal | |
| CN110716645A (en) | Augmented reality data presentation method and device, electronic equipment and storage medium | |
| US20150185825A1 (en) | Assigning a virtual user interface to a physical object | |
| US20150187108A1 (en) | Augmented reality content adapted to changes in real world space geometry | |
| CN111541907B (en) | Article display method, apparatus, device and storage medium | |
| US20150187137A1 (en) | Physical object discovery | |
| CN108594999B (en) | Control method and device for panoramic image display system | |
| CN106462242A (en) | User interface control using gaze tracking | |
| US20200226383A1 (en) | Environment-based application presentation | |
| CN108573403A (en) | A kind of multidimensional vision purchase guiding system and method | |
| CN109582122A (en) | Augmented reality information providing method, device and electronic equipment | |
| CN111860252A (en) | Image processing method, apparatus and storage medium | |
| CN112990043A (en) | Service interaction method and device, electronic equipment and storage medium | |
| WO2020151430A1 (en) | Air imaging system and implementation method therefor | |
| CN108401173A (en) | Interactive terminal, method and the computer readable storage medium of mobile live streaming | |
| CN111901518B (en) | Display method and device and electronic equipment | |
| CN114063784A (en) | Simulated virtual XR BOX somatosensory interaction system and method | |
| CN112509152A (en) | Car watching method, system, equipment and readable medium based on AR technology | |
| CN114327083A (en) | House property, object display method and device, readable storage medium and electronic equipment | |
| CN113723168A (en) | Artificial intelligence-based subject identification method, related device and storage medium | |
| Bhowmik | Natural and intuitive user interfaces with perceptual computing technologies |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20220704 Granted publication date: 20200908 |
|
| PP01 | Preservation of patent right |