WO2020151255A1 - Display control system and method based on mobile terminal - Google Patents

Display control system and method based on mobile terminal Download PDF

Info

Publication number
WO2020151255A1
WO2020151255A1 PCT/CN2019/109473 CN2019109473W WO2020151255A1 WO 2020151255 A1 WO2020151255 A1 WO 2020151255A1 CN 2019109473 W CN2019109473 W CN 2019109473W WO 2020151255 A1 WO2020151255 A1 WO 2020151255A1
Authority
WO
WIPO (PCT)
Prior art keywords
displayed
display
dimensional
model
mobile terminal
Prior art date
Application number
PCT/CN2019/109473
Other languages
French (fr)
Chinese (zh)
Inventor
李新福
Original Assignee
广东康云科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东康云科技有限公司 filed Critical 广东康云科技有限公司
Publication of WO2020151255A1 publication Critical patent/WO2020151255A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the invention relates to the field of control technology, in particular to a display control system and method based on a mobile terminal.
  • the purpose of the present invention is to provide a display control method and system based on a mobile terminal and a display control system based on a mobile terminal.
  • the first aspect of the technical solution of the present invention is a display control system based on a mobile terminal, including:
  • the 3D data acquisition module is used to acquire 3D data of the object to be displayed
  • the three-dimensional data processing module is used to process the acquired three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
  • the rendering compression optimization unit is used to perform rendering and compression optimization on the original 3D model of the object to be displayed to obtain the optimized 3D model of the object to be displayed;
  • the interactive display module is used to compress the optimized 3D model according to the obtained link or the object to be displayed Interactive display of the model;
  • the mobile terminal is used to obtain the obtained link or the compressed and optimized three-dimensional model of the object to be displayed, and generate a display control signal;
  • the display module is used to display according to the display control signal.
  • the three-dimensional data acquisition module includes:
  • Aerial photography scanner used to scan the three-dimensional data of the area and perform local preprocessing
  • Indoor scanner used to scan 3D data of indoor environment and perform local preprocessing
  • Outdoor scanning module used to scan 3D data of outdoor environment and perform local preprocessing
  • Object scanner used to scan the three-dimensional data of the object and perform local preprocessing
  • Human body scanner used to scan the three-dimensional data of the human body and perform local preprocessing
  • the third-party 3D data acquisition module is used to acquire the 3D data of the object to be displayed from the third party.
  • the 3D data processing module includes a 3D cloud model library and a rendering compression optimization unit,
  • the 3D cloud model library is used to intelligently process the 3D data of the object to be displayed to obtain the original 3D model of the object to be displayed and the corresponding link.
  • the intelligent processing includes model repair, editing, cropping, surface reduction, and model reduction , Compression, material processing, texture processing, denoising, coloring and light processing.
  • the three-dimensional cloud model library includes:
  • the access management unit is used to authorize the user with corresponding access rights according to the user's valid login credentials
  • Intelligent processing unit used for model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, denoising, coloring and light processing, to obtain the original 3D model of the object to be displayed;
  • the link generating unit is used to generate the corresponding link according to the original three-dimensional model of the object to be displayed;
  • the database is used to store the user's behavior data when viewing interactive display content, the user's valid login credentials, the original three-dimensional model of the object to be displayed, and the corresponding link.
  • the interactive display module is specifically configured to display the compressed and optimized three-dimensional model of the object to be displayed or the original three-dimensional model of the object to be displayed in the first smart display screen according to the interaction with the user.
  • the mobile terminal includes at least one of a mobile phone, an IPAD, a notebook, and a smart watch.
  • the mobile terminal includes:
  • the first communication unit is configured to receive the obtained link or the compressed and optimized three-dimensional model of the object to be displayed;
  • the display unit is used to display the obtained link or the compressed and optimized 3D model of the object to be displayed;
  • the control unit is used to control the three-dimensional model displayed by the display unit according to the input signal and generate a corresponding display control signal;
  • the second communication unit is used to generate a display control signal.
  • the mobile terminal-based display control system further includes a communication system, and the communication system includes:
  • Voice message unit used to provide voice message service
  • Telephone customer service unit used to provide telephone customer service
  • Robot customer service unit used to provide robot voice customer service
  • the live video customer service unit is used to provide live video customer service.
  • the interactive display module includes a multi-dimensional visual real-shopping module
  • the multi-dimensional visual real-shopping module specifically includes:
  • 3D scene display unit used to provide automatic navigation service, scene switching service, 3D real scene service, space roaming service, free walking service, 2D floor plan service and 3D house plan service;
  • AI intelligent voice shopping guide service is used to provide multi-national voice commentary services, three-dimensional product display services, three-dimensional shopping guide services, AI smart voice answer services and three-dimensional robot commentary services.
  • the interactive display content is sent to the second smart display screen in the form of a signal.
  • the second aspect of the technical solution of the present invention is a display control method based on a mobile terminal, which includes the following steps:
  • the acquired three-dimensional data of the object to be displayed is processed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
  • the beneficial effects of the present invention are: a display control system and method based on a mobile terminal of the present invention obtain, process, and render compression optimization to obtain a compressed and optimized three-dimensional model of the object to be displayed, and then compress it according to the object to be displayed through the mobile terminal
  • the optimized 3D model generates a display control signal, and then the display module displays the display control signal according to the display control signal.
  • the additional mobile terminal is used to display the display module, which solves the problem of when the display module’s screen is too large or the installation distance is far or suspended , It is difficult to control or operate during human-computer interaction, which has the advantages of convenient operation and good user experience.
  • Figure 1 is a block diagram of the overall structure of the mobile terminal-based display control system of the present invention.
  • FIG. 2 is a structural block diagram of a preferred embodiment of the display control system based on mobile terminals of the present invention
  • FIG. 3 is a structural block diagram of another preferred embodiment of the display control system based on a mobile terminal of the present invention.
  • Fig. 4 is a flowchart of a preferred embodiment of a display control method based on a mobile terminal of the present invention.
  • first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other.
  • first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element.
  • second element may also be referred to as the first element.
  • the use of any and all examples or exemplary language (“such as”, “such as”, etc.) provided herein is only intended to better illustrate the embodiments of the present invention, and unless otherwise required, will not impose limitations on the scope of the present invention .
  • a display control system based on a mobile terminal of the present invention includes:
  • the three-dimensional data acquisition module 10 is used to acquire three-dimensional data of the object to be displayed;
  • the three-dimensional data processing module 11 is configured to process the acquired three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
  • the rendering compression optimization unit 12 is used to perform rendering and compression optimization on the original three-dimensional model of the object to be displayed, to obtain a compressed and optimized three-dimensional model of the object to be displayed;
  • the interactive display module 13 is used for interactive display based on the obtained link or the compressed and optimized three-dimensional model of the object to be displayed.
  • the interactive display includes the first smart display screen, AR device, VR device and browser based on interaction with the user.
  • At least one of the devices in the device displays the compressed and optimized three-dimensional model of the object to be displayed or the original three-dimensional model of the object to be displayed
  • the first smart display screen includes an air imaging device, an air screen, a PC computer screen, a tablet computer screen, and a smart screen.
  • the interaction with the user includes at least one of somatosensory control, eye tracking, gesture control, voice recognition, brain wave control, touch control, screen switching control, and face recognition;
  • the mobile terminal 18 is used to obtain the obtained link or the compressed and optimized three-dimensional model of the object to be displayed, and to generate a display control
  • the display module 19 is used for displaying according to the display control signal
  • the big data analysis backend 14 is used to analyze and count the behavior of users when watching interactive display content.
  • the three-dimensional data processing module 11 includes a three-dimensional cloud model library.
  • objects include objects (such as commodities) and environments (such as the indoor environment of a museum).
  • the three-dimensional data of the object can be two-dimensional images, point cloud data of the object, etc., which can be collected by manual or automatic scanning equipment (such as cameras, aerial drones, automatic scanning robots, etc.), or through third parties Interface (such as Internet interface, etc.) is directly imported.
  • the present invention includes at least two compression processes: the three-dimensional cloud model library includes at least one compression process, and the rendering compression optimization unit 12 will perform another compression before generating the compressed and optimized three-dimensional model of the object to be displayed.
  • the original three-dimensional model of the object to be displayed is displayed on the PC screen, tablet computer (such as IPAD) screen, and smart phone screen or browser to achieve interactive display through interaction with the user.
  • the user only needs to pass the corresponding link (such as URL link) can be accessed, which saves the process of loading APP, which is more efficient and more convenient.
  • the air screen displays the compressed and optimized three-dimensional model of the object to be displayed through interaction with the user.
  • the present invention also supports the display of the compressed and optimized three-dimensional model of the object to be displayed in an air imaging manner (that is, through an air imaging device), which has richer functions and more shocking visual effects.
  • the three-dimensional model of the object is a virtual model, which can be used for 360-degree browsing or viewing without blind angles, and the model can be enlarged through the interaction of the first smart display, AR device, VR device, and browser with the user , Zoom out, color change and visual switching, to meet the individual needs of different viewers.
  • the invention supports different intelligent terminals and devices such as AR equipment, VR equipment, PC computer screen, tablet computer (such as IPAD) screen, smart phone screen, air imaging device, air screen, etc. to access and display the three-dimensional model, with more abundant functions.
  • the mobile terminal 18 is configured to obtain the link obtained from the air screen or the rendering compression optimization unit or the compressed and optimized three-dimensional model of the object to be displayed, and generate a display control signal.
  • the display module can be a second smart display, the size of the second smart display is larger, or the second smart display is installed at a higher position (such as suspended installation) and installed at a longer distance (such as a person standing on the side of a pool, The screen is installed on the other side of the pool).
  • the mobile terminal 18 may include smart devices such as mobile phones, IPADs, and mobile computers.
  • the mobile terminal is also provided with a first communication unit 1801, a display unit 1802, a control unit 1803, and a second communication unit 1804.
  • the first communication unit 1801 is used to receive the obtained link or the compressed and optimized three-dimensional model of the object to be displayed;
  • the display unit 1802 is used to display the obtained link or the compressed and optimized three-dimensional model of the object to be displayed;
  • the control unit 1803 is used to According to the input signal, the three-dimensional model displayed by the display unit is controlled and the corresponding display control signal is generated;
  • the second communication unit 1804 is used for generating the display control signal.
  • the input signal may be at least one of a touch screen input signal, a gesture signal, and a voice input signal.
  • the display control signal includes at least one control signal of a viewing angle control signal, a color control signal, and a zoom control signal of the three-dimensional model.
  • the three-dimensional data acquisition module includes:
  • the aerial scanner 101 is used to scan three-dimensional data of an area (such as a certain city) and perform local preprocessing;
  • the indoor scanner 102 is used to scan 3D data of an indoor environment (such as inside a museum) and perform local preprocessing;
  • the outdoor scanning model 103 is used to scan 3D data of an outdoor environment (such as an outdoor exhibition) and perform local preprocessing;
  • the object scanner 104 is used to scan 3D data of objects (such as sneakers, pens, etc.) and perform local preprocessing;
  • the human body scanner 105 is used to scan the three-dimensional data of the human body and perform local preprocessing
  • the third-party 3D data acquisition module 106 is used to acquire 3D data of the object to be displayed from a third party (such as a scan model provider).
  • the aerial scanner 101 may use a drone or other aerial scanning equipment with a camera, which can acquire scan data of a certain area (for example, a certain city) through aerial scanning.
  • a drone or other aerial scanning equipment with a camera which can acquire scan data of a certain area (for example, a certain city) through aerial scanning.
  • the indoor scanner 102 may be a handheld scanning device (such as a camera with a support frame) or other automatic scanning devices (such as an automatic scanning robot).
  • a handheld scanning device such as a camera with a support frame
  • other automatic scanning devices such as an automatic scanning robot
  • the outdoor scanner 103 may be a handheld scanning device (such as a camera with a support frame) or other automatic scanning equipment (such as an automatic scanning robot).
  • a handheld scanning device such as a camera with a support frame
  • other automatic scanning equipment such as an automatic scanning robot
  • the object scanner 104 may be a handheld scanning device (such as an RGB-D camera with a support frame, etc.).
  • the human body scanner 105 may be an existing human body scanner specifically for human body modeling.
  • the aerial scanner 101, the indoor scanner 102, the outdoor scanning module 103, the object scanner 104 and the human body scanner 105 are all integrated with GPU chips, which can perform preliminary processing on the collected data such as two-dimensional images locally (such as Two-dimensional images are initially stitched according to depth information, etc.), which reduces the processing burden on the cloud.
  • the three-dimensional cloud model library 11 includes:
  • the access management unit 111 is configured to authorize the user with corresponding access rights according to the user's valid login credentials
  • the intelligent processing unit 112 is used to perform model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, denoising, coloring, and light processing to obtain the original three-dimensional model of the object to be displayed;
  • the link generating unit 113 is configured to generate a corresponding link according to the original three-dimensional model of the object to be displayed;
  • the database 114 is used to store the user's behavior data when viewing the interactive display content, the user's valid login credentials, the original three-dimensional model of the object to be displayed, and the corresponding link.
  • the user's valid login credential can be obtained by cooperating with the camera to perform face recognition.
  • the user can also register by inputting one or more personal details (such as name, age, location, gender, etc.) on the intelligent processing unit 112.
  • the user can be any user who has valid login credentials, and valid login credentials can be obtained by paying the fees for corresponding permissions.
  • the intelligent processing unit 112 integrates AI algorithms, and can automatically perform model repair, cropping, surface reduction, model reduction, compression, material processing, texture processing, and lighting processing on the three-dimensional data of the object to be displayed, with a high degree of intelligence.
  • the intelligent processing unit 112 may be an application program installed on a computing device.
  • the computing device may be, but not limited to, devices such as smart phones, tablet computers, notebook computers, smart watches, smart TVs, and computers.
  • it further includes a display cabinet, the air screen is installed on one surface of the display cabinet, and a booth for placing objects or real models of the objects is arranged in the display cabinet.
  • the display cabinet is composed of several planes and/or curved surfaces.
  • the display cabinet may be a rectangular parallelepiped and composed of six planes.
  • the display cabinet may be a variation of a rectangular parallelepiped.
  • one surface is composed of a curved surface.
  • the display cabinet can be in the shape of other polyhedrons.
  • the space enclosed by the multiple surfaces of the display cabinet may be a closed space or an open space, such as a rectangular parallelepiped with an open top.
  • the display cabinet is equipped with a booth for placing objects or real models of objects.
  • the air screen is arranged on one surface of the display cabinet, and the air screen can be a transparent LCD touch screen or the like.
  • the air screen may be a flat screen or a curved screen.
  • the air screen can also be used to display two-dimensional images or text.
  • multiple sides of the display cabinet are air screens, which can display the three-dimensional model of the article in different directions.
  • part of the air screen can display information other than the three-dimensional model, such as two-dimensional images, text descriptions, product LOGO, and so on.
  • the air screen can also provide corresponding software buttons on the display interface for users to choose, such as QR code payment buttons, color switching buttons, and viewing angle switching buttons.
  • the air screen 13 is provided with a somatosensory sensor 131, a gesture sensor 132, an eye tracker 133, a camera 134, a touch screen 135, a voice collection module 136, and brain wave collection.
  • Device 137, ultrasonic sensor 138 and infrared sensor 139 are provided with a somatosensory sensor 131, a gesture sensor 132, an eye tracker 133, a camera 134, a touch screen 135, a voice collection module 136, and brain wave collection.
  • Device 137 ultrasonic sensor 138 and infrared sensor 139.
  • the somatosensory sensor 131 is used to capture the user's somatosensory signal (such as the user's body motion signal when a car is driving in a simulation).
  • the gesture sensor 132 is used to capture the user's gesture signal (for example, a signal to switch the angle of view by grasping a certain commodity through the palm and thumb).
  • the eye tracker 133 is used to capture the user's eye movements. There are two purposes of eye tracking: one is to automatically switch the display content according to the focus of the eyeball. For example, if the user’s eyeball stays or stares at one of the multiple three-dimensional display models for several seconds, the air screen can Automatically switch to the scene of the 3D model for further detailed display; 2. Real-time monitoring of the user's eye movements.
  • the camera 134 is used to capture an image of the user.
  • the camera may adopt an RGB-D camera capable of simultaneously collecting two-dimensional face image information and depth information to obtain more accurate user images.
  • the touch screen 135 is used for the user to input touch instructions through touch.
  • the touch screen can be attached to the air screen or combined with the air screen into one.
  • the voice collection module 136 is used to collect the user's voice signal.
  • the user's voice signal can be the user's voice command signals such as "open the door”, “turn on the air conditioner in the car", “change the body color to black” and so on.
  • the voice collection module may be a voice collection device such as a microphone or a microphone.
  • the brain wave acquisition device 137 is used to collect the user's brain wave signal so as to recognize the user's ideas or thoughts, so as to perform corresponding operations on the three-dimensional model of the object displayed on the air screen, such as color switching, visual switching, and so on.
  • the ultrasonic sensor 138 is used to sense whether someone is approaching through ultrasonic waves, so that when someone approaches, the standby screen is switched to a three-dimensional model real-time display screen (that is, the air screen is called out), which is more intelligent.
  • the infrared sensor 139 is used to sense whether someone is approaching through infrared rays, so that when someone approaches, the standby screen is switched to a three-dimensional model real-time display screen (that is, the air screen is called out), and the degree of intelligence is higher.
  • the first communication unit 1801 of the mobile terminal 18 obtains the obtained link from the air screen 13 or the compressed and optimized three-dimensional model of the object to be displayed, and the display unit 1802 performs compression and optimization of the three-dimensional model according to the obtained link or the object to be displayed.
  • the control unit 1803 controls the three-dimensional model displayed by the display unit according to the input signal and generates a corresponding display control signal.
  • the second communication unit 1804 generates a display control signal and sends the signal to the display module 19, which can be
  • the second smart display screen enables the content displayed on the second smart display screen to be synchronized with the content displayed on the mobile terminal 18.
  • the first communication unit 1801 of the mobile terminal 18 obtains the obtained link or the optimized three-dimensional model of the object to be displayed from the rendering compression optimization unit 12, and the display unit 1802 compresses the optimized three-dimensional model according to the obtained link or the object to be displayed.
  • the model is displayed.
  • the control unit 1803 controls the three-dimensional model displayed by the display unit according to the input signal, and generates the corresponding display control signal.
  • the second communication unit 1804 generates the display control signal and sends the signal to the display module 19 and the display module 19 It may be a second smart display screen, so that the content displayed on the second smart display screen is synchronized with the content displayed on the mobile terminal 18.
  • the communication system 15 is further included, and the communication system 15 includes:
  • the voice message unit 151 is used to provide voice message service
  • the telephone customer service unit 152 is used to provide telephone customer service
  • the robot customer service unit 153 is used to provide robot voice customer service
  • the live video customer service unit 154 is used to provide live video customer service.
  • the present invention can also provide robotic voice customer service (models pre-trained through self-learning) and video live customer service (models obtained by scanning and modeling real people, which can be customized) services , The way is more flexible.
  • the big data analysis backend 14 includes:
  • the newly added user statistics unit 141 is used to count the number of newly added users
  • the user retention statistics unit 142 is used to count the number of retained users
  • the activity analysis unit 143 is used to analyze the activity of the user
  • the user information analysis unit 144 is used to analyze the user's gender, age, registration information, and IP distribution;
  • the hot spot analysis unit 145 is used to analyze the user's viewing hot spot and generate a corresponding heat map
  • the user viewing behavior analysis unit 146 is used to perform user viewing behavior analysis.
  • the user viewing behavior analysis includes eye tracking, facial expression analysis, somatosensory motion analysis, mouse browsing trajectory analysis and video recording, gesture analysis, and brain wave analysis. At least one
  • the information sharing unit 147 is used to share and publish the analysis results of the big data analysis background.
  • tracking the viewer's eye movements is mainly to identify the focus of the viewer's attention (when seeing the concerned part, the user's eyeballs will be different from the situation where the user does not see the concerned part, such as the time that the eyeball stays is different), so that The air screen directly switches the three-dimensional model of the object to the focus or details of the viewer's attention (if it is recognized that the user is paying attention to the body of the car, it will directly switch to the three-dimensional model of the car body).
  • the facial expression recognition of the user is mainly used to recognize the viewer's current mood (such as happy, unhappy, etc.).
  • the information sharing unit 147 can share and publish the results of big data analysis to existing general social media, such as WeChat, Weibo, and blogs.
  • Fig. 2 as a further preferred embodiment, it further includes:
  • the air screen remote control module 16 is used to remotely control the display content of the air screen.
  • the remote control includes the production and playback of advertisements, the update of display content, the layout of the display content, and the scheduling of the display content.
  • the present invention also adds an air screen remote control module 16, which can remotely control the display content of the air screen, meets the personalized customization requirements of different users, and can remotely operate the air screen anytime and anywhere, realizing data cross-space Sharing is more convenient.
  • the interactive display module includes a multi-dimensional visual real-scene shopping module 17, and the multi-dimensional visual real-scene shopping module 17 specifically includes:
  • the three-dimensional scene display unit 171 is used to provide automatic navigation services, scene switching services, three-dimensional real-world services, space roaming services, free walking services, two-dimensional floor plan services and three-dimensional house plan services;
  • AI smart voice shopping guide service 172 used to provide multi-country voice commentary services, three-dimensional product display services, three-dimensional shopping guide (obtained by scanning real people, customizable) services, AI smart voice answer services and three-dimensional robot commentary (pre-trained models) )service.
  • a display control method based on a mobile terminal in this embodiment includes the following steps:
  • the three-dimensional cloud model library 11 performs intelligent processing on the three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link.
  • the intelligent processing includes model repair, editing, cropping, surface reduction, model reduction, Compressing, processing materials, processing textures, denoising, coloring and processing lights;
  • the rendering compression optimization unit 12 performs rendering and compression optimization on the original three-dimensional model of the object to be displayed, to obtain a compressed and optimized three-dimensional model of the object to be displayed;
  • the air screen 13 interacts with the user, and interactively displays the compressed and optimized three-dimensional model of the object according to the result of the interaction; the specific display content of the air screen 13 can also be controlled by the air screen remote control module 16;
  • the big data analysis backend 14 analyzes and counts the behavior of users when viewing interactive display content
  • the 3D cloud model library 11 sends the link corresponding to the original 3D model of the object to be displayed to the first smart display or AR/VR device, so that the user can access the original 3D model of the object to be displayed by opening the link;
  • the mobile terminal 18 obtains the obtained link or the compressed and optimized three-dimensional model of the object to be displayed from the rendering compression optimization unit 12, and generates a display control signal;
  • the second smart display 19 performs display according to the display control signal.
  • the control unit 1803 of the mobile terminal controls the three-dimensional model displayed by the display unit 1802 and generates a control signal, which is sent to the second smart display 19 via the second communication unit 1804, so that the second smart display 19 is displayed on the mobile terminal 18.
  • the display is the same, and the display synchronization of the second smart display 19 and the mobile terminal 18 is realized.
  • the embodiments of the present invention can be realized or implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory.
  • the method can be implemented in a computer program using standard programming techniques-including a non-transitory computer readable storage medium configured with a computer program, where the storage medium so configured allows the computer to operate in a specific and predefined manner-according to the specific
  • Each program can be implemented in a high-level process or object-oriented programming language to communicate with the computer system. However, if necessary, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
  • the processes (or variants and/or combinations thereof) described herein can be executed under the control of one or more computer systems configured with executable instructions, and can be used as codes that are executed collectively on one or more processors (such as , Executable instructions, one or more computer programs, or one or more applications), implemented by hardware or a combination thereof.
  • the computer program includes a plurality of instructions executable by one or more processors.
  • the method can be implemented in any type of computing platform that is operably connected to a suitable computing platform, including but not limited to personal computers, minicomputers, main frames, workstations, networks or distributed computing environments, separate or integrated computers Platform, or communication with charged particle tools or other imaging devices, etc.
  • Aspects of the present invention can be implemented by machine-readable codes stored on non-transitory storage media or devices, whether removable or integrated into computing platforms, such as hard disks, optical reading and/or writing storage media, RAM, ROM, etc., so that they can be read by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein.
  • machine-readable code or part thereof, can be transmitted through a wired or wireless network.
  • machine-readable media include instructions or programs that implement the steps described above in combination with a microprocessor or other data processors
  • the invention described herein includes these and other different types of non-transitory computer-readable storage media.
  • the present invention also includes the computer itself.
  • a computer program can be applied to input data to perform the functions described herein, thereby transforming the input data to generate output data that is stored in non-volatile memory.
  • the output information can also be applied to one or more output devices such as displays.
  • the converted data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on the display.

Abstract

A display control system and method based on a mobile terminal. Acquisition, processing and rendering compression optimization are performed to obtain a three-dimensional model of an object to be displayed after compression optimization; then a display control signal is generated by means of the mobile terminal according to the three-dimensional model of the object to be displayed after the compression optimization; a display module displays according to the display control signal, and the display module is subjected to display control by means of the additionally provided mobile terminal. The problem that control or operation is not easy during man-machine interaction when a screen of the display module is too large or the mounting distance is long or suspension mounting is solved, and the advantages of being convenient to operate and good in user experience are achieved. The method can be widely applied to the technical field of display.

Description

一种基于移动终端的展示控制系统及方法Display control system and method based on mobile terminal 技术领域Technical field
本发明涉及控制技术领域，尤其是一种基于移动终端的展示控制系统及方法。The invention relates to the field of control technology, in particular to a display control system and method based on a mobile terminal.
背景技术Background technique
在进行人机交互时，当使用屏(普通屏或空气屏)等来展示产品的三维模型时，若屏的尺寸太大时，或安装的距离过远(比如人站在水池的一侧，屏安装在水池的另一侧)或过高(比如屏是高空悬挂时)时，则会产生操作不方便，或是控制上不方便，用户体验差等状况。例如，当屏过大时，通过交互方式与屏进行交互时，由于距离原因或者物理原因，操作起来极为不方便。When performing human-computer interaction, when using a screen (normal screen or air screen) to display the three-dimensional model of the product, if the size of the screen is too large, or the installation distance is too far (such as standing on the side of the pool, When the screen is installed on the other side of the pool) or is too high (for example, when the screen is suspended at a high altitude), it will cause inconvenient operation, inconvenient control, and poor user experience. For example, when the screen is too large, it is extremely inconvenient to operate due to distance or physical reasons when interacting with the screen in an interactive manner.
发明内容Summary of the invention
为解决上述技术问题，本发明的目的在于：提供一种基于移动终端的展示控制方法及系统基于移动终端的展示控制系统。In order to solve the above technical problems, the purpose of the present invention is to provide a display control method and system based on a mobile terminal and a display control system based on a mobile terminal.
本发明的技术方案第一方面为一种基于移动终端的展示控制系统，包括：The first aspect of the technical solution of the present invention is a display control system based on a mobile terminal, including:
三维数据获取模块，用于获取待展示对象的三维数据；The 3D data acquisition module is used to acquire 3D data of the object to be displayed;
三维数据处理模块，用于将获取的待展示对象的三维数据进行处理以得到待展示对象的原始三维模型和对应的链接；The three-dimensional data processing module is used to process the acquired three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
渲染压缩优化单元，用于对待展示对象的原始三维模型进行渲染和压缩优化，得到待展示对象压缩优化后的三维模型；交互展示模块，用于根据得到的链接或待展示对象压缩优化后的三维模型进行交互展示；The rendering compression optimization unit is used to perform rendering and compression optimization on the original 3D model of the object to be displayed to obtain the optimized 3D model of the object to be displayed; the interactive display module is used to compress the optimized 3D model according to the obtained link or the object to be displayed Interactive display of the model;
移动终端，用于获取得到的链接或待展示对象压缩优化后的三维模型，并生成显示控制信号；The mobile terminal is used to obtain the obtained link or the compressed and optimized three-dimensional model of the object to be displayed, and generate a display control signal;
显示模块，用于根据显示控制信号进行显示。The display module is used to display according to the display control signal.
作为上述技术手段的一种改进，其中所述三维数据获取模块包括：As an improvement of the above technical means, the three-dimensional data acquisition module includes:
航拍扫描仪，用于扫描区域范围的三维数据并进行本地预处理；Aerial photography scanner, used to scan the three-dimensional data of the area and perform local preprocessing;
室内扫描仪，用于扫描室内环境的三维数据并进行本地预处理；Indoor scanner, used to scan 3D data of indoor environment and perform local preprocessing;
室外扫描模仪，用于扫描室外环境的三维数据并进行本地预处理；Outdoor scanning module, used to scan 3D data of outdoor environment and perform local preprocessing;
物体扫描仪，用于扫描物体的三维数据并进行本地预处理；Object scanner, used to scan the three-dimensional data of the object and perform local preprocessing;
人体扫描仪，用于扫描人体的三维数据并进行本地预处理；Human body scanner, used to scan the three-dimensional data of the human body and perform local preprocessing;
第三方三维数据获取模块，用于从第三方获取待展示对象的三维数据。The third-party 3D data acquisition module is used to acquire the 3D data of the object to be displayed from the third party.
作为上述技术手段的一种改进，其中三维数据处理模块包括三维云端模型库和渲染压缩优化单元，As an improvement of the above technical means, the 3D data processing module includes a 3D cloud model library and a rendering compression optimization unit,
其中三维云端模型库，用于对待展示对象的三维数据进行智能化处理，得到待展示对象的原始三维模型和对应的链接，所述智能化处理包括模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、去噪、着色和处理灯光。The 3D cloud model library is used to intelligently process the 3D data of the object to be displayed to obtain the original 3D model of the object to be displayed and the corresponding link. The intelligent processing includes model repair, editing, cropping, surface reduction, and model reduction , Compression, material processing, texture processing, denoising, coloring and light processing.
作为上述技术手段的一种改进，其中所述三维云端模型库包括：As an improvement of the above technical means, the three-dimensional cloud model library includes:
访问管理单元，用于根据用户的有效登录凭证授权用户相应的访问权限；The access management unit is used to authorize the user with corresponding access rights according to the user's valid login credentials;
智能处理单元，用于进行模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、去噪、着色和处理灯光，得到待展示对象的原始三维模型；Intelligent processing unit, used for model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, denoising, coloring and light processing, to obtain the original 3D model of the object to be displayed;
链接生成单元，用于根据待展示对象的原始三维模型生成对应的链接；The link generating unit is used to generate the corresponding link according to the original three-dimensional model of the object to be displayed;
数据库，用于存储用户观看交互展示内容时的行为数据、用户的有效登录凭证、待展示对象的原始三维模型以及对应的链接。The database is used to store the user's behavior data when viewing interactive display content, the user's valid login credentials, the original three-dimensional model of the object to be displayed, and the corresponding link.
作为上述技术手段的一种改进，所述交互展示模块具体用于：根据与用户的交互在第一智能显示屏中显示待展示对象压缩优化后的三维模型或待展示对象的原始三维模型。As an improvement of the above technical means, the interactive display module is specifically configured to display the compressed and optimized three-dimensional model of the object to be displayed or the original three-dimensional model of the object to be displayed in the first smart display screen according to the interaction with the user.
作为上述技术手段的一种改进，其中移动终端包括手机、IPAD、笔记本和智能手表中的至少一个。As an improvement of the above technical means, the mobile terminal includes at least one of a mobile phone, an IPAD, a notebook, and a smart watch.
作为上述技术手段的一种改进，其中移动终端包括：As an improvement of the above technical means, the mobile terminal includes:
第一通讯单元，用于接收得到的链接或待展示对象压缩优化后的三维模型；The first communication unit is configured to receive the obtained link or the compressed and optimized three-dimensional model of the object to be displayed;
显示单元，用于显示得到的链接或待展示对象压缩优化后的三维模型；The display unit is used to display the obtained link or the compressed and optimized 3D model of the object to be displayed;
控制单元，用于根据输入的信号对显示单元显示的三维模型进行控制，并生成对应的显示控制信号；The control unit is used to control the three-dimensional model displayed by the display unit according to the input signal and generate a corresponding display control signal;
第二通讯单元，用于生成显示控制信号。The second communication unit is used to generate a display control signal.
作为上述技术手段的一种改进，其中基于移动终端的展示控制系统还包括通讯系统，所述通讯系统包括：As an improvement of the above technical means, the mobile terminal-based display control system further includes a communication system, and the communication system includes:
语音留言单元，用于提供语音留言服务；Voice message unit, used to provide voice message service;
电话客服单元，用于提供电话客服服务；Telephone customer service unit, used to provide telephone customer service;
机器人客服单元，用于提供机器人语音客服服务；Robot customer service unit, used to provide robot voice customer service;
视频真人客服单元，用于提供视频真人客服服务。The live video customer service unit is used to provide live video customer service.
作为上述技术手段的一种改进，其中所述交互展示模块包括多维视觉实景购模块，所述 多维视觉实景购模块具体包括：As an improvement of the above technical means, the interactive display module includes a multi-dimensional visual real-shopping module, and the multi-dimensional visual real-shopping module specifically includes:
三维场景展示单元，用于提供自动导览服务、场景切换服务、三维实景服务、空间漫游服务、自由行走服务、二维平面图服务和三维户型图服务；3D scene display unit, used to provide automatic navigation service, scene switching service, 3D real scene service, space roaming service, free walking service, 2D floor plan service and 3D house plan service;
AI智能语音导购服务，用于提供多国语音解说服务、三维产品展示服务、三维导购员服务、AI智能语音解答服务和三维机器人解说服务。AI intelligent voice shopping guide service is used to provide multi-national voice commentary services, three-dimensional product display services, three-dimensional shopping guide services, AI smart voice answer services and three-dimensional robot commentary services.
将交互展示的内容以信号的形式发送至第二智能显示屏。The interactive display content is sent to the second smart display screen in the form of a signal.
本发明的技术方案第二方面为一种基于移动终端的展示控制方法，包括以下步骤：The second aspect of the technical solution of the present invention is a display control method based on a mobile terminal, which includes the following steps:
获取待展示对象的三维数据；Obtain the three-dimensional data of the object to be displayed;
获取的待展示对象的三维数据进行处理以得到待展示对象的原始三维模型和对应的链接；The acquired three-dimensional data of the object to be displayed is processed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
对待展示对象的原始三维模型进行渲染和压缩优化，得到待展示对象压缩优化后的三维模型；Perform rendering and compression optimization on the original 3D model of the object to be displayed, and obtain a compressed and optimized 3D model of the object to be displayed;
根据得到的链接或待展示对象压缩优化后的三维模型进行交互展示；Perform interactive display based on the obtained link or the compressed and optimized 3D model of the object to be displayed;
通过移动终端从交互展示模块获取展示的内容并发送控制信号；Obtain the displayed content from the interactive display module through the mobile terminal and send control signals;
接收移动终端发来的控制信号并根据控制信号进行显示。Receive the control signal sent by the mobile terminal and display according to the control signal.
本发明的有益效果是：本发明的一种基于移动终端的展示控制系统及方法，通过获取、处理和渲染压缩优化得到待展示对象压缩优化后的三维模型，然后通过移动终端根据待展示对象压缩优化后的三维模型生成显示控制信号，再由显示模块根据显示控制信号进行显示，通过增设的移动终端来对显示模块进行显示控制，解决了当显示模块的屏过大或者安装距离远或悬挂安装，进行人机交互时不易控制或操作的问题，具有操作方便，用户体验好的优点。The beneficial effects of the present invention are: a display control system and method based on a mobile terminal of the present invention obtain, process, and render compression optimization to obtain a compressed and optimized three-dimensional model of the object to be displayed, and then compress it according to the object to be displayed through the mobile terminal The optimized 3D model generates a display control signal, and then the display module displays the display control signal according to the display control signal. The additional mobile terminal is used to display the display module, which solves the problem of when the display module’s screen is too large or the installation distance is far or suspended , It is difficult to control or operate during human-computer interaction, which has the advantages of convenient operation and good user experience.
附图说明Description of the drawings
图1为本发明基于移动终端的展示控制系统的整体结构框图；Figure 1 is a block diagram of the overall structure of the mobile terminal-based display control system of the present invention;
图2为本发明的基于移动终端的展示控制系统的一种优选实施例结构框图；2 is a structural block diagram of a preferred embodiment of the display control system based on mobile terminals of the present invention;
图3为本发明的基于移动终端的展示控制系统的另一种优选实施例结构框图；3 is a structural block diagram of another preferred embodiment of the display control system based on a mobile terminal of the present invention;
图4为本发明的基于移动终端的展示控制方法的一种优选实施例流程图。Fig. 4 is a flowchart of a preferred embodiment of a display control method based on a mobile terminal of the present invention.
具体实施方式detailed description
以下将结合实施例和附图对本发明的构思、具体结构及产生的技术效果进行清楚、完整的描述，以充分地理解本发明的目的、方案和效果。In the following, the concept, specific structure and technical effects of the present invention will be clearly and completely described in conjunction with the embodiments and the drawings, so as to fully understand the purpose, scheme and effects of the present invention.
需要说明的是，如无特殊说明，当某一特征被称为“固定”、“连接”在另一个特征，它可以直接固定、连接在另一个特征上，也可以间接地固定、连接在另一个特征上。此外，本 公开中所使用的上、下、左、右等描述仅仅是相对于附图中本公开各组成部分的相互位置关系来说的。在本公开中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。此外，除非另有定义，本文所使用的所有的技术和科学术语与本技术领域的技术人员通常理解的含义相同。本文说明书中所使用的术语只是为了描述具体的实施例，而不是为了限制本发明。本文所使用的术语“和/或”包括一个或多个相关的所列项目的任意的组合。It should be noted that, unless otherwise specified, when a feature is called "fixed" or "connected" to another feature, it can be directly fixed or connected to another feature, or indirectly fixed or connected to another feature. One feature. In addition, the top, bottom, left, right and other descriptions used in the present disclosure are only relative to the mutual positional relationship of the components of the present disclosure in the drawings. The singular forms of "a", "said" and "the" used in the present disclosure are also intended to include plural forms, unless the context clearly indicates other meanings. In addition, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art. The terms used in the specification herein are only for describing specific embodiments, not for limiting the present invention. The term "and/or" as used herein includes any combination of one or more related listed items.
应当理解，尽管在本公开可能采用术语第一、第二、第三等来描述各种元件，但这些元件不应限于这些术语。这些术语仅用来将同一类型的元件彼此区分开。例如，在不脱离本公开范围的情况下，第一元件也可以被称为第二元件，类似地，第二元件也可以被称为第一元件。本文所提供的任何以及所有实例或示例性语言(“例如”、“如”等)的使用仅意图更好地说明本发明的实施例，并且除非另外要求，否则不会对本发明的范围施加限制。It should be understood that, although the terms first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, without departing from the scope of the present disclosure, the first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element. The use of any and all examples or exemplary language ("such as", "such as", etc.) provided herein is only intended to better illustrate the embodiments of the present invention, and unless otherwise required, will not impose limitations on the scope of the present invention .
参考图1，本发明一种基于移动终端的展示控制系统，包括：Referring to Fig. 1, a display control system based on a mobile terminal of the present invention includes:
三维数据获取模块10，用于获取待展示对象的三维数据；The three-dimensional data acquisition module 10 is used to acquire three-dimensional data of the object to be displayed;
三维数据处理模块11，用于将获取的待展示对象的三维数据进行处理以得到待展示对象的原始三维模型和对应的链接；The three-dimensional data processing module 11 is configured to process the acquired three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
渲染压缩优化单元12，用于对待展示对象的原始三维模型进行渲染和压缩优化，得到待展示对象压缩优化后的三维模型；The rendering compression optimization unit 12 is used to perform rendering and compression optimization on the original three-dimensional model of the object to be displayed, to obtain a compressed and optimized three-dimensional model of the object to be displayed;
交互展示模块13，用于根据得到的链接或待展示对象压缩优化后的三维模型进行交互展示，所述交互展示包括根据与用户的交互在第一智能显示屏、AR设备、VR设备和浏览器中的至少一种设备中显示待展示对象压缩优化后的三维模型或待展示对象的原始三维模型，所述第一智能显示屏包括空气成像装置、空气屏、PC电脑屏、平板电脑屏和智能手机屏中的至少一种，所述与用户的交互包括体感控制、眼球跟踪、手势控制、语音识别、脑波控制、触摸控制、画面切换控制和人脸识别中的至少一种；The interactive display module 13 is used for interactive display based on the obtained link or the compressed and optimized three-dimensional model of the object to be displayed. The interactive display includes the first smart display screen, AR device, VR device and browser based on interaction with the user. At least one of the devices in the device displays the compressed and optimized three-dimensional model of the object to be displayed or the original three-dimensional model of the object to be displayed, and the first smart display screen includes an air imaging device, an air screen, a PC computer screen, a tablet computer screen, and a smart screen. At least one of the mobile phone screen, the interaction with the user includes at least one of somatosensory control, eye tracking, gesture control, voice recognition, brain wave control, touch control, screen switching control, and face recognition;
移动终端18，用于获取得到的链接或待展示对象压缩优化后的三维模型，并生成显示控The mobile terminal 18 is used to obtain the obtained link or the compressed and optimized three-dimensional model of the object to be displayed, and to generate a display control
制信号；Control signal
显示模块19，用于根据显示控制信号进行显示；The display module 19 is used for displaying according to the display control signal;
大数据分析后台14，用于对用户观看交互展示内容时的行为进行分析和统计。The big data analysis backend 14 is used to analyze and count the behavior of users when watching interactive display content.
优选地，三维数据处理模块11包括三维云端模型库。Preferably, the three-dimensional data processing module 11 includes a three-dimensional cloud model library.
具体地，对象包括物品(如商品)和环境(如博物馆的室内环境)等。对象的三维数据可以是二维的图像、对象的点云数据等，其可通过各手动或自动的扫描设备(如相机、航拍 无人机、自动扫描机器人等)来采集，也可以通过第三方接口(如互联网接口等)直接导入。Specifically, objects include objects (such as commodities) and environments (such as the indoor environment of a museum). The three-dimensional data of the object can be two-dimensional images, point cloud data of the object, etc., which can be collected by manual or automatic scanning equipment (such as cameras, aerial drones, automatic scanning robots, etc.), or through third parties Interface (such as Internet interface, etc.) is directly imported.
本发明包含至少2次压缩过程：三维云端模型库至少包括一次压缩过程，而在渲染压缩优化单元12还会再经过一次压缩才能生成待展示对象压缩优化后的三维模型。The present invention includes at least two compression processes: the three-dimensional cloud model library includes at least one compression process, and the rendering compression optimization unit 12 will perform another compression before generating the compressed and optimized three-dimensional model of the object to be displayed.
其中，待展示对象的原始三维模型展示在PC电脑屏、平板电脑(如IPAD)屏和智能手机屏或浏览器上，以通过与用户进行交互实现交互展示，用户只需通过相应的链接(如URL链接)进行访问即可，省去了装载APP的过程，效率更高且更加方便。而空气屏则通过与用户进行交互展示待展示对象压缩优化后的三维模型。此外，本发明还支持将待展示对象压缩优化后的三维模型以空气成像的方式(即通过空气成像装置)进行显示，功能更丰富，视觉效果更震撼。Among them, the original three-dimensional model of the object to be displayed is displayed on the PC screen, tablet computer (such as IPAD) screen, and smart phone screen or browser to achieve interactive display through interaction with the user. The user only needs to pass the corresponding link (such as URL link) can be accessed, which saves the process of loading APP, which is more efficient and more convenient. The air screen displays the compressed and optimized three-dimensional model of the object to be displayed through interaction with the user. In addition, the present invention also supports the display of the compressed and optimized three-dimensional model of the object to be displayed in an air imaging manner (that is, through an air imaging device), which has richer functions and more shocking visual effects.
优选地，对象的三维模型是虚拟的模型，可供用户进行360度无死角的浏览或观看，而且可以通过第一智能显示屏、AR设备、VR设备和浏览器与用户的交互实现模型的放大、缩小、颜色变换和视觉切换，满足了不同观看者的个性化需求。本发明支持AR设备、VR设备、PC电脑屏、平板电脑(如IPAD)屏、智能手机屏、空气成像装置、空气屏等不同的智能终端、设备来进行三维模型访问与展示，功能更加丰富。Preferably, the three-dimensional model of the object is a virtual model, which can be used for 360-degree browsing or viewing without blind angles, and the model can be enlarged through the interaction of the first smart display, AR device, VR device, and browser with the user , Zoom out, color change and visual switching, to meet the individual needs of different viewers. The invention supports different intelligent terminals and devices such as AR equipment, VR equipment, PC computer screen, tablet computer (such as IPAD) screen, smart phone screen, air imaging device, air screen, etc. to access and display the three-dimensional model, with more abundant functions.
移动终端18，用于从空气屏或渲染压缩优化单元获取得到的链接或待展示对象压缩优化后的三维模型，并生成显示控制信号。显示模块可以是第二智能显示屏，第二智能显示屏的尺寸较大，或者第二智能显示屏安装位置较高(比如悬空安装)，安装距离较远(比如人站在水池的一侧，屏安装在水池的另一侧)。The mobile terminal 18 is configured to obtain the link obtained from the air screen or the rendering compression optimization unit or the compressed and optimized three-dimensional model of the object to be displayed, and generate a display control signal. The display module can be a second smart display, the size of the second smart display is larger, or the second smart display is installed at a higher position (such as suspended installation) and installed at a longer distance (such as a person standing on the side of a pool, The screen is installed on the other side of the pool).
具体地，移动终端18可以包括手机、IPAD、移动电脑等智能设备。移动终端还设置有第一通讯单元1801、显示单元1802、控制单元1803和第二通讯单元1804。第一通讯单元1801，用于接收得到的链接或待展示对象压缩优化后的三维模型；显示单元1802，用于显示得到的链接或待展示对象压缩优化后的三维模型；控制单元1803，用于根据输入的信号对显示单元显示的三维模型进行控制，并生成对应的显示控制信号；第二通讯单元1804，用于生成显示控制信号。Specifically, the mobile terminal 18 may include smart devices such as mobile phones, IPADs, and mobile computers. The mobile terminal is also provided with a first communication unit 1801, a display unit 1802, a control unit 1803, and a second communication unit 1804. The first communication unit 1801 is used to receive the obtained link or the compressed and optimized three-dimensional model of the object to be displayed; the display unit 1802 is used to display the obtained link or the compressed and optimized three-dimensional model of the object to be displayed; the control unit 1803 is used to According to the input signal, the three-dimensional model displayed by the display unit is controlled and the corresponding display control signal is generated; the second communication unit 1804 is used for generating the display control signal.
本发明的一个实施例中，优选地，输入的信号可以为触屏输入信号、手势信号和语音输入信号等中的至少一个信号。In an embodiment of the present invention, preferably, the input signal may be at least one of a touch screen input signal, a gesture signal, and a voice input signal.
本发明的一个实施例中，优选地，显示控制信号包括三维模型的视角控制信号、颜色控制信号、缩放控制信号等中的至少一个控制信号。In an embodiment of the present invention, preferably, the display control signal includes at least one control signal of a viewing angle control signal, a color control signal, and a zoom control signal of the three-dimensional model.
参考图2，进一步作为优选的实施方式，所述三维数据获取模块包括：Referring to FIG. 2, as a further preferred embodiment, the three-dimensional data acquisition module includes:
航拍扫描仪101，用于扫描区域范围(如某个城市)的三维数据并进行本地预处理；The aerial scanner 101 is used to scan three-dimensional data of an area (such as a certain city) and perform local preprocessing;
室内扫描仪102，用于扫描室内环境(如某博物馆内部)的三维数据并进行本地预处理；The indoor scanner 102 is used to scan 3D data of an indoor environment (such as inside a museum) and perform local preprocessing;
室外扫描模仪103，用于扫描室外环境(如某个室外的展会)的三维数据并进行本地预处理；The outdoor scanning model 103 is used to scan 3D data of an outdoor environment (such as an outdoor exhibition) and perform local preprocessing;
物体扫描仪104，用于扫描物体(如球鞋、钢笔等)的三维数据并进行本地预处理；The object scanner 104 is used to scan 3D data of objects (such as sneakers, pens, etc.) and perform local preprocessing;
人体扫描仪105，用于扫描人体的三维数据并进行本地预处理；The human body scanner 105 is used to scan the three-dimensional data of the human body and perform local preprocessing;
第三方三维数据获取模块106，用于从第三方(如扫描模型提供商)获取待展示对象的三维数据。The third-party 3D data acquisition module 106 is used to acquire 3D data of the object to be displayed from a third party (such as a scan model provider).
具体地，航拍扫描仪101可采用带有摄像头的无人机或其他空中扫描设备，其能通过航拍扫描的方式获取某个特定区域(如某个城市)的扫描数据。Specifically, the aerial scanner 101 may use a drone or other aerial scanning equipment with a camera, which can acquire scan data of a certain area (for example, a certain city) through aerial scanning.
室内扫描仪102，可以是手持扫描设备(如带支撑架的相机)或其他自动扫描设备(如自动扫描机器人)。The indoor scanner 102 may be a handheld scanning device (such as a camera with a support frame) or other automatic scanning devices (such as an automatic scanning robot).
室外扫描仪103，可以是手持扫描设备(如带支撑架的相机)或其他自动扫描设备(如自动扫描机器人)。The outdoor scanner 103 may be a handheld scanning device (such as a camera with a support frame) or other automatic scanning equipment (such as an automatic scanning robot).
物体扫描仪104，可以是手持的扫描设备(如带支撑架的RGB-D摄像机等)。The object scanner 104 may be a handheld scanning device (such as an RGB-D camera with a support frame, etc.).
人体扫描仪105，可以是现有专门针对人体建模的人体扫描仪。The human body scanner 105 may be an existing human body scanner specifically for human body modeling.
航拍扫描仪101、室内扫描仪102、室外扫描模仪103、物体扫描仪104和人体扫描仪105内均集成有GPU芯片，能在本地对采集的二维图片等数据进行初步的处理(如将二维图片按深度信息进行初步拼接等)，减轻了云端的处理负担。The aerial scanner 101, the indoor scanner 102, the outdoor scanning module 103, the object scanner 104 and the human body scanner 105 are all integrated with GPU chips, which can perform preliminary processing on the collected data such as two-dimensional images locally (such as Two-dimensional images are initially stitched according to depth information, etc.), which reduces the processing burden on the cloud.
参考图2，进一步作为优选的实施方式，以三维云端模型库11作为三维数据处理模块为例，三维云端模型库11包括：Referring to FIG. 2, as a further preferred embodiment, taking the three-dimensional cloud model library 11 as a three-dimensional data processing module as an example, the three-dimensional cloud model library 11 includes:
访问管理单元111，用于根据用户的有效登录凭证授权用户相应的访问权限；The access management unit 111 is configured to authorize the user with corresponding access rights according to the user's valid login credentials;
智能处理单元112，用于进行模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、去噪、着色和处理灯光，得到待展示对象的原始三维模型；The intelligent processing unit 112 is used to perform model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, denoising, coloring, and light processing to obtain the original three-dimensional model of the object to be displayed;
链接生成单元113，用于根据待展示对象的原始三维模型生成对应的链接；The link generating unit 113 is configured to generate a corresponding link according to the original three-dimensional model of the object to be displayed;
数据库114，用于存储用户观看交互展示内容时的行为数据、用户的有效登录凭证、待展示对象的原始三维模型以及对应的链接。The database 114 is used to store the user's behavior data when viewing the interactive display content, the user's valid login credentials, the original three-dimensional model of the object to be displayed, and the corresponding link.
具体地，用户的有效登录凭证可以通过配合摄像头进行人脸识别后获得。用户还可以通过在智能处理单元112上输入一个或多个个人详细信息(如姓名、年龄、位置、性别等)来进行注册。用户可以是拥有有效登录凭证的任何用户，而有效登录凭证可通过支付相应权限的费用来获得。Specifically, the user's valid login credential can be obtained by cooperating with the camera to perform face recognition. The user can also register by inputting one or more personal details (such as name, age, location, gender, etc.) on the intelligent processing unit 112. The user can be any user who has valid login credentials, and valid login credentials can be obtained by paying the fees for corresponding permissions.
智能处理单元112集成了AI算法，能自动对待展示对象的三维数据进行模型修复、裁剪、减面、减模、压缩、处理材质、处理贴图和处理灯光等处理，智能化程度高。The intelligent processing unit 112 integrates AI algorithms, and can automatically perform model repair, cropping, surface reduction, model reduction, compression, material processing, texture processing, and lighting processing on the three-dimensional data of the object to be displayed, with a high degree of intelligence.
智能处理单元112可以是设置在计算设备上的应用程序。优选地，计算设备可以是但不限于智能手机、平板电脑、笔记本电脑、智能手表、智能电视、计算机等设备。The intelligent processing unit 112 may be an application program installed on a computing device. Preferably, the computing device may be, but not limited to, devices such as smart phones, tablet computers, notebook computers, smart watches, smart TVs, and computers.
进一步作为优选的实施方式，还包括展示柜，所述空气屏安装在展示柜的一个面上，所述展示柜内设有放置对象或对象的真实模型的展台。Further as a preferred embodiment, it further includes a display cabinet, the air screen is installed on one surface of the display cabinet, and a booth for placing objects or real models of the objects is arranged in the display cabinet.
优选地，所述展示柜由若干个平面和/或曲面组成，在一些实施例中，所述展示柜可以是长方体，由六个平面组成。在另一些实施例中，所述展示柜可以是长方体的变体，例如在长方体中，有一个面由曲面构成。或者，展示柜可以是其他多面体的形状。在一些实施例中，所述展示柜的多个面围成的空间可以是一个密闭空间，也可以是一个开放空间，如可以是一个顶部开放的长方体。展示柜内设有用于放置物品或物品的真实模型的展台。Preferably, the display cabinet is composed of several planes and/or curved surfaces. In some embodiments, the display cabinet may be a rectangular parallelepiped and composed of six planes. In other embodiments, the display cabinet may be a variation of a rectangular parallelepiped. For example, in a rectangular parallelepiped, one surface is composed of a curved surface. Alternatively, the display cabinet can be in the shape of other polyhedrons. In some embodiments, the space enclosed by the multiple surfaces of the display cabinet may be a closed space or an open space, such as a rectangular parallelepiped with an open top. The display cabinet is equipped with a booth for placing objects or real models of objects.
空气屏设置在展示柜的一个面上，空气屏可以是透明液晶触摸屏等。所述空气屏可以是平面屏或者是曲面屏。在一些实施例中，所述空气屏还能用于显示二维图像或者文字。在一些实施例中，展示柜有多个面是空气屏，可以在不同的方向显示该物品的三维模型。在另一些实施例中，部分空气屏可以显示除了三维模型以外的信息，如二维图像、文字介绍、产品LOGO等等。此外，空气屏还可在显示界面上提供相应的软件按钮供用户进行选择，如二维码支付按钮、颜色切换按钮、视角切换按钮等。The air screen is arranged on one surface of the display cabinet, and the air screen can be a transparent LCD touch screen or the like. The air screen may be a flat screen or a curved screen. In some embodiments, the air screen can also be used to display two-dimensional images or text. In some embodiments, multiple sides of the display cabinet are air screens, which can display the three-dimensional model of the article in different directions. In other embodiments, part of the air screen can display information other than the three-dimensional model, such as two-dimensional images, text descriptions, product LOGO, and so on. In addition, the air screen can also provide corresponding software buttons on the display interface for users to choose, such as QR code payment buttons, color switching buttons, and viewing angle switching buttons.
参考图2，进一步作为优选的实施方式，所述空气屏13所述空气屏上设有体感传感器131、手势传感器132、眼球跟踪器133、摄像头134、触摸屏135、语音采集模块136、脑波采集装置137、超声波传感器138和红外传感器139。2, further as a preferred embodiment, the air screen 13 is provided with a somatosensory sensor 131, a gesture sensor 132, an eye tracker 133, a camera 134, a touch screen 135, a voice collection module 136, and brain wave collection. Device 137, ultrasonic sensor 138 and infrared sensor 139.
具体地，体感传感器131，用于捕捉用户的体感信号(如汽车模拟驾驶时用户的肢体动作信号)。Specifically, the somatosensory sensor 131 is used to capture the user's somatosensory signal (such as the user's body motion signal when a car is driving in a simulation).
手势传感器132，用于捕捉用户的手势信号(如通过手掌拇指抓取某件商品进行视角切换的信号等)。The gesture sensor 132 is used to capture the user's gesture signal (for example, a signal to switch the angle of view by grasping a certain commodity through the palm and thumb).
眼球跟踪器133，用于捕捉用户的眼部动作。眼球跟踪的目的有2个：1个是根据眼球的关注点自动进行展示内容切换，例如，用户的眼球在具有多个三维展示模型中的某一个三维模型停留或凝视了数秒，则空气屏可以自动切换到该三维模型的场景进行进一步细节展示；2、对用户的眼球动作进行实时监控。The eye tracker 133 is used to capture the user's eye movements. There are two purposes of eye tracking: one is to automatically switch the display content according to the focus of the eyeball. For example, if the user’s eyeball stays or stares at one of the multiple three-dimensional display models for several seconds, the air screen can Automatically switch to the scene of the 3D model for further detailed display; 2. Real-time monitoring of the user's eye movements.
摄像头134，用于捕捉用户的图像。优选地，所述摄像头可采用能同时采集二维人脸图像信息和深度信息的RGB-D的摄像头，以获取更加精确的用户图像。The camera 134 is used to capture an image of the user. Preferably, the camera may adopt an RGB-D camera capable of simultaneously collecting two-dimensional face image information and depth information to obtain more accurate user images.
触摸屏135，用于用户通过触摸的方式输入触摸指令。优选地，触摸屏可以贴在空气屏上或与空气屏合二为一。The touch screen 135 is used for the user to input touch instructions through touch. Preferably, the touch screen can be attached to the air screen or combined with the air screen into one.
语音采集模块136，用于采集用户的语音信号。以展示为汽车导购展示为例，用户的语音信号可以是“打开车门”、“打开车内空调”、“将车身颜色换成黑色”等用户的语音指令信号。优选地，语音采集模块可以是拾音器、麦克风等语音采集设备。The voice collection module 136 is used to collect the user's voice signal. Taking the display as a car shopping guide display as an example, the user's voice signal can be the user's voice command signals such as "open the door", "turn on the air conditioner in the car", "change the body color to black" and so on. Preferably, the voice collection module may be a voice collection device such as a microphone or a microphone.
脑波采集装置137，用于采集用户的脑波信号，以便于识别用户的意念或想法，从而对空气屏所显示对象的三维模型进行相应的操作，如颜色切换、视觉切换等等。The brain wave acquisition device 137 is used to collect the user's brain wave signal so as to recognize the user's ideas or thoughts, so as to perform corresponding operations on the three-dimensional model of the object displayed on the air screen, such as color switching, visual switching, and so on.
超声波传感器138，用于通过超声波感应是否有人接近，以便在有人靠近时由待机画面切换为三维模型实时展示画面(即将空气屏唤出)，智能化程度更高。The ultrasonic sensor 138 is used to sense whether someone is approaching through ultrasonic waves, so that when someone approaches, the standby screen is switched to a three-dimensional model real-time display screen (that is, the air screen is called out), which is more intelligent.
红外传感器139，用于通过红外线感应是否有人接近，以便在有人靠近时由待机画面切换为三维模型实时展示画面(即将空气屏唤出)，智能化程度更高。The infrared sensor 139 is used to sense whether someone is approaching through infrared rays, so that when someone approaches, the standby screen is switched to a three-dimensional model real-time display screen (that is, the air screen is called out), and the degree of intelligence is higher.
参考图2，移动终端18的第一通讯单元1801从空气屏13获取得到的链接或待展示对象压缩优化后的三维模型，显示单元1802根据得到的链接或待展示对象压缩优化后的三维模型进行显示，控制单元1803根据输入的信号对显示单元显示的三维模型进行控制，并生成对应的显示控制信号，第二通讯单元1804生成显示控制信号，将信号发送至显示模块19，显示模块19可以是第二智能显示屏，使得第二智能显示屏显示的内容与移动终端18显示的内容同步。Referring to FIG. 2, the first communication unit 1801 of the mobile terminal 18 obtains the obtained link from the air screen 13 or the compressed and optimized three-dimensional model of the object to be displayed, and the display unit 1802 performs compression and optimization of the three-dimensional model according to the obtained link or the object to be displayed. Display, the control unit 1803 controls the three-dimensional model displayed by the display unit according to the input signal and generates a corresponding display control signal. The second communication unit 1804 generates a display control signal and sends the signal to the display module 19, which can be The second smart display screen enables the content displayed on the second smart display screen to be synchronized with the content displayed on the mobile terminal 18.
参考图3，移动终端18的第一通讯单元1801从渲染压缩优化单元12获取得到的链接或待展示对象压缩优化后的三维模型，显示单元1802根据得到的链接或待展示对象压缩优化后的三维模型进行显示，控制单元1803根据输入的信号对显示单元显示的三维模型进行控制，并生成对应的显示控制信号，第二通讯单元1804生成显示控制信号，将信号发送至显示模块19，显示模块19可以是第二智能显示屏，使得第二智能显示屏显示的内容与移动终端18显示的内容同步。3, the first communication unit 1801 of the mobile terminal 18 obtains the obtained link or the optimized three-dimensional model of the object to be displayed from the rendering compression optimization unit 12, and the display unit 1802 compresses the optimized three-dimensional model according to the obtained link or the object to be displayed. The model is displayed. The control unit 1803 controls the three-dimensional model displayed by the display unit according to the input signal, and generates the corresponding display control signal. The second communication unit 1804 generates the display control signal and sends the signal to the display module 19 and the display module 19 It may be a second smart display screen, so that the content displayed on the second smart display screen is synchronized with the content displayed on the mobile terminal 18.
参考图2，进一步作为优选的实施方式，还包括通讯系统15，所述通讯系统15包括：Referring to FIG. 2, as a further preferred embodiment, the communication system 15 is further included, and the communication system 15 includes:
语音留言单元151，用于提供语音留言服务；The voice message unit 151 is used to provide voice message service;
电话客服单元152，用于提供电话客服服务；The telephone customer service unit 152 is used to provide telephone customer service;
机器人客服单元153，用于提供机器人语音客服服务；The robot customer service unit 153 is used to provide robot voice customer service;
视频真人客服单元154，用于提供视频真人客服服务。The live video customer service unit 154 is used to provide live video customer service.
本发明除了提供传统的语音留言、电话客服服务外，还可提供机器人语音客服(通过自学习的方式预先训练的模型)和视频真人客服(对真人扫描并建模得到的模型，可定制)服 务，方式更加灵活。In addition to providing traditional voice message and telephone customer service services, the present invention can also provide robotic voice customer service (models pre-trained through self-learning) and video live customer service (models obtained by scanning and modeling real people, which can be customized) services , The way is more flexible.
参考图2，进一步作为优选的实施方式，所述大数据分析后台14包括：Referring to FIG. 2, further as a preferred embodiment, the big data analysis backend 14 includes:
新增用户统计单元141，用于统计新增的用户数量；The newly added user statistics unit 141 is used to count the number of newly added users;
用户留存统计单元142，用于统计留存的用户数量；The user retention statistics unit 142 is used to count the number of retained users;
活跃度分析单元143，用于分析用户的活跃度；The activity analysis unit 143 is used to analyze the activity of the user;
用户信息分析单元144，用于分析用户的性别、年龄、注册信息和IP分布；The user information analysis unit 144 is used to analyze the user's gender, age, registration information, and IP distribution;
热点分析单元145，用于分析用户的观看热点，并生成相应的热图；The hot spot analysis unit 145 is used to analyze the user's viewing hot spot and generate a corresponding heat map;
用户观看行为分析单元146，用于进行用户观看行为分析，所述用户观看行为分析包括眼球跟踪、脸部表情分析、体感动作分析、鼠标浏览轨迹分析与视频录制、手势分析以及脑波分析中的至少一种；The user viewing behavior analysis unit 146 is used to perform user viewing behavior analysis. The user viewing behavior analysis includes eye tracking, facial expression analysis, somatosensory motion analysis, mouse browsing trajectory analysis and video recording, gesture analysis, and brain wave analysis. At least one
信息共享单元147，用于共享与发布大数据分析后台的分析结果。The information sharing unit 147 is used to share and publish the analysis results of the big data analysis background.
具体地，跟踪观看者的眼球动作主要是识别观看者关注的焦点所在(在看到关注的部分时，用户的眼球会与未看到关注部分的情况不同，如眼球停留的时间不同)，以便于空气屏直接将对象的三维模型切换至观看者关注的焦点或细节(如识别到用户关注汽车的车身，则直接切换至车身的三维模型)。Specifically, tracking the viewer's eye movements is mainly to identify the focus of the viewer's attention (when seeing the concerned part, the user's eyeballs will be different from the situation where the user does not see the concerned part, such as the time that the eyeball stays is different), so that The air screen directly switches the three-dimensional model of the object to the focus or details of the viewer's attention (if it is recognized that the user is paying attention to the body of the car, it will directly switch to the three-dimensional model of the car body).
用户的脸部表情识别，主要是用于识别观看者当前的心情(如开心、不开心等)。The facial expression recognition of the user is mainly used to recognize the viewer's current mood (such as happy, unhappy, etc.).
信息共享单元147，可以将大数据分析的结果共享与发布至现有通用的社交媒体，如微信、微博、博客等。The information sharing unit 147 can share and publish the results of big data analysis to existing general social media, such as WeChat, Weibo, and blogs.
参考图2，进一步作为优选的实施方式，还包括：Referring to Fig. 2, as a further preferred embodiment, it further includes:
空气屏远程控制模块16，用于远程控制空气屏的展示内容，所述远程控制包括广告的制作与播放、展示内容的更新、展示内容的排版以及展示内容的排期。The air screen remote control module 16 is used to remotely control the display content of the air screen. The remote control includes the production and playback of advertisements, the update of display content, the layout of the display content, and the scheduling of the display content.
本发明还增设了空气屏远程控制模块16，能对空气屏的展示内容进行远程控制，满足了不同用户的个性化定制要求，且能随时随地对空气屏进行远程操作，实现了数据的跨空间共享，更加方便。The present invention also adds an air screen remote control module 16, which can remotely control the display content of the air screen, meets the personalized customization requirements of different users, and can remotely operate the air screen anytime and anywhere, realizing data cross-space Sharing is more convenient.
参考图2，进一步作为优选的实施方式，所述交互展示模块包括多维视觉实景购模块17，所述多维视觉实景购模块17具体包括：Referring to FIG. 2, as a further preferred embodiment, the interactive display module includes a multi-dimensional visual real-scene shopping module 17, and the multi-dimensional visual real-scene shopping module 17 specifically includes:
三维场景展示单元171，用于提供自动导览服务、场景切换服务、三维实景服务、空间漫游服务、自由行走服务、二维平面图服务和三维户型图服务；The three-dimensional scene display unit 171 is used to provide automatic navigation services, scene switching services, three-dimensional real-world services, space roaming services, free walking services, two-dimensional floor plan services and three-dimensional house plan services;
AI智能语音导购服务172，用于提供多国语音解说服务、三维产品展示服务、三维导购员(通过对真人扫描后获得，可定制)服务、AI智能语音解答服务和三维机器人解说(预先 训练的模型)服务。AI smart voice shopping guide service 172, used to provide multi-country voice commentary services, three-dimensional product display services, three-dimensional shopping guide (obtained by scanning real people, customizable) services, AI smart voice answer services and three-dimensional robot commentary (pre-trained models) )service.
参考图4，以交互展示模块为空气屏，第二智能显示屏为例，应用图3的系统，本实施例的一种基于移动终端的展示控制方法，包括以下步骤：Referring to Fig. 4, taking the interactive display module as an air screen and the second smart display screen as an example, applying the system of Fig. 3, a display control method based on a mobile terminal in this embodiment includes the following steps:
S1、通过三维数据获取模块获取待展示对象的三维数据；S1. Obtain the three-dimensional data of the object to be displayed through the three-dimensional data acquisition module;
S2、三维云端模型库11对待展示对象的三维数据进行智能化处理，得到待展示对象的原始三维模型和对应的链接，所述智能化处理包括模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、去噪、着色和处理灯光；S2. The three-dimensional cloud model library 11 performs intelligent processing on the three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link. The intelligent processing includes model repair, editing, cropping, surface reduction, model reduction, Compressing, processing materials, processing textures, denoising, coloring and processing lights;
S3、渲染压缩优化单元12对待展示对象的原始三维模型进行渲染和压缩优化，得到待展示对象压缩优化后的三维模型；S3. The rendering compression optimization unit 12 performs rendering and compression optimization on the original three-dimensional model of the object to be displayed, to obtain a compressed and optimized three-dimensional model of the object to be displayed;
S4、空气屏13与用户进行交互，并根据交互的结果互动展示对象压缩优化后的三维模型；空气屏13的具体显示内容还可以由空气屏远程控制模块16控制；S4. The air screen 13 interacts with the user, and interactively displays the compressed and optimized three-dimensional model of the object according to the result of the interaction; the specific display content of the air screen 13 can also be controlled by the air screen remote control module 16;
S5、大数据分析后台14对用户观看交互展示内容时的行为进行分析和统计；S5. The big data analysis backend 14 analyzes and counts the behavior of users when viewing interactive display content;
S6、三维云端模型库11将待展示对象的原始三维模型对应的链接发送给第一智能显示屏或AR/VR设备，使得用户能通过打开链接的方式访问待展示对象的原始三维模型；S6. The 3D cloud model library 11 sends the link corresponding to the original 3D model of the object to be displayed to the first smart display or AR/VR device, so that the user can access the original 3D model of the object to be displayed by opening the link;
S7、移动终端18从渲染压缩优化单元12获取得到的链接或待展示对象压缩优化后的三维模型，并生成显示控制信号；S7. The mobile terminal 18 obtains the obtained link or the compressed and optimized three-dimensional model of the object to be displayed from the rendering compression optimization unit 12, and generates a display control signal;
S8、第二智能显示屏19根据显示控制信号进行显示。通过移动终端的控制单元1803将显示单元1802显示的三维模型进行控制并生成控制信号，经由第二通讯单元1804发送给第二智能显示屏19，从而使得第二智能显示屏19显示与移动终端18的显示一致，实现了第二智能显示屏19与移动终端18的显示同步。S8. The second smart display 19 performs display according to the display control signal. The control unit 1803 of the mobile terminal controls the three-dimensional model displayed by the display unit 1802 and generates a control signal, which is sent to the second smart display 19 via the second communication unit 1804, so that the second smart display 19 is displayed on the mobile terminal 18. The display is the same, and the display synchronization of the second smart display 19 and the mobile terminal 18 is realized.
应当认识到，本发明的实施例可以由计算机硬件、硬件和软件的组合、或者通过存储在非暂时性计算机可读存储器中的计算机指令来实现或实施。所述方法可以使用标准编程技术-包括配置有计算机程序的非暂时性计算机可读存储介质在计算机程序中实现，其中如此配置的存储介质使得计算机以特定和预定义的方式操作——根据在具体实施例中描述的方法和附图。每个程序可以以高级过程或面向对象的编程语言来实现以与计算机系统通信。然而，若需要，该程序可以以汇编或机器语言实现。在任何情况下，该语言可以是编译或解释的语言。此外，为此目的该程序能够在编程的专用集成电路上运行。It should be recognized that the embodiments of the present invention can be realized or implemented by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory. The method can be implemented in a computer program using standard programming techniques-including a non-transitory computer readable storage medium configured with a computer program, where the storage medium so configured allows the computer to operate in a specific and predefined manner-according to the specific The methods and drawings described in the examples. Each program can be implemented in a high-level process or object-oriented programming language to communicate with the computer system. However, if necessary, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. Furthermore, the program can be run on a programmed application specific integrated circuit for this purpose.
此外，可按任何合适的顺序来执行本文描述的过程的操作，除非本文另外指示或以其他方式明显地与上下文矛盾。本文描述的过程(或变型和/或其组合)可在配置有可执行指令的一个或多个计算机系统的控制下执行，并且可作为共同地在一个或多个处理器上执行的代码(例 如，可执行指令、一个或多个计算机程序或一个或多个应用)、由硬件或其组合来实现。所述计算机程序包括可由一个或多个处理器执行的多个指令。In addition, the operations of the processes described herein may be performed in any suitable order, unless otherwise indicated herein or otherwise clearly contradictory to the context. The processes (or variants and/or combinations thereof) described herein can be executed under the control of one or more computer systems configured with executable instructions, and can be used as codes that are executed collectively on one or more processors (such as , Executable instructions, one or more computer programs, or one or more applications), implemented by hardware or a combination thereof. The computer program includes a plurality of instructions executable by one or more processors.
进一步，所述方法可以在可操作地连接至合适的任何类型的计算平台中实现，包括但不限于个人电脑、迷你计算机、主框架、工作站、网络或分布式计算环境、单独的或集成的计算机平台、或者与带电粒子工具或其它成像装置通信等等。本发明的各方面可以以存储在非暂时性存储介质或设备上的机器可读代码来实现，无论是可移动的还是集成至计算平台，如硬盘、光学读取和/或写入存储介质、RAM、ROM等，使得其可由可编程计算机读取，当存储介质或设备由计算机读取时可用于配置和操作计算机以执行在此所描述的过程。此外，机器可读代码，或其部分可以通过有线或无线网络传输。当此类媒体包括结合微处理器或其他数据处理器实现上文所述步骤的指令或程序时，本文所述的发明包括这些和其他不同类型的非暂时性计算机可读存储介质。当根据本发明所述的方法和技术编程时，本发明还包括计算机本身。Further, the method can be implemented in any type of computing platform that is operably connected to a suitable computing platform, including but not limited to personal computers, minicomputers, main frames, workstations, networks or distributed computing environments, separate or integrated computers Platform, or communication with charged particle tools or other imaging devices, etc. Aspects of the present invention can be implemented by machine-readable codes stored on non-transitory storage media or devices, whether removable or integrated into computing platforms, such as hard disks, optical reading and/or writing storage media, RAM, ROM, etc., so that they can be read by a programmable computer, and when the storage medium or device is read by the computer, it can be used to configure and operate the computer to perform the processes described herein. In addition, the machine-readable code, or part thereof, can be transmitted through a wired or wireless network. When such media include instructions or programs that implement the steps described above in combination with a microprocessor or other data processors, the invention described herein includes these and other different types of non-transitory computer-readable storage media. When programming according to the methods and techniques of the present invention, the present invention also includes the computer itself.
计算机程序能够应用于输入数据以执行本文所述的功能，从而转换输入数据以生成存储至非易失性存储器的输出数据。输出信息还可以应用于一个或多个输出设备如显示器。在本发明优选的实施例中，转换的数据表示物理和有形的对象，包括显示器上产生的物理和有形对象的特定视觉描绘。A computer program can be applied to input data to perform the functions described herein, thereby transforming the input data to generate output data that is stored in non-volatile memory. The output information can also be applied to one or more output devices such as displays. In a preferred embodiment of the present invention, the converted data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on the display.
以上所述，只是本发明的较佳实施例而已，本发明并不局限于上述实施方式，只要其以相同的手段达到本发明的技术效果，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明保护的范围之内。在本发明的保护范围内其技术方案和/或实施方式可以有各种不同的修改和变化。The above are only preferred embodiments of the present invention. The present invention is not limited to the above-mentioned embodiments, as long as it achieves the technical effects of the present invention by the same means, everything is done within the spirit and principle of the present invention. Any modifications, equivalent replacements, improvements, etc. of should be included in the protection scope of the present invention. Within the protection scope of the present invention, its technical solutions and/or implementation manners may have various modifications and changes.

Claims (10)

  1. 一种基于移动终端的展示控制系统，其特征在于：包括：A display control system based on a mobile terminal is characterized in that it includes:
    三维数据获取模块，用于获取待展示对象的三维数据；The 3D data acquisition module is used to acquire 3D data of the object to be displayed;
    三维数据处理模块，用于将获取的待展示对象的三维数据进行处理以得到待展示对象的原始三维模型和对应的链接；The three-dimensional data processing module is used to process the acquired three-dimensional data of the object to be displayed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
    渲染压缩优化单元，用于对待展示对象的原始三维模型进行渲染和压缩优化，得到待展示对象压缩优化后的三维模型；The rendering compression optimization unit is used to perform rendering and compression optimization on the original 3D model of the object to be displayed, and obtain the compressed and optimized 3D model of the object to be displayed;
    交互展示模块，用于根据得到的链接或待展示对象压缩优化后的三维模型进行交互展示；Interactive display module, used for interactive display based on the obtained link or the compressed and optimized 3D model of the object to be displayed;
    移动终端，用于获取得到的链接或待展示对象压缩优化后的三维模型，并生成显示控制信号；The mobile terminal is used to obtain the obtained link or the compressed and optimized three-dimensional model of the object to be displayed, and generate a display control signal;
    显示模块，用于根据显示控制信号进行显示。The display module is used to display according to the display control signal.
  2. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：所述三维数据获取模块包括：A display control system based on a mobile terminal according to claim 1, wherein the three-dimensional data acquisition module comprises:
    航拍扫描仪，用于扫描区域范围的三维数据并进行本地预处理；Aerial photography scanner, used to scan the three-dimensional data of the area and perform local preprocessing;
    室内扫描仪，用于扫描室内环境的三维数据并进行本地预处理；Indoor scanner, used to scan 3D data of indoor environment and perform local preprocessing;
    室外扫描模仪，用于扫描室外环境的三维数据并进行本地预处理；Outdoor scanning module, used to scan 3D data of outdoor environment and perform local preprocessing;
    物体扫描仪，用于扫描物体的三维数据并进行本地预处理；Object scanner, used to scan the three-dimensional data of the object and perform local preprocessing;
    人体扫描仪，用于扫描人体的三维数据并进行本地预处理；Human body scanner, used to scan the three-dimensional data of the human body and perform local preprocessing;
    第三方三维数据获取模块，用于从第三方获取待展示对象的三维数据。The third-party 3D data acquisition module is used to acquire the 3D data of the object to be displayed from the third party.
  3. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：三维数据处理模块包括三维云端模型库，The display control system based on a mobile terminal according to claim 1, wherein the three-dimensional data processing module includes a three-dimensional cloud model library,
    其中三维云端模型库，用于对待展示对象的三维数据进行智能化处理，得到待展示对象的原始三维模型和对应的链接，所述智能化处理包括模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、去噪、着色和处理灯光。The 3D cloud model library is used to intelligently process the 3D data of the object to be displayed to obtain the original 3D model of the object to be displayed and the corresponding link. The intelligent processing includes model repair, editing, cropping, surface reduction, and model reduction , Compression, material processing, texture processing, denoising, coloring and light processing.
  4. 根据权利要求3所述的一种基于移动终端的展示控制系统，其特征在于：所述三维云端模型库包括：A display control system based on a mobile terminal according to claim 3, wherein the three-dimensional cloud model library includes:
    访问管理单元，用于根据用户的有效登录凭证授权用户相应的访问权限；The access management unit is used to authorize the user with corresponding access rights according to the user's valid login credentials;
    智能处理单元，用于进行模型修复、剪辑、裁剪、减面、减模、压缩、处理材质、处理贴图、去噪、着色和处理灯光，得到待展示对象的原始三维模型；Intelligent processing unit, used for model repair, editing, cropping, surface reduction, mold reduction, compression, material processing, texture processing, denoising, coloring and light processing, to obtain the original 3D model of the object to be displayed;
    链接生成单元，用于根据待展示对象的原始三维模型生成对应的链接；The link generating unit is used to generate the corresponding link according to the original three-dimensional model of the object to be displayed;
    数据库，用于存储用户观看交互展示内容时的行为数据、用户的有效登录凭证、待展示 对象的原始三维模型以及对应的链接。The database is used to store the user's behavior data when viewing interactive display content, the user's valid login credentials, the original three-dimensional model of the object to be displayed, and the corresponding link.
  5. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：所述交互展示模块具体用于：The mobile terminal-based display control system according to claim 1, wherein the interactive display module is specifically used for:
    根据与用户的交互在第一智能显示屏中显示待展示对象压缩优化后的三维模型或待展示对象的原始三维模型。According to the interaction with the user, the compressed and optimized three-dimensional model of the object to be displayed or the original three-dimensional model of the object to be displayed is displayed on the first smart display screen.
  6. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：移动终端包括手机、IPAD、笔记本电脑和智能手表中的至少一个。The display control system based on a mobile terminal according to claim 1, wherein the mobile terminal includes at least one of a mobile phone, an IPAD, a notebook computer, and a smart watch.
  7. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：移动终端包括：A display control system based on a mobile terminal according to claim 1, wherein the mobile terminal comprises:
    第一通讯单元，用于接收得到的链接或待展示对象压缩优化后的三维模型；The first communication unit is configured to receive the obtained link or the compressed and optimized three-dimensional model of the object to be displayed;
    显示单元，用于显示得到的链接或待展示对象压缩优化后的三维模型；The display unit is used to display the obtained link or the compressed and optimized 3D model of the object to be displayed;
    控制单元，用于根据输入的信号对显示单元显示的三维模型进行控制，并生成对应的显示控制信号；The control unit is used to control the three-dimensional model displayed by the display unit according to the input signal and generate a corresponding display control signal;
    第二通讯单元，用于将生成的显示控制信号发送给显示模块。The second communication unit is used to send the generated display control signal to the display module.
  8. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：还包括通讯系统，所述通讯系统包括：A display control system based on a mobile terminal according to claim 1, characterized in that it further comprises a communication system, said communication system comprising:
    语音留言单元，用于提供语音留言服务；Voice message unit, used to provide voice message service;
    电话客服单元，用于提供电话客服服务；Telephone customer service unit, used to provide telephone customer service;
    机器人客服单元，用于提供机器人语音客服服务；Robot customer service unit, used to provide robot voice customer service;
    视频真人客服单元，用于提供视频真人客服服务。The live video customer service unit is used to provide live video customer service.
  9. 根据权利要求1所述的一种基于移动终端的展示控制系统，其特征在于：所述交互展示模块包括多维视觉实景购模块，所述多维视觉实景购模块具体包括：The mobile terminal-based display control system according to claim 1, wherein the interactive display module includes a multi-dimensional visual real-scenes shopping module, and the multi-dimensional visual real-sale shopping module specifically includes:
    三维场景展示单元，用于提供自动导览服务、场景切换服务、三维实景服务、空间漫游服务、自由行走服务、二维平面图服务和三维户型图服务；3D scene display unit, used to provide automatic navigation service, scene switching service, 3D real scene service, space roaming service, free walking service, 2D floor plan service and 3D house plan service;
    AI智能语音导购服务，用于提供多国语音解说服务、三维产品展示服务、三维导购员服务、AI智能语音解答服务和三维机器人解说服务。AI intelligent voice shopping guide service is used to provide multi-national voice commentary services, three-dimensional product display services, three-dimensional shopping guide services, AI smart voice answer services and three-dimensional robot commentary services.
  10. 一种基于移动终端的展示控制方法，其特征在于：包括以下步骤：A display control method based on a mobile terminal is characterized in that it includes the following steps:
    获取待展示对象的三维数据；Obtain the three-dimensional data of the object to be displayed;
    获取的待展示对象的三维数据进行处理以得到待展示对象的原始三维模型和对应的链接；The acquired three-dimensional data of the object to be displayed is processed to obtain the original three-dimensional model of the object to be displayed and the corresponding link;
    对待展示对象的原始三维模型进行渲染和压缩优化，得到待展示对象压缩优化后的三维 模型；Perform rendering and compression optimization on the original 3D model of the object to be displayed, and obtain the compressed and optimized 3D model of the object to be displayed;
    根据得到的链接或待展示对象压缩优化后的三维模型进行交互展示；Perform interactive display based on the obtained link or the compressed and optimized 3D model of the object to be displayed;
    通过移动终端获取得到的链接或待展示对象压缩优化后的三维模型，并生成显示控制信号；Obtain the obtained link or compressed and optimized 3D model of the object to be displayed through the mobile terminal, and generate a display control signal;
    根据显示控制信号进行显示。Display according to the display control signal.
PCT/CN2019/109473 2019-01-21 2019-09-30 Display control system and method based on mobile terminal WO2020151255A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910052164.1 2019-01-21
CN201910052164.1A CN109918005A (en) 2019-01-21 2019-01-21 A kind of displaying control system and method based on mobile terminal

Publications (1)

Publication Number Publication Date
WO2020151255A1 true WO2020151255A1 (en) 2020-07-30

Family

ID=66960428

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/109473 WO2020151255A1 (en) 2019-01-21 2019-09-30 Display control system and method based on mobile terminal

Country Status (2)

Country Link
CN (1) CN109918005A (en)
WO (1) WO2020151255A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109918005A (en) * 2019-01-21 2019-06-21 广东康云科技有限公司 A kind of displaying control system and method based on mobile terminal
CN110298918A (en) * 2019-08-02 2019-10-01 湖南海诚宇信信息技术有限公司 One kind is based on GPU real-time three-dimensional modeling display device and three-dimensional modeling display methods
CN111080799A (en) * 2019-12-04 2020-04-28 广东康云科技有限公司 Scene roaming method, system, device and storage medium based on three-dimensional modeling
CN112286437A (en) * 2020-10-27 2021-01-29 四川日报网络传媒发展有限公司 Interactive display equipment and method and device of display cabinet, display cabinet and computer readable storage medium
CN112364403A (en) * 2020-11-23 2021-02-12 四川大学 3D intelligent matching display system and method for shoe moving end

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104731343A (en) * 2015-04-14 2015-06-24 上海云富网络科技有限公司 Virtual reality man-machine interaction children education experience system based on mobile terminal
US20160132962A1 (en) * 2013-06-17 2016-05-12 Spreadtrum Commications (Shanghai) Co. Ltd. Three-dimensional shopping platform displaying system
CN109085966A (en) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 A kind of three-dimensional display system and method based on cloud computing
CN109918005A (en) * 2019-01-21 2019-06-21 广东康云科技有限公司 A kind of displaying control system and method based on mobile terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106408620A (en) * 2016-09-08 2017-02-15 成都希盟泰克科技发展有限公司 Compressive sensing-based three-dimensional grid model data processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160132962A1 (en) * 2013-06-17 2016-05-12 Spreadtrum Commications (Shanghai) Co. Ltd. Three-dimensional shopping platform displaying system
CN104731343A (en) * 2015-04-14 2015-06-24 上海云富网络科技有限公司 Virtual reality man-machine interaction children education experience system based on mobile terminal
CN109085966A (en) * 2018-06-15 2018-12-25 广东康云多维视觉智能科技有限公司 A kind of three-dimensional display system and method based on cloud computing
CN109918005A (en) * 2019-01-21 2019-06-21 广东康云科技有限公司 A kind of displaying control system and method based on mobile terminal

Also Published As

Publication number Publication date
CN109918005A (en) 2019-06-21

Similar Documents

Publication Publication Date Title
CN109085966B (en) Three-dimensional display system and method based on cloud computing
WO2020151255A1 (en) Display control system and method based on mobile terminal
US10474336B2 (en) Providing a user experience with virtual reality content and user-selected, real world objects
US9479736B1 (en) Rendered audiovisual communication
CN111541907B (en) Article display method, apparatus, device and storage medium
CN106683197A (en) VR (virtual reality) and AR (augmented reality) technology fused building exhibition system and VR and AR technology fused building exhibition method
CN108933892A (en) Portable electronic device and its control method
CN107358007A (en) Control the method, apparatus of intelligent domestic system and calculate readable storage medium storing program for executing
Cucchiara et al. Visions for augmented cultural heritage experience
CN107077750A (en) Incarnation selection mechanism
CN112199016B (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
JP2017536715A (en) Expression of physical interaction in 3D space
CN103400543A (en) 3D (three-dimensional) interactive display system and display method thereof
CN111448568B (en) Environment-based application presentation
WO2020151432A1 (en) Data processing method and system for intelligent house viewing
WO2020151428A1 (en) Live-action 3d intelligent visual monitoring system and method
WO2020151425A1 (en) Switching display method and system for 3d real scene visual monitoring
CN108594999A (en) Control method and device for panoramic picture display systems
TWI795762B (en) Method and electronic equipment for superimposing live broadcast character images in real scenes
CN108701355A (en) GPU optimizes and the skin possibility predication based on single Gauss online
WO2020151430A1 (en) Air imaging system and implementation method therefor
CN105472358A (en) Intelligent terminal about video image processing
CN113453027A (en) Live video and virtual makeup image processing method and device and electronic equipment
CN113014960B (en) Method, device and storage medium for online video production
CN108364354A (en) Display system based on artificial intelligence and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19911537

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19911537

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 19911537

Country of ref document: EP

Kind code of ref document: A1