CN114327334A - Environment information transmission system based on light ray analysis and transmission method thereof - Google Patents
Environment information transmission system based on light ray analysis and transmission method thereof Download PDFInfo
- Publication number
- CN114327334A CN114327334A CN202111609336.4A CN202111609336A CN114327334A CN 114327334 A CN114327334 A CN 114327334A CN 202111609336 A CN202111609336 A CN 202111609336A CN 114327334 A CN114327334 A CN 114327334A
- Authority
- CN
- China
- Prior art keywords
- streaming media
- illumination model
- acquisition device
- environment
- display terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 21
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000005286 illumination Methods 0.000 claims abstract description 39
- 230000007613 environmental effect Effects 0.000 claims description 22
- 238000004891 communication Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
Landscapes
- Image Generation (AREA)
Abstract
The invention provides an environment information transmission system based on light ray analysis and a transmission method thereof, wherein scanning information data of an environment is acquired by a planar streaming media acquisition device and is transmitted to a central processor, and the scanning information data comprises environment depth information and environment color information; the central processor constructs an initial frame local illumination model based on the scanning information data, updates a global illumination model in real time based on the initial frame local illumination model, draws an update frame, and sends the update frame to the streaming media display terminal for display. The environment information transmission system based on the light ray analysis and the transmission method thereof can judge the plane streaming media in 3d, can be used for low-end equipment, and avoid the shooting cost of an expensive 3d camera.
Description
Technical Field
The invention belongs to the technical field of video information processing, and particularly relates to an environment information transmission system based on light ray analysis and a transmission method thereof.
Background
The traditional video is a planar streaming media, the 3d analysis of the planar streaming media must depend on ambient light, the ambient light is a standard for showing the 3d structure of the current scene, but the light is also blocked, and the diffuse reflection of the material is influenced, so the streaming media needs to be processed, and the 3d structure of the planar streaming media is finally drawn.
Disclosure of Invention
Aiming at the defects, the invention provides an environmental information transmission system based on light analysis and a transmission method thereof.
The technical scheme adopted by the invention is specifically as follows:
the environment information transmission system based on light ray analysis comprises a streaming media display terminal, a planar streaming media acquisition device and a mobile power supply; the streaming media display terminal is connected with the plane streaming media acquisition device; the mobile power supply is connected with the plane streaming media acquisition device and provides power for the plane streaming media acquisition device; the plane streaming media acquisition device is connected with the central processor, and the central processor is connected with the streaming media display terminal through the wireless communication module.
The environmental information transmission method based on the light ray analysis adopts the environmental information transmission system based on the light ray analysis, and comprises the following steps:
(1) scanning information data of an environment are acquired through a planar streaming media acquisition device, and the scanning information data are transmitted to a central processor, wherein the scanning information data comprise environment depth information and environment color information;
(2) the central processor constructs an initial frame local illumination model based on the scanning information data, updates a global illumination model in real time based on the initial frame local illumination model, draws an update frame, and sends the update frame to the streaming media display terminal for display;
further, the step (2) specifically comprises the following steps:
(21) denoising environmental depth information in the scanning information data and converting the environmental depth information into three-dimensional point cloud, namely an initial frame local illumination model;
(22) matching the spatial positions of the local illumination model and the global illumination model of the initial frame, and reversely solving the environmental spatial position parameters of the planar streaming media acquisition device;
(23) fusing the local illumination model and the global illumination model of the initial frame to obtain an updated global illumination model, and performing light rendering on the updated global illumination model according to the environmental space position parameter of the planar streaming media acquisition device, wherein the screen capture of the light-rendered global illumination model is an update frame;
(24) and the user adjusts the scanning process according to the update frame displayed by the streaming media display terminal.
The specific process of the step (24) is as follows: and if the update frame displayed by the streaming media display terminal has a blank space caused by object shielding, moving the planar streaming media acquisition device and adjusting the scanning angle to avoid shielding the object.
The environment information transmission system based on the light ray analysis and the transmission method thereof can judge the plane streaming media in 3d, can be used for low-end equipment, and avoid the shooting cost of an expensive 3d camera.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments according to the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, and it should be understood that when the terms "comprises" and/or "comprising" are used in this specification, they specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof, unless the context clearly indicates otherwise.
The environment information transmission system based on light ray analysis comprises a streaming media display terminal, a planar streaming media acquisition device and a mobile power supply; the streaming media display terminal is connected with the plane streaming media acquisition device; the mobile power supply is connected with the plane streaming media acquisition device and provides power for the plane streaming media acquisition device; the plane streaming media acquisition device is connected with the central processor, and the central processor is connected with the streaming media display terminal through the wireless communication module.
The streaming media display terminal can be a handheld device, and the central processor and the mobile power supply are arranged in a mobile carrier. A user carries a mobile carrier and holds the planar streaming media acquisition device to scan the environment. The streaming media display terminal and the plane streaming media acquisition device exchange information in a wireless network mode. The plane flow media collecting device is connected with a central processor and a mobile power supply which are arranged in a mobile carrier through cables, the cables are formed by collinear combination of data lines and power lines, one end of each cable is connected with the plane flow media collecting device, the other end of each cable is divided into a power interface and a data interface, the power interfaces are connected with the mobile power supply, and the data interfaces are connected with a USB interface of the central processor.
The central processor may be a computer.
The plane streaming media acquisition device is used for acquiring environmental information to obtain scanning information data and transmitting the scanning information data to the central processor through a data interface of a cable, the central processor performs real-time modeling on the received scanning information data to obtain an initial frame local illumination model and feeds a modeling result back to the streaming media display terminal through a wireless network, and a user adjusts and controls a scanning process through the initial frame local illumination model displayed by the streaming media display terminal.
The streaming media display terminal can display the initial frame local illumination model in real time and can also control the scanning process of the planar streaming media acquisition device through the streaming media display terminal.
The environmental information transmission method of the environmental information transmission system based on the light ray analysis comprises the following steps:
(1) scanning information data of an environment are acquired through a planar streaming media acquisition device, and the scanning information data are transmitted to a central processor, wherein the scanning information data comprise environment depth information and environment color information;
(2) the central processor constructs an initial frame local illumination model based on the scanning information data, updates a global illumination model in real time based on the initial frame local illumination model, draws an update frame, and sends the update frame to the streaming media display terminal for display;
the method specifically comprises the following steps:
(21) denoising environmental depth information in the scanning information data and converting the environmental depth information into three-dimensional point cloud, namely an initial frame local illumination model;
(22) matching the spatial positions of the local illumination model and the global illumination model of the initial frame, and reversely solving the environmental spatial position parameters of the planar streaming media acquisition device;
(23) fusing the local illumination model and the global illumination model of the initial frame to obtain an updated global illumination model, and performing light rendering on the updated global illumination model according to the environmental space position parameter of the planar streaming media acquisition device, wherein the screen capture of the light-rendered global illumination model is an update frame;
(24) and the user adjusts the scanning process according to the update frame displayed by the streaming media display terminal. And if the update frame displayed by the streaming media display terminal has a blank space caused by object shielding, moving the planar streaming media acquisition device and adjusting the scanning angle to avoid shielding the object.
The foregoing is merely exemplary and illustrative of the present invention and various modifications, additions and substitutions may be made by those skilled in the art to the specific embodiments described without departing from the scope of the invention as defined in the following claims.
While the present invention has been described in terms of the preferred embodiments described above, it should be understood that these embodiments are illustrative only, and the claims are not limited to those embodiments. Those skilled in the art will be able to make modifications and substitutions in light of the present disclosure, which are to be considered as falling within the scope of the appended claims. Each feature disclosed or illustrated in this specification may be incorporated in the invention, whether alone or in any appropriate combination with any other feature disclosed or illustrated herein.
Claims (4)
1. The environment information transmission system based on light ray analysis is characterized by comprising a streaming media display terminal, a planar streaming media acquisition device and a mobile power supply; the streaming media display terminal is connected with the plane streaming media acquisition device; the mobile power supply is connected with the plane streaming media acquisition device and provides power for the plane streaming media acquisition device; the plane streaming media acquisition device is connected with the central processor, and the central processor is connected with the streaming media display terminal through the wireless communication module.
2. The light analysis-based environmental information transfer method, wherein the light analysis-based environmental information transfer system of claim 1 is used, comprising the steps of:
(1) scanning information data of an environment are acquired through a planar streaming media acquisition device, and the scanning information data are transmitted to a central processor, wherein the scanning information data comprise environment depth information and environment color information;
(2) the central processor constructs an initial frame local illumination model based on the scanning information data, updates a global illumination model in real time based on the initial frame local illumination model, draws an update frame, and sends the update frame to the streaming media display terminal for display.
3. The method for transmitting environmental information based on light ray analysis according to claim 1, wherein the step (2) comprises the following steps:
(21) denoising environmental depth information in the scanning information data and converting the environmental depth information into three-dimensional point cloud, namely an initial frame local illumination model;
(22) matching the spatial positions of the local illumination model and the global illumination model of the initial frame, and reversely solving the environmental spatial position parameters of the planar streaming media acquisition device;
(23) fusing the local illumination model and the global illumination model of the initial frame to obtain an updated global illumination model, and performing light rendering on the updated global illumination model according to the environmental space position parameter of the planar streaming media acquisition device, wherein the screen capture of the light-rendered global illumination model is an update frame;
(24) and the user adjusts the scanning process according to the update frame displayed by the streaming media display terminal.
4. A method for transmitting environmental information based on light analysis according to claim 3, wherein the step (24) comprises the following steps: and if the update frame displayed by the streaming media display terminal has a blank space caused by object shielding, moving the planar streaming media acquisition device and adjusting the scanning angle to avoid shielding the object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111609336.4A CN114327334A (en) | 2021-12-27 | 2021-12-27 | Environment information transmission system based on light ray analysis and transmission method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111609336.4A CN114327334A (en) | 2021-12-27 | 2021-12-27 | Environment information transmission system based on light ray analysis and transmission method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114327334A true CN114327334A (en) | 2022-04-12 |
Family
ID=81012611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111609336.4A Pending CN114327334A (en) | 2021-12-27 | 2021-12-27 | Environment information transmission system based on light ray analysis and transmission method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114327334A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103500013A (en) * | 2013-10-18 | 2014-01-08 | 武汉大学 | Real-time three-dimensional mapping system and method based on Kinect and streaming media technology |
| CN106856012A (en) * | 2017-01-12 | 2017-06-16 | 上海云拟科技有限公司 | A kind of real-time large scale scene 3-D scanning modeling method and system |
| CN108089191A (en) * | 2017-12-25 | 2018-05-29 | 中山大学 | A kind of Global localization system and method based on laser radar |
-
2021
- 2021-12-27 CN CN202111609336.4A patent/CN114327334A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103500013A (en) * | 2013-10-18 | 2014-01-08 | 武汉大学 | Real-time three-dimensional mapping system and method based on Kinect and streaming media technology |
| CN106856012A (en) * | 2017-01-12 | 2017-06-16 | 上海云拟科技有限公司 | A kind of real-time large scale scene 3-D scanning modeling method and system |
| CN108089191A (en) * | 2017-12-25 | 2018-05-29 | 中山大学 | A kind of Global localization system and method based on laser radar |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111345029B (en) | Target tracking method and device, movable platform and storage medium | |
| CN109660723B (en) | Panoramic shooting method and device | |
| US10560637B2 (en) | Image processing system, remotely controlled shooting assembly and exposure information prompt method | |
| CN106658148B (en) | VR playing method, VR playing device and VR playing system | |
| CN106131407A (en) | Shooting synchronous method and synchronizer | |
| CN110796738B (en) | Three-dimensional visualization method and device for state tracking of inspection equipment | |
| CN105407297A (en) | Multi-view-angle video acquisition systems | |
| US20230179734A1 (en) | Video image display method and apparatus, multimedia device and storage medium | |
| CN103389887A (en) | Image counterpoint display method and apparatus thereof | |
| KR20200074490A (en) | Vehicle and vehicle image controlling method | |
| JP2022030844A (en) | Information processing program, information processing device, and information processing method | |
| CN114327334A (en) | Environment information transmission system based on light ray analysis and transmission method thereof | |
| CN108712604B (en) | Panoramic shooting method and mobile terminal | |
| CN204795269U (en) | Can realize remote control's two -way camera in portable front and back | |
| WO2011107037A2 (en) | System, method and device for capturing scene in coverage region of antenna | |
| CN110113575A (en) | A kind of agriculture feelings information real-time monitoring platform based on NB-IoT | |
| CN115061380A (en) | Device control method and device, electronic device and readable storage medium | |
| CN114494659A (en) | Image display method and device, AR head-mounted equipment and storage medium | |
| CN103716528A (en) | PTZ camera remote control system and method based on touch terminal | |
| CN208820925U (en) | WirelessHD video camera and video conferencing system | |
| CN102316272B (en) | Remote controller control method, apparatus thereof and remote controller | |
| US10620585B2 (en) | Method, device, system and storage medium for displaying a holographic portrait in real time | |
| CN108537839B (en) | Visual guidance strong real-time pointing device based on field bus | |
| CN111818481A (en) | Unmanned aerial vehicle data interaction method, device, system and storage medium | |
| CN112925413B (en) | Augmented reality glasses and touch method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |