CN115361521A - Holographic image video conference system - Google Patents
Holographic image video conference system Download PDFInfo
- Publication number
- CN115361521A CN115361521A CN202210986658.9A CN202210986658A CN115361521A CN 115361521 A CN115361521 A CN 115361521A CN 202210986658 A CN202210986658 A CN 202210986658A CN 115361521 A CN115361521 A CN 115361521A
- Authority
- CN
- China
- Prior art keywords
- video
- holographic
- conference
- participants
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a holographic image video conference system, which belongs to the technical field of computers, and is provided with a conference video acquisition system, wherein a laser positioning device is used for capturing the position and the attitude signal of a current talker in a conference process in real time, and a mobile camera set and a mobile microphone array set are controlled based on an acquisition central control module so as to capture the dynamic information of the current talker; meanwhile, all conventional videos are collected through a common camera and a common microphone, and are subjected to real-time holographic processing through a cloud processing server, so that holographic projection of all participants is achieved, and at last, holographic video display and switching control are performed through a holographic image real-time display system, so that 3D conversation between a conversation person and the conference person is achieved efficiently, and meeting experience and immersion of the conversation person and the conference person are favorably met.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a holographic video conference system.
Background
Hologram or holographic projection technology, which is a technology for recording and reproducing a real three-dimensional image of an object by using interference and diffraction principles; the holographic projection technology can be used for reproducing real 3D images in space to meet the visual perception function of observers, but the holographic projection technology is only applied to stage performance scenes, so that how to apply the holographic projection technology to the current daily life office becomes the current research focus to improve the reality and experience of the current daily life office;
at present, an existing remote video conference system can only present 2D videos of conference participants mutually, 3D conversation between the conference participants and the conference participants cannot be achieved, and with the development of VR technology pair, although a batch of virtual conference systems based on VR technology appear, compared with holographic projection technology, a virtual conference system based on VR technology needs additional VR equipment worn by the conference participants, so that convenience is low, meanwhile, the virtual conference system based on VR technology has the defects of insufficient immersion of real scenes and the like, and the experience of the real scenes of both conference participants is difficult to guarantee; although some video conference systems based on holographic projection technology are available, for example, chinese patent No. CN111736694a is a holographic presentation method, storage medium and system for a teleconference, the present invention provides an immersive conference effect by using a robot to simulate the body motions of participants of a teleconference, and fusing the sounds into the motions, but the information collection is comprehensive, only motion information can be captured, and dynamic capture cannot be performed for the spatial information and the mood of the current conference, so the experience feeling is low, the conference immersion feeling is insufficient, in addition, the conference communication cost is high, holographic projection of all conference personnel cannot be realized, and further, 3D conversation between the conference personnel and the conference personnel cannot be realized efficiently.
Therefore, it is desirable to invent a video conferencing system for holography to solve the above problems.
Disclosure of Invention
The invention aims to solve the defects in the prior art and provides a holographic video conference system.
In order to achieve the purpose, the invention adopts the following technical scheme:
a holographic image video conference system comprises a conference video acquisition system, a cloud processing server and a holographic image real display system; the conference video acquisition system, the cloud processing server and the holographic image real-time display system are respectively in communication connection through a 5G network;
the conference video acquisition system comprises a laser positioning device, an acquisition central control module, a mobile camera set and a mobile microphone array set; the holographic image real display system comprises a main display device, a slave display unit and a loudspeaker;
the conference video acquisition system is used for acquiring holographic video data of a current speaker in a conference process;
the cloud processing server is used for performing data transfer on the holographic video data of the current speaker;
the holographic image real-time display system is used for acquiring the holographic video data of the current speaker and displaying the holographic video data in real time so as to realize the 3D interaction of the remote video conference.
Further, the laser positioning device is used for acquiring a laser signal of the current speaker in a target area; the acquisition central control module is used for acquiring the laser signal of the current speaker, calculating the position information and the attitude information of the current speaker according to the laser signal, and controlling the mobile camera set and the mobile microphone array set to move according to the position information and the attitude information; the mobile camera set comprises at least four depth cameras with equal directions and is used for collecting holographic video data of the current talker in real time; the mobile microphone array set comprises a plurality of microphone arrays and is used for collecting voice data of the current talker in real time.
Further, the conference video acquisition system is also used for acquiring the conventional video data of all the participants.
Further, the cloud processing server further comprises a video analysis module and a holographic video processing module; the video analysis module is used for acquiring the conventional video data of all the participants and performing framing processing to form a plurality of frames of conventional video images of all the participants; the video processing module is used for performing holographic operation on the conventional video images of all the participants aiming at the frames to obtain holographic images of the participants of the frames and performing video frame combination processing to generate holographic video data of the participants.
Further, the holographic operations, comprising:
acquiring a frame of conventional video images of all the participants, and constructing a video center with four equal sides by taking the bottom edge of the conventional video images of all the participants as the side length;
rotating each frame of the conventional video image of all the participants in the directions of 90 degrees, 180 degrees and 270 degrees based on the video center to generate a frame of holographic image of all the participants;
and repeating the operations according to the frame sequence to obtain a plurality of frames of holographic images of all the participants, and carrying out video frame merging processing to obtain holographic video data of all the participants.
Furthermore, a video conference program is arranged in the main display device and used for establishing video conference communication and carrying out conference process control; the slave display unit comprises four slave display terminals and is used for carrying out real-time 3D display on the holographic video data based on the holographic projection screen; the loudspeaker is used for displaying the voice data played while the holographic video data is displayed in real time in a 3D mode.
Furthermore, the four slave display terminals are arranged on the roof of the speech area of the conference room and are respectively arranged in equal intervals at 45 degrees; the holographic projection screen is composed of 4 pieces of trapezoidal-structure holographic films and is inversely hung in the centers of the four slave display terminals in a pyramid shape.
Compared with the prior art, the invention has the beneficial effects that:
the holographic video conference system provided by the embodiment of the invention is provided with a conference video acquisition system, captures the position and attitude signals of the current talker in the conference process in real time through a laser positioning device, and controls a mobile camera set and a mobile microphone array set based on an acquisition central control module to realize the dynamic information capture of the current talker; meanwhile, the general video acquisition is carried out through a common camera and a microphone, the video acquisition is carried out in real time through a cloud processing server, the holographic projection of all participants is further realized, and finally the holographic video display and switching control are carried out through a holographic image real-time display system, so that the 3D conversation between the conversation person and the conference person is efficiently realized, the meeting experience feeling and the immersion feeling of the conversation person and the conference person are favorably met.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention.
Fig. 1 is a functional block diagram of a video conference system according to a first embodiment of the present invention;
fig. 2 is a schematic functional block diagram of a holographic video conference system according to a second embodiment of the present invention;
fig. 3 is a schematic functional module diagram of a video conferencing system for holography according to a fourth embodiment of the present invention;
fig. 4 is a functional block diagram of a video conference system with holograms according to a fifth embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
In the description of the present invention, it is to be understood that the terms "upper", "lower", "front", "rear", "left", "right", "top", "bottom", "inner", "outer", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention.
In one embodiment, referring to fig. 1, a holographic video conference system is provided, including a conference video acquisition system 100, a cloud processing server 200, and a holographic image implementation system 300; the conference video acquisition system 100, the cloud processing server 200 and the holographic image real-time display system 300 are respectively in communication connection through a 5G network;
the conference video acquisition system 100 comprises a laser positioning device 110, an acquisition central control module 120, a mobile camera set 130 and a mobile microphone array set 140; the holographic image display system 300 comprises a master display device 310, a slave display unit 320 and a loudspeaker 330;
the conference video acquisition system 100 is configured to acquire holographic video data of a current speaker during a conference;
the cloud processing server 200 is configured to perform data transfer on the holographic video data of the current talker;
the holographic image real-time display system 300 is configured to acquire holographic video data of the current speaker and perform real-time display, so as to implement remote video conference 3D interaction.
At this point it should be noted that: the holographic video data in this embodiment is mainly collected for the current talker.
Based on the first embodiment of the holographic video conference system, as shown in fig. 2, the present embodiment provides a second embodiment of the holographic video conference system, and different from the first embodiment, the present embodiment specifically introduces the conference video acquisition system 100, and the specific contents thereof are as follows:
in this embodiment, the laser positioning device 110 is configured to obtain a laser signal of the current talker in a target area; the acquisition center control module 120 is configured to acquire a laser signal of the current talker, calculate position information and attitude information of the current talker according to the laser signal, and control the mobile camera set 130 and the mobile microphone array set 140 to move according to the position information and the attitude information; the mobile camera group 130 comprises at least four equi-azimuth depth cameras, and is used for collecting holographic video data of the current talker in real time; the mobile microphone array set 140 includes a plurality of microphone arrays for collecting voice data of the current talker in real time.
Based on the second embodiment of the holographic video conference system, the present embodiment provides a third embodiment of a holographic video conference system, and different from the second embodiment, another implementation of the conference video acquisition system 100 will be specifically described in the present embodiment, and the specific contents thereof are as follows:
in this embodiment, the conference video capture system 100 is further configured to capture general video data of all participants;
at this point it should be noted that: unlike the second embodiment, in the present embodiment, the conference video capturing system 100 captures the objects as the overall participants, and the conference video capturing system 100 includes only a camera set and a microphone array set.
Based on the first embodiment of the video conference system with holograms, as shown in fig. 3, a fourth embodiment of the video conference system with holograms is proposed in this embodiment, and different from the first embodiment, this embodiment specifically introduces the cloud processing server 200, and its specific contents are as follows:
in this embodiment, the cloud processing server 200 further includes a video parsing module 210 and a holographic video processing module 220; the video analysis module 210 is configured to obtain conventional video data of all participants, perform framing processing on the conventional video data, and form a plurality of frames of conventional video images of all the participants; the holographic video processing module 220 is configured to perform holographic operation on a plurality of frames of the conventional video images of all the participants to obtain a plurality of frames of the holographic images of all the participants, and perform video frame merging processing to generate holographic video data of all the participants.
At this point it should be noted that: the holographic video data in this embodiment is obtained by performing data processing on general video data of all participants collected by a common camera device, and the cloud processing server 200 in this embodiment mainly performs holographic processing on the general video data of all participants to obtain a holographic image of all participants.
In this embodiment, the holographic operations comprise:
acquiring a frame of conventional video images of all the participants, and constructing a video center with four equal sides by taking the bottom edge of the conventional video images of all the participants as the side length;
rotating each frame of the conventional video image of all the participants in the directions of 90 degrees, 180 degrees and 270 degrees based on the video center to generate a frame of holographic image of all the participants;
and repeating the operation according to the frame sequence to obtain a plurality of frames of holographic images of all the participants, and carrying out video frame combination processing to obtain holographic video data of all the participants.
Based on the first embodiment of the video conference system with holograms, as shown in fig. 4, a fifth embodiment of the video conference system with holograms is proposed in this embodiment, and different from the first embodiment, this embodiment specifically introduces the video conference system with holograms 300, and its specific contents are as follows:
in this embodiment, the main display device 310 is provided with a video conference program for establishing video conference communication and performing conference process control; the slave display unit 320 comprises four slave display terminals, and is used for performing real-time 3D display on the holographic video data based on a holographic projection screen; the microphone 330 is used for voice data played while the holographic video data is being 3D-displayed in real time.
The four slave display terminals are arranged on the roof of a speech area of the conference room and are respectively arranged in an equal division manner at 45 degrees; the holographic projection screen is composed of 4 pieces of trapezoidal structure holographic films and is inversely hung in the centers of the four slave display terminals in a pyramid shape;
it should be noted that at this point; the content of the main display device 310 for controlling the conference process includes real-time display and display switching of the holographic video data of the current conference participant and the holographic video data of all the conference participants, so that the conference participant and all the conference participants can see the holographic video of the other party in the whole conference process.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (7)
1. A holographic image video conference system is characterized by comprising a conference video acquisition system, a cloud processing server and a holographic image real-time display system; the conference video acquisition system, the cloud processing server and the holographic image real-time display system are respectively in communication connection through a 5G network;
the conference video acquisition system comprises a laser positioning device, an acquisition central control module, a mobile camera set and a mobile microphone array set; the holographic image real display system comprises a main display device, a slave display unit and a loudspeaker;
the conference video acquisition system is used for acquiring holographic video data of a current speaker in a conference process;
the cloud processing server is used for performing data transfer on the holographic video data of the current speaker;
the holographic image real-time display system is used for acquiring the holographic video data of the current talker and displaying the holographic video data in real time so as to realize the 3D interaction of the remote video conference.
2. The video conferencing system of claim 1, wherein the laser positioning device is configured to obtain a laser signal of the current talker in the target area; the acquisition central control module is used for acquiring the laser signal of the current speaker, calculating the position information and the attitude information of the current speaker according to the laser signal, and controlling the mobile camera set and the mobile microphone array set to move according to the position information and the attitude information; the mobile camera group comprises at least four depth cameras with equal directions and is used for collecting holographic video data of the current speaker in real time; the mobile microphone array set comprises a plurality of microphone arrays and is used for collecting voice data of the current talker in real time.
3. The holographic video conferencing system of claim 1, wherein the conferencing video capture system is further configured to capture general video data of all participants.
4. The video conferencing system for holography according to claim 3, wherein said cloud processing server further comprises a video parsing module and a holographic video processing module; the video analysis module is used for acquiring the conventional video data of all the participants and performing framing processing to form a plurality of frames of conventional video images of all the participants; the holographic video processing module is used for carrying out holographic operation on the conventional video images of all the participants aiming at a plurality of frames so as to obtain the holographic images of the all the participants of a plurality of frames, and carrying out video frame combination processing so as to generate holographic video data of the all the participants.
5. The video conferencing system for holography according to claim 4, wherein the holography operation comprises:
acquiring a frame of conventional video images of all the participants, and constructing a video center with four equal edges by taking the bottom edge of the conventional video images of all the participants as the side length;
rotating each frame of the conventional video image of all the participants in the directions of 90 degrees, 180 degrees and 270 degrees based on the video center to generate a frame of holographic image of all the participants;
and repeating the operations according to the frame sequence to obtain a plurality of frames of holographic images of all the participants, and carrying out video frame merging processing to obtain holographic video data of all the participants.
6. The video conferencing system for holography according to claim 1, wherein said main display device is provided with a video conferencing program for establishing video conferencing communication and controlling the conferencing process; the slave display unit comprises four slave display terminals and is used for carrying out real-time 3D display on the holographic video data based on the holographic projection screen; the loudspeaker is used for displaying the voice data played while the holographic video data is displayed in real time in a 3D mode.
7. The video conferencing system for holography according to claim 6, wherein said four slave display terminals are disposed on the roof of the lecture area of the conference room and arranged at 45 degrees respectively; the holographic projection screen is composed of 4 pieces of trapezoidal structure holographic films and is inversely hung in the centers of the four slave display terminals in a pyramid shape.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210986658.9A CN115361521A (en) | 2022-08-17 | 2022-08-17 | Holographic image video conference system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210986658.9A CN115361521A (en) | 2022-08-17 | 2022-08-17 | Holographic image video conference system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115361521A true CN115361521A (en) | 2022-11-18 |
Family
ID=84003162
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210986658.9A Pending CN115361521A (en) | 2022-08-17 | 2022-08-17 | Holographic image video conference system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115361521A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116958353A (en) * | 2023-07-27 | 2023-10-27 | 深圳优立全息科技有限公司 | Holographic projection method based on dynamic capture and related device |
| CN116958353B (en) * | 2023-07-27 | 2024-05-24 | 深圳优立全息科技有限公司 | Holographic projection method based on dynamic capture and related device |
-
2022
- 2022-08-17 CN CN202210986658.9A patent/CN115361521A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116958353A (en) * | 2023-07-27 | 2023-10-27 | 深圳优立全息科技有限公司 | Holographic projection method based on dynamic capture and related device |
| CN116958353B (en) * | 2023-07-27 | 2024-05-24 | 深圳优立全息科技有限公司 | Holographic projection method based on dynamic capture and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6583808B2 (en) | Method and system for stereo videoconferencing | |
| Zhang et al. | Viewport: A distributed, immersive teleconferencing system with infrared dot pattern | |
| US6853398B2 (en) | Method and system for real-time video communication within a virtual environment | |
| CN1732687A (en) | Method, system and apparatus for telepresence communications | |
| CN108076307B (en) | AR-based video conference system and AR-based video conference method | |
| CN106210703A (en) | The utilization of VR environment bust shot camera lens and display packing and system | |
| CN110333837B (en) | Conference system, communication method and device | |
| CN104902263A (en) | System and method for showing image information | |
| CN106385465A (en) | Remote interactive robot system and remote interactive robot method | |
| CN114827517A (en) | Projection video conference system and video projection method | |
| CN105959614A (en) | Method and system for processing video conference | |
| CN115639976B (en) | Multi-mode multi-angle synchronous display method and system for virtual reality content | |
| CN112333415A (en) | Method and device for demonstrating remote video conference | |
| JP3488096B2 (en) | Face image control method in three-dimensional shared virtual space communication service, three-dimensional shared virtual space communication device, and program recording medium therefor | |
| CN114327055A (en) | 3D real-time scene interaction system based on meta-universe VR/AR and AI technologies | |
| CN110012257A (en) | Call method, device and terminal | |
| CN108320331B (en) | Method and equipment for generating augmented reality video information of user scene | |
| CN115361521A (en) | Holographic image video conference system | |
| CN113676690A (en) | Method, device and storage medium for realizing video conference | |
| CN104780341B (en) | A kind of information processing method and information processing unit | |
| CN112565720A (en) | 3D projection system based on holographic technology | |
| Zhang et al. | Improving immersive experiences in telecommunication with motion parallax [applications corner] | |
| CN113315885B (en) | Holographic studio and system for remote interaction | |
| WO2022127747A1 (en) | Method and system for real social using virtual scene | |
| CN113259544B (en) | Remote interactive holographic demonstration system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |