CN113094015A - Holographic multi-screen display implementation method and system, computer equipment and storage medium - Google Patents
Holographic multi-screen display implementation method and system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN113094015A CN113094015A CN202110417663.3A CN202110417663A CN113094015A CN 113094015 A CN113094015 A CN 113094015A CN 202110417663 A CN202110417663 A CN 202110417663A CN 113094015 A CN113094015 A CN 113094015A
- Authority
- CN
- China
- Prior art keywords
- operating system
- host
- rendering
- virtual operating
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000009877 rendering Methods 0.000 claims abstract description 102
- 238000012545 processing Methods 0.000 claims abstract description 24
- 230000015654 memory Effects 0.000 claims description 47
- 238000004891 communication Methods 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 14
- 238000009432 framing Methods 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 7
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000035515 penetration Effects 0.000 description 2
- 230000026676 system process Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
Abstract
The invention provides a holographic multi-screen display implementation method, a holographic multi-screen display implementation system, computer equipment and a storage medium, wherein the system comprises the following steps: a host and a display; a host operating system is installed and operated on the host, and a plurality of virtual operating systems which operate independently are established and managed through the host operating system; the virtual operating system manages one independent display card; the virtual operating system is used for acquiring data streams; the independent display card is used for performing rendering processing according to the data stream from the virtual operating system to obtain a rendering picture; the display is used for displaying the rendering picture. The invention improves the utilization rate of hardware resources and improves the rendering efficiency.
Description
Technical Field
The invention relates to the technical field of holographic display, in particular to a holographic multi-screen display implementation method, a holographic multi-screen display implementation system, computer equipment and a storage medium.
Background
Today, the quality of life of people is improved day by day, the requirement of people on the quality of life is higher and higher, the product introduction seen on the existing market is displayed in the form of pictures and characters, the display mode shows a two-dimensional effect, the user feels that the display is not thorough, the expressed meaning is not clear enough, and the experience feeling is worse.
Although with the development of artificial intelligence technology and virtual reality technology, it has been possible to present to users in a three-dimensional manner, i.e., a holographic manner. However, holographic displays often require multiple screens to be displayed to the user. Therefore, how to realize multi-screen holographic display is a technical problem which needs to be solved urgently by the technical personnel in the field.
Disclosure of Invention
The invention aims to provide a holographic multi-screen display implementation method, a holographic multi-screen display implementation system, computer equipment and a storage medium, so that the utilization rate of hardware resources is improved, and the rendering efficiency is improved.
The technical scheme provided by the invention is as follows:
the invention provides a holographic multi-screen display implementation system, which comprises:
a host and a display;
a host operating system is installed and operated on the host, and a plurality of virtual operating systems which operate independently are established and managed through the host operating system;
the virtual operating system manages one independent display card;
the virtual operating system is used for acquiring data streams;
the independent display card is used for performing rendering processing according to the data stream from the virtual operating system to obtain a rendering picture;
the display is used for displaying the rendering picture.
Further, the host operating system includes:
the instruction acquisition module is used for acquiring a creation instruction for creating the virtual operating system; the creation instruction comprises a creation parameter;
and the creating module is used for creating a corresponding virtual operating system according to the creating parameters.
Further, the host operating system further includes:
the data acquisition module is used for acquiring rendering requirements and image files;
the information acquisition module is used for acquiring the video memory information of the independent video card;
the first processing module is used for selecting a virtual operating system which meets the rendering requirement according to the video memory information;
and the first communication module is used for transmitting the rendering requirement and the image file to a corresponding virtual operating system.
Further, the virtual operating system includes:
the second communication module is used for acquiring the image file and the rendering requirement;
the second processing module is used for converting the image file into a data stream of a picture format supported by the independent display card;
the independent display card includes:
and the rendering module is used for framing the data stream according to the rendering requirement under the control of the virtual operating system, and respectively rendering the framed images to obtain corresponding rendering pictures.
The invention also provides a holographic multi-screen display implementation method, which comprises a host and a display, wherein a mainboard of the host is provided with a plurality of independent display cards, and the host is connected with the display through the independent display cards; the method comprises the following steps:
the host runs a host operating system, and a plurality of virtual running systems which run independently are created and managed through the host operating system;
the virtual operating system acquires a data stream;
the independent display card acquires a data stream from a virtual operating system which governs the independent display card, and renders the data stream to obtain a rendered picture; a virtual operating system governs an independent display card;
the display displays the rendering picture.
Further, the creating and managing a plurality of independently operating virtual operating systems by the host operating system includes the steps of:
the host operating system acquires a creation instruction for creating the virtual operating system; the creation instruction comprises a creation parameter;
and the host operating system creates a corresponding virtual operating system according to the creation parameters.
Further, the method also comprises the following steps:
the host operating system acquires a rendering requirement and an image file;
the host operating system acquires the video memory information of the independent video card;
the host operating system selects a virtual operating system which meets the rendering requirement according to the video memory information;
and the host operating system transmits the rendering requirement and the image file to a corresponding virtual operating system.
Further, the step of acquiring the data stream by the virtual operating system includes:
the virtual operating system converts the image file into a data stream in a picture format supported by the independent display card;
the step of rendering the data stream to obtain a rendered picture comprises the following steps:
and under the control of the virtual operating system, the independent display card frames the data stream according to the rendering requirement, and respectively renders the framed images to obtain corresponding rendering pictures.
The invention also provides a computer device, which comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the processor is used for executing the computer program stored in the memory to realize the operation executed by the holographic multi-screen display realization method.
The invention also provides a storage medium, which stores at least one instruction, and the instruction is loaded and executed by a processor to implement the operations performed by the holographic multi-screen display implementation method.
By the holographic multi-screen display implementation method, the holographic multi-screen display implementation system, the computer equipment and the storage medium, the hardware resource utilization rate can be improved, and the rendering efficiency can be improved.
Drawings
The above features, technical features, advantages and implementations of a holographic multi-screen display implementation method, system, computer device and storage medium will be further described in the following detailed description of preferred embodiments in a clearly understandable manner, with reference to the accompanying drawings.
FIG. 1 is a schematic structural diagram of an embodiment of a holographic multi-screen display implementation system according to the present invention;
FIG. 2 is a flow chart of an embodiment of a holographic multi-screen display implementation method of the present invention;
FIG. 3 is a flow chart of another embodiment of a holographic multi-screen display implementation method of the present invention;
fig. 4 is a flowchart of another embodiment of a holographic multi-screen display implementation method of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For the sake of simplicity, the drawings only schematically show the parts relevant to the present invention, and they do not represent the actual structure as a product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically illustrated or only labeled. In this document, "one" means not only "only one" but also a case of "more than one".
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
In addition, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not intended to indicate or imply relative importance.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will be made with reference to the accompanying drawings. It is obvious that the drawings in the following description are only some examples of the invention, and that for a person skilled in the art, other drawings and embodiments can be derived from them without inventive effort.
An embodiment of the present invention, as shown in fig. 1, is a holographic multi-screen display implementation system, including:
a host and a display;
a host operating system is installed and operated on the host, and a plurality of virtual operating systems which operate independently are established and managed through the host operating system;
the virtual operating system manages one independent display card;
the virtual operating system is used for acquiring data streams;
the independent display card is used for performing rendering processing according to the data stream from the virtual operating system to obtain a rendering picture;
the display is used for displaying the rendering picture.
Specifically, the embodiment of the invention comprises a host computer for installing an operating system and allocating resources and a plurality of displays for displaying a desktop, wherein the displays are connected with the host computer through independent display cards. The host machine adopts a high-performance host machine to carry a plurality of independent hard disks, the embodiment carries a plurality of independent display cards for outputting images in the host machine, namely, the same CPU is used for driving more than two GPUs to be used for displaying a desktop on each independent display.
The display adopts VGA or HDMI communication line and host computer to carry out wired connection, owing to adopt local connection structure, so can use wired connection to promote image file transmission's stability by a wide margin.
The host is internally provided with a host operating system, a plurality of independent virtual operating systems are arranged under the host operating system, and each independent display card corresponds to one independent virtual operating system. The independent display card comprises a physical display card and a virtual display card, a plurality of virtual operating systems are created by adopting a single host operating system, and each virtual operating system controls and manages the structure of one display card, so that the data transmission is more stable.
In the embodiment of the invention, when in use, the display directly realizes data processing through the virtual operating system manager arranged on the host, and realizes data rendering on the independent display card. A single host is connected with a plurality of displays through a display card penetration technology. The host controls the host operating system to manage a plurality of virtual operating systems through a CPU, and a single virtual operating system manages a single independent display card to provide desktop cloud service for a single display.
Preferably, the holographic multi-screen display implementation system further comprises a storage server for storing a large number of image files, the storage server is wirelessly connected with the host through a switch, or the storage server is effectively connected through a USB data line or an RS485 cable, so that the host does not need to store a large number of image files, when the holographic display is needed, the image files needing to be displayed are called from the storage server, and therefore the memory occupation of the host can be greatly reduced, the host can quickly establish a virtual operation system, the time consumed by image rendering is reduced, the holographic display rendering picture can be efficiently realized, the effect of loading and displaying the rendering picture in a short time is realized, the user experience is optimized, the waiting time is shortened, and the picture display efficiency of a holographic scene is improved.
In an embodiment of the present invention, based on the foregoing embodiment, the host operating system in this embodiment includes:
the instruction acquisition module is used for acquiring a creation instruction for creating the virtual operating system; the creation instruction comprises a creation parameter;
and the creating module is used for creating a corresponding virtual operating system according to the creating parameters.
Specifically, the virtual operating system is a virtualized operating system virtualized on the host, and the type of the virtual operating system supports a windows operating system, a Linux operating system, an Android operating system, and an apple operating system. The creation parameters include, but are not limited to, the size of the memory space of the virtual run system, the mirroring information, and the number of virtual run systems. The mirror image information is a mirror image of the virtual operating system, and the virtual operating system can be directly established on the host according to the mirror image information. The process of creating the corresponding virtual operating systems specifically includes creating a corresponding number of initial virtual operating systems according to the mirror image information and the size of the memory space, then performing custom configuration on the created initial virtual operating systems, detecting after the configuration is completed, and completing the creation of the virtual operating systems after the detection is passed.
The invention adopts virtualization technology to virtualize a plurality of independent virtual operating systems simultaneously, bypasses the host operating system, controls the independent display card by the virtual operating system, performs rendering processing on the image file, and then directly outputs the image file to the display to display a rendering picture, thereby reducing the resource occupation of the host and improving the rendering efficiency.
In an embodiment of the present invention, based on the foregoing embodiment, the host operating system in this embodiment further includes:
the data acquisition module is used for acquiring rendering requirements and image files;
the information acquisition module is used for acquiring the video memory information of the independent video card;
the first processing module is used for selecting a virtual operating system which meets the rendering requirement according to the video memory information;
and the first communication module is used for transmitting the rendering requirement and the image file to a corresponding virtual operating system.
Specifically, in this embodiment, after the plurality of virtual operating systems are created in the above manner, the rendering requirements input by the user need to be acquired, where the rendering requirements include rendering types, rendering colors, and the like. The video memory information comprises a video card address, a video card support mode, a video card size and video card resource using conditions. The host operating system obtains rendering requirements from an input device (e.g., keyboard, mouse, etc.) of the host, and in addition, the host operating system obtains image files from a local or storage server. And the host operating system also acquires the video memory information of the independent video card, and then searches and screens the virtual operating system which meets the rendering requirement according to the rendering requirement and the video memory information.
The holographic multi-screen display implementation system is formed by constructing a semi-virtualized virtual operation system, wherein the semi-virtualization can utilize intel hardware virtualization (intel VT-D \ X) technology to distribute required hardware to a plurality of virtual operation systems for use, a Linux system (deep customized version) is used as a host system for configuration, and then a virtual environment is established to operate a virtual operation system windows based on the host system.
By bypassing various software and hardware condition limitations of multi-GPU combined rendering, each display card can be connected with a plurality of display devices to meet the performance requirements of the holographic house, meanwhile, the GPU cost can be further reduced on hardware, because the display card does not need an SLI bridge and GPU limitations of the same type, which means that cheaper middle-end display cards or even lower-end display cards can be tried along with the optimization of an application program later, the cost can be better controlled, each virtual operation system has independent use rights of the hardware, the use of the hardware between the virtual operation systems is independent, the performance loss caused by the virtual operation systems is avoided, and the utilization rate of hardware resources reaches 99% (GPU part). The core of the holographic house virtual system is in the configuration management and distribution of Linux matched with Intel hardware IO virtualization, namely, the Linux system version of the virtual environment has no hard requirement, a Linux kernel has KVM virtual operating system support, version selection or customization is carried out according to the environment suitable for operating the virtual operating system, for example, functional components except KVM are abandoned to leave more residual resources for the virtual operating system as much as possible by selecting the Linux kernel with few occupied resources, and the waste and the loss of hardware resources are reduced.
In an embodiment of the present invention, based on the above embodiment, the virtual operating system in this embodiment includes:
the second communication module is used for acquiring the image file and the rendering requirement;
the second processing module is used for converting the image file into a data stream of a picture format supported by the independent display card;
the independent display card includes:
and the rendering module is used for framing the data stream according to the rendering requirement under the control of the virtual operating system, and respectively rendering the framed images to obtain corresponding rendering pictures.
Specifically, the image file includes a file in a format such as a video file, a picture file, and the like, and the image file includes a 2D image file or a 3D image file. Through a plurality of transmission channels between display and the independent display card, a plurality of transmission channels include: the system comprises a main channel for transmitting rendering requirements, a 2D image rendering display channel for transmitting a data stream converted from a 2D image file, and a 3D image rendering display channel for transmitting a data stream converted from a 3D image file.
The input port of the virtual operating system is connected with the output port of the independent display card, the virtual operating system is used for transmitting and processing the image files acquired from the host operating system, the virtual operating system processes the image files acquired from the host operating system into data streams, and each frame signal of the data streams represents a complete image. And the virtual operating system sends the data stream to the unique independent display card managed by the virtual operating system, and the independent display card renders the data stream.
Illustratively, the virtual run system captures the image file in real time and then converts the image file into a data stream. And the independent display card performs framing processing on the data stream under the control of the virtual operation system to obtain a frame image of one frame. And then, respectively rendering the frame images of each frame according to the rendering requirements to obtain corresponding rendering pictures. The method comprises the steps that a plurality of independent display cards are installed on a host, each independent display card is connected to at least one display, the independent display cards convert data streams into framing images based on RGB signals through analyzing video data stream formats, and then different rendered pictures are displayed on different displays to form the holographic multi-screen system.
In an embodiment of the present invention, as shown in fig. 1 and fig. 2, a holographic multi-screen display implementation method includes a host and a display, where a main board of the host is provided with a plurality of independent display cards, and the host is connected to the display through the independent display cards; the method comprises the following steps:
s100, the host runs a host operating system, and a plurality of virtual running systems which run independently are created and managed through the host operating system;
s200, the virtual operating system acquires data stream;
s300, the independent display card acquires data streams from a virtual operating system which governs the independent display card, and renders the data streams to obtain a rendered picture; a virtual operating system governs an independent display card;
s400, the display displays the rendering picture.
Specifically, the embodiment of the invention comprises a host computer for installing an operating system and allocating resources and a plurality of displays for displaying a desktop, wherein the displays are connected with the host computer through independent display cards. The host machine adopts a high-performance host machine to carry a plurality of independent hard disks, the embodiment carries a plurality of independent display cards for outputting images in the host machine, namely, the same CPU is used for driving more than two GPUs to be used for displaying a desktop on each independent display.
The display adopts VGA or HDMI communication line and host computer to carry out wired connection, owing to adopt local connection structure, so can use wired connection to promote image file transmission's stability by a wide margin.
The host is internally provided with a host operating system, a plurality of independent virtual operating systems are arranged under the host operating system, and each independent display card corresponds to one independent virtual operating system. The independent display card comprises a physical display card and a virtual display card, a plurality of virtual operating systems are created by adopting a single host operating system, and each virtual operating system controls and manages the structure of one display card, so that the data transmission is more stable.
In the embodiment of the invention, when in use, the display directly realizes data processing through the virtual operating system manager arranged on the host, and realizes data rendering on the independent display card. A single host is connected with a plurality of displays through a display card penetration technology. The host controls the host operating system to manage a plurality of virtual operating systems through a CPU, and a single virtual operating system manages a single independent display card to provide desktop cloud service for a single display.
Preferably, the holographic multi-screen display implementation system further comprises a storage server for storing a large number of image files, the storage server is wirelessly connected with the host through a switch, or the storage server is effectively connected through a USB data line or an RS485 cable, so that the host does not need to store a large number of image files, when the holographic display is needed, the image files needing to be displayed are called from the storage server, and therefore the memory occupation of the host can be greatly reduced, the host can quickly establish a virtual operation system, the time consumed by image rendering is reduced, the holographic display rendering picture can be efficiently realized, the effect of loading and displaying the rendering picture in a short time is realized, the user experience is optimized, the waiting time is shortened, and the picture display efficiency of a holographic scene is improved.
In an embodiment of the present invention, as shown in fig. 1 and fig. 3, a holographic multi-screen display implementation method includes a host and a display, where a main board of the host is provided with a plurality of independent display cards, and the host is connected to the display through the independent display cards; the method comprises the following steps:
s110, the host runs a host operating system;
s120, the host operating system acquires a creation instruction for creating the virtual operating system; the creation instruction comprises a creation parameter;
s130, the host operating system creates a corresponding virtual operating system according to the creation parameters;
s200, the virtual operating system acquires data stream;
s300, the independent display card acquires data streams from a virtual operating system which governs the independent display card, and renders the data streams to obtain a rendered picture; a virtual operating system governs an independent display card;
s400, the display displays the rendering picture.
Specifically, the same portions of this embodiment as those of the above embodiment are referred to the above embodiment, and are not described in detail here. The virtual operating system is a virtualized operating system which is virtualized on the host, and the type of the virtual operating system supports a windows operating system, a Linux operating system, an Android operating system and an apple operating system. All the virtual operating systems operate independently at the same time. The creation parameters include, but are not limited to, the size of the memory space of the virtual run system, the mirroring information, and the number of virtual run systems. The mirror image information is a mirror image of the virtual operating system, and the virtual operating system can be directly established on the host according to the mirror image information. The process of creating the corresponding virtual operating systems specifically includes creating a corresponding number of initial virtual operating systems according to the mirror image information and the size of the memory space, then performing custom configuration on the created initial virtual operating systems, detecting after the configuration is completed, and completing the creation of the virtual operating systems after the detection is passed.
The invention adopts virtualization technology to virtualize a plurality of independent virtual operating systems simultaneously, processes the image file through the virtual operating systems, bypasses the host operating system, controls the independent display card to perform rendering processing of the image file by the virtual operating systems, and directly outputs the rendering processing to the display to display a rendering picture, thereby reducing the resource occupation of the host and improving the rendering efficiency.
In an embodiment of the present invention, as shown in fig. 1 and 4, a holographic multi-screen display implementation method includes a host and a display, where a main board of the host is provided with a plurality of independent display cards, and the host is connected to the display through the independent display cards; the method comprises the following steps:
s100, the host runs a host operating system, and a plurality of virtual running systems which run independently are created and managed through the host operating system;
s140, the host operating system acquires a rendering demand and an image file;
s150, the host operating system acquires the video memory information of the independent video card;
s160, the host operating system selects a virtual operating system which meets the rendering requirement according to the video memory information;
s170, the host operating system transmits the rendering requirement and the image file to a corresponding virtual running system;
s210, the virtual operating system converts the image file into a data stream in a picture format supported by the independent display card;
s310, the independent display card acquires data stream from a virtual operating system which governs the independent display card;
s320, framing the data stream by the independent display card under the control of the virtual operation system, and respectively rendering the framed images according to the rendering requirements to obtain corresponding rendering pictures; a virtual operating system governs an independent display card;
s400, the display displays the rendering picture.
Specifically, an input port of the virtual operating system is connected to an output port of the independent graphics card, the virtual operating system is used for transmitting and processing the image file acquired from the host operating system, the virtual operating system processes the image file acquired from the host operating system into a data stream, and each frame signal of the data stream represents a complete image. And the virtual operating system sends the data stream to the unique independent display card managed by the virtual operating system, and the independent display card renders the data stream.
Illustratively, the virtual run system captures the image file in real time and then converts the image file into a data stream. And the independent display card performs framing processing on the data stream under the control of the virtual operation system to obtain a frame image of one frame. And then, respectively rendering the frame images of each frame according to the rendering requirements to obtain corresponding rendering pictures. The method comprises the steps that a plurality of independent display cards are installed on a host, each independent display card is connected to at least one display, the independent display cards convert data streams into framing images based on RGB signals through analyzing video data stream formats, and then different rendered pictures are displayed on different displays to form the holographic multi-screen system.
In this embodiment, after the plurality of virtual operating systems are created in the above manner, the rendering requirements input by the user need to be acquired, where the rendering requirements include rendering types, rendering colors, and the like. The video memory information comprises a video card address, a video card support mode, a video card size and video card resource using conditions. The host operating system obtains rendering requirements from an input device (e.g., keyboard, mouse, etc.) of the host, and in addition, the host operating system obtains image files from a local or storage server. And the host operating system also acquires the video memory information of the independent video card, and then searches and screens the virtual operating system which meets the rendering requirement according to the rendering requirement and the video memory information.
The holographic multi-screen display implementation system is formed by constructing a semi-virtualized virtual operation system, wherein the semi-virtualization can utilize intel hardware virtualization (intel VT-D \ X) technology to distribute required hardware to a plurality of virtual operation systems for use, a Linux system (deep customized version) is used as a host system for configuration, and then a virtual environment is established to operate a virtual operation system windows based on the host system.
By the mode, various software and hardware condition limitations of multi-GPU combined rendering are bypassed, each display card can be connected with a plurality of display devices to meet the performance requirements of the holographic house, meanwhile, the GPU cost can be further reduced on hardware, because the display card does not need an SLI bridge and GPU limitations of the same type, later, with the optimization of an application program, cheaper middle-end display cards or even lower-end display cards can be tried, the cost can be better controlled, in this way, each virtual operation system has independent use rights of the hardware, the use of the hardware among the virtual operation systems is independent, the virtual system for operating the holographic house software cannot cause performance loss due to the fact that the GPU is used, and the utilization rate of hardware resources reaches 99% (part). The core of the holographic house virtual system is in the configuration management and distribution of Linux matched with Intel hardware IO virtualization, namely, the version of the Linux system in the virtual environment has no hard requirement, a Linux kernel has KVM virtual operating system support, and version selection or customization is carried out according to the environment suitable for operating the virtual operating system, for example, functional components except KVM are abandoned to leave more residual resources for the virtual operating system as much as possible by selecting the Linux kernel with few occupied resources, so that the waste and the loss of hardware resources are reduced, and the Linux kernel is only used as a host system and a console of the virtual operating system.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of program modules is illustrated, and in practical applications, the above-described distribution of functions may be performed by different program modules, that is, the internal structure of the apparatus may be divided into different program units or modules to perform all or part of the above-described functions. Each program module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one processing unit, and the integrated unit may be implemented in a form of hardware, or may be implemented in a form of software program unit. In addition, the specific names of the program modules are only used for distinguishing the program modules from one another, and are not used for limiting the protection scope of the application.
In one embodiment of the invention, a computer device comprises a processor, a memory, wherein the memory is used for storing a computer program; and the processor is used for executing the computer program stored in the memory to realize the holographic multi-screen display realization method in the corresponding method embodiment.
The computer equipment can be desktop computer, notebook computer, palm computer, tablet computer, mobile phone, man-machine interactive screen and other equipment. The computer device may include, but is not limited to, a processor, a memory. Those skilled in the art will appreciate that the foregoing is merely exemplary of a computing device and is not intended to limit the computing device, and that it may include more or less components than those shown, or some of the components may be combined, or different components, such as: the computer device may also include input/output interfaces, displays, network access devices, communication buses, communication interfaces, and the like. A communication interface and a communication bus, and may further comprise an input/output interface, wherein the processor, the memory, the input/output interface and the communication interface complete communication with each other through the communication bus. The memory stores a computer program, and the processor is configured to execute the computer program stored in the memory to implement the holographic multi-screen display implementation method in the corresponding method embodiment.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may be an internal storage unit of the computer device, such as: hard disks or memories of computer devices. The memory may also be an external storage device to the computer device, such as: the computer equipment is provided with a plug-in hard disk, an intelligent memory Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like. Further, the memory may also include both an internal storage unit and an external storage device of the computer device. The memory is used for storing the computer program and other programs and data required by the computer device. The memory may also be used to temporarily store data that has been output or is to be output.
A communication bus is a circuit that connects the described elements and enables transmission between the elements. For example, the processor receives commands from other elements through the communication bus, decrypts the received commands, and performs calculations or data processing according to the decrypted commands. The memory may include program modules such as a kernel (kernel), middleware (middleware), an Application Programming Interface (API), and applications. The program modules may be comprised of software, firmware or hardware, or at least two of the same. The input/output interface forwards commands or data entered by a user via the input/output interface (e.g., sensor, keyboard, touch screen). The communication interface connects the computer device with other network devices, user devices, networks. For example, the communication interface may be connected to a network by wire or wirelessly to connect to external other network devices or user devices. The wireless communication may include at least one of: wireless fidelity (WiFi), Bluetooth (BT), Near Field Communication (NFC), Global Positioning Satellite (GPS) and cellular communications, among others. The wired communication may include at least one of: universal Serial Bus (USB), high-definition multimedia interface (HDMI), asynchronous transfer standard interface (RS-232), and the like. The network may be a telecommunications network and a communications network. The communication network may be a computer network, the internet of things, a telephone network. The computer device may be connected to the network via a communication interface, and a protocol by which the computer device communicates with other network devices may be supported by at least one of an application, an Application Programming Interface (API), middleware, a kernel, and a communication interface.
In an embodiment of the present invention, a storage medium stores at least one instruction, and the instruction is loaded and executed by a processor to implement the operations performed by the corresponding embodiments of the holographic multi-screen display implementation method. For example, the storage medium may be a read-only memory (ROM), a Random Access Memory (RAM), a compact disc read-only memory (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, and the like.
They may be implemented in program code that is executable by a computing device such that it is executed by the computing device, or separately, or as individual integrated circuit modules, or as a plurality or steps of individual integrated circuit modules. Thus, the present invention is not limited to any specific combination of hardware and software.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or recited in detail in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/computer device and method may be implemented in other ways. For example, the above-described apparatus/computer device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units may be stored in a storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by sending instructions to relevant hardware through a computer program, where the computer program may be stored in a storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program may be in source code form, object code form, an executable file or some intermediate form, etc. The storage medium may include: any entity or device capable of carrying the computer program, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signal, telecommunication signal, software distribution medium, etc. It should be noted that the content of the storage medium may be increased or decreased as appropriate according to the requirements of legislation and patent practice in the jurisdiction, for example: in certain jurisdictions, in accordance with legislation and patent practice, computer-readable storage media do not include electrical carrier signals and telecommunications signals.
It should be noted that the above embodiments can be freely combined as necessary. The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A holographic multi-screen display implementation system, comprising:
a host and a display;
a host operating system is installed and operated on the host, and a plurality of virtual operating systems which operate independently are established and managed through the host operating system;
the virtual operating system manages one independent display card;
the virtual operating system is used for acquiring data streams;
the independent display card is used for performing rendering processing according to the data stream from the virtual operating system to obtain a rendering picture;
the display is used for displaying the rendering picture.
2. The holographic multi-screen display implementation system of claim 1, wherein the host operating system comprises:
the instruction acquisition module is used for acquiring a creation instruction for creating the virtual operating system; the creation instruction comprises a creation parameter;
and the creating module is used for creating a corresponding virtual operating system according to the creating parameters.
3. A holographic multi-screen display implementation system according to claim 1, wherein the host operating system further comprises:
the data acquisition module is used for acquiring rendering requirements and image files;
the information acquisition module is used for acquiring the video memory information of the independent video card;
the first processing module is used for selecting a virtual operating system which meets the rendering requirement according to the video memory information;
and the first communication module is used for transmitting the rendering requirement and the image file to a corresponding virtual operating system.
4. The holographic multi-screen display implementation system of claim 3, wherein the virtual run system comprises:
the second communication module is used for acquiring the image file and the rendering requirement;
the second processing module is used for converting the image file into a data stream of a picture format supported by the independent display card;
the independent display card includes:
and the rendering module is used for framing the data stream according to the rendering requirement under the control of the virtual operating system, and respectively rendering the framed images to obtain corresponding rendering pictures.
5. A holographic multi-screen display implementation method is characterized by comprising a host and a display, wherein a mainboard of the host is provided with a plurality of independent display cards, and the host is connected with the display through the independent display cards; the method comprises the following steps:
the host runs a host operating system, and a plurality of virtual running systems which run independently are created and managed through the host operating system;
the virtual operating system acquires a data stream;
the independent display card acquires a data stream from a virtual operating system which governs the independent display card, and renders the data stream to obtain a rendered picture; a virtual operating system governs an independent display card;
the display displays the rendering picture.
6. A holographic multi-screen display implementation method according to claim 5, wherein the creating and managing, by the host operating system, a number of independently running virtual running systems comprises the steps of:
the host operating system acquires a creation instruction for creating the virtual operating system; the creation instruction comprises a creation parameter;
and the host operating system creates a corresponding virtual operating system according to the creation parameters.
7. The holographic multi-screen display implementation method of claim 5, further comprising the steps of:
the host operating system acquires a rendering requirement and an image file;
the host operating system acquires the video memory information of the independent video card;
the host operating system selects a virtual operating system which meets the rendering requirement according to the video memory information;
and the host operating system transmits the rendering requirement and the image file to a corresponding virtual operating system.
8. The holographic multi-screen display implementation method of claim 4, wherein the step of acquiring the data stream by the virtual operating system comprises the steps of:
the virtual operating system converts the image file into a data stream in a picture format supported by the independent display card;
the step of rendering the data stream to obtain a rendered picture comprises the following steps:
and under the control of the virtual operating system, the independent display card frames the data stream according to the rendering requirement, and respectively renders the framed images to obtain corresponding rendering pictures.
9. A computer device comprising a processor, a memory and a computer program stored in the memory and executable on the processor, wherein the processor is configured to execute the computer program stored in the memory to perform the operations of the holographic multi-screen display implementation method as claimed in any one of claims 5 to 8.
10. A storage medium having at least one instruction stored therein, wherein the instruction is loaded and executed by a processor to implement the operations performed by the holographic multi-screen display implementation method according to any one of claims 5 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110417663.3A CN113094015A (en) | 2021-04-19 | 2021-04-19 | Holographic multi-screen display implementation method and system, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110417663.3A CN113094015A (en) | 2021-04-19 | 2021-04-19 | Holographic multi-screen display implementation method and system, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113094015A true CN113094015A (en) | 2021-07-09 |
Family
ID=76678518
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110417663.3A Pending CN113094015A (en) | 2021-04-19 | 2021-04-19 | Holographic multi-screen display implementation method and system, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113094015A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023045572A1 (en) * | 2021-09-27 | 2023-03-30 | 中兴通讯股份有限公司 | Information processing method and apparatus thereof, cloud terminal, cloud server, and storage medium |
| CN117078499A (en) * | 2023-10-13 | 2023-11-17 | 统信软件技术有限公司 | Dual-graphics-card rendering processing method and device, computing equipment and readable storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101441555A (en) * | 2008-04-03 | 2009-05-27 | 南京科融数据系统有限公司 | Video multiple-screen combined playing technology based on windows multiple-screen system |
| US20120084774A1 (en) * | 2010-09-30 | 2012-04-05 | Microsoft Corporation | Techniques For Load Balancing GPU Enabled Virtual Machines |
| CN103491188A (en) * | 2013-09-30 | 2014-01-01 | 上海沃帆信息科技有限公司 | Implementation method for enabling multiple users to share graphic workstation by using virtual desktop and GPU pass-through |
| CN205193879U (en) * | 2015-10-20 | 2016-04-27 | 国家超级计算深圳中心(深圳云计算中心) | Cloud calculates system of playing up |
| CN107302458A (en) * | 2017-07-03 | 2017-10-27 | 武汉攀升鼎承科技有限公司 | A kind of distributed desktop cloud structure and implementation method |
| CN110647375A (en) * | 2019-09-23 | 2020-01-03 | 天津卓朗科技发展有限公司 | Image rendering method and device of cloud desktop and cloud server |
-
2021
- 2021-04-19 CN CN202110417663.3A patent/CN113094015A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101441555A (en) * | 2008-04-03 | 2009-05-27 | 南京科融数据系统有限公司 | Video multiple-screen combined playing technology based on windows multiple-screen system |
| US20120084774A1 (en) * | 2010-09-30 | 2012-04-05 | Microsoft Corporation | Techniques For Load Balancing GPU Enabled Virtual Machines |
| CN103491188A (en) * | 2013-09-30 | 2014-01-01 | 上海沃帆信息科技有限公司 | Implementation method for enabling multiple users to share graphic workstation by using virtual desktop and GPU pass-through |
| CN205193879U (en) * | 2015-10-20 | 2016-04-27 | 国家超级计算深圳中心(深圳云计算中心) | Cloud calculates system of playing up |
| CN107302458A (en) * | 2017-07-03 | 2017-10-27 | 武汉攀升鼎承科技有限公司 | A kind of distributed desktop cloud structure and implementation method |
| CN110647375A (en) * | 2019-09-23 | 2020-01-03 | 天津卓朗科技发展有限公司 | Image rendering method and device of cloud desktop and cloud server |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023045572A1 (en) * | 2021-09-27 | 2023-03-30 | 中兴通讯股份有限公司 | Information processing method and apparatus thereof, cloud terminal, cloud server, and storage medium |
| CN117078499A (en) * | 2023-10-13 | 2023-11-17 | 统信软件技术有限公司 | Dual-graphics-card rendering processing method and device, computing equipment and readable storage medium |
| CN117078499B (en) * | 2023-10-13 | 2024-01-23 | 统信软件技术有限公司 | Dual-graphics-card rendering processing method and device, computing equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108681436B (en) | Image quality parameter adjusting method, device, terminal and storage medium | |
| CN112004086B (en) | Video data processing method and device | |
| CN110647375A (en) | Image rendering method and device of cloud desktop and cloud server | |
| CN102053871B (en) | Application program image display method and device | |
| EP2631901A2 (en) | Apparatus and method for displaying an image on a sink device | |
| CN110070496B (en) | Method and device for generating image special effect and hardware device | |
| CN106598514B (en) | Method and system for switching virtual reality mode in terminal equipment | |
| CN113094015A (en) | Holographic multi-screen display implementation method and system, computer equipment and storage medium | |
| CN115809106A (en) | Cloud desktop system, cloud desktop display method, terminal device and storage medium | |
| CN114817630A (en) | Card display method, card display device, electronic device, storage medium, and program product | |
| CN110782387B (en) | Image processing method and device, image processor and electronic equipment | |
| JP2023538825A (en) | Methods, devices, equipment and storage media for picture to video conversion | |
| CN115373618B (en) | Multi-screen display method and device, vehicle machine and storage medium | |
| TWI600312B (en) | Display interface bandwidth modulation | |
| KR101686981B1 (en) | Rendering interface objects defined by a separate application | |
| CN115988265A (en) | Rendering method and device of display picture and terminal equipment | |
| CN112672182B (en) | Live broadcast interface display method, device, electronic equipment and computer readable medium | |
| CN116248889A (en) | Image encoding and decoding method and device and electronic equipment | |
| US9911175B2 (en) | Modification of graphical command tokens | |
| US10560727B2 (en) | Server structure for supporting multiple sessions of virtualization | |
| CN114398018A (en) | Picture display method, device, storage medium and electronic equipment | |
| CN112738422A (en) | Seat picture display system and display method thereof | |
| CN114518854A (en) | Screen projection method and equipment | |
| CN111683077A (en) | Virtual reality equipment and data processing method | |
| CN113038036A (en) | Background image display method, video processing equipment, display system and main control card |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210709 |
|
| RJ01 | Rejection of invention patent application after publication |