CN113365036A - Projection system for on-site multimedia production - Google Patents
Projection system for on-site multimedia production Download PDFInfo
- Publication number
- CN113365036A CN113365036A CN202010137892.5A CN202010137892A CN113365036A CN 113365036 A CN113365036 A CN 113365036A CN 202010137892 A CN202010137892 A CN 202010137892A CN 113365036 A CN113365036 A CN 113365036A
- Authority
- CN
- China
- Prior art keywords
- canvas
- module
- scene
- projection system
- processing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000009877 rendering Methods 0.000 claims abstract description 9
- 239000000463 material Substances 0.000 claims description 19
- 238000012544 monitoring process Methods 0.000 claims description 3
- 238000011065 in-situ storage Methods 0.000 claims 1
- 230000008676 import Effects 0.000 abstract description 3
- 238000000034 method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- Projection Apparatus (AREA)
Abstract
The invention provides a projection system for on-site multimedia production, which relates to the technical field of multimedia projection, and comprises: the system comprises a scene display module, a scene calibration module, a shade, a canvas processing module, a multimedia content processing module, a play sequence processing module and a rendering output module; the invention can realize the calibration of projection pictures and scenes, the range of drawing image masks and canvas, the import and adjustment of multimedia contents and the export of videos in a software system.
Description
Technical Field
The invention relates to the technical field of multimedia projection, in particular to a projection system for on-site multimedia production.
Background
At present, multimedia projection is widely applied to the directions of singing meetings, light shows, digital entertainment and the like, and perfect fusion of objects and animations can be realized through multimedia projection to generate strong visual impact.
With the development of multimedia production technology, more and more projection-related functions with multimedia production technology are developed, which mainly display three-dimensional images (including still images and animation) on two-dimensional planes by means of parallel projection and perspective projection in computer graphics, and mainly include the following steps: 1. establishing a corresponding three-dimensional model according to framing and observation of a projected object, and establishing a three-dimensional coordinate by referring to factors such as the position, the direction, the angle and the like projected by a projector; 2. and the matching of the projected image and the actual scene is realized through projection transformation.
The most basic functionality of current multimedia production technology related to projection consists of many independent production software systems, such as 3DsMAX, Maya, Photoshop, after effects, Premiere, etc. The manufacturing process comprises the steps of early-stage setting, shot scene shooting, shot correction, perspective conversion, three-dimensional modeling, three-dimensional animation, rendering, later-stage synthesis, clipping, output and the like; finally, playing the video and animation and other forms; the method specifically comprises the following steps: 1. projecting a calibration image onto a scene using a projector; 2. shooting a scene by using a single camera, and importing the picture into a production software system, such as photoshop, aftereffects and the like; 3. in the manufacturing software system, the image shot by the camera is adjusted to be matched with the calibration picture by using a deformation, distortion and replacement plug-in, and the matching result is exported in the form of a mask; 4. making multimedia content; the steps need to mobilize different hardware devices and different manufacturing software systems, all the steps cannot be directly operated on a complete system, and the steps can be switched only through manual operation of a user, so that the manufacturing efficiency is low, the requirement on the manufacturing skill of the user is high, and the manufacturing can be completed by one team.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, it is an object of the present invention to provide a projection system for live multimedia production, which realizes the calibration of projection pictures and scenes, the range of drawing image masks and canvas, the import and adjustment of multimedia contents, and the export of video in one software system.
The invention provides a projection system for on-site multimedia production, comprising:
a scene display module: the system is used for calling a camera picture in real time and projecting a calibration picture to an actual scene through a projector;
a scene calibration module: the camera calibration system is used for calibrating a camera picture and an actual scene;
mask, canvas processing module: for drawing an image mask and determining a canvas range;
the multimedia content processing module: the system is used for dragging the user-defined material into the shade and editing the material;
a play sequence processing module: the playing sequence number is used for compiling the material;
a rendering output module: for deriving the play sequence, and rendering the play sequence as a video, and saving the video to the local hard disk.
In an embodiment of the invention, the mask and canvas processing module draws the image mask by obtaining a surface layout of a projection scene and setting a canvas size based on the surface layout.
In an embodiment of the present invention, the customized material includes a picture, a video, a text and a material.
In an embodiment of the present invention, the scene display module creates and monitors a camera picture stored in a real-time database in real time through the SCADA server.
In an embodiment of the present invention, the mask and the canvas processing module determine the canvas range by loading the layout generated by the AutoCAD extension module and drawing the image mask by the AutoCAD extension module.
As described above, the projection system for on-site multimedia production of the present invention has the following advantages: the method integrates all originally isolated steps in the multimedia projection into a software system, displays the steps in a visual mode, extracts the most important and common functions in the multimedia projection, unifies the user interaction interface, adopts a WYSIWYG (what you see is what you get) user interaction mode, reduces the learning cost of a user, improves the operation efficiency and increases the operation accuracy; the user does not need to switch among the software systems, and does not need to master a large amount of post-production theories and skills, the production of the multimedia projection can be realized, and the threshold of the production of the multimedia projection is reduced.
Drawings
Fig. 1 is a block diagram of a projection system disclosed in an embodiment of the present invention.
Fig. 2 is a schematic diagram of the operation of the projection system disclosed in the embodiment of the present invention.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
As shown in fig. 1, the present invention provides a projection system for on-site multimedia production, the projection system comprising:
1. a scene display module: the system is used for calling a camera picture in real time and projecting a calibration picture to an actual scene through a projector;
the scene display module is used for establishing and monitoring a camera picture stored in a real-time calling real-time database at a port through an SCADA server; the specific control flow is as follows:
1.1: starting an application program expemeassa.exe of a service end of a Supervisory Control And Data Acquisition (SCADA) system, And connecting a real-time database of the SCADA system;
starting an application program PowerRealInfo.exe of a client (namely a computer running the projection system) and trying to connect with an SCADA server;
1.2: the SCADA server side creates monitoring and waits for thread connection at a port, waits for network connection of a client side, and meanwhile reads a real-time database after set delay;
1.3: if the connection between the SCADA server and the client is successful, the SCADA server sends a camera picture stored in a real-time database after waiting for receiving the acquisition command; and if the connection between the SCADA server and the client fails, the client waits for the set delay.
2. A scene calibration module: the camera calibration system is used for calibrating a camera picture and an actual scene; judging whether the image plane of the camera picture is superposed with the photosensitive surface of the calibration plane; when the image plane is not coincident with the photosensitive surface, the position of the head is moved until the image plane is coincident with the photosensitive surface; when the image plane is superposed with the photosensitive surface, calculating the tangent value of an included angle beta between the object plane and the image plane; when the object distance changes, calibrating the lens position of the camera according to the tangent value, and then transmitting light sensation data into a program through a byte array; the specific program control flow is as follows:
2.1: the client side main application program PowerViewer.exe is started, and a layout generated by an AutoCAD extension module and camera picture data acquired by a real-time database are loaded;
2.2: the following operations are selected:
(1) firstly, selecting nodes bound with subgraphs from a layout graph; then loading a calibration subgraph of the projector through a database, and reading all switches, knife switches and current node IDs in the calibration subgraph; finally, the state is restored to be the current loaded historical data file, and then a normalized vector image is displayed;
(2) firstly, selecting current loading recovery historical data; then popping up a dialog box to select a historical data file; finally, extracting a binary byte stream file loaded with historical data from the database, converting the binary byte stream file into a required format, and updating a current image and transmitting the updated image to an image drawing unit to use new data;
(3) and selecting the node data bound with the subgraph to read the binary stream file, and then loading and displaying the preview graph through the image drawing unit.
3. Mask, canvas processing module: the image processing device is used for processing the picture stack after the image drawing unit draws the image mask and determining the canvas range;
the mask and the canvas processing module draw the image mask through the image drawing unit by acquiring the surface layout numerical value of the projection scene and setting the size of the canvas on the basis of the surface layout.
4. The multimedia content processing module: the method comprises the steps of reading a file stream, dragging the file stream into a shade and editing the file stream by analyzing a binary file stream (namely a user-defined material);
the user-defined material comprises pictures, videos, texts and materials.
5. A play sequence processing module: storing the serial numbers of the files to be played through a list, putting the files into a queue for sorting, and then selecting the playing serial numbers for compiling the materials;
6. a rendering output module: for exporting the play sequence file, firstly reading the file sequence number, converting the file sequence number into a binary stream file, opening a port, rendering the play sequence into a video, and saving the video to a local hard disk.
As shown in fig. 2, the projection system works as follows:
the method comprises the following steps: transmitting the calibration picture to a projector, calling a current available camera, and carrying out picture acquisition on a scene;
step two: carrying out calibration operation according to the camera picture and the actual scene;
step three: acquiring the surface layout of a current projected scene;
step four: setting the size of a canvas according to the surface layout of a current projected scene, and drawing an image mask;
step five: self-defining materials including pictures, videos, texts and materials;
step six: dragging the material into each shade;
step seven: editing the material;
step eight: compiling the playing sequence number of the material;
step nine: and deriving a play sequence, and automatically rendering the play sequence into a video and keeping the video to a local hard disk.
In summary, the present invention realizes the calibration of the projection picture and the scene, the range of the drawn image mask and the canvas, the import and adjustment of the multimedia content, and the export of the video in one software system. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (5)
1. A projection system for in-situ multimedia production, the projection system comprising:
a scene display module: the system is used for calling a camera picture in real time and projecting a calibration picture to an actual scene through a projector;
a scene calibration module: the camera calibration system is used for calibrating a camera picture and an actual scene;
mask, canvas processing module: for drawing an image mask and determining a canvas range;
the multimedia content processing module: the system is used for dragging the user-defined material into the shade and editing the material;
a play sequence processing module: the playing sequence number is used for compiling the material;
a rendering output module: for deriving the play sequence, and rendering the play sequence as a video, and saving the video to the local hard disk.
2. The projection system for on-site multimedia production of claim 1, wherein: the mask and canvas processing module draws the image mask by acquiring the surface layout of the projection scene and setting the size of the canvas on the basis of the surface layout.
3. The projection system for on-site multimedia production of claim 1, wherein: the user-defined material comprises pictures, videos, texts and materials.
4. The projection system for on-site multimedia production of claim 1, wherein: the scene display module is used for establishing and monitoring a camera picture stored in a real-time calling real-time database at a port through an SCADA server.
5. The projection system for on-site multimedia production of claim 1, wherein: the mask and canvas processing module is a layout generated by loading an AutoCAD extension module, and the image mask is drawn by the AutoCAD extension module to determine the canvas range.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010137892.5A CN113365036A (en) | 2020-03-03 | 2020-03-03 | Projection system for on-site multimedia production |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010137892.5A CN113365036A (en) | 2020-03-03 | 2020-03-03 | Projection system for on-site multimedia production |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113365036A true CN113365036A (en) | 2021-09-07 |
Family
ID=77523325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010137892.5A Pending CN113365036A (en) | 2020-03-03 | 2020-03-03 | Projection system for on-site multimedia production |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113365036A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101551664A (en) * | 2009-05-04 | 2009-10-07 | 大道计算机技术(上海)有限公司 | Big screen commanding and dispatching system and realizing method thereof |
| CN107801018A (en) * | 2017-10-31 | 2018-03-13 | 深圳中广核工程设计有限公司 | A kind of 3D animation three-dimensional video-frequency manufacturing systems and method played based on ring curtain |
| US10373325B1 (en) * | 2018-09-28 | 2019-08-06 | Lightform, Inc. | Method for augmenting a scene in real space with projected visual content |
-
2020
- 2020-03-03 CN CN202010137892.5A patent/CN113365036A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101551664A (en) * | 2009-05-04 | 2009-10-07 | 大道计算机技术(上海)有限公司 | Big screen commanding and dispatching system and realizing method thereof |
| CN107801018A (en) * | 2017-10-31 | 2018-03-13 | 深圳中广核工程设计有限公司 | A kind of 3D animation three-dimensional video-frequency manufacturing systems and method played based on ring curtain |
| US10373325B1 (en) * | 2018-09-28 | 2019-08-06 | Lightform, Inc. | Method for augmenting a scene in real space with projected visual content |
Non-Patent Citations (1)
| Title |
|---|
| 陈萱华等: "影视后期制作中遮罩技术的实现", 《电影评介》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11721071B2 (en) | Methods and systems for producing content in multiple reality environments | |
| US7324069B2 (en) | Animation review methods and apparatus | |
| US11354774B2 (en) | Facial model mapping with a neural network trained on varying levels of detail of facial scans | |
| US7596764B2 (en) | Multidimensional image data processing | |
| US11443450B2 (en) | Analyzing screen coverage of a target object | |
| US20220375152A1 (en) | Method for Efficiently Computing and Specifying Level Sets for Use in Computer Simulations, Computer Graphics and Other Purposes | |
| US11625900B2 (en) | Broker for instancing | |
| US11720233B2 (en) | Method for associating production elements with a production approach | |
| CN113365036A (en) | Projection system for on-site multimedia production | |
| EP4097607B1 (en) | Applying non-destructive edits to nested instances for efficient rendering | |
| KR20130035485A (en) | System for publishing 3d virtual reality moving picture and method for publishing the same | |
| US20230196702A1 (en) | Object Deformation with Bindings and Deformers Interpolated from Key Poses | |
| Ding et al. | Research on the Key Technology of Augmented Reality Technology in the Application and Development of Children's Plant Science Popularization Education | |
| CN113379926A (en) | Digital asset manufacturing method and system | |
| CN117437342A (en) | Three-dimensional scene rendering method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210907 |