CN104660872A - Virtual scene synthesis system and method - Google Patents
Virtual scene synthesis system and method Download PDFInfo
- Publication number
- CN104660872A CN104660872A CN201510078882.8A CN201510078882A CN104660872A CN 104660872 A CN104660872 A CN 104660872A CN 201510078882 A CN201510078882 A CN 201510078882A CN 104660872 A CN104660872 A CN 104660872A
- Authority
- CN
- China
- Prior art keywords
- signal
- virtual scene
- camera head
- background data
- vision signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides a virtual scene synthesis system and method. The system comprises a camera device, a background storage device, a video capture card, a chroma key and an image layer adjustment special-effect module, wherein the camera device is used for acquiring video signals; the background storage device is used for storing background data matched with the camera device for use; the video capture card is connected with the camera device and is used for receiving the signals output by the camera device and processing the signals; the chroma key is connected with the video capture card and used for receiving the video signals of the camera device and performing image matting on the video signals of the camera device; the image layer adjustment special-effect module is connected with the chroma key and the background storage device, and is used for synthesizing the video signals and the background data, outputting synthesis signals and generating a virtual scene after synthesis of the video signals and the background data. With the adoption of the virtual scene synthesis system and method, spatial alternation of objects in a scene can be modified at will for replacement, a rich and flexible scene editing function is realized, and video materials can be played on a multimedia platform at will.
Description
Technical field
The present invention relates to field of video processing, refer to a kind of system and method being applied to the virtual scene synthesis of interaction platform especially.
Background technology
Virtual scenery is that a kind of emerging studio high-tech that virtual reality technology combines with traditional colour key technology solves official documents and correspondence, the human and material resources, the financial resources that expend needed for traditional studio are built in its both a large amount of saving, greatly expanding again the artistic expression space of studio, is the inexorable trend that studio is built.
At present, along with the aggravation of competition of market economy, enterprise production and management incorporates national, global competitive scope gradually.Efficient information interchange easily, flexibly training system, and the collaborative needs of powerful work, become the primary demand of large and medium-sized enterprise's informatization.Along with the development of mechanics of communication, present people can realize Video chat and video conference etc.
But those technology are only confined to the display of folk prescription image, namely show the video image of the other side in real time.But, along with the development of Virtual Simulation, above-mentioned technology oneself through the demand of user forever cannot be met.Existing interactive multimedia synthetic technology, the module of application is more, and structure is more complicated all, and implement also more difficult, control operation is relative complex also, and is all the scene being exclusively used in certain specific function.
Summary of the invention
The present invention is directed to the deficiencies in the prior art, propose a kind of virtual scene synthesis system and method, flexibility is high, and does not waste system resource.
First aspect, the invention provides a kind of virtual scene synthesis system, comprising:
Camera head, for carrying out the collection of vision signal;
Background storage device, for storing and the matching used background data of described camera head;
Video frequency collection card, is connected with described camera head, for receive described camera head export signal and processing signals;
Chroma key, is connected with described video frequency collection card, for receiving the vision signal of described camera head, and the vision signal of described camera head is carried out stingy picture;
Layer adjustment FX Module, is connected with described chroma key and described background storage device, after vision signal and described background data being synthesized, exports composite signal, produces the virtual scene after vision signal and background data synthesis.
Preferably, also comprise: filter, be connected with the output of audio file, for filtering described audio file;
Sound card, is connected with described filter, for gathering audio signal and described audio signal being sent to synthesizer;
Synthesizer, adjusts FX Module with described sound card and described layer and is connected, and synthesizes for the audio signal described composite signal and described sound card exported, and output video file.
Preferably, also comprise: display unit, adjust FX Module with described layer and be connected, for showing the virtual scene after synthesis.
Preferably, described camera head is connected with described processing unit by IEEE1394 socket.
Preferably, also comprise: apparatus for processing audio, comprise the Mike connected successively, preposition Hybrid amplifier device, power amplification device and audio amplifier.
Second aspect, the invention provides a kind of virtual scene synthetic method, comprising:
Obtain the background data that camera head uses;
Carried out the collection of image or image by camera head, and the vision signal of collection is outputted to chroma key by video frequency collection card;
By chroma key, the foreground signal of video camera is carried out stingy picture, and export layer adjustment FX Module to;
Export composite signal after vision signal and described background data are synthesized by layer adjustment FX Module, produce the virtual scene after vision signal and background data synthesis.
Preferably, after vision signal and described background data synthesized by described layer adjustment FX Module, export composite signal, after producing the step of the virtual scene after vision signal and background data synthesis, also comprise:
The audio signal that described composite signal and sound card export is synthesized by synthesizer, and output video file generated virtual scenery.
The present invention relates to making video technology, application is wide, according to the storyboard first editted to take material, the character activities image taken at the blue back surface field scape taken by the virtual scene of computer manufacture and video camera and camera live carries out digitlization synthesis, personage and virtual background are synchronously changed, thus realizes the synthesis of image.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
The structural representation of the virtual scene synthesis system that Fig. 1 provides for the embodiment of the present invention;
The schematic flow sheet of the virtual scene synthetic method that Fig. 2 provides for the embodiment of the present invention.
Reference numeral:
1, camera head; 2, background storage device; 3, video frequency collection card; 4, chroma key; 5, layer adjustment FX Module; 6, filter; 7, audio file; 8, sound card; 9, synthesizer; 10, display unit.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention; technical scheme in the embodiment of the present invention is removed, intactly described; obviously; described embodiment is only the present invention's part embodiment; instead of whole embodiments; based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 1 shows the structural representation of virtual scene synthesis system in the embodiment of the present invention, as shown in Figure 1, virtual scene synthesis system in the embodiment of the present invention, comprise: camera head 1, for carrying out the collection of vision signal, wherein, camera head 1 is video camera or camera, shown camera can be digital, and being connected with IEEE1394 socket in host computer, also can be camera or the video camera of other types; Background storage device 2, for storing and the matching used background data of camera head 1; Wherein, background data and background material, background material is setting in advance.Be understandable that, hobby and the interest of operator are depended in the selection of background material, and operator can select oneself arbitrarily, the present invention is not limited, video frequency collection card 3, is connected with described camera head 1, for receive described camera head 1 export signal and processing signals; Chroma key 4, is connected with described video frequency collection card 3, for receiving the vision signal of described camera head 1, and the vision signal of described camera head 1 is carried out stingy picture; Particularly, real-time for the static or movable image of object or person person can be separated by chroma key 4 from indigo plant/green background, synthesize with other background again, obtain new image layer adjustment FX Module 5, be connected with described chroma key 4 and background storage device 2, after vision signal and described background data being synthesized, export composite signal, produce the virtual scene after vision signal and background data synthesis.
Be understandable that, background storage device 2, chroma key 4 and image layer adjustment FX Module 5 all can be arranged in computer, that is, the context vault for storing background data is provided with in computer, chroma key 4 is for being arranged on a client in computer or software, in time setting scene, carry out image or image collection by camera or video camera, peripheral hardware is connected with host computer.Then camera or video camera are connected with video frequency collection card 3, if use digital camera to gather, so direct and above-mentioned video frequency collection card 3 is connected, if use analog camera or video camera to gather, it is so also needed to be connected with analog to digital converter, thus carry out analog-to-digital conversion, the signal of analog camera collection is carried out processing be input to again in above-mentioned video frequency collection card 3.Signal after above-mentioned video frequency collection card 3 processes just is input in chroma key 4.
Further, in another embodiment, also comprise: filter 6, be connected with the output of audio file 7, for filtering described audio file 7; Sound card 8, is connected with filter 6, for gathering audio signal and described audio signal being sent to synthesizer 9; Synthesizer 9 adjusts FX Module 5 with sound card 8 and layer and is connected, and synthesizes for the audio signal described composite signal and sound card 8 exported, and output video file.
In a particular application, synthesize through layer adjustment FX Module 5 after vision signal is carried out scratching picture by chroma key 4, the audio frequency that after synthesis, image can export with sound card 8 combines, the video file with audio frequency is generated through synthesizer 9, export to display unit 10, display unit 10 and layer adjust FX Module 5 and are connected, and for showing the virtual scene after synthesis, display unit 10 can be display or television system.Thus can see that personage and the picture shown by computer or television screen combine, make the part that the image of personage becomes important in whole picture, and can matching background picture, produce the virtual scene after figure and ground's synthesis in the planes.
Further, in other embodiments, also comprise not shown apparatus for processing audio, comprise the Mike connected successively, preposition Hybrid amplifier device, power amplification device and audio amplifier.
In the present embodiment, the embodiment of the present invention adopts in real time dynamically indigo plant/green screen to scratch picture and synthetic technology, picture shown by personage and computer or television screen is combined, make the part that the image of personage becomes important in whole picture, and can matching background picture, produce the virtual scene after figure and ground's synthesis in the planes, for example, according to the storyboard first editted to take material, the character activities image taken at the blue back surface field scape taken by the virtual scene of computer manufacture and video camera and camera live carries out digitlization synthesis, personage and virtual background are synchronously changed, thus realize the synthesis of image, such as, background selects park, camera live shooting personage sings before indigo plant/green screen, audience can see from TV or computer screen the sight sung before personage stands in park.
Fig. 2 shows the schematic flow sheet of virtual scene synthetic method in the embodiment of the present invention, and as shown in Figure 2, the virtual scene synthetic method in the present embodiment, comprises the steps:
201, the background data that camera head uses is obtained;
In the present embodiment, by choosing the matching used background data of different video cameras, the display format of video just can be different, and the present embodiment can arbitrarily be revised the spatial alternation of the object in scene and replace, and realizes abundant scene editting function flexibly.
202, carried out the collection of image or image by camera head, and the vision signal of collection is outputted to chroma key by video frequency collection card;
203, by chroma key, the foreground signal of video camera is carried out stingy picture, and export layer adjustment FX Module to;
204, layer adjustment FX Module exports composite signal after vision signal and described background data being synthesized, and produces the virtual scene after vision signal and background data synthesis.
Wherein, after step 204, also comprise:
205, the audio signal that described composite signal and sound card export is synthesized by synthesizer, and output video file generated virtual scenery.
The present embodiment can realize high-definition virtual scenery, and performer and scene are merged completely, and can ensure the stingy picture effect that performer is good; Can arbitrarily revise the spatial alternation of the object in scene and replace, realize abundant scene editting function flexibly.
The virtual scene of the present embodiment synthesizes the flow process that can perform in the embodiment of the method shown in aforesaid Fig. 2, and the present embodiment does not describe in detail at this.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies, then the present invention is also intended to comprise these change and modification.
Claims (7)
1. a virtual scene synthesis system, is characterized in that, comprising:
Camera head, for carrying out the collection of vision signal;
Background storage device, for storing and the matching used background data of described camera head;
Video frequency collection card, is connected with described camera head, for receive described camera head export signal and processing signals;
Chroma key, is connected with described video frequency collection card, for receiving the vision signal of described camera head, and the vision signal of described camera head is carried out stingy picture;
Layer adjustment FX Module, is connected with described chroma key and described background storage device, after vision signal and described background data being synthesized, exports composite signal, produces the virtual scene after vision signal and background data synthesis.
2. system according to claim 1, is characterized in that, also comprises:
Filter, is connected with the output of audio file, for filtering described audio file;
Sound card, is connected with described filter, for gathering audio signal and described audio signal being sent to synthesizer;
Synthesizer, adjusts FX Module with described sound card and described layer and is connected, and synthesizes for the audio signal described composite signal and described sound card exported, and output video file.
3. system according to claim 2, is characterized in that, also comprises:
Display unit, adjusts FX Module with described layer and is connected, for showing the virtual scene after synthesis.
4. system according to claim 1, is characterized in that, described camera head is connected with described video frequency collection card by IEEE1394 socket.
5. system according to claim 1, is characterized in that, also comprises:
Apparatus for processing audio, comprises the Mike connected successively, preposition Hybrid amplifier device, power amplification device and audio amplifier.
6. a virtual scene synthetic method, is characterized in that, comprising:
Obtain the background data that camera head uses;
Carried out the collection of image or image by camera head, and the vision signal of collection is outputted to chroma key by video frequency collection card;
By chroma key, the foreground signal of video camera is carried out stingy picture, and export layer adjustment FX Module to;
Export composite signal after vision signal and described background data are synthesized by layer adjustment FX Module, produce the virtual scene after vision signal and background data synthesis.
7. method according to claim 6, it is characterized in that, after vision signal and described background data synthesized by described layer adjustment FX Module, export composite signal, after producing the step of the virtual scene after vision signal and background data synthesis, also comprise:
The audio signal that described composite signal and sound card export is synthesized by synthesizer, and output video file generated virtual scenery.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510078882.8A CN104660872A (en) | 2015-02-14 | 2015-02-14 | Virtual scene synthesis system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510078882.8A CN104660872A (en) | 2015-02-14 | 2015-02-14 | Virtual scene synthesis system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104660872A true CN104660872A (en) | 2015-05-27 |
Family
ID=53251533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510078882.8A Pending CN104660872A (en) | 2015-02-14 | 2015-02-14 | Virtual scene synthesis system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104660872A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105208265A (en) * | 2015-07-31 | 2015-12-30 | 维沃移动通信有限公司 | Shooting demonstration method and terminal |
| CN105208458A (en) * | 2015-09-24 | 2015-12-30 | 广州酷狗计算机科技有限公司 | Virtual frame display method and device |
| CN105376547A (en) * | 2015-11-17 | 2016-03-02 | 广州市英途信息技术有限公司 | Micro video course recording system and method based on 3D virtual synthesis technology |
| CN105430089A (en) * | 2015-12-11 | 2016-03-23 | 华夏银行股份有限公司 | Remote service method, self-service method and device |
| CN105654005A (en) * | 2016-01-04 | 2016-06-08 | 陕西科技大学 | Parent-child type restaurant architecture and application method thereof for children entertainment |
| CN105959595A (en) * | 2016-05-27 | 2016-09-21 | 西安宏源视讯设备有限责任公司 | Virtuality to reality autonomous response method for virtuality and reality real-time interaction |
| CN106303289A (en) * | 2015-06-05 | 2017-01-04 | 福建凯米网络科技有限公司 | A kind of real object and virtual scene are merged the method for display, Apparatus and system |
| CN107105173A (en) * | 2017-04-24 | 2017-08-29 | 武汉折叠空间科技有限公司 | A kind of self-service video creating method of interactive |
| CN108108023A (en) * | 2018-01-02 | 2018-06-01 | 联想(北京)有限公司 | A kind of display methods and display system |
| CN108449569A (en) * | 2018-03-13 | 2018-08-24 | 重庆虚拟实境科技有限公司 | Virtual meeting method, system, device, computer installation and storage medium |
| CN109743464A (en) * | 2019-02-28 | 2019-05-10 | 努比亚技术有限公司 | Desktop background display methods, mobile terminal and computer readable storage medium |
| CN110459048A (en) * | 2019-09-03 | 2019-11-15 | 亳州职业技术学院 | A kind of intelligent guider interpretation system based on VR technology |
| CN112954459A (en) * | 2021-03-04 | 2021-06-11 | 网易（杭州）网络有限公司 | Video data processing method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101472079A (en) * | 2007-12-26 | 2009-07-01 | 北京同步科技有限公司 | Generator of dynamic background |
| CN101500092A (en) * | 2008-10-16 | 2009-08-05 | 黄福宝 | Broadcast stage MTV synthesizing method |
| CN101677386A (en) * | 2008-08-01 | 2010-03-24 | 中兴通讯股份有限公司 | System capable of selecting real-time virtual call background and video call method |
| CN103841299A (en) * | 2012-11-23 | 2014-06-04 | 西安天动数字科技有限公司 | Virtual studio system |
-
2015
- 2015-02-14 CN CN201510078882.8A patent/CN104660872A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101472079A (en) * | 2007-12-26 | 2009-07-01 | 北京同步科技有限公司 | Generator of dynamic background |
| CN101677386A (en) * | 2008-08-01 | 2010-03-24 | 中兴通讯股份有限公司 | System capable of selecting real-time virtual call background and video call method |
| CN101500092A (en) * | 2008-10-16 | 2009-08-05 | 黄福宝 | Broadcast stage MTV synthesizing method |
| CN103841299A (en) * | 2012-11-23 | 2014-06-04 | 西安天动数字科技有限公司 | Virtual studio system |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106303289A (en) * | 2015-06-05 | 2017-01-04 | 福建凯米网络科技有限公司 | A kind of real object and virtual scene are merged the method for display, Apparatus and system |
| CN106303289B (en) * | 2015-06-05 | 2020-09-04 | 福建凯米网络科技有限公司 | Method, device and system for fusion display of real object and virtual scene |
| CN105208265A (en) * | 2015-07-31 | 2015-12-30 | 维沃移动通信有限公司 | Shooting demonstration method and terminal |
| CN105208458B (en) * | 2015-09-24 | 2018-10-02 | 广州酷狗计算机科技有限公司 | Virtual screen methods of exhibiting and device |
| CN105208458A (en) * | 2015-09-24 | 2015-12-30 | 广州酷狗计算机科技有限公司 | Virtual frame display method and device |
| CN105376547A (en) * | 2015-11-17 | 2016-03-02 | 广州市英途信息技术有限公司 | Micro video course recording system and method based on 3D virtual synthesis technology |
| CN105430089A (en) * | 2015-12-11 | 2016-03-23 | 华夏银行股份有限公司 | Remote service method, self-service method and device |
| CN105654005A (en) * | 2016-01-04 | 2016-06-08 | 陕西科技大学 | Parent-child type restaurant architecture and application method thereof for children entertainment |
| CN105959595A (en) * | 2016-05-27 | 2016-09-21 | 西安宏源视讯设备有限责任公司 | Virtuality to reality autonomous response method for virtuality and reality real-time interaction |
| CN107105173A (en) * | 2017-04-24 | 2017-08-29 | 武汉折叠空间科技有限公司 | A kind of self-service video creating method of interactive |
| CN108108023A (en) * | 2018-01-02 | 2018-06-01 | 联想(北京)有限公司 | A kind of display methods and display system |
| US10809532B2 (en) | 2018-01-02 | 2020-10-20 | Lenovo (Beijing) Co., Ltd. | Display method and display system |
| CN108449569A (en) * | 2018-03-13 | 2018-08-24 | 重庆虚拟实境科技有限公司 | Virtual meeting method, system, device, computer installation and storage medium |
| CN109743464A (en) * | 2019-02-28 | 2019-05-10 | 努比亚技术有限公司 | Desktop background display methods, mobile terminal and computer readable storage medium |
| CN110459048A (en) * | 2019-09-03 | 2019-11-15 | 亳州职业技术学院 | A kind of intelligent guider interpretation system based on VR technology |
| CN112954459A (en) * | 2021-03-04 | 2021-06-11 | 网易（杭州）网络有限公司 | Video data processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104660872A (en) | Virtual scene synthesis system and method | |
| US9160938B2 (en) | System and method for generating three dimensional presentations | |
| KR101713772B1 (en) | Apparatus and method for pre-visualization image | |
| CN108305308A (en) | It performs under the line of virtual image system and method | |
| CN108965746A (en) | Image synthesizing method and system | |
| KR101669897B1 (en) | Method and system for generating virtual studio image by using 3-dimensional object modules | |
| CN106657719A (en) | Intelligent virtual studio system | |
| US20110304735A1 (en) | Method for Producing a Live Interactive Visual Immersion Entertainment Show | |
| CN102739984A (en) | Method and system for realizing high-definition virtual scenery | |
| CN108961368A (en) | The method and system of real-time live broadcast variety show in three-dimensional animation environment | |
| CN1547131A (en) | Virtual reality interactive control system | |
| CN115118880A (en) | XR virtual shooting system based on immersive video terminal is built | |
| Robotham et al. | Audiovisual database with 360 video and higher-order Ambisonics audio for perception, cognition, behavior, and QoE evaluation research | |
| CN109756683A (en) | Panorama audio-video method for recording, device, storage medium and computer equipment | |
| CN112153472A (en) | Method and device for generating special picture effect, storage medium and electronic equipment | |
| CN106454295A (en) | Real-time holographic projection device and method based on pure color background | |
| CN206302475U (en) | A kind of intelligent virtual studio system | |
| Hu | The effects of digital video technology on modern film | |
| CN109801377A (en) | Broadcast information processing method and system | |
| TWI706292B (en) | Virtual Theater Broadcasting System | |
| CN115187108A (en) | Distributed color ranking method and system based on virtual stage | |
| CN116962744A (en) | Live webcast link interaction method, device and live broadcast system | |
| KR20170059310A (en) | Device for transmitting tele-presence image, device for receiving tele-presence image and system for providing tele-presence image | |
| KR20070064082A (en) | System and method for producing moving image using chroma-key | |
| KR102374665B1 (en) | Method and system for generating broadcast video for personal broadcasting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150527 |
|
| RJ01 | Rejection of invention patent application after publication |