CN207460313U - Mixed reality studio system - Google Patents
Mixed reality studio system Download PDFInfo
- Publication number
- CN207460313U CN207460313U CN201721662257.9U CN201721662257U CN207460313U CN 207460313 U CN207460313 U CN 207460313U CN 201721662257 U CN201721662257 U CN 201721662257U CN 207460313 U CN207460313 U CN 207460313U
- Authority
- CN
- China
- Prior art keywords
- scene
- camera device
- mixed reality
- reality
- studio system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
Mixed reality studio system.A kind of mixed reality studio system, including：First camera device, for gathering current virtual scene；Second camera device, for gathering realities of the day scene；Central server is connected to first camera device and second camera device, with according to the virtual scene and the reality scene, generation fusion scene；3D display device is connected to the central server, for the fusion scene to be presented；And LED display module, for default scene to be presented, the default scene is part or all of for the reality scene.The mixed reality studio system of the utility model utilizes the first camera device and the second camera device superposition filmed image, central server is according to virtual scene and reality scene, generation fusion scene, reaches a stage and builds a variety of sceneries and switch at any time, reduces the effect of later stage manual manufacture.
Description
Technical field
The utility model is related to computer image technology field, more particularly to a kind of mixed reality studio system.
Background technology
Virtual studio is a kind of television program designing technology for uniqueness that developed recently gets up.Its essence is will to calculate
The real-time synthesis that the character activities image that the virtual three-dimensional scene that mechanism is made is taken on site with television camera is digitized, makes
Personage can synchronously change with virtual background, so as to fulfill the fusion of the two, to obtain perfect synthesis picture.
Technology is performed in a radio or TV programme in existing live streaming, using outdoor scene is shot, the later stage is added to be superimposed content production, completes last imaging conduct
It is broadcast live, performs in a radio or TV programme or recorded broadcast content., superposition post-digital content, figure cumbersome to the film source modification recorded after the completion of recording
Picture, special efficacy also have certain cost of labor.On the other hand, the replacement update of scenery also has very big cost of manufacture and time
Cost.
Therefore, modernize studio and be badly in need of a kind of quickly and conveniently live streaming and perform in a radio or TV programme content production instrument and more flexibly
Stage background change mode.
Utility model content
Solve needed for the utility model to be that existing live streaming performs in a radio or TV programme that the modification of technology film source is cumbersome, stage background alternates inconvenient
The problem of.
In order to solve the above technical problems, technical solutions of the utility model provide a kind of mixed reality studio system, including：
First camera device, for gathering current virtual scene；Second camera device, for gathering realities of the day scene；Center
Server is connected to first camera device and second camera device, with according to the virtual scene and the reality
Scene, generation fusion scene；3D display device is connected to the central server, for the fusion scene to be presented；And LED
Display screen module, for default scene to be presented, the default scene is part or all of for the reality scene.
Optionally, there is at least one moveable object, first camera device includes language in the reality scene
Sound identifies module and multiple position sensors, and the position sensor is used to obtain the location information of the object.
Optionally, a cloud server is also connected with, the speech recognition module of first camera device is connected to institute
State cloud server.
Optionally, the virtual scene includes word, picture or film.
Optionally, the reality scene includes word, picture or film.
Optionally, first camera device is augmented reality wear-type all-in-one machine.
Optionally, the central server includes an image procossing module, to perform image synthesis and Rendering operations.
Compared with the prior art, the mixed reality studio system of technical solutions of the utility model shoots with video-corder dress using first
Put (for example, augmented reality wear-type all-in-one machine) and the second camera device (for example, professional camera) superposition filmed image, center
Server is according to virtual scene and reality scene, using image processing algorithm by the real image of shooting and digital content, computer
Image, the suture of computer animation special efficacy, generation fusion scene；On the other hand, set up a platform wall using LED display module,
Image processing software and visual perspective effect stitching algorithm are rendered by 3D, simulate different stage sets, reaches a stage and takes
It builds a variety of sceneries at any time to switch, captured in real-time content is superimposed the suture of content real-time rendering with augmented reality, improves content interest
It is artificial to reduce post-production for taste and diversity.
For the above-mentioned technical proposal of the utility model and advantage is enable to be clearer and more comprehensible, special embodiment below, and combine
Detailed description are as follows for attached drawing.
Description of the drawings
Fig. 1 is the schematic diagram of the mixed reality studio system of one embodiment of the utility model.
Fig. 2 is the structure diagram of the first camera device of one embodiment of the utility model.
Specific embodiment
Further to illustrate that the utility model is to reach the technological means and effect that predetermined purpose of utility model taken,
Below in conjunction with attached drawing and preferred embodiment, to according to the utility model proposes specific embodiment, structure, feature and effect,
It is described in detail.
As background technology is mentioned, existing mixed reality studio system, the film source after the completion of recording to having recorded
It changes cumbersome；On the other hand, the replacement update of scenery also has very big cost of manufacture and time cost.
Based on this, technical solutions of the utility model provide a kind of mixed reality studio system, are taken using LED display modules
Stage background wall is built, image processing software and visual perspective effect stitching algorithm are rendered by 3D, simulate different stage sets, it is real
Existing scenery switches at any time.
Refering to Fig. 1, Fig. 1 is the schematic diagram of the mixed reality studio system of one embodiment of the utility model.Mixed reality
Studio system include the first camera device 120, the second camera device 130, central server 150,3D display device 160 and
LED display module 110.
First camera device 120, for gathering current virtual scene 140a, 140b, 140c.The virtual scene
140a, 140b, 140c are the content of augmented reality, can include word, picture or film, as virtual scene includes in Fig. 1
Suspension word 140a, automobile 140b and Oriental Pearl 140c.Virtual scene 140a, 140b, 140c are by the first camera device 120
The holographic imaging cast out.Holographic technique utilizes interference and diffraction principle record and the real 3-D view of reconstructed object
Record and the technology reproduced.Its first step is to record object light-wave information using principle of interference, this i.e. shooting process：Subject
The object beam of diffusion formula is formed under laser irradiation；Another part laser with reference to light beam as being mapped on holofilm and object light
Beam superposition generates interference, the position phase and amplitude of each point on object light wave is converted into the intensity being spatially varying, so as to utilize
Contrast and interval between interference fringe record the full detail of object light wave.Virtual scene 140a, 140b, 140c can only
It is obtained by the first camera device 120 and seen over the display, bore hole is invisible.
In one embodiment, first camera device 120 can be augmented reality wear-type all-in-one machine.Augmented reality
Wear-type all-in-one machine can be configured with three-dimensional camera, depth transducer, speech recognition module, multiple position sensors,
And Inertial Measurement Unit.The in vitro camera is used to obtain the content of augmented reality namely virtual scene shown in FIG. 1 ---
Suspension word 140a, automobile 140b and Oriental Pearl 140c.
In another embodiment, first camera device 120 can also integrate one or more control buttons and direction
Controller.Radio network interface and/or bluetooth module can also be configured in first camera device 120, so that this first is taken the photograph
Recording device can be interacted with other external equipments such as keyboard.First camera device 120 can also include two
Or more than two power supply units, to provide longer usage time.
Second camera device 130, for gathering realities of the day scene.The reality scene includes word, picture or shadow
Piece can also include the announcer in studio.Word, picture or the film of reality scene can be presented in a LED display
On module 110 (being discussed further below).Second camera device 130 can be professional camera, and professional camera refers to taking the photograph
Camera recorder and player combination one kind product in camera.Professional camera is divided into as two kinds of DVCAM and DVCPRO.DVCAM is in video and sound
Frequency collect and record aspect and DV is essentially identical, record code check is 25Mbps, and audio is using two kinds of sampling configurations of 48kHz and 32kHz.
DVCPRO is a kind of new number format released on the basis of DV forms.It uses 4:1:1 sampling, 5:1 compression, 18 microns
Track width.The image of announcer, guide or main broadcaster in reality scene can be recorded by the second camera device 130, equally
Ground, word, picture or the film presented in LED display modules 110 etc. can also be recorded by the second camera device 130.
Refering to Fig. 2, Fig. 2 is the structure diagram of the first camera device of one embodiment of the utility model.In an implementation
In example, there is at least one moveable object in the reality scene.Movable objects can be the hand of announcer, can also
It is such as instruction device.As previously mentioned, the first camera device 120 includes speech recognition module 122 and multiple position sensings
Device 121, the position sensor 121 are used to obtain the location information of the object.Work as movable objects, such as the gesture of announcer
When changing, the position sensor of the first camera device 120 obtains the location information of hand, you can what identification announcer sent
Action command.Speech recognition module 122 can obtain announcer's phonetic order.
In another embodiment, the mixed reality presentation system is also connected with a cloud server 170, and described first shoots with video-corder
The speech recognition module 122 of device 120 is connected to the cloud server 170.The cloud computing of terminal device and network side
Platform Server establishes connection, after the first camera device 120 receives announcer's phonetic order, by cloud server 170 to upper
It states phonetic order and carries out semantic analysis, and analysis result is back to central server 150 (being discussed further below), realize to virtual
The voice control of scene or reality scene.
LED display module 110, for being presented default scene, the default scene for the reality scene part or
All.In studio, a setting is built using indoor small space distance LED display screen module 110, with second camera device
130 form a perspective view, and what is presented in LED display modules 110 can be scene content picture typesetted in advance, shadow
Piece or 3D modeling scene are shot by 130 Visual Angle in Perspective of the second camera device, and reach analog simulation scene shoots with video-corder effect.
In one embodiment, LED display module 110 can one be connected to central server 150 (being discussed further below) and multiple
The display system of playing device.
Central server 150 is connected to first camera device 120 and second camera device 130, with according to institute
State virtual scene 140a, 140b, 140c and the reality scene, generation fusion scene.The central server 150 includes a figure
As processing module (not depending on going out in figure), to perform image synthesis and Rendering operations, to generate fusion scene.Image procossing module
It can include one or more GPU to perform the first of central server 150 the instruction, first instruction is suitable for using specific
Image processing algorithm the real image of shooting and digital content, computerized image, computer animation special efficacy are sutured into real time imagery.
3D display device 160 is connected to the central server 150, for the fusion scene to be presented.3D display device 160
Can be bore hole 3D display device, by display by two it is secondary there are the left images of potential difference and right image be presented respectively to left eye and
Right eye obtains the visual effect of 3D.The fusion scene, by dummy object, scene or system prompt information and real scene
It is overlapped, realizes " enhancing " to reality.
In conclusion the mixed reality studio system of technical solutions of the utility model using the first camera device (for example,
Augmented reality wear-type all-in-one machine) and the second camera device (for example, professional camera) superposition filmed image, central server root
According to virtual scene and reality scene, using image processing algorithm by the real image of shooting and digital content, computerized image, computer
Animation effect sutures, generation fusion scene；On the other hand, set up a platform wall using LED display module, rendered by 3D
Image processing software and visual perspective effect stitching algorithm, simulate different stage sets, reach a stage and build a variety of stages
Setting switches at any time, and captured in real-time content is superimposed the suture of content real-time rendering with augmented reality, and it is interesting and various to improve content
Property, it is artificial to reduce post-production.Aspect is shot with video-corder, is taken the photograph simultaneously using the camera-shooting and recording device with augmented reality function and professional camera
Record, single sintering carry the film of augmented reality content.Augmented reality content can interact operation, can also playing animation
Special efficacy, true stage and announcer, host can coordinate augmented reality content to carry out performing in a radio or TV programme making work, can also and enhance
Real content carries out certain interactive operation.
The above is only the preferred embodiment of the present utility model, not makees limit in any form to the utility model
System, although the utility model has been disclosed with preferred embodiment as above, is not limited to the utility model, any to be familiar with sheet
Technical professional is not being departed from the range of technical solutions of the utility model, when the technology contents work using the disclosure above
Go out a little change or be modified to the equivalent embodiments of equivalent variations, as long as be without departing from the content of the technical scheme of the utility model, according to
According to any simple modification, equivalent change and modification that the technical essence of the utility model makees above example, still fall within
In the range of technical solutions of the utility model.
Claims (7)
1. a kind of mixed reality studio system, which is characterized in that including：
First camera device, for gathering current virtual scene；
Second camera device, for gathering realities of the day scene；
Central server is connected to first camera device and second camera device, with according to the virtual scene and
The reality scene, generation fusion scene；
3D display device is connected to the central server, for the fusion scene to be presented；And
LED display module, for default scene to be presented, the default scene is part or all of for the reality scene.
2. mixed reality studio system according to claim 1, which is characterized in that have at least in the reality scene
One moveable object, first camera device include speech recognition module and multiple position sensors, the position
Sensor is used to obtain the location information of the object.
3. mixed reality studio system according to claim 2, which is characterized in that be also connected with a cloud server, institute
The speech recognition module for stating the first camera device is connected to the cloud server.
4. mixed reality studio system according to claim 1, which is characterized in that the virtual scene include word,
Picture or film.
5. mixed reality studio system according to claim 1, which is characterized in that the reality scene include word,
Picture or film.
6. mixed reality studio system according to claim 1, which is characterized in that first camera device is enhancing
Real wear-type all-in-one machine.
7. mixed reality studio system according to claim 1, which is characterized in that the central server includes a figure
As processing module, to perform image synthesis and Rendering operations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721662257.9U CN207460313U (en) | 2017-12-04 | 2017-12-04 | Mixed reality studio system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721662257.9U CN207460313U (en) | 2017-12-04 | 2017-12-04 | Mixed reality studio system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN207460313U true CN207460313U (en) | 2018-06-05 |
Family
ID=62275656
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201721662257.9U Active CN207460313U (en) | 2017-12-04 | 2017-12-04 | Mixed reality studio system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN207460313U (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109257589A (en) * | 2018-10-12 | 2019-01-22 | 王宇溪 | Long-range 3-D scanning holographic cartoon special efficacy generates vertical aobvious system and method |
| CN109327694A (en) * | 2018-11-19 | 2019-02-12 | 威创集团股份有限公司 | A kind of 3D control room method for changing scenes, device, equipment and storage medium |
| CN109639933A (en) * | 2018-12-07 | 2019-04-16 | 北京美吉克科技发展有限公司 | A kind of method and system of 360 degree of panorama program makings of virtual studio |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| CN111698522A (en) * | 2019-03-12 | 2020-09-22 | 北京竞技时代科技有限公司 | Live system based on mixed reality |
| WO2021238804A1 (en) * | 2020-05-29 | 2021-12-02 | 深圳市瑞立视多媒体科技有限公司 | Mixed reality virtual preview photographing system |
| CN114302027A (en) * | 2021-12-22 | 2022-04-08 | 上海正在上演文化科技有限公司 | Digital performance SaaS system based on 5G technology |
-
2017
- 2017-12-04 CN CN201721662257.9U patent/CN207460313U/en active Active
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109257589A (en) * | 2018-10-12 | 2019-01-22 | 王宇溪 | Long-range 3-D scanning holographic cartoon special efficacy generates vertical aobvious system and method |
| CN109257589B (en) * | 2018-10-12 | 2023-05-30 | 王宇溪 | Remote three-dimensional scanning holographic animation special effect generation and display system and method thereof |
| CN109327694A (en) * | 2018-11-19 | 2019-02-12 | 威创集团股份有限公司 | A kind of 3D control room method for changing scenes, device, equipment and storage medium |
| CN109327694B (en) * | 2018-11-19 | 2021-03-09 | 威创集团股份有限公司 | 3D control room scene switching method, device, equipment and storage medium |
| CN109639933A (en) * | 2018-12-07 | 2019-04-16 | 北京美吉克科技发展有限公司 | A kind of method and system of 360 degree of panorama program makings of virtual studio |
| CN109639933B (en) * | 2018-12-07 | 2021-12-24 | 北京美吉克科技发展有限公司 | Method and system for making 360-degree panoramic program in virtual studio |
| CN111698522A (en) * | 2019-03-12 | 2020-09-22 | 北京竞技时代科技有限公司 | Live system based on mixed reality |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| WO2021238804A1 (en) * | 2020-05-29 | 2021-12-02 | 深圳市瑞立视多媒体科技有限公司 | Mixed reality virtual preview photographing system |
| CN114302027A (en) * | 2021-12-22 | 2022-04-08 | 上海正在上演文化科技有限公司 | Digital performance SaaS system based on 5G technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN207460313U (en) | Mixed reality studio system | |
| US11669298B2 (en) | Virtual and real object recording in mixed reality device | |
| CN111970535B (en) | Virtual live broadcast method, device, system and storage medium | |
| CN108200445B (en) | Virtual playing system and method of virtual image | |
| JP6785282B2 (en) | Live broadcasting method and equipment by avatar | |
| KR101713772B1 (en) | Apparatus and method for pre-visualization image | |
| US8339402B2 (en) | System and method of producing an animated performance utilizing multiple cameras | |
| US7791608B2 (en) | System and method of animating a character through a single person performance | |
| CN104866101A (en) | Real-time interactive control method and real-time interactive control device of virtual object | |
| CN108305308A (en) | It performs under the line of virtual image system and method | |
| CN106909217A (en) | A kind of line holographic projections exchange method of augmented reality, apparatus and system | |
| CN105959513A (en) | True three-dimensional virtual studio system and realization method thereof | |
| WO2023236656A1 (en) | Method and apparatus for rendering interactive picture, and device, storage medium and program product | |
| CN115631287A (en) | Digital virtual stage figure display system | |
| JP2006217183A (en) | Data processor and program for generating multimedia data | |
| CN108270978A (en) | A kind of image processing method and device | |
| Gomide | Motion capture and performance | |
| JP2024080412A (en) | DISPLAY CONTROL PROGRAM, DISPLAY CONTROL DEVICE, AND DISPLAY CONTROL METHOD | |
| WO2023119271A1 (en) | Advanced multimedia system for analysis and accurate emulation of live events | |
| JP2024051665A (en) | Moving image synthesis system, moving image synthesis method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |