CN218998118U - Background matching device of virtual studio - Google Patents

Background matching device of virtual studio Download PDF

Info

Publication number
CN218998118U
CN218998118U CN202222922024.5U CN202222922024U CN218998118U CN 218998118 U CN218998118 U CN 218998118U CN 202222922024 U CN202222922024 U CN 202222922024U CN 218998118 U CN218998118 U CN 218998118U
Authority
CN
China
Prior art keywords
camera
direction sensor
moving device
gyroscope
calibration module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202222922024.5U
Other languages
Chinese (zh)
Inventor
沈磊
邓勇勇
杨国彬
罗浩
陈金全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou Yangming Culture Communication Co ltd
Original Assignee
Guizhou Yangming Culture Communication Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou Yangming Culture Communication Co ltd filed Critical Guizhou Yangming Culture Communication Co ltd
Priority to CN202222922024.5U priority Critical patent/CN218998118U/en
Application granted granted Critical
Publication of CN218998118U publication Critical patent/CN218998118U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

The utility model discloses a background matching device of a virtual studio, which comprises a transverse moving device and a longitudinal moving device arranged on the transverse moving device, wherein an installation platform is fixed on the longitudinal moving device, a rotation direction device is fixed on the installation platform, a pitching device is arranged on the rotation direction device, and a binocular camera is fixed on the pitching device; the transverse moving device is provided with an X-direction sensor, the longitudinal moving device is provided with a Y-direction sensor, the top side of the binocular camera is provided with an inclined table, and the inclined table is provided with a gyroscope; the X-direction sensor and the Y-direction sensor are connected to the camera calibration module, the gyroscope is connected to the camera calibration module through the compensator, and the camera calibration module is further connected with the camera controller, the camera image processor and the background matching unit. The utility model can provide timely dynamic external parameter update for the camera calibration module, and the gyroscope is arranged on the inclined table and then compensated by the compensator, thereby reducing the processing difficulty of data.

Description

Background matching device of virtual studio
Technical Field
The utility model relates to a background matching device, in particular to a background matching device of a virtual studio.
Background
The virtual studio is a novel live broadcast or playing mode, firstly, a three-dimensional portrait is shot in a blue box through a camera, then background is removed through matting processing in the later period, and then a prepared three-dimensional background and the three-dimensional portrait are fused through a background matching unit, but because the portrait and the background are three-dimensional, the portrait needs to be positioned, the relations of depth of field, shielding, perspective and the like can be processed according to the relative relation between the portrait and the three-dimensional background, so that the fusion of the three-dimensional virtual background and the portrait is more natural, and the real position of the portrait needs to be positioned through a camera image, and a camera calibration module is needed to be used for calibration.
At present, in order to be convenient for calibration, the camera is generally fixed, external parameters are updated after adjustment, that is to say, the external parameters are difficult to update synchronously, and a plurality of live scenes require camera movement to shoot an ideal effect, but in virtual broadcasting, the camera is limited by the requirement of camera calibration and basically can only be in static shooting, so that shooting techniques and later effects are greatly limited.
Disclosure of Invention
The utility model aims to solve the technical problem of providing a background matching device of a virtual studio, which can provide dynamic external parameter acquisition for a camera calibration module, so that a camera is in a dynamic shooting process in time, and the position calibration of a portrait in the later period is not influenced, thereby ensuring that a virtual background and a three-dimensional portrait are well fused.
In order to solve the technical problems, the technical scheme of the utility model is as follows:
the background matching device of the virtual studio comprises a transverse moving device and a longitudinal moving device arranged on the transverse moving device, wherein an installation platform is fixed on the longitudinal moving device, a rotation direction device is fixed on the installation platform, a pitching device is arranged on the rotation direction device, and a binocular camera is fixed on the pitching device; the transverse moving device is provided with an X-direction sensor, the longitudinal moving device is provided with a Y-direction sensor, the top side of the binocular camera is provided with an inclined table, and the inclined table is provided with a gyroscope; the X-direction sensor and the Y-direction sensor are connected to the camera calibration module, the gyroscope is connected to the camera calibration module through the compensator, and the camera calibration module is further connected with the camera controller, the camera image processor and the background matching unit.
Further, the compensator is used for compensating the installation inclination angle of the gyroscope on the binocular camera.
Further, the X-direction sensor, the Y-direction sensor and the gyroscope jointly provide external parameters of the camera for the camera calibration module.
Further, the camera calibration module obtains internal parameters from the camera controller.
Further, the external parameters include X coordinate, Y coordinate, rotation angle and pitch angle of the camera.
Further, the internal parameters include focal length of the camera, pixels, and an internal parameter matrix.
Further, the X-direction sensor and the Y-direction sensor are both composed of an infrared emitter and an infrared receiver.
The utility model has the advantages that:
the utility model has the advantages that the utility model can provide timely parameter update for the camera calibration module when the camera dynamically shoots, so that the camera can accurately position the image by shooting the image in the process of moving shooting, and the gyroscope is arranged on the inclined table, thereby the rotation can cause the change of the gyroscope, and the installation inclination angle of the compensator for compensating the gyroscope on the binocular camera is increased, thereby not only reducing the number of sensors, but also reducing the processing difficulty of data.
Drawings
FIG. 1 is a schematic perspective view of the present utility model;
FIG. 2 is a schematic block diagram of the circuit of the present utility model;
fig. 3 is a schematic block diagram of camera calibration principle.
In the figure, a 1-transverse moving device, a 2-longitudinal moving device, a 3-mounting platform, a 4-rotation direction device, a 5-pitching device, a 6-binocular camera, a 7-gyroscope, a 71-inclined platform, an 8-infrared emitter and an 81-infrared receiver.
Detailed Description
The following describes the embodiments of the present utility model further with reference to the drawings. The description of these embodiments is provided to assist understanding of the present utility model, but is not intended to limit the present utility model. In addition, the technical features of the embodiments of the present utility model described below may be combined with each other as long as they do not collide with each other.
As shown in fig. 1-3:
the background matching device of the virtual studio comprises a transverse moving device 1 and a longitudinal moving device 2 arranged on the transverse moving device 1, wherein an installation platform 3 is fixed on the longitudinal moving device 2, a rotation direction device 4 is fixed on the installation platform 3, a pitching device 5 is arranged on the rotation direction device 4, and a binocular camera 6 is fixed on the pitching device 5; the transverse moving device 1 is provided with an X-direction sensor, the longitudinal moving device 2 is provided with a Y-direction sensor, the top side of the binocular camera 6 is provided with an inclined table 71, and the inclined table 71 is provided with a gyroscope 7; the X-direction sensor and the Y-direction sensor are connected to the camera calibration module, the gyroscope 7 is connected to the camera calibration module through a compensator, and the camera calibration module is further connected with the camera controller, the camera image processor and the background matching unit.
In video recording in a virtual studio, since the moving range of a portrait is not large, usually close-range shooting is performed, only horizontal and vertical movements are required for the movement of a camera, and rotation and pitching angle shooting are required for the movement of the camera itself, so that the utility model aims at the situation, the horizontal movement parameters of the camera are acquired through an X-direction sensor and a Y-direction sensor, the rotation of the camera is controlled through a rotation direction device 4, the pitching movement is controlled through a pitching device 5, and both rotation and pitching can be converted into angle changes, so that the camera can be acquired through a gyroscope 7, but if the gyroscope 7 is coaxial with the rotation direction, the rotation angle does not cause the inclination angle change of the gyroscope 7, so that the rotation direction change cannot be measured, so that the gyroscope 7 is installed on a tilting table 71, so that the rotation can cause the change of the gyroscope 7, but the inclination angle of the installation of the compensator gyroscope 7 on the binocular camera 6 is increased because the inclination of the tilting table 71 is increased.
The camera calibration principle and formula are shown in fig. 3 (the prior art is not repeated), wherein the external parameters are used for converting coordinates from the world coordinate system into the camera coordinate system, the internal parameters are used for converting coordinates from the camera coordinate system into the pixel coordinate system, so that the position in the real world can be calculated from the graph of the camera, the external parameters are provided by an X-direction sensor, a Y-direction sensor and a gyroscope 7 together, and mainly comprise the X-coordinate, the Y-coordinate, the rotation angle and the pitch angle of the camera (the camera does not move forwards and backwards, so that the Z-direction can be introduced into constant or zero processing) for calibrating the relative position of the camera in real time, the internal parameters are acquired from a camera controller by a camera calibration module, and the internal parameters comprise the focal length, the pixels and the internal parameter matrix of the camera, and the internal parameters can be directly acquired when the camera is set.
The X-direction sensor and the Y-direction sensor are used for measuring coordinates, each sensor is composed of an infrared emitter 8 and an infrared receiver 81, infrared ranging is relatively timely in response, errors are small, and errors of a mechanical displacement sensor are slightly larger.
After the camera calibration module (the camera commonly used in industrial cameras or automatic production lines in the prior art is used for calibrating the position of an object in the real world according to shooting, thereby providing control parameters for a manipulator and the like), acquiring the shot picture from the graphic processor of the camera, and determining the position and coordinates of a portrait in the real world according to the shot picture and the variation of the shot internal parameters and the shot external parameters of the camera, so that the coordinates can be transmitted to the background matching unit, the background matching unit can be better fused with a virtual background according to the coordinates of the portrait, and the relations of depth of field, shielding, perspective and the like are processed, so that the fusion of the three-dimensional virtual background and the portrait is more natural.
The utility model has the advantages that the utility model can provide timely parameter update for the camera calibration module when the camera dynamically shoots, so that the camera can accurately position the image by shooting the image in the process of moving shooting, the gyroscope 7 is arranged on the inclined table, thereby the rotation can cause the change of the gyroscope 7, and the installation inclination angle of the compensator for compensating the gyroscope 7 on the binocular camera is increased, thereby not only reducing the number of sensors, but also reducing the processing difficulty of data.
The embodiments of the present utility model have been described in detail above with reference to the accompanying drawings, but the present utility model is not limited to the described embodiments. It will be apparent to those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the utility model, and yet fall within the scope of the utility model.

Claims (7)

1. A background matching device of a virtual studio is characterized in that: the device comprises a transverse moving device and a longitudinal moving device arranged on the transverse moving device, wherein the longitudinal moving device is fixedly provided with a mounting platform, a rotation direction device is fixedly arranged on the mounting platform, a pitching device is arranged on the rotation direction device, and a binocular camera is fixedly arranged on the pitching device; the transverse moving device is provided with an X-direction sensor, the longitudinal moving device is provided with a Y-direction sensor, the top side of the binocular camera is provided with an inclined table, and the inclined table is provided with a gyroscope; the X-direction sensor and the Y-direction sensor are connected to the camera calibration module, the gyroscope is connected to the camera calibration module through the compensator, and the camera calibration module is further connected with the camera controller, the camera image processor and the background matching unit.
2. The background matching device for a virtual studio according to claim 1, wherein: the compensator is used for compensating the installation inclination angle of the gyroscope on the binocular camera.
3. The background matching apparatus of a virtual studio according to claim 2, wherein: the X-direction sensor, the Y-direction sensor and the gyroscope jointly provide external parameters of the camera for the camera calibration module.
4. The background matching apparatus of a virtual studio according to claim 2, wherein: the camera calibration module obtains internal parameters from a camera controller.
5. The background matching apparatus of a virtual studio according to claim 3, wherein: the external parameters comprise X coordinates, Y coordinates, a rotation angle and a pitch angle of the camera.
6. The background matching device for a virtual studio of claim 4, wherein: the internal parameters include focal length of the camera, pixels, and an internal parameter matrix.
7. The background matching device for a virtual studio according to any one of claims 1-6, wherein: the X-direction sensor and the Y-direction sensor are both composed of an infrared emitter and an infrared receiver.
CN202222922024.5U 2022-11-03 2022-11-03 Background matching device of virtual studio Active CN218998118U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202222922024.5U CN218998118U (en) 2022-11-03 2022-11-03 Background matching device of virtual studio

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202222922024.5U CN218998118U (en) 2022-11-03 2022-11-03 Background matching device of virtual studio

Publications (1)

Publication Number Publication Date
CN218998118U true CN218998118U (en) 2023-05-09

Family

ID=86193724

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202222922024.5U Active CN218998118U (en) 2022-11-03 2022-11-03 Background matching device of virtual studio

Country Status (1)

Country Link
CN (1) CN218998118U (en)

Similar Documents

Publication Publication Date Title
CN110763152B (en) Underwater active rotation structure light three-dimensional vision measuring device and measuring method
CN107358631B (en) Binocular vision reconstruction method considering three-dimensional distortion
CN108363946B (en) Face tracking system and method based on unmanned aerial vehicle
CN109951692B (en) Method for realizing automatic trapezoidal correction of projector based on included angle between camera and optical path of optical machine
CN111540004A (en) Single-camera polar line correction method and device
CN102230758A (en) Method and device for testing tracking stability precision during travel of self-propelled gun
CN111024047B (en) Six-degree-of-freedom pose measurement device and method based on orthogonal binocular vision
CN101766021A (en) Imaging apparatus and a control method of the imaging apparatus
JP2002071309A (en) Three-dimensional image-detecting device
CN111476876B (en) Three-dimensional image rendering method, device, equipment and readable storage medium
CN114708326A (en) Full-automatic camera calibration system and method for adaptively adjusting brightness and ambiguity
CN107274352A (en) A kind of image processing method and the real-time sampling system applied to lens distortion and photography distortion correction
CN107421503B (en) Single-detector three-linear-array three-dimensional mapping imaging method and system
CN218998118U (en) Background matching device of virtual studio
CN112258581B (en) On-site calibration method for panoramic camera with multiple fish glasses heads
CN110942475B (en) Ultraviolet and visible light image fusion system and rapid image registration method
WO2021134219A1 (en) Parameter calibration method and apapratus
CN110989645A (en) Target space attitude processing method based on compound eye imaging principle
CN116309881A (en) Tripod head camera external parameter measuring and calculating method, device, equipment and medium
CN112113505B (en) Portable scanning measurement device and method based on line structured light
CN113421300A (en) Method and device for determining actual position of object in fisheye camera image
CN107770586A (en) cloud computer device
CN112381888A (en) Dynamic compensation method for H-shaped steel cutting path
CN112884847A (en) Dual-camera calibration method and system
CN112213711A (en) Calibration method of TOF camera

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant