TWI515691B - Composition video producing method by reconstruction the dynamic situation of the capture spot - Google Patents

Composition video producing method by reconstruction the dynamic situation of the capture spot Download PDF

Info

Publication number
TWI515691B
TWI515691B TW103134957A TW103134957A TWI515691B TW I515691 B TWI515691 B TW I515691B TW 103134957 A TW103134957 A TW 103134957A TW 103134957 A TW103134957 A TW 103134957A TW I515691 B TWI515691 B TW I515691B
Authority
TW
Taiwan
Prior art keywords
dynamic
environment
reconstruction
site
image
Prior art date
Application number
TW103134957A
Other languages
Chinese (zh)
Other versions
TW201614588A (en
Inventor
張榮正
Original Assignee
明新科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 明新科技大學 filed Critical 明新科技大學
Priority to TW103134957A priority Critical patent/TWI515691B/en
Application granted granted Critical
Publication of TWI515691B publication Critical patent/TWI515691B/en
Publication of TW201614588A publication Critical patent/TW201614588A/en

Links

Landscapes

  • Studio Devices (AREA)

Description

現場動態情境重建之合成錄像拍製方法 Synthetic video shooting method for on-site dynamic situation reconstruction

本發明是有關於一種現場動態情境重建之合成錄像拍製方法,特別是有關於一種於虛擬實境攝影棚執行key板合成拍攝時,同時以螢幕投射預先錄製之戶外或客製環境光源,以產生較為逼真且自然之影像之現場動態情境重建之合成錄像拍製方法。 The invention relates to a synthetic video shooting method for on-site dynamic situation reconstruction, in particular to a method for performing a keyboard composite shooting in a virtual reality studio while simultaneously projecting a pre-recorded outdoor or custom environment light source with a screen. A synthetic video production method that produces a lively dynamic situation reconstruction of a more realistic and natural image.

隨電腦運算能力之迅速提升,虛擬實境(Virtual Reality)攝影棚技術已普遍應用於新聞、節目製播或是婚紗拍攝等。舉一簡例而言,電視氣象預報中常見播報員站立於大型動態氣象圖前,配合圖內容解說以形成生動易懂之效果。然,其實際之攝影棚拍攝作業中,播報員背後僅為一通稱藍板或綠板(或稱key板)之布幕,電視畫面所見之動態氣象圖則由電腦動畫產生,於攝影棚中拍攝播報員連同身後之key板影像後,再利用嵌景技術(Chroma-key)進行去背合成,亦即將key板部分去除而嵌入電腦動畫氣象圖,而成為觀眾於電視畫面所見之合成畫面。或是另一簡例而言,新人在棚內拍攝婚紗照時,係站在key板前定位以供攝影師執行拍照作業,而後再進行去背合成,以將key板去除而嵌入實景拍攝之大自然或建築物影像,以達到如同新人在戶外拍攝之影像效果。至於其他常見之虛擬實境攝影棚應用中,演出者(被拍攝者)則更能進一步與場景產生互動,再後後製進行影像合成作業。 With the rapid improvement of computer computing power, Virtual Reality studio technology has been widely used in news, program production or wedding photography. For a simple example, the common broadcasters in the TV weather forecast stand in front of the large dynamic weather map, and cooperate with the content of the map to form a vivid and understandable effect. However, in the actual studio shooting operation, behind the broadcaster is only a curtain called the blue board or the green board (or the key board). The dynamic weather map seen on the TV screen is generated by computer animation in the studio. After shooting the broadcaster together with the keyboard image behind him, the Chroma-key technology is used to perform back-synthesis. The keyboard is partially removed and embedded in the computer animated weather map, which becomes a composite picture seen by the viewer on the TV screen. Or in another example, when a new person takes a wedding photo in the shed, the photographer stands in front of the key board for the photographer to perform the photographing work, and then performs the back-synthesis to remove the key board and embed the real shot. Natural or building images to achieve imagery like newcomers shooting outdoors. As for other common virtual reality studio applications, the performer (the subject) is more able to interact with the scene and then perform image synthesis.

關於虛擬實境攝影棚技術,其主要優點包含能省去設置佈景之搭棚及道具費用,以及能省去人員至戶外拍攝的麻煩與不便。但是,拍攝影像最重要的其中一點在於光線,雖然棚內都會架設棚燈以提供充足的光源,但其光源仍與戶外不同時刻之前景的光線有所不同,例如,被攝人 物臉上的反光會受到被攝人物的前景的光線所照射,當前景的光線強弱會造成被攝人物臉上光線的強弱反射,又如,當被攝人物的前景為煙火閃爍時,被攝人物的臉上也會產生快速的明暗色彩的變化。由於習知技術在棚內架設的棚燈難以重現現場被攝人物的前景的動態光源的變化,以致於最後去背合成後之影像無法如於戶外拍攝般自然與逼真的缺點。 With regard to virtual reality studio technology, its main advantages include the elimination of the cost of setting up the scaffolding and props, as well as the trouble and inconvenience of eliminating the need for personnel to shoot outdoors. However, one of the most important aspects of shooting images is light. Although the sheds are erected in the shed to provide a sufficient light source, the light source is still different from the light at the front of the outdoors, for example, the subject. The reflection on the face of the object will be illuminated by the light of the foreground of the subject. The intensity of the current scene will cause the reflection of the light on the face of the person being photographed. For example, when the foreground of the subject is flickering, the subject is photographed. The face of the character also produces a rapid change in light and dark colors. It is difficult for the shed lamp erected in the shed to reproduce the change of the dynamic light source of the foreground of the scened person, so that the image after the final synthesis cannot be as natural and realistic as the outdoor shooting.

有鑑於上述習知技藝之問題,本發明之目的就是在提供一種現場動態情境重建之合成錄像拍製方法,以解決習知於虛擬實境攝影棚所拍攝出之合成錄像不如戶外拍攝般真實之問題。 In view of the above-mentioned problems of the prior art, the object of the present invention is to provide a synthetic video recording method for on-site dynamic situation reconstruction, so as to solve the fact that the synthetic video captured by the virtual reality studio is not as real as the outdoor shooting. problem.

根據本發明之目的,提出一種現場動態情境重建之合成錄像拍製方法,其包含下列步驟:S11:在現場環境至少架設一台第一攝製裝置及至少一台第二攝製裝置,第一攝製裝置與第二攝製裝置構成現場環境補捉裝置;現場環境補捉裝置用以分別擷取被攝物所在環境中之現場動態情境,如利用該第一攝製裝置擷取被攝物的背景形成一背景影像、利用第二攝製裝置擷取被攝物的前景形成一現場環境光源影像;其中,上述被攝物的背景可包含建築、大自然環境、人物、動物、物品或上述二者以上之組合。而該攝像目標可包含人物、動物、物品或上述二者以上之組合。 According to the purpose of the present invention, a synthetic video recording method for on-site dynamic situation reconstruction is provided, which comprises the following steps: S11: at least one first camera device and at least one second camera device are installed in the field environment, and the first filming device And the second filming device constitutes a field environment catching device; the field environment catching device is used to respectively capture the dynamic situation of the scene in the environment of the object, such as using the first filming device to capture the background of the object to form a background The image, using the second camera to capture the foreground of the object to form a scene ambient light source image; wherein the background of the object may include a building, a natural environment, a person, an animal, an item, or a combination of the two or more. The camera target may include a person, an animal, an item, or a combination of the two or more.

其中,第一攝製裝置可為多鏡攝製,即可使用多個第一攝製裝置對被攝物的背景進行攝製,以形成多鏡攝製所形成的背景影像。 Wherein, the first filming device can be multi-mirror filming, that is, the background of the object can be filmed by using a plurality of first filming devices to form a background image formed by multi-mirror filming.

其中,第二攝製裝置可為m*n組(m與n為正整數),m為橫向解析度列數,n為直向解析度行數,對於不限定的實施方式,當m=n=1時,第二攝製裝置可為1組;該第二攝製裝置對被攝物的前景之中心形成一現場環境光源影像;或,第二攝製裝置可為2(m*n,m=1,n=2)組,這些第二攝製裝置分別對被攝物的前景之中心的左方與右方的中心形成一現場環境光源影像;或第二攝製裝置可為4(m*n,m=2,n=2)組,這些第二攝製裝置分別對被攝物的前景之中心的四個象限的中心形成一現場環境光源影像;對於不限定的實施方式,若對於現場環境光源重建需要更高解析度時, 則可使用m*n=6或以上。 Wherein, the second filming device may be an m*n group (m and n are positive integers), m is a horizontal resolution column number, and n is a straight resolution line number. For an undefined embodiment, when m=n= 1st, the second filming device may be a group; the second filming device forms a scene environment light source image for the center of the foreground of the object; or the second filming device may be 2 (m*n, m=1, n=2) group, these second filming devices respectively form a scene environment light source image for the left and right centers of the center of the foreground of the object; or the second filming device may be 4 (m*n, m= 2, n = 2) group, these second filming devices respectively form a scene environment light source image for the center of the four quadrants in the center of the foreground of the object; for the unrestricted embodiment, if the field environment light source reconstruction needs more At high resolution, Then m*n=6 or more can be used.

S12:利用一環境重建裝置將該現場動態情境進行重建形成一動態重建虛境,該動態重建虛境係利用動態照明影像重建出現場環境光源;環境重建裝置包含至少一影像播放裝置、環型反射裝置、至少一重建影像攝製裝置及一合成幕,該動態照明影像係經由該影像播放裝置將該現場環境光源影像於該環型反射裝置播放所成;其中,合成幕可為藍幕或綠幕;影像播放裝置可使用一台或多台的影像播放的放影機或投影機等,不為所限;重建影像攝製裝置可使用一台或多台的影像拍攝設備、燈光輔助設備或放音裝置等,不為所限;當,第二攝製裝置為1(m*n,m=n=1)組時,第二攝製裝置所形成的現場環境光源影像為1組,則該影像播放裝置係以該環型反射裝置之中心播放該第二攝製裝置所產生的該現場環境光源影像;或當,第二攝製裝置可為2(m*n,m=1,n=2)組時,第二攝製裝置所形成的現場環境光源影像為2組,係對被攝物的前景之中心的左方與右方的中心形成2組的現場環境光源影像,則可使用2組的影像播放裝置,分別以該環型反射裝置之中心為鏡像對稱播放該第二攝製裝置所產生的該現場環境光源影像,即,第一組第二攝製裝置係對被攝物的前景之中心的左方形成現場環境光源影像、第一組影像播放裝置置於環型反射裝置中心偏右播放對被攝物的前景之中心的左方的現場環境光源影像、第二組第二攝製裝置係對被攝物的前景之中心的右方形成現場環境光源影像、第二組影像播放裝置置於環型反射裝置中心偏左播放被攝物的前景之中心的右方的現場環境光源影像;同樣,當第二攝製裝置可為4(m*n,m=2,n=2)組,這些第二攝製裝置分別對被攝物的前景的四個解析點(spot)的中心形成一現場環境光源影像,分別為第(1,1)組第二攝製裝置對被攝物的前景之中心的(1,1)解析點的中心形成第(1,1)組之現場環境光源影像、第(1,2)組第二攝製裝置對被攝物的前景之中心的(1,2)解析點的中心形成第(1,2)組之現場環境光源影像、第(2,1)組第二攝製裝置對被攝物的前景之中心的(2,1)解析點的中心形成第(2,1) 組之現場環境光源影像、第(2,2)組第二攝製裝置對被攝物的前景之中心的(2,2)解析點的中心形成第(2,2)組之現場環境光源影像。重建現場光源情境時播放裝置第(i,j)組置於環型反射裝置中心偏向第(i,j)組攝製裝置對稱方向播放第(i,j)組的現場環境光源影像。 S12: reconstructing the dynamic situation of the scene by using an environment reconstruction device to form a dynamic reconstruction virtual environment, wherein the dynamic reconstruction virtual environment reconstructs the field ambient light source by using the dynamic illumination image; the environment reconstruction device includes at least one image playback device and a ring reflection The device, the at least one reconstructed image capturing device and a composite screen, wherein the dynamic lighting image is formed by playing the live ambient light source image on the ring-shaped reflecting device; wherein the synthetic screen can be a blue screen or a green screen The video playback device can use one or more video playback projectors or projectors, etc., and is limited to; the reconstructed image capture device can use one or more video capture devices, lighting auxiliary devices or playback. The device or the like is not limited; when the second filming device is 1 (m*n, m=n=1) group, the scene environment light source image formed by the second filming device is one group, then the image playing device Playing the scene environment light source image generated by the second filming device at the center of the ring type reflecting device; or when the second filming device is 2 (m*n, m=1, n=2) group, First The scene environment light source image formed by the filming device is two groups, and two sets of scene environment light source images are formed on the left and right centers of the foreground of the foreground of the object, and two groups of video playback devices can be used. Playing the scene environment light source image generated by the second filming device with the center of the ring type reflecting device as a mirror image symmetrically, that is, the first group of second film forming devices form a scene environment on the left side of the center of the foreground of the object The light source image, the first group of image playback devices are placed at the center of the ring-shaped reflecting device, and the right side of the foreground of the object is played to the left of the scene environment light source image, and the second group of second filming device is for the foreground of the object. The right side of the center forms the image of the scene ambient light source, and the second group of image playback devices is placed on the right side of the center of the foreground of the ring-shaped reflecting device to play the foreground of the object; the same is true when the second filming device It may be a group of 4 (m*n, m=2, n=2), and these second filming devices respectively form a scene environment light source image for the center of the four spots of the foreground of the object, respectively (1 , 1) The second filming device forms the (1, 1) group of the scene environment light source image, and the (1, 2) group second filming at the center of the (1, 1) analysis point of the center of the foreground of the object. The center of the (1, 2) analysis point of the center of the foreground of the object forms the scene environment image of the (1, 2) group, and the foreground of the second (2, 1) group of the second filming device The center of the (2,1) resolution point at the center forms the second (2,1) The scene environment light source image of the group, the second (2, 2) group second shooting device forms the scene environment light source image of the (2, 2) group at the center of the (2, 2) analysis point of the center of the foreground of the object. When the scene light source situation is reconstructed, the (i, j) group of the playback device is placed in the center of the ring-shaped reflection device to deflect the image of the field environment light source of the (i, j) group in the symmetric direction of the (i, j) group of the filming device.

環型反射裝置可為環形或凹面的反射鏡,為較佳效果,環型反射裝置的中心可設置於該攝像目標拍攝中心(如臉部)之前方,設置的位置可為該攝像目標拍攝中心水平上方的+30°~+60°位置,並朝向該攝像目標;其中,角度係以拍攝該攝像目標中心之水平為0°,向前方之上方為正角度,向前方下方為負角度。 The ring-shaped reflecting device can be a circular or concave mirror. For better results, the center of the ring-shaped reflecting device can be disposed in front of the shooting target shooting center (such as the face), and the set position can be the shooting target shooting center. The position of +30°~+60° above the horizontal direction is toward the camera target; wherein the angle is 0° at the center of the camera target, a positive angle toward the front, and a negative angle toward the front and the bottom.

較佳地,該環型反射裝置可由複數個反射鏡陣列彼此排列成環形凹面所形成,而該反射鏡陣列係由複數個凸面反射鏡所組成。 Preferably, the annular reflecting device is formed by a plurality of mirror arrays arranged in an annular concave shape, and the mirror array is composed of a plurality of convex mirrors.

S13:將攝像目標設置於該動態重建虛境中,該動態照明影像係照射於該攝像目標上,並同時利用該重建影像攝製裝置拍攝位在該合成幕前之該攝像目標以產生一初始錄像;S14:將該背景影像與該初始錄像進行合成,將該攝像目標影像重建於該動態重建虛境中,以拍製形成合成錄像。 S13: setting a camera target in the dynamic reconstruction virtual environment, the dynamic illumination image is irradiated on the image capturing target, and simultaneously capturing the image capturing target located in front of the synthetic screen by the reconstructed image capturing device to generate an initial recording. S14: synthesizing the background image and the initial video, reconstructing the camera target image in the dynamic reconstruction virtual environment, and forming a composite video by shooting.

又進一步,該現場動態情境可加入現場聲音,該現場環境補捉裝置則包含聲音擷取裝置,由該聲音擷取裝置擷取被攝物所在環境的聲源所產生的現場聲音;該動態重建虛境則包含動態聲音,該環境重建裝置進一步包含播音裝置,該動態聲音係由該播音裝置重建該現場聲音所產生;該重建影像攝製裝置則錄製該動態聲音形成該初始錄像之一部份。 Further, the live dynamic situation can be added to the live sound, and the live environment capture device includes a sound capture device, and the sound capture device captures the live sound generated by the sound source of the environment in which the object is located; the dynamic reconstruction The virtual environment includes a dynamic sound, and the environment reconstruction device further includes a sounding device, wherein the dynamic sound is generated by the sound reproducing device reconstructing the live sound; and the reconstructed image capturing device records the dynamic sound to form a part of the initial video.

更進一步,該現場動態情境可增加現場空氣流動,該現場環境補捉裝置進一步包含風向風速錄製裝置,該現場空氣流動係由該風向風速錄製裝置擷取被攝物所在環境的空氣流動所產生;該動態重建虛境則包含動態空氣流動,該環境重建裝置則包含送風裝置,該動態空氣流動係由該送風裝置重建該現場空氣流動所產生。 Further, the on-site dynamic situation may increase on-site air flow, and the on-site environmental capture device further includes a wind direction wind speed recording device, wherein the on-site air flow is generated by the wind direction wind speed recording device extracting air flow of the environment in which the object is located; The dynamic reconstruction virtual environment includes dynamic air flow, and the environmental reconstruction device includes a blower device, and the dynamic air flow is generated by the air blow device reconstructing the on-site air flow.

再進一步,該現場動態情境可增加現場溫濕度指標,該現場環境補捉裝置則包含溫濕度擷取裝置,該現場溫濕度指標係由該溫濕度擷取裝置擷取被攝物所在環境的溫度或濕度之一或其組合所產生;該動態重 建虛境則包含一動態溫濕度指標,該環境重建裝置則包含空調裝置,該動態溫濕度指標係由該空調裝置重建該現場溫濕度指標所產生。 Further, the on-site dynamic situation can increase the on-site temperature and humidity index, and the on-site environment capture device includes a temperature and humidity extraction device, and the on-site temperature and humidity indicator is obtained by the temperature and humidity extraction device to extract the temperature of the environment in which the object is located. Produced by one or a combination of humidity; the dynamic weight The virtual environment includes a dynamic temperature and humidity indicator, and the environment reconstruction device includes an air conditioning device, and the dynamic temperature and humidity indicator is generated by the air conditioning device reconstructing the on-site temperature and humidity index.

更進一步,該現場動態情境可增加實體移動資訊,該現場環境補捉裝置進一步包含移動偵測裝置,該實體移動資訊係由該移動偵測裝置擷取被攝物所在環境的震動或移動所產生;該動態重建虛境則包含動態移動,該環境重建裝置則包含移動平台裝置,該動態移動係由該移動平台裝置重建該現場被攝物所在環境的震動或移動產生。 Further, the live dynamic situation may increase physical movement information, and the on-site environment capture device further includes a motion detection device, wherein the physical movement information is generated by the motion detection device capturing the vibration or movement of the environment of the object. The dynamic reconstruction virtual environment includes dynamic movement, and the environment reconstruction device includes a mobile platform device generated by the mobile platform device to reconstruct the vibration or movement of the environment in which the on-site object is located.

根據本發明之另一目的,係提出一種現場動態情境重建之合成錄像拍製方法,可用於先以虛擬角色與現場產生互動,再於攝影棚內使該攝像目標合成至動態重建虛境中,以拍製形成攝像目標與現場互動的合成錄像。包含下列步驟:S21:在現場環境至少架設一台第一攝製裝置及至少一台第二攝製裝置,第一攝製裝置與第二攝製裝置構成現場環境補捉裝置;現場環境補捉裝置用以分別擷取一虛擬角色與一現場物件互動所在環境中之現場動態情境,如利用該第一攝製裝置擷取該虛擬角色與該現場物件互動的影像及背景形成一背景影像、利用第二攝製裝置擷取該虛擬角色與該現場物件互動的前景形成一現場環境光源影像;其中,上述被攝物的背景可包含建築、大自然環境、人物、動物、物品或上述二者以上之組合。而該攝像目標可包含人物、動物、物品或上述二者以上之組合。該虛擬角色與該現場物件的互動可如使該虛擬角色與該現場物件對話、招呼、交互動作等,不為所限。 According to another object of the present invention, a synthetic video recording method for dynamic scene reconstruction in the field is proposed, which can be used to first interact with the scene by using a virtual character, and then synthesize the camera target into a dynamic reconstruction virtual environment in the studio. A synthetic video that interacts with the scene to form a camera target. The method comprises the following steps: S21: at least one first filming device and at least one second filming device are set up in the on-site environment, the first filming device and the second filming device constitute a site environment capturing device; the on-site environment capturing device is used for respectively Taking a live dynamic situation in a environment in which a virtual character interacts with a live object, such as using the first camera to capture an image and background of the virtual character interacting with the live object to form a background image, using a second camera 撷The foreground of the virtual character interacting with the live object forms a live environment light source image; wherein the background of the object may include a building, a natural environment, a person, an animal, an item, or a combination of the two or more. The camera target may include a person, an animal, an item, or a combination of the two or more. The interaction between the virtual character and the live object may be such that the virtual character interacts with the live object, greets, interacts, etc., and is not limited.

其中,第一攝製裝置可為多鏡攝製,即可使用多個第一攝製裝置對該虛擬角色與該現場物件互動的影像及背景進行攝製,以形成多鏡攝製所形成的背景影像。 The first filming device can be multi-mirror filming, that is, a plurality of first filming devices can be used to record the image and background of the virtual character interacting with the live object to form a background image formed by multi-mirror filming.

S22:利用一環境重建裝置將該現場動態情境進行重建形成一動態重建虛境,該動態重建虛境係利用動態照明影像重建出現場環境光源;環境重建裝置包含至少一影像播放裝置、環型反射裝置、至少一重建影像攝製裝置及一合成幕,該動態照明影像係經由該影像播放裝置將該現場環境光源影像於該環型反射裝置播放所成;其中,合成幕可為藍幕或綠 幕;影像播放裝置可使用一台或多台的影像播放的放影機或投影機等,不為所限;重建影像攝製裝置可使用一台或多台的影像拍攝設備、燈光輔助設備或放音裝置等,不為所限;環型反射裝置可為環形或凹面的反射鏡,為較佳效果,環型反射裝置的中心可設置於該攝像目標拍攝中心(如臉部)之前方,設置的位置可為該攝像目標拍攝中心水平上方的+30°~+60°位置,並朝向該攝像目標;其中,角度係以拍攝該攝像目標中心之水平為0°,向前方之上方為正角度,向前方下方為負角度。 S22: reconstructing the dynamic situation of the scene by using an environment reconstruction device to form a dynamic reconstruction virtual environment, wherein the dynamic reconstruction virtual environment reconstructs the field ambient light source by using the dynamic illumination image; the environment reconstruction device includes at least one image playback device and a ring reflection a device, at least one reconstructed image capturing device and a composite screen, wherein the dynamic lighting image is formed by playing the live ambient light source image on the ring-shaped reflecting device; wherein the synthetic screen can be blue screen or green The video playback device can use one or more video playback projectors or projectors, etc., and is limited to; the reconstructed image capture device can use one or more video capture devices, lighting auxiliary devices or The sound device and the like are not limited; the ring-shaped reflecting device may be a ring-shaped or concave mirror, which is a better effect, and the center of the ring-shaped reflecting device may be disposed in front of the shooting target shooting center (such as the face). The position of the camera target is +30°~+60° above the level of the shooting center, and faces the camera target; wherein the angle is 0° at the center of the camera target, and the front angle is a positive angle , a negative angle toward the front and the bottom.

較佳地,該環型反射裝置可由複數個反射鏡陣列彼此排列成環形凹面所形成,而該反射鏡陣列係由複數個凸面反射鏡所組成。 Preferably, the annular reflecting device is formed by a plurality of mirror arrays arranged in an annular concave shape, and the mirror array is composed of a plurality of convex mirrors.

S23:將攝像目標設置於該動態重建虛境中,該動態照明影像係照射於該攝像目標上,並同時利用該重建影像攝製裝置拍攝位在該合成幕前之該攝像目標模仿該虛擬角色互動動作以產生一初始錄像;S24:將該背景影像移除該虛擬角色影像並合成至該初始錄像,拍製形成一合成錄像,如此,該合成錄像可將該攝像目標影像重建於該動態重建虛境中,具有模仿虛擬角色與現場互動的合成錄像。 S23: setting a camera target in the dynamic reconstruction virtual environment, the dynamic illumination image is irradiated on the image capturing target, and simultaneously capturing the virtual object interaction by capturing the image capturing target in front of the synthetic screen by using the reconstructed image capturing device The action is to generate an initial video; S24: the background image is removed from the virtual character image and synthesized into the initial video, and a synthetic video is formed by the shooting, so that the synthesized video can reconstruct the imaging target image in the dynamic reconstruction virtual In the environment, there is a synthetic video that mimics the interaction between virtual characters and the scene.

又進一步,該現場動態情境可加入現場聲音,該現場環境補捉裝置則包含聲音擷取裝置,由該聲音擷取裝置擷取虛擬角色與現場產生互動的現場聲音;該動態重建虛境則包含動態聲音,該環境重建裝置進一步包含播音裝置,該動態聲音係由該播音裝置重建該現場聲音所產生;該重建影像攝製裝置則錄製該動態聲音形成該初始錄像之一部份。 Further, the live dynamic situation may be added to the live sound, and the live environment capture device includes a sound capture device, and the sound capture device captures the live sound of the virtual character interacting with the scene; the dynamic reconstruction virtual environment includes The dynamic sounding device further includes a sounding device generated by the sound reproducing device reconstructing the live sound; the reconstructed image capturing device recording the dynamic sound to form a portion of the initial video.

更進一步,該現場動態情境可增加現場空氣流動,該現場環境補捉裝置進一步包含風向風速錄製裝置,該現場空氣流動係由該風向風速錄製裝置擷取被攝物所在環境的空氣流動所產生;該動態重建虛境則包含動態空氣流動,該環境重建裝置則包含送風裝置,該動態空氣流動係由該送風裝置重建該現場空氣流動所產生。 Further, the on-site dynamic situation may increase on-site air flow, and the on-site environmental capture device further includes a wind direction wind speed recording device, wherein the on-site air flow is generated by the wind direction wind speed recording device extracting air flow of the environment in which the object is located; The dynamic reconstruction virtual environment includes dynamic air flow, and the environmental reconstruction device includes a blower device, and the dynamic air flow is generated by the air blow device reconstructing the on-site air flow.

更進一步,該現場動態情境可再包含一實體移動資訊、該現場環境補捉裝置可再包含一移動偵測裝置,係可由該移動偵測裝置擷取被 攝物所在環境的震動或移動所產生該實體移動資訊,可將實體移動資訊收集後供該動態重建虛境重建時使用。該動態重建虛境可進一步包含一動態移動、該環境重建裝置進一步包含一移動平台裝置;該移動平台裝置接收該實體移動資訊驅動移動平台裝置使移動平台裝置產生模擬被攝物所在環境的震動或移動,重建該現場實體移動。 Further, the live dynamic scenario may further include a physical mobile information, and the live environment capture device may further include a motion detection device, which may be captured by the motion detection device. The physical movement information generated by the vibration or movement of the environment in which the object is located can be used to collect the physical movement information for reconstruction of the dynamic reconstruction virtual environment. The dynamic reconstruction virtual environment may further comprise a dynamic mobile device, the environment reconstruction device further comprising a mobile platform device; the mobile platform device receiving the physical mobile information driving the mobile platform device to cause the mobile platform device to generate a vibration of the environment in which the simulated object is located or Move to rebuild the live entity move.

再進一步,該現場動態情境可增加現場溫濕度指標,該現場環境補捉裝置則包含溫濕度擷取裝置,該現場溫濕度指標係由該溫濕度擷取裝置擷取被攝物所在環境的溫度或濕度之一或其組合所產生;該動態重建虛境則包含一動態溫濕度指標,該環境重建裝置則包含空調裝置,該動態溫濕度指標係由該空調裝置重建該現場溫濕度指標所產生。 Further, the on-site dynamic situation can increase the on-site temperature and humidity index, and the on-site environment capture device includes a temperature and humidity extraction device, and the on-site temperature and humidity indicator is obtained by the temperature and humidity extraction device to extract the temperature of the environment in which the object is located. Or one of the humidity or a combination thereof; the dynamic reconstruction virtual environment includes a dynamic temperature and humidity indicator, and the environmental reconstruction device includes an air conditioning device, and the dynamic temperature and humidity indicator is generated by the air conditioning device reconstructing the on-site temperature and humidity index .

承上所述,本發明之現場動態情境重建之合成錄像拍製方法,於戶外預先拍攝場景時,將會同時地擷取當時的環境光源,而於棚內拍攝時,則將該所擷取之環境光源投射出,以重建當時場景拍攝之光影變化,使得key板去除後之合成錄像能更為真實,以達到如同在戶外般拍攝的感覺,可應用於旅遊重現攝影、嘉年華會攝影、藝術創作攝影、文化創意攝影或紀念性影片攝影(婚紗影像…等)等。 As described above, the synthetic video recording method of the on-site dynamic situation reconstruction of the present invention captures the ambient light source at the same time when the scene is pre-shooted outdoors, and captures the scene when shooting in the shed. The ambient light source is projected to reconstruct the light and shadow changes taken at the scene, so that the synthetic video after the key board is removed can be more realistic, so as to achieve the feeling of shooting outdoors, can be applied to tourism reproduction photography, carnival photography, Art creation photography, cultural creative photography or commemorative film photography (wedding images, etc.).

又,本發明之現場動態情境重建之合成錄像拍製方法,可使一虛擬角色在現場進行代位拍攝,虛擬角色可與現場的人物、設施、動物、植物等產生互動,例如對話、動作互動、轉動移動等,由於拍攝場景時,可同時地擷取當時的環境光源、聲音、風吹、環境溫濕度、震動或移動等,而於棚內拍攝時,則將該所擷取之環境光源投射出重建、聲音重建、風吹重建、環境溫濕度、震動或移動重建,以重現當時場景拍攝之環境變化及虛擬角色的現場互動,使得拍攝的攝像目標影像在key板去除後之合成錄像能將更為真實、呈現出更為真實的環境光源變化、聲音、風吹、環境溫濕度、震動或移動與虛擬角色互動的重建,以達到如同在現場現地拍攝的更真實性。 Moreover, the synthetic video recording method of the on-site dynamic situation reconstruction of the present invention enables a virtual character to perform subrogation shooting on the spot, and the virtual character can interact with the characters, facilities, animals, plants, etc. on the scene, such as dialogue, action interaction, Rotate the movement, etc., when shooting the scene, you can simultaneously capture the ambient light source, sound, wind, ambient temperature and humidity, vibration or movement at the same time, and when shooting in the shed, project the captured ambient light source Reconstruction, sound reconstruction, wind reconstruction, ambient temperature and humidity, vibration or motion reconstruction to reproduce the environmental changes of the scene shooting and the live interaction of the virtual characters, so that the synthetic video of the captured camera image after the key board is removed will be more Realizing, presenting more realistic changes in ambient light source, sound, wind, ambient temperature and humidity, vibration or movement and interaction with virtual characters to achieve more authenticity as if they were taken on-site.

S11~S14、S21~S24‧‧‧步驟 S11~S14, S21~S24‧‧‧ steps

1‧‧‧環境補捉裝置 1‧‧‧Environmental capture device

11‧‧‧第一攝製裝置 11‧‧‧First filming device

12‧‧‧第二攝製裝置 12‧‧‧Second filming device

13‧‧‧風向風速錄製裝置 13‧‧‧Wind wind speed recording device

14‧‧‧聲音擷取裝置 14‧‧‧Sound extraction device

15‧‧‧溫濕度擷取裝置 15‧‧‧Warm and humidity extraction device

16‧‧‧移動偵測裝置 16‧‧‧Moving detection device

3‧‧‧重建影像攝製裝置 3‧‧‧Reconstruction of image processing equipment

4‧‧‧環型反射裝置 4‧‧‧Ring Reflector

41‧‧‧反射鏡陣列 41‧‧‧Mirror array

411‧‧‧凸面反射鏡 411‧‧‧ convex mirror

5‧‧‧合成幕 5‧‧‧Synthesis

6‧‧‧環境重建裝置 6‧‧‧Environmental reconstruction device

61‧‧‧影像播放裝置 61‧‧‧Video playback device

62‧‧‧送風裝置 62‧‧‧Air supply device

63‧‧‧播音裝置 63‧‧‧Broadcasting device

64‧‧‧空調裝置 64‧‧‧Air conditioning unit

65‧‧‧移動平台裝置 65‧‧‧Mobile platform device

A‧‧‧背景影像 A‧‧‧ background image

B‧‧‧現場環境光源影像 B‧‧‧Site ambient light source image

C‧‧‧攝像目標 C‧‧‧ camera target

D‧‧‧合成錄像 D‧‧‧Synthesis video

L1‧‧‧投射距離 L1‧‧‧ throwing distance

L2‧‧‧反射距離 L2‧‧‧reflection distance

Spot1,1、Spot1,2、Spot2,1、Spot2,2‧‧‧攝像目標的照明區域解析點 Spot 1,1 , Spot 1,2 , Spot 2,1 , Spot 2,2 ‧‧‧ Lighting area resolution point of the camera target

Cam1,1、Cam1,2、Cam2,1、Cam2,2‧‧‧重建影像攝製裝置 Cam 1,1 , Cam 1,2 , Cam 2,1 , Cam 2,2 ‧‧‧Reconstructed image capture unit

Pjtr1,1、Pjtr1,2、Pjtr2,1、Pjtr2,2‧‧‧形成投射的動態照明 Pjtr 1,1 , Pjtr 1,2 , Pjtr 2,1 , Pjtr 2,2 ‧‧‧ Dynamic illumination that forms the projection

第1圖 係為本發明之現場動態情境重建之合成錄像拍製方法之第一 流程圖。 Figure 1 is the first method of synthetic video recording method for on-site dynamic situation reconstruction of the present invention. flow chart.

第2圖 係為本發明之現場動態情境重建之合成錄像拍製方法之實施例之示意圖。 Fig. 2 is a schematic view showing an embodiment of a synthetic video recording method for on-site dynamic situation reconstruction of the present invention.

第3圖 係為本發明之現場動態情境重建之合成錄像拍製方法之擷取被攝物的前景之示意圖。 Figure 3 is a schematic diagram of the foreground of the captured object taken by the synthetic video recording method of the live dynamic situation reconstruction of the present invention.

第4圖 係為本發明之現場動態情境重建之合成錄像拍製方法之將現場動態情境進行重建形成動態重建虛境之示意圖。 Figure 4 is a schematic diagram of the dynamic scene reconstruction method of the dynamic scene reconstruction method of the present invention to form a dynamic reconstruction virtual environment.

第5圖 係為本發明之現場動態情境重建之合成錄像拍製方法之利用動態照明影像重建出現場環境光源之示意圖。 Fig. 5 is a schematic diagram of the method for reconstructing a field ambient light using a dynamic illumination image by a synthetic video recording method for on-site dynamic situation reconstruction of the present invention.

第6圖 係為本發明之現場動態情境重建之合成錄像拍製方法之合成影像示意圖。 Figure 6 is a schematic diagram of a composite image of a synthetic video recording method for on-site dynamic situation reconstruction of the present invention.

第7圖 係為本發明之現場動態情境重建之合成錄像拍製方法之環型反射裝置示意圖。 Figure 7 is a schematic view of a ring-shaped reflecting device of a synthetic video recording method for on-site dynamic situation reconstruction of the present invention.

第8圖 係為本發明之現場動態情境重建之合成錄像拍製方法之利用環型反射裝置產生動態照明影像重建出現場環境光源之示意圖。 Figure 8 is a schematic diagram of a synthetic optical recording method for real-time dynamic situation reconstruction of the present invention, which uses a ring-shaped reflecting device to generate a dynamic illumination image to reconstruct a field ambient light source.

第9圖 係為本發明之現場動態情境重建之合成錄像拍製方法之將現場動態情境進行重建形成動態重建虛境之示意圖。 Figure 9 is a schematic diagram of the dynamic scene reconstruction method of the dynamic scene reconstruction method of the present invention to form a dynamic reconstruction virtual environment.

第10圖 係為本發明之現場動態情境重建之合成錄像拍製方法之利用重建影像攝製裝置拍攝以產生一初始錄像之示意圖。 Figure 10 is a schematic diagram of the method of reconstructing an image capturing apparatus for generating a preliminary recording by the synthetic video recording method of the live dynamic situation reconstruction of the present invention.

第11圖 係為本發明之現場動態情境重建之合成錄像拍製方法之利用多組鏡頭擷取被攝物的前景及利用多組影像播放裝置產生動態照明影像之示意圖。 Figure 11 is a schematic diagram of a composite video recording method for on-site dynamic situation reconstruction of the present invention, which utilizes multiple sets of lenses to capture the foreground of the object and a plurality of sets of video playback devices to generate dynamic illumination images.

第12圖 係為本發明之現場動態情境重建之合成錄像拍製方法之利用多組影像播放裝置重建出現場環境光源之示意圖。 FIG. 12 is a schematic diagram of a method for reconstructing a field ambient light source by using a plurality of sets of image playing devices according to the method for synthesizing a video recording of a live dynamic situation reconstruction of the present invention.

第13圖 係為本發明之現場動態情境重建之合成錄像拍製方法之利用多組影像播放裝置投射在環型反射裝置產生動態照明影像重建出現場環境光源之示意圖。 Figure 13 is a schematic diagram of a composite video recording method for on-site dynamic situation reconstruction of the present invention. A plurality of sets of image playback devices are projected onto a ring-shaped reflecting device to generate a dynamic illumination image to reconstruct a field ambient light source.

第14圖 係為本發明之現場動態情境重建之合成錄像拍製方法之第二流程圖。 Figure 14 is a second flow chart of a synthetic video recording method for on-site dynamic situation reconstruction of the present invention.

為利 貴審查員瞭解本發明之技術特徵、內容與優點及其所能達成之功效,茲將本發明配合附圖,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本發明實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係解讀、侷限本發明於實際實施上的權利範圍,合先敘明。 The technical features, contents, and advantages of the present invention, as well as the advantages thereof, can be understood by the present inventors, and the present invention will be described in detail with reference to the accompanying drawings. The subject matter is only for the purpose of illustration and description. It is not intended to be a true proportion and precise configuration after the implementation of the present invention. Therefore, the scope and configuration relationship of the attached drawings should not be interpreted or limited. First described.

請參閱第1圖,第1圖係為本發明之現場動態情境重建之合成錄像拍製方法之第一流程圖,其流程步驟如下:步驟S11:在現場環境至少架設一台第一攝製裝置11及至少一台第二攝製裝置12,第一攝製裝置11與第二攝製裝置12構成現場環境補捉裝置1;利用現場環境補捉裝置1擷取被攝物所在環境中之現場動態情境;現場動態情境包含背景影像A及現場環境光源影像B,背景影像A為擷取被攝物的背景所產生,係利用該第一攝製裝置11擷取被攝物的背景所形成;現場環境光源影像B為擷取被攝物所在前景環境所產生,係利用第二攝製裝置12擷取被攝物的前景所形成。 Please refer to FIG. 1 . FIG. 1 is a first flowchart of a method for synthesizing a video recording of a live dynamic situation reconstruction according to the present invention. The process steps are as follows: Step S11: at least one first camera 11 is installed in the site environment. And at least one second filming device 12, the first filming device 11 and the second filming device 12 constitute a field environment capturing device 1; using the field environment capturing device 1 to capture the scene dynamic situation in the environment of the object; The dynamic scene includes a background image A and a scene environment light source image B. The background image A is generated by capturing the background of the object, and is formed by capturing the background of the object by using the first filming device 11; In order to capture the foreground environment in which the subject is located, the second filming device 12 is used to capture the foreground of the subject.

請參閱第2圖、第2圖係為本發明之現場動態情境重建之合成錄像拍製方法之實施方式的實施例之示意圖,環境補捉裝置1用於擷取被攝物所在環境中之現場動態情境,環境補捉裝置1包含第一攝製裝置11、第二攝製裝置12,在具體應用上,第一攝製裝置11、第二攝製裝置12可均使用廣角攝影機;以分別由廣角攝影機的第一攝製裝置11擷取被攝物的背景形成背景影像A,即背景影像A係經由如廣角攝影機錄製所形成的(於圖式中為便於說明,將背景標示為符號A);利用廣角攝影機的第二攝製裝置12擷取被攝物的前景所形成現場環境光源影像B,即現場環境光源影像B係經由如廣角攝影機錄製所形成的(於圖式中為便於說明,將前景標示為符號B)。 Please refer to FIG. 2 and FIG. 2 , which are schematic diagrams of an embodiment of a method for synthesizing a video recording method of a live dynamic situation reconstruction according to the present invention. The environment capturing device 1 is used for capturing the scene in the environment where the object is located. The dynamic situation, the environment capture device 1 includes a first camera device 11 and a second camera device 12. In a specific application, the first camera device 11 and the second camera device 12 can each use a wide-angle camera; A filming device 11 captures the background of the object to form a background image A, that is, the background image A is formed by recording as a wide-angle camera (the background is denoted by the symbol A for convenience of explanation in the drawing); using a wide-angle camera The second filming device 12 captures the scene environment light source image B formed by the foreground of the object, that is, the scene environment light source image B is formed by recording as a wide-angle camera (in the figure, for convenience of description, the foreground is marked as symbol B) ).

請參閱第3圖、第3圖係為本發明之現場動態情境重建之合成錄像拍製方法之擷取被攝物的前景之示意圖,第二攝製裝置12擷取被攝物的前景時,較佳的係攝取現場環境光源的來源,如圖所示,以形成現場 環境光源影像B;對於更好的攝影技巧,可將主要的光線來源調設於現場環境光源影像B相對於被攝物適當高度,俾利於更具真實感;例如圖示的太陽位置,係位於被攝物右上方30°位置,則第二攝製裝置12擷取前景時,可將太陽調設於現場環境光源影像B的右上角。 Please refer to FIG. 3 and FIG. 3 , which are diagrams showing the foreground of the captured object in the synthetic video recording method of the on-site dynamic situation reconstruction of the present invention. When the second imaging device 12 captures the foreground of the object, Good system to take the source of the ambient light source, as shown, to form the scene Ambient light source image B; for better photography techniques, the main light source can be set to the scene environment light source image B relative to the appropriate height of the object, which is more realistic; for example, the position of the sun is located When the second filming device 12 captures the foreground, the sun can be set to the upper right corner of the live environment light source image B.

第一攝製裝置11可為多鏡攝製,即可使用多個第一攝製裝置11對被攝物的背景進行攝製,以形成多鏡攝製所形成的背景影像A。而第二攝製裝置12可為1組或m*n組,若第二攝製裝置12為1組,則對被攝物的前景之中心(主要的光線來源的中心為調校位置)拍攝形成一現場環境光源影像B;若第二攝製裝置12可為2(m*n,m=1,n=2)組,則分別對被攝物的前景之中心的左方與右方的中心(左方與右方主要的光線來源的中心為調校位置)拍攝形成一現場環境光源影像B;若第二攝製裝置為4(m*n,m=2,n=2,m為橫向解析度列數,n為直向解析度行數)組,則分別對被攝物的前景之中心的四個解析點(spot)拍攝形成一現場環境光源影像B。 The first filming device 11 can be multi-mirror filming, that is, the background of the object can be photographed using a plurality of first filming devices 11 to form a background image A formed by multi-mirror filming. The second camera 12 can be a group or a m*n group. If the second camera 12 is a group, the center of the foreground of the subject (the center of the main light source is the adjustment position) is formed. The scene environment light source image B; if the second filming device 12 can be a group of 2 (m*n, m=1, n=2), respectively, the left and right centers of the center of the foreground of the object (left) The center of the main source of light and the right side is the calibration position) to form a scene environment light source image B; if the second filming device is 4 (m*n, m=2, n=2, m is the horizontal resolution column) The number, n is the direct resolution number of rows) group, respectively, the four resolution spots of the center of the foreground of the subject are photographed to form a live ambient light source image B.

為增進被攝物所在環境中之現場動態情境的真實性,再請參閱第2圖,環境補捉裝置1除包含第一攝製裝置11、第二攝製裝置12外,可進一步包含風向風速錄製裝置13、聲音擷取裝置14、溫濕度擷取裝置15、移動偵測裝置16,分別蒐集現場的聲音、風向風速或溫濕度、與移動(震動)加速度資訊等,與背景影像A、現場環境光源影像B構成更具真實感的現場動態情境。其中,風向風速錄製裝置13可使用至少一台的風向風速儀為實施,記錄被攝物所在環境中時間與風向風速的變化;聲音擷取裝置14可使用至少一台的現場錄音機為實施,記錄被攝物所在環境中聲音與時間的變化;溫濕度擷取裝置15可使用至少一台的溫濕度儀為實施;對於不限定的實施方式移動偵測裝置16可用一台三軸加速度感測器實施,記錄被攝物所在環境中震動或移動的變化。 In order to improve the authenticity of the on-site dynamic situation in the environment in which the subject is located, referring to FIG. 2, the environment capture device 1 may further include a wind direction wind speed recording device in addition to the first camera device 11 and the second camera device 12. 13. The sound capturing device 14, the temperature and humidity capturing device 15, and the motion detecting device 16 respectively collect sounds, wind direction or temperature and humidity, and movement (vibration) acceleration information, etc., and background image A, on-site ambient light source Image B constitutes a more realistic live dynamic situation. The wind direction wind speed recording device 13 can be implemented by using at least one wind direction anemometer to record changes in time and wind direction wind speed in the environment in which the object is located; the sound capturing device 14 can be implemented by using at least one field recorder. The change of sound and time in the environment of the object; the temperature and humidity picking device 15 can be implemented by using at least one temperature and humidity meter; for the non-limiting embodiment, the motion detecting device 16 can use a three-axis acceleration sensor. Implement to record changes in vibration or movement in the environment in which the subject is located.

由此,被攝物所在環境中之現場動態情境中的背景變化的影像、前景變化的影像、時間與風向風速的變化、聲音與時間的變化、溫濕度與時間的變化、震動或移動變化等,可以被記錄下來形成完整的現場動態情境,日後可依據記錄下來的現場動態情境予以重建,則可以使重建後 的現場動態更具有真實性。 Thus, the background image of the scene dynamics in the environment in which the subject is located, the image of the foreground change, the change of time and wind direction, the change of sound and time, the change of temperature and humidity and time, the vibration or movement change, etc. Can be recorded to form a complete on-site dynamic situation, which can be reconstructed in the future based on the recorded dynamic situation of the scene, which can be reconstructed The dynamics of the scene are more authentic.

步驟S12:請參見第4圖,第4圖為本發明將現場動態情境進行重建形成動態重建虛境之示意圖,係利用一環境重建裝置6將現場動態情境進行重建形成動態重建虛境,環境重建裝置6包含至少一影像播放裝置61、環型反射裝置4、至少一重建影像攝製裝置3及一合成幕5;經重建所形成的動態重建虛境包含動態照明影像,動態照明影像係經由該影像播放裝置61將該現場環境光源影像B於該環型反射裝置4播放所形成;請參見第5圖,第5圖為本發明利用動態照明影像重建出現場環境光源之示意圖,在圖中,影像播放裝置61可以螢幕投影機為實施,利用影像播放裝置61將現場環境光源影像B投射在環型反射裝置4上,圖中也繪示環型反射裝置4反射出光線重建出現場的前景環境(圖中以現場環境光源影像B為表示),例如第3圖中現場前景的光源來自於被攝物右上方30°位置太陽,以第二攝製裝置12擷取前景所形成的現場環境光源影像B,於第5圖中,由影像播放裝置61將現場環境光源影像B投射在環型反射裝置4,環型反射裝置4則反射出重建的右上方30°位置太陽的光源,由此,現場環境光源可以成功的重建。 Step S12: Please refer to FIG. 4, which is a schematic diagram of the present invention for reconstructing a dynamic situation on the scene to form a dynamic reconstruction virtual environment. The environment reconstruction device 6 is used to reconstruct the dynamic situation of the scene to form a dynamic reconstruction virtual environment, and the environment is reconstructed. The device 6 includes at least one video playback device 61, a ring-shaped reflective device 4, at least one reconstructed image capturing device 3, and a composite screen 5; the reconstructed virtual reconstruction virtual environment includes a dynamic illumination image through which the dynamic illumination image is transmitted The playback device 61 forms the live environment light source image B on the ring-shaped reflection device 4; see FIG. 5, FIG. 5 is a schematic diagram of reconstructing a field ambient light source by using a dynamic illumination image in the present invention. The playback device 61 can be implemented by a screen projector, and the live environment light source image B is projected onto the annular reflection device 4 by the image playback device 61. The figure also shows the foreground environment of the annular reflection device 4 reflecting the light reconstruction field ( In the figure, the scene ambient light source image B is shown. For example, in Fig. 3, the light source of the scene foreground comes from the sun at the top right of the object at 30°. The field environment light source image B formed by the foreground is captured by the second filming device 12. In the fifth figure, the scene environment light source image B is projected by the image playback device 61 on the ring type reflection device 4, and the ring type reflection device 4 reflects The source of the sun at the 30° position on the upper right side of the reconstruction, whereby the on-site ambient light source can be successfully reconstructed.

環型反射裝置4可為環形或凹面的反射鏡,為較佳效果,在第4圖中,環型反射裝置4的中心可設置於該攝像目標C拍攝中心(如臉部)之前方,設置的位置中心可為該攝像目標C拍攝中心水平上方的+30°~+60°位置,並朝向該攝像目標C;其中,角度係以拍攝該攝像目標中心之水平為0°,向前方之上方為正角度,向前方下方為負角度。 The annular reflection device 4 can be a circular or concave mirror, which is a preferred effect. In the fourth figure, the center of the annular reflection device 4 can be disposed in front of the imaging center C (such as the face), and is set. The position center can be the +30°~+60° position above the center of the camera target C, and is directed toward the camera target C; wherein the angle is 0° at the center of the camera target, and is above the front It is a positive angle and a negative angle toward the front and the bottom.

再配合第3圖說明,第3圖中現場前景的光源來自於被攝物右上方30°位置太陽,於第5圖中,由影像播放裝置61將現場環境光源影像B投射在環型反射裝置4,環型反射裝置4則反射出重建的右上方30°位置太陽的光源;若使環型反射裝置4設置的位置中心為該攝像目標C之前方的拍攝中心(如臉部)水平上方的+30°~+60°位置,則環型反射裝置4反射出的前景光源(被攝物右上方30°位置太陽)可以正好適當的照射在該攝像目標C的臉部,可以更為成功的重建出現場的前景。 Referring to FIG. 3, the light source of the foreground in FIG. 3 is from the sun at the top right of the object at 30°, and in FIG. 5, the live environment light source image B is projected by the image playback device 61 on the ring-shaped reflecting device. 4. The toroidal reflection device 4 reflects the light source of the reconstructed upper right 30° position of the sun; if the center of the position of the annular reflection device 4 is set to be above the shooting center (such as the face) of the image capturing target C At a position of +30° to +60°, the foreground light source reflected by the ring-shaped reflecting device 4 (the sun at the upper right side of the subject at 30°) can be appropriately irradiated on the face of the imaging target C, which can be more successful. Reconstruct the prospects of the field.

請參見第7圖,第7圖為本發明之環型反射裝置示意圖,對 於更佳的動態重建虛境呈現,該環型反射裝置4可由複數個反射鏡陣列41彼此排列成環形凹面所形成,而該反射鏡陣列41係由複數個凸面反射鏡411所組成。再請參見第8圖,第8圖為本發明之利用環型反射裝置產生動態照明影像重建出現場環境光源之示意圖,圖中僅繪示環形凹面的環型反射裝置4,影像播放裝置61將現場環境光源影像B投射在環型反射裝置4上時(由影像播放裝置61以垂直於環型反射裝置4之投射距離L1,投射在環型反射裝置4),藉由環形凹面的環型反射裝置4,可將投射的現場環境光源影像B更為集中的反射出現場前景的光源(如太陽的光源)(由環型反射裝置4以為垂直於攝像目標C之反射距離L2,反射在攝像目標C上);對於較佳的動態重建虛境呈現效果,投射距離L1與反射距離L2可為相同或相近的距離。 Please refer to FIG. 7. FIG. 7 is a schematic view of the ring-shaped reflecting device of the present invention. In the case of a better dynamic reconstruction virtual environment, the annular reflection device 4 can be formed by a plurality of mirror arrays 41 arranged in an annular concave shape, and the mirror array 41 is composed of a plurality of convex mirrors 411. Referring to FIG. 8 again, FIG. 8 is a schematic diagram of the present invention for generating a dynamic illumination image by using a ring-shaped reflection device to reconstruct a field ambient light source. Only the annular concave-shaped annular reflection device 4 is illustrated, and the image playback device 61 When the on-site ambient light source image B is projected on the annular reflection device 4 (projected by the image playback device 61 at a projection distance L1 perpendicular to the annular reflection device 4, projected on the annular reflection device 4), the annular reflection by the annular concave surface The device 4 can reflect the projected field environment light source image B more concentratedly to reflect the foreground light source (such as the sun light source) (the reflection reflection distance L2 perpendicular to the imaging target C by the ring type reflection device 4 is reflected in the imaging target) C)); for a better dynamic reconstruction virtual environment rendering effect, the projection distance L1 and the reflection distance L2 may be the same or similar distances.

影像播放裝置61可使用一台或多台的影像播放的放影機或投影機為實施,但不為所限;當第二攝製裝置12為1組時,第二攝製裝置12所形成的現場環境光源影像B為1組,則影像播放裝置61係以環型反射裝置4之中心播放第二攝製裝置12所產生該現場環境光源影像B;當第二攝製裝置12為2組時,第二攝製裝置12所形成的現場環境光源影像B為2組,則可使用2組的影像播放裝置61,分別以該環型反射裝置4之中心為鏡像對稱播放該第二攝製裝置61所產生的現場環境光源影像B,即,第一組第二攝製裝置12係對被攝物的前景之中心的左方形成現場環境光源影像B1(未標示於圖中)、第二組影像播放裝置61播放對被攝物的前景之中心的左方的現場環境光源影像B1(未標示於圖中)、第二組第二攝製裝置12係對被攝物的前景之中心的右方形成現場環境光源影像B2、第一組影像播放裝置61播放被攝物的前景之中心的右方的現場環境光源影像B2;請參見第12圖,第12圖為本發明之利用多組影像播放裝置重建出現場環境光源之示意圖;第二攝製裝置12可為m*n組,這些第二攝製裝置12分別對被攝物的前景之中心的形成一現場環境光源影像Bi,j,(i=1,…,m、j=1,…,n)分別為第二攝製裝置12對被攝物的前景之中心形成左側之現場環境光源影像Bi,j、位於右側第二攝製裝置12對被攝物的前景之中心形成右側之現場環境光源影像Bi,j+1。在重建出現場前景的二個前景光源時, 2組第二攝製裝置61(標號Pjtri,j,右側Pjtri,j+1與左側Ptjri,i)分別對現場環境光源影像Bi,j播放,在環型反射裝置4上反射,重建出現場前景的前景光源。 The video playback device 61 can be implemented by using one or more video playback players or projectors, but is not limited thereto; when the second camera device 12 is a group, the second camera device 12 forms a scene. The image source device B is a group, and the video playback device 61 plays the scene environment light source image B generated by the second camera device 12 at the center of the ring type reflection device 4; when the second camera device 12 is two groups, the second When the scene environment light source image B formed by the filming device 12 is two groups, the two groups of video playback devices 61 can be used, and the scene generated by the second filming device 61 is played by mirroring the center of the ring type reflecting device 4 as a mirror image. The ambient light source image B, that is, the first group of second camera devices 12 forms a live ambient light source image B 1 (not shown in the figure) on the left side of the foreground of the subject, and the second group of video playback devices 61 play The scene ambient light source image B 1 (not shown in the figure) on the left side of the foreground of the subject, and the second group second photographing device 12 form the scene ambient light source on the right side of the center of the foreground of the subject image B 2, a first set of video playback Right center prospects opposing player 61 subject scene ambient light source image B 2; see FIG. 12, graph 12 of the present invention utilizing a plurality of sets of video playback apparatus schematic of the ambient light to reconstruct the scene; second The filming device 12 may be an m*n group, and the second filming devices 12 respectively form a scene environment light source image B i,j , (i=1, . . . , m, j=1, at the center of the foreground of the object. ..., n) respectively, the second filming device 12 forms a scene energy source image B i,j on the left side of the foreground of the subject, and a scene on the right side of the foreground of the foreground of the second filming device 12 on the right side of the object Ambient light source image B i,j+1 . When reconstructing two foreground light sources in the foreground of the field, two sets of second filming devices 61 (labels Pjtr i,j , right side Pjtr i,j+1 and left side Ptjr i,i ) respectively correspond to the scene ambient light source image B i,j Playback, reflected on the ring-shaped reflecting device 4, reconstructs the foreground light source in which the foreground of the field appears.

對於不限定的實施方式,若第二攝製裝置12可為2(m*n,m=1,n=2,m為橫向解析度列數,n為直向解析度行數)組,這些第二攝製裝置12分別對被攝物的前景之中心的形成一現場環境光源影像Bi,j,分別為第左側第二攝製裝置12對被攝物的前景之中心形成左側之現場環境光源影像B1,1、位於右側第二攝製裝置12對被攝物的前景之中心形成右側之現場環境光源影像B1,2。在重建出現場前景的二個前景光源時,2組第二攝製裝置61(標號Pjtri,j,右側Pjtr2,1與左側Pjtr1,1)分別對左右2組的現場環境光源影像Bi,j(左側B1,1與右側B1,2)播放,在環型反射裝置4上反射,重建出現場前景的左側與右側的前景光源。 For the non-limiting embodiment, if the second imaging device 12 can be 2 (m*n, m=1, n=2, m is the horizontal resolution column number, n is the direct resolution number of rows), these The second filming device 12 respectively forms a scene environment light source image B i,j for the center of the foreground of the object , and respectively forms the scene environment light source image B on the left side of the foreground of the foreground of the object by the second left filming device 12 1,1 , the second filming device 12 on the right side forms the scene environment light source image B 1,2 on the right side of the foreground of the subject. When reconstructing two foreground light sources in the foreground of the field, two sets of second filming devices 61 (labels Pjtr i,j , right side Pjtr 2,1 and left side Pjtr 1,1 ) respectively respectively to the left and right groups of the field environment light source images B i , j (left side B 1,1 and right side B 1,2 ) plays, reflects on the ring-shaped reflecting device 4, reconstructs the foreground light source on the left and right sides of the foreground of the field.

對於不限定的實施方式,當第二攝製裝置12可為4(m*n,m=2,n=2,m為橫向解析度列數,n為直向解析度行數)組,這些第二攝製裝置12分別對被攝物的前景之中心的四個解析點(spot)的中心形成一現場環境光源影像Bi,j,分別為第(1,1)組第二攝製裝置12對被攝物的前景之第(1,1)組解析點之現場環境光源影像B1,1、第(1,2)組第二攝製裝置12對被攝物的前景之第(1,2)組解析點之現場環境光源影像B1,2、第(2,1)組第二攝製裝置12對被攝物的前景之第(2,1)組解析點之現場環境光源影像B2,1、第(2,2)組第二攝製裝置12對被攝物的前景之第(2,2)組解析點之現場環境光源影像B2,2。而相對的,4組第二攝製裝置61(標號Pjtri,j)分別對4組的現場環境光源影像Bi,j播放,在環型反射裝置4上反射,重建出現場前景的四個象限的前景光源。 For the non-limiting embodiment, when the second imaging device 12 can be 4 (m*n, m=2, n=2, m is the horizontal resolution column number, n is the direct resolution line number), these The second filming device 12 respectively forms a scene environment light source image B i,j for the center of the four spots of the foreground of the subject, which are the (1, 1) group second filming device 12 pairs, respectively. The foreground (1, 1) group of the foreground (1, 1) group of the scenes, the ambient light source image B 1,1 , the (1, 2) group of the second camera 12, the foreground (1, 2) group of the subject the analysis point B of the second image scene filmed ambient light source 1, (2,1) to the first group 12 of the foreground subject in the (2,1) points of the set of resolution source image scene environment B 2,1, The second (2, 2) group second imaging device 12 analyzes the scene ambient light source image B 2, 2 of the (2, 2) group of the foreground of the subject. In contrast, four sets of second filming devices 61 (labels Pjtr i,j ) are respectively played on the four sets of live ambient light source images B i,j and reflected on the ring-shaped reflecting device 4 to reconstruct four quadrants of the foreground of the field. The foreground light source.

合成幕5在具體實施上,可為藍幕或綠幕,當被攝目標位於藍幕或綠幕前拍攝,拍攝後的影片則容易將藍幕或綠幕去除(稱為顏色去背、chroma key),有利於影像的合成。 In the specific implementation, the synthetic screen 5 can be a blue screen or a green screen. When the target is shot in front of the blue screen or the green screen, the film after the shooting is easy to remove the blue screen or the green screen (called color back, chroma Key), which is conducive to the synthesis of images.

由此,例如可經由環型反射裝置4反射出影像播放裝置61播放的動態照明,照射在攝像目標C的中心(如臉部)上,重現出現場的前景的光線來源、強弱、變化等;例如,夕陽時分太陽光線來自於攝像目標的臉部水平線的上方角度約15度,不同於正午時分太陽光線來自於攝像目標的臉部水平線的上方角度約85度,這二種前景光線在攝像目標臉部的 強弱方向則不相同,將使重建的動態重建虛境更具真實性。 Thereby, for example, the dynamic illumination played by the video playback device 61 can be reflected by the ring type reflection device 4, and irradiated on the center (such as the face) of the imaging target C to reproduce the light source, strength, change, etc. of the foreground of the field. For example, at sunset, the sun's rays come from the upper angle of the face of the camera's target at an angle of about 15 degrees. Unlike the midday sun, the sun's rays come from the upper horizontal line of the camera's target at an angle of about 85 degrees. In the target face of the camera The direction of strength and weakness is different, which will make the dynamic reconstruction of the reconstruction more authentic.

再如,若攝像目標C身處在煙火的現場或前方行車車燈照明時,煙火的閃爍及車燈的移動造成攝像目標臉部的光影變化,將使重建的動態重建虛境更具真實性。 For another example, if the camera C is in the fireworks scene or in the front of the driving lights, the flickering of the fireworks and the movement of the lights cause the light and shadow changes of the face of the camera target, which will make the reconstructed dynamic reconstruction virtual reality more authentic. .

更進一步,若現場環境補捉裝置1除攝影機外,有聲音蒐集的擷取裝置錄音設備14、風向風速蒐集的風向風速錄製裝置13、移動偵測裝置16、及溫濕度蒐集的溫濕度擷取裝置15時;環境重建裝置6進一步可包含播音裝置63(具體可用放音設備及音箱構成)、送風裝置62(具體可用風扇或風機構成)、空調裝置64(具體可用溫濕度控制的空調設備或可使用造雪機等構成)、移動平台裝置65(具體可用一承載台做立體移動的平台構成),分別重建出現場的聲音、風向風速或溫濕度、震動或移動等。 Further, if the on-site environment capture device 1 is in addition to the camera, the sound collection device recording device 14 with the sound collection, the wind direction wind speed recording device 13 collected by the wind direction, the motion detection device 16, and the temperature and humidity collection of the temperature and humidity collection The device 15 may further include a sounding device 63 (specifically, a sound emitting device and a sound box may be used), a blowing device 62 (specifically, a fan or a fan may be used), and an air conditioning device 64 (specifically, a temperature and humidity controlled air conditioner or The snow platform can be used, and the mobile platform device 65 (which can be configured by a platform for three-dimensional movement) can reconstruct the sound of the appearing field, wind direction or temperature, humidity, vibration or movement.

因此,動態重建虛境除包含動態照明影像外,尚可包含現場的聲音、風向風速或溫濕度等;其中,動態照明影像係經由現場環境光源影像B於該環型反射裝置4播放所形成,重建的聲音、風向風速或溫濕度則分別由播音裝置63、送風裝置62、空調裝置64、移動平台裝置65所形成,將使攝像目標身處的動態重建虛境,在動態照明、聲音重現、風向風速重現或溫濕度(或如飄雪)重現、震動或移動重現,更為接近現場實境。 Therefore, the dynamic reconstruction virtual environment may include the sound of the scene, the wind direction wind speed or the temperature and humidity, etc., wherein the dynamic illumination image is formed by playing the live environment light source image B on the ring type reflection device 4, The reconstructed sound, wind direction wind speed or temperature and humidity are respectively formed by the sounding device 63, the air blowing device 62, the air conditioning device 64, and the mobile platform device 65, which will dynamically reconstruct the virtual environment at the camera target body, and dynamically reproduce the sound and sound. Wind speed reappears or temperature and humidity (or snow) reappear, vibrate or move to reproduce, closer to the actual situation.

步驟S13:再參見第4圖,將攝像目標C設置於動態重建虛境中,動態照明影像係照射於攝像目標C上,並同時利用重建影像攝製裝置3拍攝位在合成幕5前之攝像目標C以產生初始錄像;其中,重建影像攝製裝置3實施上可為一組或多組的攝影機,可錄製位於合成幕5前的攝像目標C在動態重建虛境中的影像及聲音等;由於動態重建虛境以動態照明重建出現場的現場前景的光源(如太陽的光源、煙火閃爍、行進車燈變化,甚至複數個現場環境光源影像B)、重建出現場的聲音、重建出現場的風向風速、重建出現場的溫濕度的冷熱、重建出現場的震動或移動,使初始錄像具有更真實感,大幅改善習知技術的呆板與失真。 Step S13: Referring again to FIG. 4, the imaging target C is set in the dynamic reconstruction virtual environment, and the dynamic illumination image is irradiated onto the imaging target C, and at the same time, the reconstructed image capturing device 3 is used to capture the imaging target located in front of the synthetic screen 5. C is used to generate an initial video; wherein the reconstructed image capturing device 3 can be implemented as one or more sets of cameras, and can record images and sounds of the moving target C in front of the synthetic screen 5 in the dynamic reconstruction virtual environment; Reconstructing the virtual environment to reconstruct the foreground light source of the field with dynamic illumination (such as the sun's light source, pyrotechnic flicker, changing headlights, or even multiple scenes of ambient light source image B), reconstructing the sound of the appearing field, and reconstructing the wind direction of the field Reconstructing the temperature and humidity of the field, rebuilding the vibration or movement of the field, making the initial video more realistic and greatly improving the rigidity and distortion of the conventional technology.

其中,在上述位於合成幕5前進行拍攝之攝像目標C,則可包含人物、動物、物品或上述二者以上之組合,使攝像目標C可與人物、動物、物品產生互動,藉由重建影像攝製裝置3產生初始錄像。 The image capturing target C that is photographed before the synthetic screen 5 may include a person, an animal, an article, or a combination of the two or more, so that the camera object C can interact with the person, the animal, and the object to reconstruct the image. The filming device 3 produces an initial recording.

步驟S14:如第6圖,第6圖為本發明之合成影像示意圖,將第一攝製裝置11攝製的背景影像A合成至初始錄像上,拍製形成合成錄像D;合成錄像D係將攝像目標C影像重建於動態重建虛境中所拍製而成。在圖中,攝像目標C的臉部光線來自於動態照明(由影像播放裝置61將現場環境光源影像B投射在環型反射裝置4反射出來照射在攝像目標C的臉部)、聲音來自於重建出現場的聲音,又因風向風速重現可使攝像目標C的頭髮與衣服可依據拍攝的時間而動態地飄動,再因溫濕度重現可使攝像目標C依據拍攝的時間而動態地感受到冷熱交替而呈現出對應的表情動作,再因震動或移動重現可使攝像目標C的位移可依據拍攝的時間而動態地震動或移動;因此拍製形成的合成錄像D更為逼真、自然,可用於例如可為氣象主播、拍婚紗的新人、節慶、旅遊拍製等等。 Step S14: Figure 6 is a schematic view of the composite image of the present invention. The background image A taken by the first filming device 11 is synthesized onto the initial video, and the composite video D is formed by shooting; the synthetic video D system is used to capture the image. The C image reconstruction was made in the dynamic reconstruction virtual environment. In the figure, the face light of the imaging target C comes from dynamic illumination (the live environment light source image B is projected by the video playback device 61 and reflected on the face of the imaging target C reflected by the annular reflection device 4), and the sound comes from reconstruction. The sound of the field, and the wind speed reappears, the hair and clothes of the camera C can be dynamically moved according to the shooting time, and then the temperature and humidity can be reproduced, so that the camera C can dynamically feel according to the shooting time. Alternating between hot and cold, the corresponding expression movements are presented, and then the displacement of the imaging target C can be dynamically vibrated or moved according to the time of shooting due to vibration or movement reproduction; therefore, the synthetic video D formed by the shooting is more realistic and natural, and is available. For example, it can be a weather anchor, a newcomer to shoot a wedding, a festival, a tourist film, and the like.

請參閱第14圖,其係為本發明之現場動態情境重建之合成錄像拍製方法之第二流程圖,在許多的應用實施例上,常先拍攝虛擬角色在現場環境中的影片,再於攝影棚內讓攝像目標的影像將虛擬角色的影像取代,而合成錄像D。這類的做法再習知技術上,常遇到的困難為真實度明顯不足,而且與現場的人物、動物、樹木花草(現場物件)難以產生互動,或互動不夠逼真、自然,應用本發明的技術可克服習知技術上的缺點,其流程步驟如下:S21:首先類似於前述的步驟S11,在現場環境至少架設一台第一攝製裝置11及至少一台第二攝製裝置12,第一攝製裝置11與第二攝製裝置12構成現場環境補捉裝置1;在步驟S11為補捉現場的前景與背景,在本步驟則加入虛擬角色,甚至使虛擬角色與現場的人物、動物、樹木花草(現場物件)產生互動,現場環境補捉裝置1用以分別擷取虛擬角色與現場物件互動所在環境中之現場動態情境,如利用該第一攝製裝置11擷取虛擬角色與現場物件互動的影像及背景形成背景影像A、利用第二攝製裝置12擷取虛擬角色與現場物件互動的前景形成現場環境光源影像B;其中,上述虛擬角色與現場物件的背景可包含建築、大自然環境、人物、動物、物品或上述二者以上之組合,當虛擬角色與現場物件的互動例如可使虛擬角色與現場物件進行對話、招呼、搖動樹枝、撫摸動 物等交互動作,讓影像更為生動有趣。 Please refer to FIG. 14 , which is a second flow chart of a synthetic video recording method for on-site dynamic situation reconstruction of the present invention. In many application embodiments, a movie of a virtual character in a live environment is often taken first, and then In the studio, the image of the camera target is replaced by the image of the virtual character, and the video D is synthesized. This kind of practice is technically familiar, and the difficulties often encountered are obviously insufficient in realism, and it is difficult to interact with the characters, animals, trees and flowers (field objects) on the scene, or the interaction is not realistic and natural, and the application of the present invention is The technology can overcome the shortcomings of the prior art, and the process steps are as follows: S21: Firstly, similar to the foregoing step S11, at least one first filming device 11 and at least one second filming device 12 are set up in the field environment, the first filming is performed. The device 11 and the second camera device 12 constitute a site environment capture device 1; in step S11, the foreground and background of the scene are captured, and in this step, a virtual character is added, and even the virtual character and the scene of the characters, animals, trees and flowers ( The on-site environment capture device 1 is configured to capture the live dynamic situation in the environment in which the virtual character interacts with the on-site object, for example, using the first camera device 11 to capture images of the virtual character interacting with the on-site object and The background forms the background image A, and the second filming device 12 is used to capture the foreground of the virtual character interacting with the on-site object to form the scene environment light source image B. The background of the virtual character and the on-site object may include a building, a natural environment, a character, an animal, an item, or a combination of the two or more. When the virtual character interacts with the on-site object, for example, the virtual character can talk to the on-site object. Greeting, shaking branches, stroking Interactive interactions make objects more interesting and interesting.

同樣,第一攝製裝置11可為多鏡攝製(或使用多組第一攝製裝置11),使用多個第一攝製裝置11對虛擬角色與現場物件互動的影像及背景進行攝製,以形成多鏡攝製所形成的背景影像A。 Similarly, the first filming device 11 can be multi-mirror filming (or using a plurality of sets of first filming devices 11), and the plurality of first filming devices 11 are used to record images and backgrounds of virtual characters interacting with the live objects to form a multi-mirror. The background image A formed by the filming.

同樣,第二攝製裝置12可為m*n組,如同前述的步驟S11,但僅將被攝物更換為虛擬角色與現場物件互動,即第二攝製裝置12對虛擬角色與現場物件互動的前景之中心(左方與右方的中心、四個象限的中心等)形成一現場環境光源影像B。 Similarly, the second camera 12 can be an m*n group, as in the foregoing step S11, but only the subject is replaced with a virtual character to interact with the live object, that is, the foreground of the second camera 12 interacting with the virtual object and the live object. The center (the center of the left and right, the center of the four quadrants, etc.) forms a live ambient light source image B.

更進一步,現場環境補捉裝置1除攝影機外,可架設聲音擷取裝置14(如錄音設備)、風向風速錄製裝置13、移動偵測裝置16及溫濕度擷取裝置15,分別蒐集現場的聲音、風向風速或溫濕度、震動或移動等。 Further, the on-site environment capture device 1 can be equipped with a sound capture device 14 (such as a recording device), a wind direction wind speed recording device 13, a motion detecting device 16, and a temperature and humidity capturing device 15 to collect the sound of the scene. Wind speed or temperature, humidity, vibration or movement.

S22:利用一環境重建裝置6將該現場動態情境進行重建形成一動態重建虛境,該動態重建虛境係利用動態照明影像重建出現場環境光源,動態照明影像係經由影像播放裝置61將該現場環境光源影像於該環型反射裝置4播放所成;進一步可設置播音裝置63(具體可用放音設備及音箱構成)、送風裝置62(具體可用風扇或風機構成)、空調裝置64(具體可用溫濕度控制的空調設備或造雪機等構成)、移動平台裝置65(具體可用一承載台做立體移動的平台構成),分別重建出現場的聲音、風向風速或溫濕度、震動或移動等。 S22: reconstructing the dynamic situation of the scene by using an environment reconstruction device 6 to form a dynamic reconstruction virtual environment, wherein the dynamic reconstruction virtual environment reconstructs the field ambient light source by using the dynamic illumination image, and the dynamic illumination image is the scene through the image playback device 61. The ambient light source image is played by the ring-shaped reflecting device 4; further, the sound-emitting device 63 (specifically, the sound-emitting device and the sound box can be used), the air blowing device 62 (specifically, a fan or a fan can be used), and the air-conditioning device 64 (specifically usable temperature) The air-conditioning device or the snow-making device of the humidity control device and the mobile platform device 65 (specifically, a platform for three-dimensional movement of a carrying platform) can respectively reconstruct the sound of the appearing field, the wind direction or the temperature and humidity, the vibration or the movement.

影像播放裝置61可使用一台或多台的影像播放的放影機或投影機等,不為所限;重建影像攝製裝置3可使用一台或多台的影像拍攝設備、燈光輔助設備或放音裝等。 The video playback device 61 can use one or more video playback players or projectors, etc., and is not limited to; the reconstructed image capturing device 3 can use one or more image capturing devices, lighting auxiliary devices, or Sound equipment, etc.

環型反射裝置4可由複數個反射鏡陣列41彼此排列成環形凹面所形成,而該反射鏡陣列41係由複數個凸面反射鏡411所組成,對於影像播放裝置61與第二攝製裝置12的配合,可如前步驟S12所述,在此不再重複說明。 The ring-shaped reflecting device 4 can be formed by a plurality of mirror arrays 41 arranged in an annular concave shape, and the mirror array 41 is composed of a plurality of convex mirrors 411 for the cooperation of the image playing device 61 and the second filming device 12. , as described in the previous step S12, the description will not be repeated here.

S23:將攝像目標C設置於動態重建虛境中,動態照明影像係照射於該攝像目標C上,並同時利用該重建影像攝製裝置3拍攝位在該合成幕5前之攝像目標C模仿虛擬角色互動動作以產生初始錄像; S24:將該背景影像移除該虛擬角色影像並合成至該初始錄像,形成一合成錄像D,如此,該合成錄像D可將該攝像目標C影像重建於該動態重建虛境中,具有模仿虛擬角色與現場互動的合成錄像D。 S23: The imaging target C is set in the dynamic reconstruction virtual environment, and the dynamic illumination image is irradiated on the imaging target C, and the reconstructed image capturing device 3 simultaneously captures the imaging target C in front of the synthetic screen 5 to simulate the virtual character. Interactive actions to generate an initial recording; S24: The background image is removed from the virtual character image and synthesized into the initial video to form a composite video D. Thus, the composite video D can reconstruct the camera target C image in the dynamic reconstruction virtual environment, with simulated virtual A composite video of the interaction between the character and the scene.

上述中,第一攝製裝置11及第二攝製裝置12可為數量至少一個以上之廣角攝影機,於戶外場景拍攝時,可經由多個不同角度來擷取背景、虛擬角色、現場物件及環境光源。其中背景可為建築、大自然環境、人物、動物、物品或任二以上之組合等等,現場物件包含建築物件、大自然環境物件、人物、動物、人工物件或上述二者以上之組合。後續在棚內進行虛擬實境攝影時,則利用高懸角度架設之環型顯示裝置4來播放第二攝製裝置12所擷取之現場環境光源影像,如此在拍攝初始錄像時,則可錄製到該現場環境光源影像,以取得較為真實之光影變化效果,而之後在去除合成幕5及虛擬角色之影像後,將預先拍攝之背景影像A與初始錄像進行合成,由攝像目標C來取代虛擬角色,如此可產生較為逼真且自然之動態合成錄像。其中,攝像目標C,可包含人物或動物等。 In the above, the first camera 11 and the second camera 12 can be at least one of a wide-angle camera. When shooting in an outdoor scene, the background, the virtual character, the live object, and the ambient light source can be captured through a plurality of different angles. The background may be a building, a natural environment, a character, an animal, an article, or a combination of any two or more, and the on-site object includes a building piece, a natural environment object, a character, an animal, an artificial object, or a combination of the two or more. When the virtual reality photography is performed in the shed, the ring-shaped display device 4 installed at a high hanging angle is used to play the image of the live environment light source captured by the second camera 12, so that when the initial recording is taken, the recording can be performed. The scene environment light source image is used to obtain a more realistic light and shadow change effect, and then after removing the composite screen 5 and the virtual character image, the pre-shooted background image A is combined with the initial video, and the virtual target is replaced by the camera target C. This produces a more realistic and natural dynamic composite recording. The imaging target C may include a person or an animal.

第二流程與第一流程之差異在於,第二流程在戶外預先拍攝場景時,將會利用一或多台廣角攝影機錄攝一個虛擬角色於背景前與現場物件進行互動之影像畫面,例如一個人牽著一個狗,並且同時利用另一或多台廣角攝影機擷取光線照射於該虛擬角色與現場物件時之光影變化以取得現場環境光源影像。爾後,若有人欲在棚內拍攝出與該虛擬角色於戶外拍攝之場景感覺相同之影像,該攝像目標C只要在合成板5的前方擺出與該虛擬角色當時相同之動作,並利用環型反射裝置4投射出該現場環境光源影像,然後由攝影機進行拍攝,即可於影像去背合成後,得到類似逼真、自然的合成錄像D畫面。 The difference between the second process and the first process is that the second process, when pre-shooting the scene outdoors, will use one or more wide-angle cameras to record a virtual character to interact with the live object in front of the background, such as a person holding A dog is used, and at the same time, another or a wide-angle camera is used to capture the light and shadow changes of the virtual character and the on-the-spot object to obtain the scene environment light source image. Then, if someone wants to capture an image in the shed that feels the same as the scene of the avatar shooting outdoors, the camera object C only needs to perform the same action as the avatar in front of the composite board 5, and uses the ring type. The reflection device 4 projects the image of the scene environment light source, and then the camera performs the shooting, so that the image can be back-synthesized to obtain a realistic and natural synthetic video D picture.

更進一步者,當利用廣角攝影機擷取現場環境光源影像時,同時可利用廣角攝影機錄製虛擬角色與現場物件互動或當時現場之一聲音源,而透過攝影機進行棚內攝影時,可經由環境重建裝置6同時播放出現場環境光源影像及該聲音源,使聲音源經由攝影機錄製於初始錄像中,使得經後製合成後之合成錄像於輸出時,可同時輸出該聲音源。例如,虛擬角色與狗兒(現場物件)進行互動時,廣角攝影機錄製了當時狗兒的叫聲,而 在棚內虛擬實景攝影時,於播放現場環境光源影像時同時播放該叫聲,讓攝像目標在模仿虛擬角色之動作進行拍攝並去背後製後,可取得如同重現當時現場之動態的合成錄像D,而差異僅在於主角之更換。 Furthermore, when the wide-angle camera is used to capture the image of the on-site ambient light source, the wide-angle camera can be used to record the virtual character interacting with the on-site object or one of the sound sources at the time, and the image can be reconstructed via the environment through the camera. 6 Simultaneously playing the scene environment light source image and the sound source, so that the sound source is recorded in the initial recording through the camera, so that the synthesized source can be simultaneously outputted after the post-compositing composite recording is output. For example, when a avatar interacts with a dog (on-site object), the wide-angle camera records the dog’s call at the time, and During the virtual live photography in the shed, the sound is played simultaneously while playing the live environment light source image, so that the camera target can capture the motion of the virtual character and go back to the back, and can obtain the synthetic video like the dynamic of the scene at that time. D, and the difference is only in the replacement of the protagonist.

綜合上述,本發明之現場動態情境重建之合成錄像拍製方法,於戶外預先拍攝場景時,除了拍攝背景、虛擬角色或現場物件外,還會同時地擷取當時的環境光源、聲音或二者,而於棚內進行虛擬實景拍攝時,則可將該所擷取之環境光源、聲音輸出,以重現當時場景拍攝之光影變化及音效,使得key板去除後之合成錄像能更為真實,以達到如同在戶外般拍攝或重現當時虛擬角色拍攝之臨場效果。 In summary, the composite video recording method of the live dynamic situation reconstruction of the present invention, when shooting a scene in advance, in addition to shooting a background, a virtual character or a live object, simultaneously captures the ambient light source, sound or both at the time. When the virtual reality shooting is performed in the shed, the captured ambient light source and sound can be output to reproduce the light and shadow changes and sound effects of the scene shooting, so that the synthetic video after the key board is removed can be more realistic. In order to achieve the same effect as shooting outdoors or recreating the virtual character shooting at that time.

以上所述僅為舉例性,而非為限制性者。任何未脫離本發明之精神與範疇,而對其進行之等效修改或變更,均應包含於後附之申請專利範圍中。 The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

S11~S14‧‧‧步驟 S11~S14‧‧‧Steps

Claims (13)

一種現場動態情境重建之合成錄像拍製方法,其包含下列步驟:利用一現場環境補捉裝置擷取一被攝物所在環境中之一現場動態情境;其中,該現場動態情境包含至少一背景影像及至少一現場環境光源影像,該現場環境補捉裝置包含至少一第一攝製裝置及至少一第二攝製裝置,該背景影像係利用該第一攝製裝置用以擷取被攝物的背景所產生、該現場環境光源影像係利用該第二攝製裝置擷取被攝物所在前景環境所產生;利用一環境重建裝置將該現場動態情境進行重建形成一動態重建虛境;其中,該動態重建虛境包含至少一動態照明影像,該環境重建裝置包含至少一影像播放裝置、環型反射裝置、至少一重建影像攝製裝置及一合成幕,該動態照明影像係經由該影像播放裝置將該現場環境光源影像於該環型反射裝置播放所形成;將一攝像目標設置於該動態重建虛境中,該動態照明影像係照射於該攝像目標上,並同時利用該重建影像攝製裝置拍攝位在該合成幕前之該攝像目標以產生一初始錄像;以及將該初始錄像移除背景合成幕並保留該攝像目標的錄像,合成於該背景影像之上,拍製形成一合成錄像;該合成錄像係將該攝像目標的錄像重建於該動態重建虛境中所拍製而成。 A synthetic video recording method for dynamic scenario reconstruction includes the following steps: utilizing a live environment capture device to capture a scene dynamic situation in an environment in which a subject is located; wherein the live dynamic context includes at least one background image And at least one scene environment light source device, the field environment capture device includes at least one first camera device and at least one second camera device, wherein the background image is generated by the first camera device for capturing a background of the object The on-site ambient light source image is generated by using the second filming device to capture the foreground environment of the object; and the scene dynamic situation is reconstructed by an environment reconstruction device to form a dynamic reconstruction virtual environment; wherein the dynamic reconstruction virtual environment Included in the at least one dynamic illumination image, the environment reconstruction device includes at least one image playback device, a ring-shaped reflection device, at least one reconstructed image capture device, and a composite screen, and the dynamic illumination image is used to image the live ambient light source through the image playback device Formed by the ring-shaped reflecting device; set a camera target to the move In the reconstructed virtual environment, the dynamic illumination image is irradiated onto the imaging target, and the reconstructed image capturing device is used to capture the image capturing target located in front of the synthetic screen to generate an initial recording; and the initial recording is removed from the background. The screen is synthesized and the video of the camera object is retained, and is synthesized on the background image to form a composite video. The composite video is formed by reconstructing the video of the camera target in the dynamic reconstruction virtual environment. 如申請專利範圍第1項所述之現場動態情境重建之合成錄像拍製方法,其中,該現場動態情境進一步包含一現場聲音,該現場環境補捉裝置進一步包含一聲音擷取裝置,該現場聲音係由該聲音擷取裝置擷取被攝物所在環境的聲源所產生;該動態重建虛境進一步包含一動態聲音,該環境重建裝置進一步包含一播音裝置,該動態聲音係由該播音裝置重建該現場聲音所產生;該重建影像攝製裝置進一步錄製該動態聲音形成該初始錄像之一部份。 The synthetic video recording method of the on-site dynamic situation reconstruction described in claim 1, wherein the live dynamic situation further comprises a live sound, the live environment capture device further comprising a sound capturing device, the live sound The sound capturing device is generated by extracting a sound source of the environment in which the object is located; the dynamic reconstruction virtual environment further includes a dynamic sound, and the environment reconstruction device further comprises a sounding device, wherein the dynamic sound is reconstructed by the sounding device The live sound is generated; the reconstructed image capture device further records the dynamic sound to form a portion of the initial video. 如申請專利範圍第1項所述之現場動態情境重建之合成錄像拍製方法,其中,該現場動態情境進一步包含一現場空氣流動,該現場環境補捉裝置進一步包含一風向風速錄製裝置,該現場空氣流動係由該風向風速錄 製裝置擷取被攝物所在環境的空氣流動所產生;該動態重建虛境進一步包含一動態空氣流動,該環境重建裝置進一步包含一送風裝置,該動態空氣流動係由該送風裝置重建該現場空氣流動所產生。 The synthetic video recording method of the on-site dynamic situation reconstruction described in claim 1, wherein the on-site dynamic situation further comprises an on-site air flow, the on-site environmental capture device further comprising a wind direction wind speed recording device, the scene Air flow is recorded by the wind direction The device reproduces the air flow in the environment in which the object is located; the dynamic reconstruction virtual environment further includes a dynamic air flow, and the environment reconstruction device further includes a air supply device, wherein the dynamic air flow system reconstructs the site air from the air supply device The flow is generated. 如申請專利範圍第1項所述之現場動態情境重建之合成錄像拍製方法,其中,該現場動態情境進一步包含一現場溫濕度指標,該現場環境補捉裝置進一步包含一溫濕度擷取裝置,該現場溫濕度指標係由該溫濕度擷取裝置擷取被攝物所在環境的溫度或濕度之一或其組合所產生;該動態重建虛境進一步包含一動態溫濕度指標,該環境重建裝置進一步包含一空調裝置,該動態溫濕度指標係由該空調裝置重建該現場溫濕度指標所產生。 The synthetic video recording method of the on-site dynamic situation reconstruction described in claim 1, wherein the on-site dynamic situation further includes an on-site temperature and humidity indicator, and the on-site environment capture device further comprises a temperature and humidity capture device. The on-site temperature and humidity index is generated by the temperature and humidity extraction device taking one or a combination of temperature or humidity of the environment in which the object is located; the dynamic reconstruction virtual environment further includes a dynamic temperature and humidity indicator, and the environment reconstruction device further The air conditioning device is included, and the dynamic temperature and humidity index is generated by the air conditioning device reconstructing the on-site temperature and humidity index. 一種現場動態情境重建之合成錄像拍製方法,其包含下列步驟:利用一現場環境補捉裝置擷取一虛擬角色與一現場物件互動一現場動態情境;其中,該現場動態情境包含至少一背景影像及至少一現場環境光源影像,該現場環境補捉裝置包含至少一第一攝製裝置及至少一第二攝製裝置,該背景影像係利用該第一攝製裝置用以擷取該虛擬角色與該現場物件互動所產生、該現場環境光源影像係利用該第二攝製裝置擷取該虛擬角色與該現場物件互動所在前景環境所產生;利用一環境重建裝置將該現場動態情境進行重建形成一動態重建虛境;其中,該動態重建虛境包含至少一動態照明影像,該環境重建裝置包含至少一影像播放裝置、一環型反射裝置、至少一重建影像攝製裝置及一合成幕,該動態照明影像係經由該影像播放裝置將該現場環境光源影像於該環型反射裝置重建所形成;將一攝像目標設置於該動態重建虛境中,該動態照明影像係照射於該攝像目標上,並同時利用該重建影像攝製裝置拍攝位在該合成幕前之該攝像目標模仿該虛擬角色互動動作以產生一初始錄像;以及將該初始錄像移除背景合成幕並保留該攝像目標的錄像,合成於該背景影像之上,拍製形成合成錄像;該合成錄像係將該攝像目標的錄像重建於該動態重建虛境中所拍製而成。 A synthetic video recording method for on-site dynamic situation reconstruction, comprising the steps of: utilizing a live environment capture device to capture a virtual character and interacting with a live object; a live dynamic situation; wherein the live dynamic context includes at least one background image And at least one live environment light source image, the field environment capture device includes at least one first camera device and at least one second camera device, wherein the background image is used by the first camera device to capture the virtual character and the live object The on-site ambient light source image is generated by the interaction, and the second filming device is used to capture the foreground environment in which the virtual character interacts with the on-site object; and the on-site dynamic situation is reconstructed by an environment reconstruction device to form a dynamic reconstruction virtual environment. The dynamic reconstruction virtual environment includes at least one dynamic illumination image, and the environment reconstruction device includes at least one image playback device, a ring-shaped reflection device, at least one reconstructed image capture device, and a composite screen, and the dynamic illumination image is transmitted through the image The playback device images the ambient light source in the ring type And forming a camera target in the dynamic reconstruction virtual environment, the dynamic illumination image is irradiated on the image capturing target, and simultaneously capturing the image capturing target in front of the synthetic screen by using the reconstructed image capturing device Simulating the virtual character interaction to generate an initial recording; and removing the initial recording from the background composition and retaining the recording of the camera target, synthesizing on the background image, and forming a composite video; the composite video will The video reconstruction of the camera target is made in the dynamic reconstruction virtual environment. 如申請專利範圍第5項所述之現場動態情境重建之合成錄像拍製方法, 其中,該現場動態情境進一步包含一現場聲音,該現場環境補捉裝置進一步包含一聲音擷取裝置,係由該聲音擷取裝置擷取該虛擬角色與該現場物件互動所在環境的聲源所產生;該動態重建虛境進一步包含一動態聲音,該環境重建裝置進一步包含一播音裝置,該動態聲音係由該播音裝置重建該現場聲音所產生;該重建影像攝製裝置進一步錄製該動態聲音形成該初始錄像之一部份。 A synthetic video recording method for on-site dynamic situation reconstruction as described in item 5 of the patent application scope, The live dynamic scenario further includes a live sound, the live environment capture device further comprising a sound capture device, wherein the sound capture device captures a sound source generated by the virtual character interacting with the live object The dynamic reconstruction virtual environment further includes a dynamic sound, the environment reconstruction device further comprising a sounding device, wherein the dynamic sound is generated by the sound reproducing device reconstructing the live sound; the reconstructed image capturing device further recording the dynamic sound to form the initial sound Part of the video. 如申請專利範圍第5項所述之現場動態情境重建之合成錄像拍製方法,其中,該現場動態情境進一步包含一現場空氣流動,該現場環境補捉裝置進一步包含一風向風速錄製裝置,該現場空氣流動係由該風向風速錄製裝置擷取該虛擬角色與該現場物件互動所在環境的空氣流動所產生;該動態重建虛境進一步包含一動態空氣流動,該環境重建裝置進一步包含一送風裝置,該動態空氣流動係由該送風裝置重建該現場空氣流動所產生。 The synthetic video recording method of the on-site dynamic situation reconstruction described in claim 5, wherein the on-site dynamic situation further comprises an on-site air flow, the on-site environmental capture device further comprising a wind direction wind speed recording device, the scene The air flow is generated by the wind direction recording device capturing the air flow of the environment in which the virtual character interacts with the on-site object; the dynamic reconstruction virtual environment further includes a dynamic air flow, and the environment reconstruction device further includes a air supply device, The dynamic air flow is generated by the air supply device reconstructing the on-site air flow. 如申請專利範圍第5項所述之現場動態情境重建之合成錄像拍製方法,其中,該現場動態情境進一步包含一現場溫濕度指標,該現場環境補捉裝置進一步包含一溫濕度擷取裝置,該現場溫濕度指標係由該溫濕度擷取裝置擷取該虛擬角色與該現場物件互動所在環境的溫度或濕度之一或其組合所產生;該動態重建虛境進一步包含一動態溫濕度指標,該環境重建裝置進一步包含一空調裝置,該動態溫濕度指標係由該空調裝置重建該現場溫濕度指標所產生。 The synthetic video recording method of the on-site dynamic situation reconstruction described in claim 5, wherein the on-site dynamic situation further comprises an on-site temperature and humidity indicator, the on-site environment capture device further comprising a temperature and humidity capture device, The on-site temperature and humidity indicator is generated by the temperature and humidity extraction device taking one or a combination of temperature or humidity of the environment in which the virtual character interacts with the on-site object; the dynamic reconstruction virtual environment further includes a dynamic temperature and humidity indicator. The environment reconstruction device further includes an air conditioning device, and the dynamic temperature and humidity indicator is generated by the air conditioning device reconstructing the on-site temperature and humidity index. 如申請專利範圍第1或第6項所述之現場動態情境重建之合成錄像拍製方法,其中,該現場動態情境進一步包含一實體移動資訊,該現場環境補捉裝置進一步包含一移動偵測裝置,該實體移動資訊係由該移動偵測裝置擷取被攝物所在環境的震動或移動所產生;該動態重建虛境進一步包含一動態移動,該環境重建裝置進一步包含一移動平台裝置,該動態移動係由該移動平台裝置接收該實體移動資訊,重建該現場實體移動所產生。 The synthetic video recording method of the on-site dynamic situation reconstruction according to the first or sixth aspect of the patent application, wherein the live dynamic situation further comprises a physical movement information, the on-site environment capture device further comprising a motion detection device The physical movement information is generated by the motion detection device capturing the vibration or movement of the environment in which the object is located; the dynamic reconstruction virtual environment further includes a dynamic movement, and the environment reconstruction device further includes a mobile platform device, the dynamic The mobile system receives the physical movement information from the mobile platform device and reconstructs the movement of the live entity. 如申請專利範圍第1或第6項所述之現場動態情境重建之合成錄像拍製方法,其中,該第二攝製裝置為m*n組,相對應的,該影像播放裝置為 m*n組;該等影像播放裝置係以該環型反射裝置之中心為鏡像對稱播放該第二攝製裝置所產生的該現場環境光源影像;其中,m與n為正整數,可形成m*n解析度的動態照明點。 The composite video recording method of the on-site dynamic situation reconstruction described in claim 1 or 6, wherein the second camera device is an m*n group, and correspondingly, the video playback device is The m*n group; the image playback device plays the scene environment light source image generated by the second filming device with the center of the ring type reflection device as a mirror image symmetric shape; wherein m and n are positive integers, which can form m* n resolution of dynamic illumination points. 如申請專利範圍第1或第6項所述之現場動態情境重建之合成錄像拍製方法,其中,該合成幕為綠幕或藍幕。 For example, the synthetic video recording method of the on-site dynamic situation reconstruction described in the first or sixth aspect of the patent application, wherein the synthetic screen is a green screen or a blue screen. 如申請專利範圍第1或第6項所述之現場動態情境重建之合成錄像拍製方法,其中,該環型反射裝置的中心係設置於該攝像目標拍攝中心之前方角度為+30°~+60°;其中,角度係以拍攝該攝像目標中心之水平為0°,向前方之上方為正角度,向前方下方為負角度。 The composite video recording method for on-site dynamic situation reconstruction according to the first or sixth aspect of the patent application, wherein the center of the annular reflection device is disposed at an angle of +30° to + before the imaging target shooting center. 60°; wherein the angle is 0° at the center of the image capturing target, a positive angle toward the front side, and a negative angle toward the front side. 如申請專利範圍第1或第6項項所述之現場動態情境重建之合成錄像拍製方法,其中,該環型反射裝置係由複數個反射鏡陣列彼此排列成環形凹面所形成;其中,該反射鏡陣列係由複數個凸面反射鏡所組成。 The synthetic video recording method of the on-site dynamic situation reconstruction according to the first or sixth aspect of the patent application, wherein the annular reflection device is formed by a plurality of mirror arrays arranged in an annular concave shape; wherein The mirror array is composed of a plurality of convex mirrors.
TW103134957A 2014-10-08 2014-10-08 Composition video producing method by reconstruction the dynamic situation of the capture spot TWI515691B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW103134957A TWI515691B (en) 2014-10-08 2014-10-08 Composition video producing method by reconstruction the dynamic situation of the capture spot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW103134957A TWI515691B (en) 2014-10-08 2014-10-08 Composition video producing method by reconstruction the dynamic situation of the capture spot

Publications (2)

Publication Number Publication Date
TWI515691B true TWI515691B (en) 2016-01-01
TW201614588A TW201614588A (en) 2016-04-16

Family

ID=55640293

Family Applications (1)

Application Number Title Priority Date Filing Date
TW103134957A TWI515691B (en) 2014-10-08 2014-10-08 Composition video producing method by reconstruction the dynamic situation of the capture spot

Country Status (1)

Country Link
TW (1) TWI515691B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114782255A (en) * 2022-06-16 2022-07-22 武汉大学 Semantic-based noctilucent remote sensing image high-resolution reconstruction method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107483857A (en) * 2017-08-16 2017-12-15 卓智网络科技有限公司 Micro- class method for recording and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114782255A (en) * 2022-06-16 2022-07-22 武汉大学 Semantic-based noctilucent remote sensing image high-resolution reconstruction method
CN114782255B (en) * 2022-06-16 2022-09-02 武汉大学 Semantic-based noctilucent remote sensing image high-resolution reconstruction method

Also Published As

Publication number Publication date
TW201614588A (en) 2016-04-16

Similar Documents

Publication Publication Date Title
US6685326B2 (en) Realistic scene lighting simulation
JP2015520403A (en) Karaoke dancing game
CN110248078A (en) A kind of exposure parameter acquisition methods of panoramic picture
CN107134000A (en) A kind of three-dimensional dynamic images generation method and system for merging reality
US10859852B2 (en) Real-time video processing for pyramid holographic projections
WO1995007590A1 (en) Time-varying image processor and display device
CN2667827Y (en) Quasi-panorama surrounded visual reproducing system
CN107968901A (en) The lighting system and method for a kind of simulating natural environment
JP2004523965A (en) Improved system and method for generating multiple composite images
AU2020277170B2 (en) Realistic illumination of a character for a scene
CA2979211A1 (en) Three-dimensional image source for enhanced pepper's ghost illusion
CN208609055U (en) A kind of lighting system of simulating natural environment
CN108600729A (en) Dynamic 3D models generating means and image generating method
JP4144960B2 (en) Imaging apparatus, image composition apparatus and method
US11770252B2 (en) System and method for generating a pepper's ghost artifice in a virtual three-dimensional environment
JPH09149296A (en) Moving projector system
TWI515691B (en) Composition video producing method by reconstruction the dynamic situation of the capture spot
Zhen et al. Physical world to virtual reality–motion capture technology in dance creation
CN206521965U (en) Host's interactive holographic Stage System
CN104156529A (en) Method for manufacturing holographic film source through three-dimensional model
CN101800856B (en) Method for manufacturing video OK in non-scene performance form
US20080247727A1 (en) System for creating content for video based illumination systems
CN111346392A (en) Non-dead opera demonstration system based on digital holographic technology
JP7218979B1 (en) Information processing device, information processing method and program
Zhang et al. Research on the Application of xR Extended Reality Shooting Technology in the Experimental Drama" Pipa Xing"