TWI774076B - Remote reality and control system and multi-person remote reality and control system - Google Patents

Remote reality and control system and multi-person remote reality and control system Download PDF

Info

Publication number
TWI774076B
TWI774076B TW109133888A TW109133888A TWI774076B TW I774076 B TWI774076 B TW I774076B TW 109133888 A TW109133888 A TW 109133888A TW 109133888 A TW109133888 A TW 109133888A TW I774076 B TWI774076 B TW I774076B
Authority
TW
Taiwan
Prior art keywords
reality
head
user
processing unit
unit
Prior art date
Application number
TW109133888A
Other languages
Chinese (zh)
Other versions
TW202213975A (en
Inventor
歐陽志宏
Original Assignee
智崴全球股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 智崴全球股份有限公司 filed Critical 智崴全球股份有限公司
Priority to TW109133888A priority Critical patent/TWI774076B/en
Publication of TW202213975A publication Critical patent/TW202213975A/en
Application granted granted Critical
Publication of TWI774076B publication Critical patent/TWI774076B/en

Links

Images

Landscapes

  • Studio Devices (AREA)
  • Selective Calling Equipment (AREA)

Abstract

一種遠端實境暨控制系統包括頭戴式遠端實境裝置及實境攝影裝置,頭戴式遠端實境裝置及實境攝影裝置訊號連接於網路系統;頭戴式遠端實境裝置具有顯示單元、耳機及狀態感測器訊號;狀態感測器用於感測該使用者的頭部指令,且實境攝影裝置的可轉動座模仿使用者的頭部指令同步轉動;實境攝影裝置轉播活動場所正進行的實況活動;實境攝影裝置透過網路系統將實況影像及實況音訊傳送至頭戴式遠端實境裝置,使該顯示單元顯示實況影像,且控制對耳機發出實況音訊。一種多人遠端實境暨控制系統亦在此提供。藉此,可使不同地區的使用者同時觀賞同一實況活動,且有逼真臨場感。A remote reality and control system includes a head-mounted remote reality device and a reality photography device, wherein the signals of the head-mounted remote reality device and the reality photography device are connected to a network system; the head-mounted remote reality device has a display unit and an earphone. and the state sensor signal; the state sensor is used to sense the user's head command, and the rotatable seat of the reality camera imitates the user's head command to rotate synchronously; the reality camera device is broadcasting the event venue The real-time photography device transmits the live image and live audio to the head-mounted remote reality device through the network system, so that the display unit displays the live image and controls the headset to send out the live audio. A multi-person remote reality and control system is also provided here. In this way, users in different regions can watch the same live event at the same time, and have a realistic sense of presence.

Description

遠端實境暨控制系統及多人遠端實境暨控制系統Remote reality and control system and multi-person remote reality and control system

本發明係與遠端實境系統有關;特別是指一種可實況轉播的遠端實境暨控制系統多人遠端實境暨控制系統。 The invention relates to a remote reality system; in particular, it refers to a multi-person remote reality and control system capable of live broadcasting.

隨著全球化的發展,全球各地的交流日漸活絡,比方說,運動賽事、演唱會、音樂會、產品發表會及記者會等在現今的社會中都是相當常見的交流活動。 With the development of globalization, exchanges around the world are becoming more and more active. For example, sports events, concerts, concerts, product launches and press conferences are quite common exchange activities in today's society.

因著全球各地的交流頻繁,各類疾病的傳播也逐漸猖獗,對於世界各國人民的生命財產造成了極大的威脅。然而,若是為了避免傳染性疾病的傳播而禁止或拒絕各國人民的文化活動交流,對於人類文明發展的進程來說將造成極大傷害。 Due to frequent exchanges around the world, the spread of various diseases has gradually become rampant, posing a great threat to the lives and properties of people all over the world. However, in order to avoid the spread of infectious diseases, it will cause great harm to the development of human civilization if the cultural activities and exchanges between peoples of different countries are prohibited or rejected.

為了兼顧上述文化交流及防止傳染病傳播,目前已有相關活動業者推出線上音樂會、線上演唱會、線上運動賽事觀賞的服務,以便於觀賞者可在任一地點,使用電子裝置觀看上述現場直播。 In order to take into account the above-mentioned cultural exchanges and prevent the spread of infectious diseases, relevant event operators have launched services for watching online concerts, online concerts, and online sports events, so that viewers can use electronic devices to watch the above live broadcasts at any location.

然而,使用電子裝置觀看上述現場直播,時常會發生現場攝影鏡頭所呈現的畫面並非觀賞者所欲觀賞的角度或位置,甚至發生觀賞者期待的特寫鏡頭因鏡頭放大倍率不足而看不清楚等問題。 However, when using an electronic device to watch the above-mentioned live broadcast, it often happens that the picture presented by the live camera lens is not at the angle or position that the viewer wants to watch, and even the close-up shot that the viewer expects is not clear due to insufficient lens magnification. .

由此可知,傳統現場直播的服務已無法滿足觀賞者的觀賞需求,因此目前亟需一種新穎的遠端實境暨控制系統及多人遠端實境暨控制系統,以提供可依觀賞者偏好調整的現場直播服務。 It can be seen from this that the traditional live broadcast service can no longer meet the viewing needs of viewers. Therefore, a novel remote reality and control system and a multi-person remote reality and control system are urgently needed. Adjusted live broadcast service.

有鑑於此,本發明之目的在於提供一種遠端實境暨控制系統及多人遠端實境暨控制系統,可將狀態感測器感測該使用者的頭部指令,藉由網路系統遠端控制,使實境攝影裝置的可轉動座模仿使用者的頭部指令同步轉動。實境攝影裝置透過網路系統將實況影像及實況音訊傳送至頭戴式遠端實境裝置,使該顯示單元顯示實況影像,且控制對耳機發出實況音訊。藉此,可使不同地區的使用者同時觀賞同一實況活動,且有逼真臨場感。 In view of this, the purpose of the present invention is to provide a remote reality and control system and a multi-person remote reality and control system, which can sense the user's head command with a state sensor and use a network system The remote control enables the rotatable base of the real-life photographing device to rotate synchronously by imitating the user's head command. The real-time photographing device transmits the live image and the live audio to the head-mounted remote reality device through the network system, so that the display unit displays the live image and controls the earphone to send out the live audio. In this way, users in different regions can watch the same live event at the same time, and have a realistic sense of presence.

緣以達成上述目的,本發明提供的一種遠端實境暨控制系統,包括一頭戴式遠端實境裝置及一實境攝影裝置;該頭戴式遠端實境裝置用以供使用者配戴,且訊號連接於一網路系統;該頭戴式遠端實境裝置包括一顯示單元、一對耳機、一狀態感測器及一第一處理單元,其中該顯示單元、該對耳機及該狀態感測器訊號連接於該第一處理單元;該狀態感測器用於感測該使用者的頭部指令,且該狀態感測器經由該第一處理單元產生一控制訊號並透過該網路系統發送該控制訊號;該實境攝影裝置設置於一活動場所中,該實境攝影裝置係用於轉播該活動場所正進行的一實況活動,且訊號連接於該網路系統及接收該控制訊號;該實境攝影裝置包括一攝像單元、一第一收音單元、一可轉動座及一第二處理單元,其中該攝像單元及該第一收音單元係設置於該可轉動座上,且該攝像單元、該第一收音單元及該可轉動座訊號連接於該第二處理單元,當該實境攝影裝置接收該控制訊號後,該第二處理單元控制該可轉動座模仿該使用者的頭部指令同步轉動,同時該攝像單元及該第一收音單元轉播該實況活動的一實況影像及一實況音訊,該實境攝影裝置透過 該網路系統將該實況影像及該實況音訊傳送至該頭戴式遠端實境裝置,使該第一處理單元控制該顯示單元顯示該實況影像,且控制該對耳機發出該實況音訊。 In order to achieve the above object, the present invention provides a remote reality and control system, including a head-mounted remote reality device and a reality photography device; the head-mounted remote reality device is used for the user to wear, and The signal is connected to a network system; the head-mounted remote reality device includes a display unit, a pair of earphones, a state sensor and a first processing unit, wherein the display unit, the pair of earphones and the state sensor The signal is connected to the first processing unit; the state sensor is used for sensing the head command of the user, and the state sensor generates a control signal through the first processing unit and sends the control signal through the network system a signal; the reality photography device is set in an activity place, the reality photography device is used for rebroadcasting a live event being carried out in the activity place, and the signal is connected to the network system and receives the control signal; the reality The photographing device includes a photographing unit, a first sound-receiving unit, a rotatable base, and a second processing unit, wherein the photographing unit and the first sound-receiving unit are arranged on the rotatable base, and the photographing unit, the first sound-receiving unit A radio unit and the rotatable base signal are connected to the second processing unit. After the real-life photography device receives the control signal, the second processing unit controls the rotatable base to rotate synchronously by imitating the user's head command. At the same time, the camera unit and the first radio unit broadcast a live image and a live audio of the live event. The network system transmits the live image and the live audio to the head-mounted remote reality device, so that the first processing unit controls the display unit to display the live image, and controls the pair of earphones to emit the live audio.

本發明之另一目的在於提供一種多人遠端實境暨控制系統包括複數個如上所述的頭戴式遠端實境裝置及複數個如上所述的實境攝影裝置;各該頭戴式遠端實境裝置係個別由對應的使用者配戴;各該頭戴式遠端實境裝置包括一第二收音單元訊號連接於該第一處理單元;該些實境攝影裝置設置於相同的該活動場所中;該實境攝影裝置包括一揚聲單元訊號連接於該第二處理單元;其中,各該頭戴式遠端實境裝置感測所對應的該使用者的頭部指令,且透過該網路系統發送該控制訊號至所對應的該實境攝影裝置;各該實境攝影裝置透過該網路系統接收對應的該控制訊號,以模仿對應的該使用者的頭部指令同步轉動;當該使用者對該第二收音單元發出聲音時,該第二收音單元經由該第一處理單元產生一使用者音訊,並透過該網路系統傳送至該實境攝影裝置,使該第二處理單元控制該揚聲單元播放該使用者音訊,同時位於該實境攝影裝置周圍的其他該至少一實境攝影裝置的該第一收音單元轉播該使用者音訊,並且透過該網路系統,使對應於其他該至少一實境攝影裝置的該頭戴式遠端實境裝置的該對耳機發出該使用者音訊。 Another object of the present invention is to provide a multi-person remote reality and control system including a plurality of the above-mentioned head-mounted remote reality devices and a plurality of the above-mentioned reality photography devices; each of the head-mounted remote reality devices The devices are individually worn by the corresponding users; each of the head-mounted remote reality devices includes a second radio unit that is signal-connected to the first processing unit; the reality photography devices are installed in the same activity place; the The reality photography device includes a speaker unit signal connected to the second processing unit; wherein each of the head-mounted remote reality devices senses the corresponding head command of the user, and sends the control through the network system signal to the corresponding reality photography device; each of the reality photography devices receives the corresponding control signal through the network system to imitate the corresponding user's head command to rotate synchronously; when the user responds to the first When the two radio units emit sound, the second radio unit generates a user audio through the first processing unit, and transmits it to the reality photography device through the network system, so that the second processing unit controls the speaker unit to play The user audio, while the first sound-receiving unit of the other at least one reality photography device located around the reality photography device broadcasts the user audio, and through the network system, makes it correspond to the other at least one reality The pair of earphones of the head-mounted remote reality device of the photographing device emits the user audio.

本發明之效果在於,遠端實境暨控制系統及多人遠端實境暨控制系統可將狀態感測器感測該使用者的頭部指令,藉由網路系統遠端控制,使實境攝影裝置的可轉動座模仿使用者的頭部指令同步轉動。實境攝影裝置透過網路系統將實況影像及實況音訊傳送至頭戴式遠端實境裝置,使該顯示單元顯示實況影像,且控制對耳機發出實況音訊。 多人遠端實境暨控制系統亦可使不同地區的使用者同時觀賞同一實況活動,且有逼真臨場感。 The effect of the present invention is that the remote reality and control system and the multi-person remote reality and control system can sense the user's head command with the state sensor, and use the network system to remotely control the real world. The rotatable seat of the landscape photography device imitates the user's head command to rotate synchronously. The real-time photographing device transmits the live image and the live audio to the head-mounted remote reality device through the network system, so that the display unit displays the live image and controls the earphone to send out the live audio. The multi-person remote reality and control system can also enable users in different regions to watch the same live event at the same time, and have a realistic sense of presence.

〔本發明〕 〔this invention〕

10,10a,10b,10c,10d,10e:頭戴式遠端實境裝置 10, 10a, 10b, 10c, 10d, 10e: Head mounted remote reality device

12:顯示單元 12: Display unit

14:耳機 14: Headphones

16:狀態感測器 16: Status Sensor

18:第二收音單元 18: Second radio unit

20,20a,20b,20c,20d,20e:實境攝影裝置 20, 20a, 20b, 20c, 20d, 20e: Photorealistic installations

22:攝像單元 22: Camera unit

24:第一收音單元 24: The first radio unit

26:可轉動座 26: rotatable seat

262:轉動台 262: Turntable

264:支撐臂 264: Support Arm

266:俯仰頭 266: tilt head

28:揚聲單元 28: Speaker unit

D1,D2,D3,D4:方向 D1, D2, D3, D4: direction

P:使用者 P: user

S:活動場所 S: place of activity

圖1為本發明一較佳實施例之遠端實境暨控制系統的示意圖。 FIG. 1 is a schematic diagram of a remote reality and control system according to a preferred embodiment of the present invention.

圖2為本發明一較佳實施例之頭戴式遠端實境裝置的示意圖 2 is a schematic diagram of a head-mounted remote reality device according to a preferred embodiment of the present invention

圖3為本發明一較佳實施例之實境攝影裝置的示意圖。 FIG. 3 is a schematic diagram of a real-life photographing device according to a preferred embodiment of the present invention.

圖4為本發明一較佳實施例之多人遠端實境暨控制系統的示意圖。 FIG. 4 is a schematic diagram of a multi-person remote reality and control system according to a preferred embodiment of the present invention.

為能更清楚地說明本發明,茲舉較佳實施例並配合圖式詳細說明如後。請參圖1所示,圖1為本發明一較佳實施例之遠端實境暨控制系統的示意圖。遠端實境暨控制系統包括頭戴式遠端實境裝置10及實境攝影裝置20。 In order to describe the present invention more clearly, preferred embodiments are given and described in detail with the drawings as follows. Please refer to FIG. 1 , which is a schematic diagram of a remote reality and control system according to a preferred embodiment of the present invention. The remote reality and control system includes a head-mounted remote reality device 10 and a reality camera device 20 .

請配合參考圖1及圖2,該頭戴式遠端實境裝置10用以供使用者P配戴,且該頭戴式遠端實境裝置10訊號連接於一網路系統。 Please refer to FIG. 1 and FIG. 2 together, the head-mounted remote reality device 10 is used for wearing by the user P, and the signal of the head-mounted remote reality device 10 is connected to a network system.

該頭戴式遠端實境裝置10包括一顯示單元12、一對耳機14、一狀態感測器16及一第一處理單元(圖未繪示),其中該顯示單元12、該對耳機14及該狀態感測器16訊號連接於該第一處理單元。該狀態感測器16用於感測該使用者P的頭部指令,且該狀態感測器16經由該第一處理單元產生一控制訊號並透過該網路系統發送該控制訊號。在本發明一較佳實施例中,該狀態感測器16包括陀螺儀、加速度感測器、重力感測器、三軸感測器、眼球追蹤器、腦波感測器、語音辨識器、舌部撥片或 其組合,但不以此為限制。在本發明一較佳實施例中,當該狀態感測器16為眼球追蹤器時,該狀態感測器16係設置對應於使用者的眼部。在本發明一較佳實施例中,當該狀態感測器16為語音辨識器時,該狀態感測器16係設置對應於使用者的口部。在本發明一較佳實施例中,當該狀態感測器16為舌部撥片時,該狀態感測器16係設置對應於使用者的口部或設置於使用者的口部內。 The head-mounted remote reality device 10 includes a display unit 12 , a pair of earphones 14 , a state sensor 16 and a first processing unit (not shown), wherein the display unit 12 , the pair of earphones 14 and the The signal of the state sensor 16 is connected to the first processing unit. The state sensor 16 is used for sensing the head command of the user P, and the state sensor 16 generates a control signal through the first processing unit and sends the control signal through the network system. In a preferred embodiment of the present invention, the state sensor 16 includes a gyroscope, an acceleration sensor, a gravity sensor, a three-axis sensor, an eye tracker, a brain wave sensor, a speech recognizer, tongue pick or combinations thereof, but not limited thereto. In a preferred embodiment of the present invention, when the state sensor 16 is an eye tracker, the state sensor 16 is disposed corresponding to the user's eyes. In a preferred embodiment of the present invention, when the state sensor 16 is a speech recognizer, the state sensor 16 is disposed corresponding to the user's mouth. In a preferred embodiment of the present invention, when the state sensor 16 is a tongue pick, the state sensor 16 is disposed corresponding to the user's mouth or disposed in the user's mouth.

請配合參考圖1、圖2及圖3,該實境攝影裝置20設置於一活動場所S中,該實境攝影裝置20係用於轉播該活動場所S正進行的一實況活動,且訊號連接於該網路系統及接收該控制訊號。 Please refer to FIG. 1 , FIG. 2 and FIG. 3 , the real-life photographing device 20 is installed in an activity place S, and the real-life photographing device 20 is used for rebroadcasting a live event being carried out in the activity place S, and the signal is connected to in the network system and receive the control signal.

該實境攝影裝置20包括一攝像單元22、一第一收音單元24、一可轉動座26及一第二處理單元(圖未繪示),其中該攝像單元22及該第一收音單元24係設置於該可轉動座26上,且該攝像單元22、該第一收音單元24及該可轉動座26訊號連接於該第二處理單元。在本發明一較佳實施例中,該實境攝影裝置20的該可轉動座26包括一轉動台262、一支撐臂264及一俯仰頭266,該轉動台262的底面設置於該活動場所S的一虛擬座位上,且可受操控地相對於該虛擬座位左右轉動;該支撐臂264係固設於該轉動台262上,而該俯仰頭266樞設於該支撐臂264上,且可受操控地相對於該支撐臂264上下樞擺。 The reality photography device 20 includes a camera unit 22 , a first sound pickup unit 24 , a rotatable base 26 and a second processing unit (not shown), wherein the camera unit 22 and the first sound pickup unit 24 are It is arranged on the rotatable base 26, and the camera unit 22, the first sound-receiving unit 24 and the rotatable base 26 are signal-connected to the second processing unit. In a preferred embodiment of the present invention, the rotatable base 26 of the reality photography device 20 includes a turntable 262 , a support arm 264 and a tilt head 266 , and the bottom surface of the turntable 262 is disposed in the activity place S The support arm 264 is fixed on the turntable 262, and the tilt head 266 is pivoted on the support arm 264 and can be supported by Manipulatively pivots up and down relative to the support arm 264 .

當該實境攝影裝置20接收該控制訊號後,該第二處理單元控制該可轉動座26模仿該使用者P的頭部指令同步轉動,同時該攝像單元22及該第一收音單元24轉播該實況活動的一實況影像及一實況音訊,該實境攝影裝置20透過該網路系統將該實況影像及該實況音訊傳送至該頭戴式遠端實境裝置10,使該第一處理單元控制該顯示單元12顯示該實況影像,且控制該對耳機14發出該實況音訊。如圖3所示,該第一收音 單元24係設置於該支撐臂上;該第一收音單元24包括一指向性麥克風。在本發明較佳實施例中,該頭部指令包括該使用者P的頭部動作、該使用者P的眼球轉動、該使用者P的腦波訊號、該使用者P的聲音指令、該使用者P的舌部動作或其組合。 When the real-life photography device 20 receives the control signal, the second processing unit controls the rotatable base 26 to imitate the user P's head command to rotate synchronously, and the camera unit 22 and the first radio unit 24 broadcast the A live image and a live audio of the live event, the live video device 20 transmits the live image and the live audio to the head-mounted remote reality device 10 through the network system, so that the first processing unit controls the display The unit 12 displays the live video and controls the pair of headphones 14 to emit the live audio. As shown in Figure 3, the first radio The unit 24 is disposed on the support arm; the first sound-receiving unit 24 includes a directional microphone. In a preferred embodiment of the present invention, the head command includes the head movement of the user P, the eye movement of the user P, the brain wave signal of the user P, the voice command of the user P, the use of the user P Person P's tongue movements or a combination thereof.

詳言之,當使用者P配戴該頭戴式遠端實境裝置10做出包括如圖2方向D1所示的左轉頭或右轉頭、如圖2方向D2所示的抬頭或低頭的該頭部動作時,該狀態感測器16(即陀螺儀、加速度感測器、重力感測器、三軸感測器或其組合)感測且經由該第一處理單元產生該控制訊號,該實境攝影裝置20透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台262對應做出如圖3方向D3所示的左轉動或右轉動、該俯仰頭266對應做出如圖3方向D4所示的上樞擺或下樞擺。 To be more specific, when the user P wears the head-mounted remote reality device 10 and makes the head turn left or right as shown in the direction D1 of FIG. When the head moves, the state sensor 16 (ie, a gyroscope, an acceleration sensor, a gravity sensor, a three-axis sensor or a combination thereof) senses and generates the control signal through the first processing unit. After the real-life photographing device 20 receives the control signal through the network system, the second processing unit controls the turntable 262 to rotate left or right as shown in the direction D3 in FIG. 3 , and the tilt head 266 correspondingly rotates The upper pivot or the lower pivot as shown in the direction D4 of FIG. 3 .

在本發明另一較佳實施例中,當使用者P配戴該頭戴式遠端實境裝置10做出包括眼球左轉、眼球右轉、眼球上轉、眼球下轉或其組合的該眼球轉動時,該狀態感測器(即眼球追蹤器)感測該使用者P的眼球轉動且經由該第一處理單元產生該控制訊號,該實境攝影裝置20透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台262、該俯仰頭266或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 In another preferred embodiment of the present invention, when the user P wears the head-mounted remote reality device 10 to make the eyeball rotation including left eyeball, right eyeball, eyeball up, eyeball down or a combination thereof When the state sensor (ie the eye tracker) senses the eye movement of the user P and generates the control signal through the first processing unit, the reality photography device 20 receives the control signal through the network system , the second processing unit controls the turntable 262 , the tilting head 266 or the combination thereof to rotate left, rotate right, pivot up, pivot down or a combination thereof.

在本發明又一較佳實施例中,當使用者P配戴該頭戴式遠端實境裝置10發出包括左轉、右轉、上轉、下轉或其組合的該腦波訊號時,該狀態感測器16(即腦波感測器)感測該使用者P的腦波訊號且經由該第一處理單元產生該控制訊號,該實境攝影裝置20透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台262、該俯仰頭266或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 In another preferred embodiment of the present invention, when the user P wears the head-mounted remote reality device 10 to emit the brainwave signal including left turn, right turn, up turn, down turn or a combination thereof, the state The sensor 16 (ie, the brain wave sensor) senses the brain wave signal of the user P and generates the control signal through the first processing unit, and the reality photography device 20 receives the control signal through the network system. , the second processing unit controls the turntable 262 , the tilting head 266 or the combination thereof to rotate left, rotate right, pivot up, pivot down or a combination thereof.

在本發明再一較佳實施例中,當使用者P配戴該頭戴式遠端實境裝置10發出包括左轉、右轉、上轉、下轉或其組合的該聲音指令時,該狀態感測器(即語音辨識器)辨識該使用者P的聲音指令且經由該第一處理單元產生該控制訊號,該實境攝影裝置20透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台2622、該俯仰頭266或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 In yet another preferred embodiment of the present invention, when the user P wears the head-mounted remote reality device 10 to issue the voice command including turn left, turn right, turn up, turn down or a combination thereof, the state sense A detector (ie a voice recognizer) recognizes the voice command of the user P and generates the control signal through the first processing unit. After the reality camera 20 receives the control signal through the network system, the second processing unit generates the control signal. Controlling the turntable 2622, the tilting head 266 or their combination corresponds to a left rotation, a right rotation, an upper pivot, a lower pivot or a combination thereof.

在本發明更一較佳實施例中,當使用者P配戴該頭戴式遠端實境裝置10做出包括舌部左擺、舌部右擺、舌部上擺、舌部下擺或其組合的該舌部動作時,該狀態感測器(即舌部撥片)感測該使用者P的舌部動作且經由該第一處理單元產生該控制訊號,該實境攝影裝置20透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台262、該俯仰頭266或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 In a more preferred embodiment of the present invention, when the user P wears the head-mounted remote reality device 10 to make a left-hand tongue swing, a right-hand tongue swing, a tongue-up swing, a tongue-down swing or a combination thereof When the tongue moves, the state sensor (ie, the tongue pick) senses the tongue movement of the user P and generates the control signal through the first processing unit, and the reality camera 20 passes through the network After the system receives the control signal, the second processing unit controls the turntable 262 , the tilting head 266 or a combination thereof to rotate left, rotate right, pivot up, pivot down or a combination thereof.

在本發明上述實施例中,該轉動台262及該俯仰頭266各自包括彼此連接的一驅動馬達(圖未繪示)及一齒輪組(圖未繪示),該驅動馬達可受該第二處理單元控制而帶動該齒輪組作動,進而驅使該轉動台、該俯仰頭或其組合樞轉。在本發明一較佳實施例中,該轉動台262以12點鐘方向為0度,該轉動台的左轉動及右轉動角度範圍為90度~-90度;該俯仰頭266以水平方向為0度,該俯仰頭的上樞擺及下樞擺角度範圍為30度至-20度。 In the above-mentioned embodiment of the present invention, the turntable 262 and the tilting head 266 each include a drive motor (not shown) and a gear set (not shown) connected to each other, and the drive motor can be driven by the second The processing unit controls and drives the gear set to act, thereby driving the turntable, the pitching head or a combination thereof to pivot. In a preferred embodiment of the present invention, the 12 o'clock direction of the turntable 262 is 0 degrees, the left and right rotation angles of the turntable are in the range of 90 degrees to -90 degrees; the tilting head 266 is horizontally oriented to 0 degrees, the upper and lower pivot angles of the tilt head range from 30 degrees to -20 degrees.

該攝像單元22係設置於該俯仰頭266上,當該轉動台262、該俯仰頭266或其組合動作時,該攝像單元22的鏡頭視野同步位移,使該頭戴式遠端實境裝置10的該顯示單元12顯示畫面同步位移的該實況影像。在本發明一較佳實施例中,該攝像單元22包括一廣角鏡頭組(圖未 繪示)及一望遠鏡頭組(圖未繪示),且該頭戴式遠端實境裝置10包括一切換開關(圖未繪示),當該使用者P操作該切換開關時,該頭戴式遠端實境裝置10經由該網路系統發出一控制訊號至該實境攝影裝置20的該攝像單元22,並經由該第二處理單元控制該攝像單元22使用該廣角鏡頭組或該望遠鏡頭組。在本發明一較佳實施例中,當該攝像單元22使用該廣角鏡頭組時,該顯示單元12顯示廣角的該實況影像;當該攝像單元22使用該望遠鏡頭組時,該切換開關可受操控地遙控該望遠鏡頭組的焦距,以調整該顯示單元12顯示的該實況影像的一放大比例。 The camera unit 22 is disposed on the tilt head 266 . When the rotation stage 262 , the tilt head 266 or a combination thereof moves, the lens field of view of the camera unit 22 is displaced synchronously, so that the The display unit 12 displays the live image with the screen synchronously shifted. In a preferred embodiment of the present invention, the camera unit 22 includes a wide-angle lens group (not shown in the figure). shown) and a telescopic lens set (not shown), and the head-mounted remote reality device 10 includes a switch (not shown), when the user P operates the switch, the head-mounted remote The reality device 10 sends a control signal to the camera unit 22 of the reality camera device 20 via the network system, and controls the camera unit 22 to use the wide-angle lens group or the telephoto lens group via the second processing unit. In a preferred embodiment of the present invention, when the camera unit 22 uses the wide-angle lens group, the display unit 12 displays the wide-angle live image; when the camera unit 22 uses the telephoto lens group, the switch can be manipulated The focal length of the telephoto lens group is remotely controlled to adjust a magnification ratio of the live image displayed by the display unit 12 .

該頭戴式遠端實境裝置10包括一第二收音單元18訊號連接於該第一處理單元,且該實境攝影裝置20包括一揚聲單元28訊號連接於該第二處理單元,當該使用者P對該第二收音單元18發出聲音時,該第二收音單元18經由該第一處理單元產生一使用者音訊,並透過該網路系統傳送至該實境攝影裝置20,使該第二處理單元控制該揚聲單元28播放該使用者音訊。 The head-mounted remote reality device 10 includes a second radio unit 18 connected to the first processing unit, and the reality camera 20 includes a speaker unit 28 connected to the second processing unit, when the user When P emits a sound to the second sound pickup unit 18, the second sound pickup unit 18 generates a user audio through the first processing unit, and transmits it to the reality photography device 20 through the network system, so that the second processing unit The unit controls the speaker unit 28 to play the user audio.

接著請參圖4所示,圖4為本發明一較佳實施例之多人遠端實境暨控制系統的示意圖。多人遠端實境暨控制系統包括複數個如上所述的頭戴式遠端實境裝置10a、10b、10c、10d、10e及複數個如上所述的實境攝影裝置20a、20b、20c、20d、20e。在本發明實施例中,配戴該些頭戴式遠端實境裝置10a、10b、10c、10d、10e的該些使用者係各自位於不同使用地點。 Next, please refer to FIG. 4 , which is a schematic diagram of a multi-person remote reality and control system according to a preferred embodiment of the present invention. The multi-person remote reality and control system includes a plurality of the above-mentioned head-mounted remote reality devices 10a, 10b, 10c, 10d, 10e and a plurality of the above-mentioned reality photography devices 20a, 20b, 20c, 20d, 20e. In the embodiment of the present invention, the users wearing the head-mounted remote reality devices 10a, 10b, 10c, 10d, and 10e are located at different places of use.

各該頭戴式遠端實境裝置10a、10b、10c、10d、10e係個別由對應的使用者配戴;各該頭戴式遠端實境裝置10a、10b、10c、10d、10e包括一第二收音單元訊號18連接於該第一處理單元。該些實境攝影裝置20a、20b、20c、20d、20e設置於相同的該活動場所S中;該實境攝 影裝置20a、20b、20c、20d、20e包括一揚聲單元28訊號連接於該第二處理單元。其中,各該頭戴式遠端實境裝置10a、10b、10c、10d、10e感測所對應的該使用者的頭部指令,且透過該網路系統發送該控制訊號至所對應的該實境攝影裝置20a、20b、20c、20d、20e。 Each of the head-mounted remote reality devices 10a, 10b, 10c, 10d, and 10e is individually worn by a corresponding user; each of the head-mounted remote reality devices 10a, 10b, 10c, 10d, and 10e includes a second sound-receiving unit The signal 18 is connected to the first processing unit. The real-life photography devices 20a, 20b, 20c, 20d, and 20e are installed in the same activity place S; The imaging devices 20a, 20b, 20c, 20d, and 20e include a speaker unit 28 for signal connection to the second processing unit. Wherein, each of the head-mounted remote reality devices 10a, 10b, 10c, 10d, and 10e senses the corresponding head command of the user, and sends the control signal to the corresponding reality camera through the network system Devices 20a, 20b, 20c, 20d, 20e.

各該實境攝影裝置20a、20b、20c、20d、20e透過該網路系統接收對應的該控制訊號,以模仿對應的該使用者的頭部指令同步轉動。當該使用者對該第二收音單元18發出聲音時,該第二收音單元18經由該第一處理單元產生一使用者音訊,並透過該網路系統傳送至該實境攝影裝置20a、20b、20c、20d、20e,使該第二處理單元控制該揚聲單元28播放該使用者音訊,同時位於該實境攝影裝置20a(以實境攝影裝置20a為例)周圍的其他該至少一實境攝影裝置20b、20c、20d的該第一收音單元24轉播該使用者音訊,並且透過該網路系統,使對應於其他該至少一實境攝影裝置20b、20c、20d的該頭戴式遠端實境裝置10b、10c、10d的該對耳機14發出該使用者音訊。在本發明一較佳實施例中,距離該實境攝影裝置20a最近的實境攝影裝置20c、20d的該第一收音單元24轉播該使用者音訊,且該頭戴式遠端實境裝置10c、10d的該對耳機14發出該使用者音訊最大聲;反之,因實境攝影裝置20e距離該實境攝影裝置20a最遠,因此實境攝影裝置20e的該第一收音單元24收音不佳,而該頭戴式遠端實境裝置10e的該對耳機14發出該使用者音訊最小聲或不發出該使用者音訊。 Each of the reality photographing devices 20a, 20b, 20c, 20d, and 20e receives the corresponding control signal through the network system, so as to imitate the corresponding user's head command to rotate synchronously. When the user emits a sound to the second sound pickup unit 18, the second sound pickup unit 18 generates a user sound through the first processing unit, and transmits it to the reality camera 20a, 20b, 20c, 20d, 20e, causing the second processing unit to control the speaker unit 28 to play the user's audio, while at least one other reality around the reality photography device 20a (take the reality photography device 20a as an example) The first sound-receiving unit 24 of the camera devices 20b, 20c, 20d broadcasts the user's audio, and through the network system, the head-mounted remote reality corresponding to the at least one other reality camera device 20b, 20c, 20d The pair of earphones 14 of the devices 10b, 10c, 10d emit the user audio. In a preferred embodiment of the present invention, the first sound-receiving unit 24 of the reality photography devices 20c and 20d closest to the reality photography device 20a broadcasts the user's audio, and the head-mounted remote reality devices 10c and 10d The pair of earphones 14 of the pair of earphones 14 emit the loudest sound of the user; on the contrary, because the reality photography device 20e is the farthest from the reality photography device 20a, the first sound receiving unit 24 of the reality photography device 20e has poor sound reception, and the The pair of earphones 14 of the head-mounted remote reality device 10e emits the user audio at a minimum or does not emit the user audio.

在本發明一較佳實施例中,各該實境攝影裝置20a、20b、20c、20d、20e係個別設置於該活動場所S的一虛擬座位上,且該些實境攝影裝置20a、20b、20c、20d、20e係於該活動場所S中呈陣列排列。該些實境攝影裝置20a、20b、20c、20d、20e的排列狀態包括一第一行及 一第二行,該第一行相較於該第二行靠近該活動場所S的一活動中心,且該第二行的設置高度大於該第一行的設置高度。 In a preferred embodiment of the present invention, each of the reality photography devices 20a, 20b, 20c, 20d, 20e is individually installed on a virtual seat of the activity place S, and the reality photography devices 20a, 20b, 20c, 20d, and 20e are arranged in an array in the activity place S. The arrangement state of the real-life photographing devices 20a, 20b, 20c, 20d, and 20e includes a first row and A second row, the first row is closer to an activity center of the activity place S than the second row, and the setting height of the second row is greater than the setting height of the first row.

在本發明一較佳實施例中,當各該實境攝影裝置20a(以實境攝影裝置20a為例)受控制轉動至另一實境攝影裝置20b進入鏡頭視野內時,該第二處理單元辨識該另一實境攝影裝置20b對應的使用者,並透過該網路系統發送一辨識訊號至與該實境攝影裝置20a對應的該頭戴式遠端實境裝置10a,使該第一處理單元控制該顯示單元12顯示已移除該另一實境攝影裝置20b的該實況影像或顯示已融合該另一實境攝影裝置20b對應的使用者之預設臉部的該實況影像。 In a preferred embodiment of the present invention, when each of the reality photography devices 20a (take the reality photography device 20a as an example) is controlled to rotate until another reality photography device 20b enters the field of view of the lens, the second processing unit Identify the user corresponding to the other reality photography device 20b, and send an identification signal to the head-mounted remote reality device 10a corresponding to the reality photography device 20a through the network system, so that the first processing unit controls the The display unit 12 displays the live image from which the other reality photographing device 20b has been removed or displays the live image that has been fused with the preset face of the user corresponding to the other reality photographing device 20b.

在本發明一較佳實施例中,該實況活動包括演唱會、音樂會、運動賽事、產品發表會或記者會。 In a preferred embodiment of the present invention, the live event includes a concert, a concert, a sports event, a product presentation or a press conference.

藉由本發明實施例提供的遠端實境暨控制系統及多人遠端實境暨控制系統,可將狀態感測器感測該使用者的頭部指令,藉由網路系統遠端控制,使實境攝影裝置的可轉動座模仿使用者的頭部指令同步轉動。實境攝影裝置透過網路系統將實況影像及實況音訊傳送至頭戴式遠端實境裝置,使該顯示單元顯示實況影像,且控制對耳機發出實況音訊。多人遠端實境暨控制系統亦可使不同地區的使用者同時觀賞同一實況活動,且有逼真臨場感。 With the remote reality and control system and the multi-person remote reality and control system provided by the embodiment of the present invention, the state sensor can sense the user's head command, and the remote control can be performed through the network system. The rotatable base of the reality photography device is made to rotate synchronously by imitating the user's head command. The real-time photographing device transmits the live image and the live audio to the head-mounted remote reality device through the network system, so that the display unit displays the live image and controls the earphone to send out the live audio. The multi-person remote reality and control system can also enable users in different regions to watch the same live event at the same time, and have a realistic sense of presence.

以上所述僅為本發明較佳可行實施例而已,舉凡應用本發明說明書及申請專利範圍所為之等效變化,理應包含在本發明之專利範圍內。 The above descriptions are only preferred feasible embodiments of the present invention, and any equivalent changes made by applying the description of the present invention and the scope of the patent application should be included in the patent scope of the present invention.

10:頭戴式遠端實境裝置 10: Head-mounted remote reality device

20:實境攝影裝置 20: Reality Photography Installation

P:使用者 P: user

S:活動場所 S: place of activity

Claims (20)

一種遠端實境暨控制系統,包括:一頭戴式遠端實境裝置,用以供使用者配戴,且訊號連接於一網路系統;該頭戴式遠端實境裝置包括一顯示單元、一對耳機、一狀態感測器及一第一處理單元,其中該顯示單元、該對耳機及該狀態感測器訊號連接於該第一處理單元;該狀態感測器用於感測該使用者的頭部指令,且該狀態感測器經由該第一處理單元產生一控制訊號並透過該網路系統發送該控制訊號;一實境攝影裝置,設置於一活動場所中,該實境攝影裝置係用於轉播該活動場所正進行的一實況活動,且訊號連接於該網路系統及接收該控制訊號;該實境攝影裝置包括一攝像單元、一第一收音單元、一可轉動座及一第二處理單元,其中該攝像單元及該第一收音單元係設置於該可轉動座上,且該攝像單元、該第一收音單元及該可轉動座訊號連接於該第二處理單元,當該實境攝影裝置接收該控制訊號後,該第二處理單元控制該可轉動座模仿該使用者的頭部指令同步轉動,同時該攝像單元及該第一收音單元轉播該實況活動的一實況影像及一實況音訊,該實境攝影裝置透過該網路系統將該實況影像及該實況音訊傳送至該頭戴式遠端實境裝置,使該第一處理單元控制該顯示單元顯示該實況影像,且控制該對耳機發出該實況音訊,其中該實境攝影裝置的該可轉動座包括一轉動台、一支撐臂及一俯仰頭,該轉動台的底面設置於該活動場所的一虛擬座位上,且可受操控地相對於該虛擬座位左右轉動;該支撐臂係固設於該轉動台上,而該俯仰頭樞設於該支撐臂上,且可受操控地相對於該支撐臂上下樞擺。 A remote reality and control system, comprising: a head-mounted remote reality device for users to wear, and the signal is connected to a network system; the head-mounted remote reality device comprises a display unit, a pair of an earphone, a state sensor and a first processing unit, wherein the display unit, the pair of earphones and the state sensor signal are connected to the first processing unit; the state sensor is used for sensing the head of the user part instruction, and the state sensor generates a control signal through the first processing unit and sends the control signal through the network system; a reality photography device is installed in an activity place, and the reality photography device uses Rebroadcasting a live event being carried out at the event venue, and the signal is connected to the network system and receives the control signal; the reality photography device includes a camera unit, a first radio unit, a rotatable seat and a second A processing unit, wherein the camera unit and the first sound pickup unit are arranged on the rotatable base, and the camera unit, the first sound pickup unit and the rotatable base signal are connected to the second processing unit. After the photographing device receives the control signal, the second processing unit controls the rotatable seat to imitate the user's head command to rotate synchronously, while the camera unit and the first radio unit broadcast a live image and a live broadcast of the live event audio, the reality photography device transmits the live image and the live audio to the head-mounted remote reality device through the network system, so that the first processing unit controls the display unit to display the live image and controls the pair of headphones Send out the live audio, wherein the rotatable seat of the reality photography device includes a turntable, a support arm and a tilting head, and the bottom surface of the turntable is arranged on a virtual seat in the activity place, and can be controlled Rotate left and right relative to the virtual seat; the support arm is fastened on the turntable, and the tilt head is pivoted on the support arm, and can be controlled to pivot up and down relative to the support arm. 如請求項1所述之遠端實境暨控制系統,其中該頭部指令包括該使用者的頭部動作、該使用者的眼球轉動、該使用者的腦波訊號、該使用者的聲音指令、該使用者的舌部動作或其組合。 The remote reality and control system according to claim 1, wherein the head command includes the user's head movement, the user's eyeball movement, the user's brain wave signal, and the user's voice command , the user's tongue movements, or a combination thereof. 如請求項2所述之遠端實境暨控制系統,其中當使用者配戴該頭戴式遠端實境裝置做出包括左轉頭、右轉頭、抬頭、低頭或其組合的該頭部動作時,該狀態感測器感測該使用者的頭部動作且經由該第一處理單元產生該控制訊號,該實境攝影裝置透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台、該俯仰頭或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 The remote reality and control system as claimed in claim 2, wherein when the user wears the head-mounted remote reality device, the head action includes turning left, turning right, looking up, bowing or a combination thereof When the state sensor senses the head movement of the user and generates the control signal through the first processing unit, after the reality photography device receives the control signal through the network system, the second processing unit controls The turntable, the tilting head, or a combination thereof correspondingly perform the actions of turning left, turning right, pivoting up, pivoting down, or a combination thereof. 如請求項2所述之遠端實境暨控制系統,其中當使用者配戴該頭戴式遠端實境裝置做出包括眼球左轉、眼球右轉、眼球上轉、眼球下轉或其組合的該眼球轉動時,該狀態感測器感測該使用者的眼球轉動且經由該第一處理單元產生該控制訊號,該實境攝影裝置透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台、該俯仰頭或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 The remote reality and control system as claimed in claim 2, wherein when the user wears the head-mounted remote reality device, the user performs an operation including eyeball turning left, right eyeball, eyeball upturning, eyeball downturning or a combination thereof. When the eyeball rotates, the state sensor senses the user's eyeball movement and generates the control signal through the first processing unit. After the reality photography device receives the control signal through the network system, the second processing The unit controls the turntable, the tilting head, or a combination thereof to perform left rotation, right rotation, upper pivoting, lower pivoting, or a combination thereof correspondingly. 如請求項2所述之遠端實境暨控制系統,其中當使用者配戴該頭戴式遠端實境裝置發出包括左轉、右轉、上轉、下轉或其組合的該腦波訊號時,該狀態感測器感測該使用者的腦波訊號且經由該第一處理單元產生該控制訊號,該實境攝影裝置透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台、該俯仰頭或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 The remote reality and control system as claimed in claim 2, wherein when the user wears the head-mounted remote reality device to emit the brain wave signal including left turn, right turn, up turn, down turn or a combination thereof , the state sensor senses the brain wave signal of the user and generates the control signal through the first processing unit. After the reality photography device receives the control signal through the network system, the second processing unit controls the The turntable, the tilting head, or a combination thereof correspondingly perform the actions of turning left, turning right, pivoting up, pivoting down, or a combination thereof. 如請求項2所述之遠端實境暨控制系統,其中當使用者配戴該頭戴式遠端實境裝置發出包括左轉、右轉、上轉、下轉或其組合的該聲音指令時,該狀態感測器辨識該使用者的聲音指令且經由該第一處 理單元產生該控制訊號,該實境攝影裝置透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台、該俯仰頭或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 The remote reality and control system according to claim 2, wherein when the user wears the head-mounted remote reality device to issue the voice command including turn left, turn right, turn up, turn down or a combination thereof, The state sensor recognizes the user's voice command and passes through the first place The processing unit generates the control signal, and after the real-life photographing device receives the control signal through the network system, the second processing unit controls the turntable, the tilt head, or a combination thereof to rotate left, rotate right, and pivot up accordingly. The action of a swing, a lower pivot swing, or a combination thereof. 如請求項2所述之遠端實境暨控制系統,其中當使用者配戴該頭戴式遠端實境裝置做出包括舌部左擺、舌部右擺、舌部上擺、舌部下擺或其組合的該舌部動作時,該狀態感測器感測該使用者的舌部動作且經由該第一處理單元產生該控制訊號,該實境攝影裝置透過該網路系統接收該控制訊號後,該第二處理單元控制該轉動台、該俯仰頭或其組合對應做出左轉動、右轉動、上樞擺、下樞擺或其組合的動作。 The remote reality and control system according to claim 2, wherein when the user wears the head-mounted remote reality device, the movement includes a left swing of the tongue, a right swing of the tongue, an upper swing of the tongue, a downward swing of the tongue or When the combined tongue moves, the state sensor senses the user's tongue movement and generates the control signal through the first processing unit, and the reality photography device receives the control signal through the network system. , the second processing unit controls the turntable, the tilting head, or a combination thereof to perform left rotation, right rotation, upper pivot, lower pivot or a combination thereof. 如請求項1或7所述之遠端實境暨控制系統,其中該轉動台及該俯仰頭各自包括彼此連接的一驅動馬達及一齒輪組,該驅動馬達可受該第二處理單元控制而帶動該齒輪組作動,進而驅使該轉動台、該俯仰頭或其組合樞轉。 The remote reality and control system of claim 1 or 7, wherein the turntable and the tilting head each include a drive motor and a gear set connected to each other, and the drive motor can be controlled by the second processing unit to The gear set is driven to act, thereby driving the turntable, the pitching head or the combination thereof to pivot. 如請求項1或7所述之遠端實境暨控制系統,其中該轉動台以12點鐘方向為0度,該轉動台的左轉動及右轉動角度範圍為90度~-90度;該俯仰頭以水平方向為0度,該俯仰頭的上樞擺及下樞擺角度範圍為30度至-20度。 The remote reality and control system according to claim 1 or 7, wherein the turntable is 0 degrees at 12 o'clock, and the left rotation and right rotation angles of the turntable range from 90 degrees to -90 degrees; the The horizontal direction of the tilt head is 0 degree, and the range of the upper and lower pivot angles of the tilt head is 30 degrees to -20 degrees. 如請求項1或7所述之遠端實境暨控制系統,其中該攝像單元係設置於該俯仰頭上,當該轉動台、該俯仰頭或其組合動作時,該攝像單元的鏡頭視野同步位移,使該頭戴式遠端實境裝置的該顯示單元顯示畫面同步位移的該實況影像。 The remote reality and control system according to claim 1 or 7, wherein the camera unit is arranged on the tilt head, and when the turntable, the tilt head or a combination thereof moves, the lens field of view of the camera unit is displaced synchronously , causing the display unit of the head-mounted remote reality device to display the live image with the synchronous displacement of the screen. 如請求項10所述之遠端實境暨控制系統,其中該攝像單元包括一廣角鏡頭組及一望遠鏡頭組,且該頭戴式遠端實境裝置包括一切換開關,當該使用者操作該切換開關時,該頭戴式遠端實境裝置經由 該網路系統發出一控制訊號至該實境攝影裝置的該攝像單元,並經由該第二處理單元控制該攝像單元使用該廣角鏡頭組或該望遠鏡頭組。 The remote reality and control system of claim 10, wherein the camera unit includes a wide-angle lens group and a telephoto lens group, and the head-mounted remote reality device includes a switch, when the user operates the switch , the head-mounted remote reality device via The network system sends a control signal to the camera unit of the reality photography device, and controls the camera unit to use the wide-angle lens group or the telephoto lens group through the second processing unit. 如請求項11所述之遠端實境暨控制系統,其中當該攝像單元使用該廣角鏡頭組時,該顯示單元顯示廣角的該實況影像;當該攝像單元使用該望遠鏡頭組時,該切換開關可受操控地遙控該望遠鏡頭組的焦距,以調整該顯示單元顯示的該實況影像的一放大比例。 The remote reality and control system according to claim 11, wherein when the camera unit uses the wide-angle lens group, the display unit displays the wide-angle live image; when the camera unit uses the telephoto lens group, the switch The focal length of the telescopic head group can be controlled and controlled remotely to adjust a magnification ratio of the live image displayed by the display unit. 如請求項1所述之遠端實境暨控制系統,其中該第一收音單元係設置於該支撐臂上;該第一收音單元包括一指向性麥克風。 The remote reality and control system according to claim 1, wherein the first sound pickup unit is disposed on the support arm; the first sound pickup unit includes a directional microphone. 一種遠端實境暨控制系統,包括:一頭戴式遠端實境裝置,用以供使用者配戴,且訊號連接於一網路系統;該頭戴式遠端實境裝置包括一顯示單元、一對耳機、一狀態感測器及一第一處理單元,其中該顯示單元、該對耳機及該狀態感測器訊號連接於該第一處理單元;該狀態感測器用於感測該使用者的頭部指令,且該狀態感測器經由該第一處理單元產生一控制訊號並透過該網路系統發送該控制訊號;一實境攝影裝置,設置於一活動場所中,該實境攝影裝置係用於轉播該活動場所正進行的一實況活動,且訊號連接於該網路系統及接收該控制訊號;該實境攝影裝置包括一攝像單元、一第一收音單元、一可轉動座及一第二處理單元,其中該攝像單元及該第一收音單元係設置於該可轉動座上,且該攝像單元、該第一收音單元及該可轉動座訊號連接於該第二處理單元,當該實境攝影裝置接收該控制訊號後,該第二處理單元控制該可轉動座模仿該使用者的頭部指令同步轉動,同時該攝像單元及該第一收音單元轉播該實況活動的一實況影像及一實況音訊,該實境攝影裝置透過該網路系統將該實況影像及該實況音訊傳送至該頭戴式遠 端實境裝置,使該第一處理單元控制該顯示單元顯示該實況影像,且控制該對耳機發出該實況音訊,其中該頭戴式遠端實境裝置包括一第二收音單元訊號連接於該第一處理單元,且該實境攝影裝置包括一揚聲單元訊號連接於該第二處理單元,當該使用者對該第二收音單元發出聲音時,該第二收音單元經由該第一處理單元產生一使用者音訊,並透過該網路系統傳送至該實境攝影裝置,使該第二處理單元控制該揚聲單元播放該使用者音訊。 A remote reality and control system, comprising: a head-mounted remote reality device for users to wear, and the signal is connected to a network system; the head-mounted remote reality device comprises a display unit, a pair of an earphone, a state sensor and a first processing unit, wherein the display unit, the pair of earphones and the state sensor signal are connected to the first processing unit; the state sensor is used for sensing the head of the user part instruction, and the state sensor generates a control signal through the first processing unit and sends the control signal through the network system; a reality photography device is installed in an activity place, and the reality photography device uses Rebroadcasting a live event being carried out at the event venue, and the signal is connected to the network system and receives the control signal; the reality photography device includes a camera unit, a first radio unit, a rotatable seat and a second A processing unit, wherein the camera unit and the first sound pickup unit are arranged on the rotatable base, and the camera unit, the first sound pickup unit and the rotatable base signal are connected to the second processing unit. After the photographing device receives the control signal, the second processing unit controls the rotatable seat to imitate the user's head command to rotate synchronously, while the camera unit and the first radio unit broadcast a live image and a live broadcast of the live event audio, the reality camera transmits the live image and the live audio to the head-mounted remote through the network system an end reality device, the first processing unit controls the display unit to display the live image, and controls the pair of earphones to send out the live audio, wherein the head-mounted remote reality device includes a second radio unit signal connected to the first a processing unit, and the reality photography device includes a speaker unit signal connected to the second processing unit, when the user emits a sound to the second sound pickup unit, the second sound pickup unit generates a sound through the first processing unit The user audio is transmitted to the real-world photography device through the network system, so that the second processing unit controls the speaker unit to play the user audio. 一種多人遠端實境暨控制系統,包括:複數個如請求項1所述的頭戴式遠端實境裝置,各該頭戴式遠端實境裝置係個別由對應的使用者配戴;各該頭戴式遠端實境裝置包括一第二收音單元訊號連接於該第一處理單元;複數個如請求項1所述的實境攝影裝置,設置於相同的該活動場所中;該實境攝影裝置包括一揚聲單元訊號連接於該第二處理單元;其中,各該頭戴式遠端實境裝置感測所對應的該使用者的頭部指令,且透過該網路系統發送該控制訊號至所對應的該實境攝影裝置;各該實境攝影裝置透過該網路系統接收對應的該控制訊號,以模仿對應的該使用者的頭部指令同步轉動;當該使用者對該第二收音單元發出聲音時,該第二收音單元經由該第一處理單元產生一使用者音訊,並透過該網路系統傳送至該實境攝影裝置,使該第二處理單元控制該揚聲單元播放該使用者音訊,同時位於該實境攝影裝置周圍的其他該至少一實境攝影裝置的該第一收音單元轉播該使用者音訊,並且透過該網路系統,使對應於其他該至少一實境攝影裝置的該頭戴式遠端實境裝置的該對耳機發出該使用者音訊。 A multi-person remote reality and control system, comprising: a plurality of head-mounted remote reality devices as described in claim 1, each of the head-mounted remote reality devices is individually worn by a corresponding user; The wearable remote reality device includes a second radio unit signally connected to the first processing unit; a plurality of reality photography devices as described in claim 1 are arranged in the same activity place; the reality photography device includes a The speaker unit signal is connected to the second processing unit; wherein, each of the head-mounted remote reality devices senses the corresponding head command of the user, and sends the control signal to the corresponding user through the network system Reality photography device; each of the reality photography devices receives the corresponding control signal through the network system to imitate the corresponding user's head command to rotate synchronously; when the user emits a sound to the second radio unit , the second sound-receiving unit generates a user audio through the first processing unit, and transmits it to the reality photography device through the network system, so that the second processing unit controls the speaker unit to play the user audio, and at the same time The first sound-receiving unit of the other at least one reality photography device located around the reality photography device rebroadcasts the user's audio, and through the network system, the head-mounted remote corresponding to the other at least one reality photography device is transmitted. The pair of earphones of the end reality device emits the user audio. 如請求項15所述之多人遠端實境暨控制系統,其中配戴該些頭戴式遠端實境裝置的該些使用者係各自位於不同使用地點。 The multi-person remote reality and control system as claimed in claim 15, wherein the users wearing the head-mounted remote reality devices are located at different places of use. 如請求項15所述之多人遠端實境暨控制系統,其中各該實境攝影裝置係個別設置於該活動場所的一虛擬座位上,且該些實境攝影裝置係於該活動場所中呈陣列排列。 The multi-person remote reality and control system as claimed in claim 15, wherein each of the reality photography devices is individually installed on a virtual seat in the event venue, and the reality photography devices are located in the event venue arranged in an array. 如請求項17所述之多人遠端實境暨控制系統,其中該些實境攝影裝置的排列狀態包括一第一行及一第二行,該第一行相較於該第二行靠近該活動場所的一活動中心,且該第二行的設置高度大於該第一行的設置高度。 The multi-person remote reality and control system as claimed in claim 17, wherein the arrangement state of the reality photography devices includes a first row and a second row, the first row is closer than the second row An activity center of the activity place, and the setting height of the second row is greater than the setting height of the first row. 如請求項15所述之多人遠端實境暨控制系統,其中當各該實境攝影裝置受控制轉動至另一實境攝影裝置進入鏡頭視野內時,該第二處理單元辨識該另一實境攝影裝置對應的使用者,並透過該網路系統發送一辨識訊號至與該實境攝影裝置對應的該頭戴式遠端實境裝置,使該第一處理單元控制該顯示單元顯示已移除該另一實境攝影裝置的該實況影像或顯示已融合該另一實境攝影裝置對應的使用者之預設臉部的該實況影像。 The multi-person remote reality and control system as claimed in claim 15, wherein when each of the reality photography devices is controlled to rotate until another reality photography device enters the field of view of the lens, the second processing unit identifies the other reality photography device The user corresponding to the reality photography device sends an identification signal to the head-mounted remote reality device corresponding to the reality photography device through the network system, so that the first processing unit controls the display unit to display the removed The live image of the other reality photography device may display the live image that has been fused with the preset face of the user corresponding to the other reality photography device. 如請求項15所述之多人遠端實境暨控制系統,其中該實況活動包括演唱會、音樂會、運動賽事、產品發表會或記者會。 The multi-person remote reality and control system of claim 15, wherein the live event includes a concert, a concert, a sports event, a product presentation or a press conference.
TW109133888A 2020-09-29 2020-09-29 Remote reality and control system and multi-person remote reality and control system TWI774076B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW109133888A TWI774076B (en) 2020-09-29 2020-09-29 Remote reality and control system and multi-person remote reality and control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109133888A TWI774076B (en) 2020-09-29 2020-09-29 Remote reality and control system and multi-person remote reality and control system

Publications (2)

Publication Number Publication Date
TW202213975A TW202213975A (en) 2022-04-01
TWI774076B true TWI774076B (en) 2022-08-11

Family

ID=82197146

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109133888A TWI774076B (en) 2020-09-29 2020-09-29 Remote reality and control system and multi-person remote reality and control system

Country Status (1)

Country Link
TW (1) TWI774076B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108769531A (en) * 2018-06-21 2018-11-06 深圳市道通智能航空技术有限公司 Control method, control device and the wearable device of the shooting angle of filming apparatus
CN109068062A (en) * 2013-06-07 2018-12-21 株式会社Dap实现 Long-range instant video sends system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109068062A (en) * 2013-06-07 2018-12-21 株式会社Dap实现 Long-range instant video sends system
CN108769531A (en) * 2018-06-21 2018-11-06 深圳市道通智能航空技术有限公司 Control method, control device and the wearable device of the shooting angle of filming apparatus

Also Published As

Publication number Publication date
TW202213975A (en) 2022-04-01

Similar Documents

Publication Publication Date Title
US20130176403A1 (en) Heads up display (HUD) sensor system
US7154526B2 (en) Telepresence system and method for video teleconferencing
WO2017159063A1 (en) Display device and information processing terminal device
JP2020156109A (en) Information processor, information processing method, program, and information processing system
US11006072B2 (en) Window system based on video communication
US10623698B2 (en) Video communication device and method for video communication
US20220109822A1 (en) Multi-sensor camera systems, devices, and methods for providing image pan, tilt, and zoom functionality
US20220407902A1 (en) Method And Apparatus For Real-time Data Communication in Full-Presence Immersive Platforms
US20150156481A1 (en) Heads up display (hud) sensor system
JP2016015683A (en) Image generator and image generating method
CN204681518U (en) A kind of panorama image information collecting device
TWI698128B (en) Video communication device and method for connecting video communivation to other device
TWI710247B (en) Video communication device and method for connecting video communication to other device
US20230231970A1 (en) Device for displaying images, and use of a device of this type
TWI774076B (en) Remote reality and control system and multi-person remote reality and control system
TWI750830B (en) Remote reality and control system and multi-person remote reality and control system
TWM606880U (en) Remote reality and control system and multi-user remote reality and control system
US10701313B2 (en) Video communication device and method for video communication
JP6548802B1 (en) A video distribution system that delivers live video including animation of character objects generated based on the movement of actors
JP4148252B2 (en) Image processing apparatus, image processing method, and program
WO2023248832A1 (en) Remote viewing system and on-site imaging system
US11652653B1 (en) Conferencing between remote participants
WO2022220306A1 (en) Video display system, information processing device, information processing method, and program
WO2022220707A1 (en) Virtual teleport room
WO2023113603A1 (en) Autostereoscopic display device presenting 3d-view and 3d-sound