TWI750830B - Remote reality and control system and multi-person remote reality and control system - Google Patents

Abstract

A remote reality and control system includes a chair-shaped remote reality device and a reality photography device, the chair-shaped remote reality device and the reality photography device are connected to a network system for signals; the chair-shaped remote reality device has a display Unit, earphone and controller signal; the controller is used to control the rotation action, tilt action or combination of the chair-type remote reality device, and the rotatable seat of the reality camera device imitates the motion synchronization of the chair-type remote reality device Rotation; the real-life photography device broadcasts the live activities going on at the venue; the real-life photography device transmits the live image and live audio to the chair-type remote reality device through the network system, so that the display unit displays the live image and controls the first A speaker unit emits live audio. A multi-person remote reality and control system is also provided here. In this way, users in different regions can watch the same live event at the same time, and have a realistic sense of presence.

Description

Remote reality and control system and multi-person remote reality and control system

The invention relates to a remote reality system; in particular, it refers to a multi-person remote reality and control system capable of live broadcasting.

With the development of globalization, exchanges around the world are becoming more and more active. For example, sports events, concerts, concerts, product launches and press conferences are quite common exchange activities in today's society.

Due to frequent exchanges around the world, the spread of various diseases has gradually become rampant, posing a great threat to the lives and properties of people all over the world. However, in order to avoid the spread of infectious diseases, it will cause great harm to the development of human civilization if the cultural activities and exchanges between peoples of different countries are prohibited or rejected.

In order to take into account the above-mentioned cultural exchanges and prevent the spread of infectious diseases, relevant event operators have launched services for watching online concerts, online concerts, and online sports events, so that viewers can use electronic devices to watch the above live broadcasts at any location.

However, when using an electronic device to watch the above-mentioned live broadcast, it often happens that the picture presented by the live camera lens is not at the angle or position that the viewer wants to watch, and even the close-up shot that the viewer expects is not clear due to insufficient lens magnification. .

It can be seen from this that the traditional live broadcast service can no longer meet the viewing needs of viewers. Therefore, a novel remote reality and control system and a multi-person remote reality and control system are urgently needed. Adjusted live broadcast service.

In view of this, the purpose of the present invention is to provide a remote reality and control system and a multi-person remote reality and control system, which can control the rotation, tilt, or the like of the chair-type remote reality device by a controller. In combination, through the remote control of the network system, the rotatable seat of the reality photography device can be rotated synchronously by imitating the action of the chair-type remote reality device. The real-time photography device transmits the live image and the live audio to the chair-type remote reality device through the network system, so that the display unit displays the live image, and controls the first speaker unit to send out the live audio. In this way, users in different regions can watch the same live event at the same time, and have a realistic sense of presence.

In order to achieve the above object, the present invention provides a remote reality and control system, including a chair-type remote reality device and a reality photography device; the chair-type remote reality device is used for the user to ride, and the signal is connected to a network system; the chair-type remote reality device includes a display unit, a first speaker unit, a controller and a first processing unit, wherein the display unit, the first speaker unit and the controller signal is connected to the first processing unit; the controller is used to control the rotation, tilt or combination of the chair-type remote reality device, and the controller generates a control signal through the first processing unit and send the control signal through the network system; the reality photography device is set in an event venue, the reality photography device is used for rebroadcasting a live event being carried out in the event venue, and the signal is connected to the network system and receiving the control signal; the reality photography device includes a camera unit, a first sound-receiving unit, a rotatable base and a second processing unit, wherein the camera unit and the first sound-receiving unit are arranged on the rotatable base on the camera unit, the first sound-receiving unit and the rotatable base signal are connected to the second processing unit, when the reality photography device receives the control signal, the second processing unit controls the rotatable base to imitate the The action of the chair-type remote reality device rotates synchronously, and at the same time, the camera unit and the first radio unit broadcast a live image and a live audio of the live event, the reality camera device uses the network system to broadcast the live image and the live audio. The live audio is transmitted to the chair-type remote reality device, so that the first processing unit controls the display unit to display the live image, and controls the first speaker unit to emit the live audio.

Another object of the present invention is to provide a multi-person remote reality and control system comprising a plurality of chair-shaped remote reality devices and a plurality of the above-mentioned reality photography devices; each of the chair-shaped remote devices The reality devices are individually ridden by the corresponding users; each of the chair-type remote reality devices includes a second sound-receiving unit signal connected to the first processing unit; the reality photography devices are installed in the same activity place ; The reality photography device includes a second speaker unit signal connected to the second processing unit; wherein, each of the chair-shaped remote reality devices performs a rotation action, a tilting action or a combination thereof of the chair-shaped remote reality device , and send the control signal to the corresponding reality photography device through the network system; each of the reality photography devices receives the corresponding control signal through the network system to simulate the corresponding chair-shaped remote reality The action of the device rotates synchronously; when the user emits a sound to the second sound pickup unit, the second sound pickup unit generates a user audio through the first processing unit, and transmits it to the reality photography device through the network system , causing the second processing unit to control the second speaker unit to play the user's audio, while the first audio-receiving unit of the other at least one reality-photographic device located around the reality-photographic device broadcasts the user's audio, and Through the network system, the first speaker unit of the chair-type remote reality device corresponding to the other at least one reality camera device is made to emit the user audio.

The effect of the present invention is that the remote reality and control system and the multi-person remote reality and control system can control the rotation, tilt or combination of the chair-type remote reality device by the controller through the network The remote control of the system enables the rotatable seat of the reality photography device to rotate synchronously by imitating the action of the chair-type remote reality device. The real-time photography device transmits the live image and the live audio to the chair-type remote reality device through the network system, so that the display unit displays the live image, and controls the first speaker unit to send out the live audio. The multi-person remote reality and control system can also enable users in different regions to watch the same live event at the same time, and have a realistic sense of presence.

In order to describe the present invention more clearly, preferred embodiments are given and described in detail with the drawings as follows. Please refer to FIG. 1 , which is a schematic diagram of a remote reality and control system according to a preferred embodiment of the present invention. The remote reality and control system includes a chair-type remote reality device 10 and a reality camera device 20 .

Please refer to FIG. 1 and FIG. 2 together, the chair-shaped remote reality device 10 is used for the user P to ride, and the chair-shaped remote reality device 10 is connected to a network system for signals.

The chair-type remote reality device 10 includes a display unit 12 , a first speaker unit 14 , a controller 16 and a first processing unit (not shown), wherein the display unit 12 , the first speaker The acoustic unit 14 and the controller 16 are signal-connected to the first processing unit. The controller 16 is used to control the rotation, tilt or combination of the chair-type remote reality device 10, and the controller 16 generates a control signal through the first processing unit and sends the control through the network system signal. In a preferred embodiment of the present invention, the controller 16 includes a three-axis controller or a combination thereof, but is not limited thereto.

Please refer to FIG. 1 , FIG. 2 and FIG. 3 , the real-life photographing device 20 is installed in an activity place S, and the real-life photographing device 20 is used for rebroadcasting a live event being carried out in the activity place S, and the signal is connected to in the network system and receive the control signal.

The reality photography device 20 includes a camera unit 22 , a first sound pickup unit 24 , a rotatable base 26 and a second processing unit (not shown), wherein the camera unit 22 and the first sound pickup unit 24 are It is arranged on the rotatable base 26, and the camera unit 22, the first sound-receiving unit 24 and the rotatable base 26 are signal-connected to the second processing unit. In a preferred embodiment of the present invention, the rotatable base 26 of the reality photography device 20 includes a turntable 262 , a support arm 264 and a tilt head 266 , and the bottom surface of the turntable 262 is disposed in the activity place S The support arm 264 is fixed on the turntable 262, and the tilt head 266 is pivoted on the support arm 264 and can be supported by Manipulatively pivots up and down relative to the support arm 264 .

After the reality camera 20 receives the control signal, the second processing unit controls the rotatable base 26 to imitate the rotation and/or tilt of the chair-type remote reality device 10 to rotate synchronously, while the camera unit 22 rotates synchronously. and the first radio unit 24 relays a live image and a live audio of the live event, and the live camera device 20 transmits the live image and the live audio to the chair-type remote reality device 10 through the network system , so that the first processing unit controls the display unit 12 to display the live image, and controls the first speaker unit 14 to emit the live audio. As shown in FIG. 3 , the first sound pickup unit 24 is disposed on the support arm; the first sound pickup unit 24 includes a directional microphone.

To be more specific, when the user P rides the chair-shaped remote reality device 10, he performs actions including turning left or right as shown in the direction D1 in FIG. , the controller 16 generates the control signal through the first processing unit, and after the reality camera 20 receives the control signal through the network system, the second processing unit controls the turntable 262 to correspondingly perform as shown in FIG. 3 For the left rotation or right rotation shown in the direction D3, the tilt head 266 correspondingly makes an upper pivot or a lower pivot as shown in the direction D4 in FIG. 3 .

In a preferred embodiment of the present invention, the turntable 262 and the tilting head 266 each include a drive motor (not shown) and a gear set (not shown) connected to each other, and the drive motor can be driven by the The second processing unit controls and drives the gear set to act, thereby driving the turntable, the pitching head, or a combination thereof to pivot. In a preferred embodiment of the present invention, the 12 o'clock direction of the turntable 262 is 0 degrees, the left and right rotation angles of the turntable are in the range of 90 degrees to -90 degrees; the tilting head 266 is horizontally oriented at 0 degrees, the upper and lower pivot angles of the tilt head range from 30 degrees to -20 degrees.

The camera unit 22 is disposed on the tilt head 266 . When the turntable 262 , the tilt head 266 or their combination moves, the lens field of view of the camera unit 22 is displaced synchronously, so that the chair-type remote reality device 10 is The display unit 12 displays the live image with the synchronous displacement of the screen. In a preferred embodiment of the present invention, the camera unit 22 includes a wide-angle lens group (not shown) and a telephoto lens group (not shown), and the chair-type remote reality device 10 includes a switch (not shown), when the user P operates the switch, the chair-type remote reality device 10 sends a control signal to the camera unit 22 of the reality camera 20 via the network system, and The camera unit 22 is controlled to use the wide-angle lens group or the telephoto lens group via the second processing unit. In a preferred embodiment of the present invention, when the camera unit 22 uses the wide-angle lens group, the display unit 12 displays the wide-angle live image; when the camera unit 22 uses the telephoto lens group, the switch can be manipulated The focal length of the telephoto lens group is remotely controlled to adjust a magnification ratio of the live image displayed by the display unit 12 .

The chair-type remote reality device 10 includes a second radio unit 18 connected to the first processing unit, and the reality camera 20 includes a second speaker unit 28 connected to the second processing unit. When the user P emits a sound to the second sound pickup unit 18, the second sound pickup unit 18 generates a user sound through the first processing unit, and transmits it to the reality photography device 20 through the network system, so that the The second processing unit controls the second speaker unit 28 to play the user audio.

Next, please refer to FIG. 4 , which is a schematic diagram of a multi-person remote reality and control system according to a preferred embodiment of the present invention. The multi-person remote reality and control system includes a plurality of chair-type remote reality devices 10a, 10b, 10c, 10d, 10e and a plurality of the above-mentioned reality photography devices 20a, 20b, 20c, 20d , 20e. In the embodiment of the present invention, the users who ride on the chair-type remote reality devices 10a, 10b, 10c, 10d, and 10e are located at different places of use.

Each of the chair-shaped remote reality devices 10a, 10b, 10c, 10d, and 10e is ridden by a corresponding user; each of the chair-shaped remote reality devices 10a, 10b, 10c, 10d, and 10e includes a second radio The unit signal 18 is connected to the first processing unit. The reality photography devices 20a, 20b, 20c, 20d, and 20e are installed in the same activity place S; the reality photography devices 20a, 20b, 20c, 20d, and 20e include a second speaker unit 28 for signal connection the second processing unit. Wherein, each of the chair-type remote reality devices 10a, 10b, 10c, 10d, and 10e performs a rotation action, a tilt action, or a combination thereof, and sends the control signal to the corresponding reality camera device 20a through the network system , 20b, 20c, 20d, 20e.

Each of the reality photography devices 20a, 20b, 20c, 20d, and 20e receives the corresponding control signal through the network system, so as to imitate the actions of the corresponding chair-type remote reality devices 10a, 10b, 10c, 10d, and 10e Synchronized rotation. When the user emits a sound to the second sound pickup unit 18, the second sound pickup unit 18 generates a user sound through the first processing unit, and transmits it to the reality camera 20a, 20b, 20c, 20d, and 20e, causing the second processing unit to control the second speaker unit 28 to play the user's audio, and at the same time the at least one other surrounding the reality photography device 20a (take the reality photography device 20a as an example) The first sound-receiving unit 24 of the reality photography devices 20b, 20c, 20d broadcasts the user's audio, and through the network system, the chair-shaped remote corresponding to the at least one other reality photography device 20b, 20c, 20d The first speaker unit 14 of the end-reality devices 10b, 10c, and 10d emits the user audio. In a preferred embodiment of the present invention, the first audio unit 24 of the reality photography devices 20c, 20d closest to the reality photography device 20a broadcasts the user's audio, and the chair-shaped remote reality devices 10c, 20d The first speaker unit 14 of 10d emits the loudest voice of the user; on the contrary, since the reality photography device 20e is farthest from the reality photography device 20a, the first sound receiving unit 24 of the reality photography device 20e does not receive sound. Preferably, the first speaker unit 14 of the chair-type remote reality device 10e emits the user's audio with minimal sound or does not emit the user's audio.

In a preferred embodiment of the present invention, each of the reality photography devices 20a, 20b, 20c, 20d, 20e is individually installed on a virtual seat of the activity place S, and the reality photography devices 20a, 20b, 20c, 20d, and 20e are arranged in an array in the activity place S. The arrangement state of the real-life photographing devices 20a, 20b, 20c, 20d, and 20e includes a first row and a second row, and the first row is closer to an activity center of the activity place S than the second row. And the setting height of the second row is greater than the setting height of the first row.

In a preferred embodiment of the present invention, when each of the reality photography devices 20a (take the reality photography device 20a as an example) is controlled to rotate until another reality photography device 20b enters the field of view of the lens, the second processing unit Identify the user corresponding to the other reality photography device 20b, and send an identification signal to the chair-type remote reality device 10a corresponding to the reality photography device 20a through the network system, so that the first processing unit The display unit 12 is controlled to display the live image from which the other reality photographing device 20b has been removed or display the live image that has been fused with the preset face of the user corresponding to the other reality photographing device 20b.

In a preferred embodiment of the present invention, the live event includes a concert, a concert, a sports event, a product presentation or a press conference.

With the remote reality and control system and the multi-person remote reality and control system provided by the embodiments of the present invention, the controller can control the rotation, tilt, or combination of the chair-type remote reality device. The remote control of the network system enables the rotatable seat of the reality photography device to rotate synchronously by imitating the action of the chair-type remote reality device. The real-time photography device transmits the live image and the live audio to the chair-type remote reality device through the network system, so that the display unit displays the live image, and controls the first speaker unit to send out the live audio. The multi-person remote reality and control system can also enable users in different regions to watch the same live event at the same time, and have a realistic sense of presence.

The above descriptions are only preferred feasible embodiments of the present invention, and any equivalent changes made by applying the description of the present invention and the scope of the patent application should be included in the patent scope of the present invention.

[this invention] 10, 10a, 10b, 10c, 10d, 10e: Chair-Type Remote Reality Device 12: Display unit 14: Headphones 16: Controller 18: Second radio unit 20, 20a, 20b, 20c, 20d, 20e: Photorealistic installations 22: Camera unit 24: The first radio unit 26: rotatable seat 262: Turntable 264: Support Arm 266: tilt head 28: Second speaker unit D1, D2, D3, D4: direction P: user S: place of activity

FIG. 1 is a schematic diagram of a remote reality and control system according to a preferred embodiment of the present invention. 2 is a schematic diagram of a chair-type remote reality device according to a preferred embodiment of the present invention FIG. 3 is a schematic diagram of a real-life photographing device according to a preferred embodiment of the present invention. FIG. 4 is a schematic diagram of a multi-person remote reality and control system according to a preferred embodiment of the present invention.

10: Chair-type remote reality device

20: Reality Photography Installation

P: user

S: place of activity

Claims (13)

A remote reality and control system, comprising: a chair-shaped remote reality device for a user to ride on, and the signal is connected to a network system; the chair-shaped remote reality device comprises a display unit, a a first speaker unit, a controller and a first processing unit, wherein the display unit, the first speaker unit and the controller signal are connected to the first processing unit; the controller is used to control the chair-type remote A rotation action, a tilt action or a combination thereof of the reality device, and the controller generates a control signal through the first processing unit and sends the control signal through the network system; a reality photography device is installed in an activity place , the reality photography device is used for rebroadcasting a live event being carried out in the activity place, and the signal is connected to the network system and receives the control signal; the reality photography device includes a camera unit, a first radio unit, A rotatable base and a second processing unit, wherein the camera unit and the first radio unit are arranged on the rotatable base, and the camera unit, the first radio unit and the rotatable base are signal-connected to the first Two processing units, when the reality photography device receives the control signal, the second processing unit controls the rotatable seat to rotate synchronously by imitating the action of the chair-shaped remote reality device, when the user sits on the chair-shaped remote reality device When the environment device performs an action including turning left, turning right, tilting upward, tilting top view or a combination thereof, the controller generates the control signal through the first processing unit, and the reality photography device receives the control signal through the network system After controlling the signal, the second processing unit controls the rotatable base to rotate left, rotate right, pivot up, pivot down or a combination thereof; at the same time, the camera unit and the first radio unit broadcast the live event a live image and a live audio, the live camera device transmits the live image and the live audio to the chair-type remote reality device through the network system, so that the first processing unit controls the display unit to display the live image, and control the first speaker unit to send out the live audio. The remote reality and control system according to claim 1, wherein the rotatable base of the reality photography device comprises a turntable, a support arm and a tilting head, and the bottom surface of the turntable is arranged on the bottom of the activity place. on a virtual seat, and can be controlled to rotate left and right relative to the virtual seat; the support arm is fastened to the turntable, and the tilt head is pivoted on the support arm and can be controlled relative to the support arm The support arm pivots up and down. The remote reality and control system of claim 1 or 2, wherein the turntable and the tilt head each include a drive motor and a gear set connected to each other, and the drive motor can be controlled by the second processing unit to The gear set is driven to act, thereby driving the turntable, the pitching head or the combination thereof to pivot. The remote reality and control system according to claim 1 or 2, wherein the 12 o'clock direction of the turntable is 0 degrees, and the left and right turn angles of the turntable range from 90 degrees to -90 degrees; the The horizontal direction of the tilt head is 0 degree, and the range of the upper and lower pivot angles of the tilt head is 30 degrees to -20 degrees. The remote reality and control system as claimed in claim 1 or 2, wherein the camera unit is arranged on the tilt head, and when the turntable, the tilt head or a combination thereof moves, the lens field of view of the camera unit is displaced synchronously , causing the display unit of the chair-type remote reality device to display the live image with the synchronous displacement of the screen. The remote reality and control system according to claim 5, wherein the camera unit includes a wide-angle lens group and a telephoto lens group, and the chair-type remote reality device includes a switch, when the user operates the switch When switching on and off, the chair-type remote reality device sends a control signal to the camera unit of the reality photography device via the network system, and controls the camera unit to use the wide-angle lens group or the telephoto lens via the second processing unit Group. The remote reality and control system as claimed in claim 6, wherein when the camera unit uses the wide-angle lens set, the display unit displays the wide-angle live image; When the unit uses the telescopic head group, the switch can be controlled to remotely control the focal length of the telescopic head group, so as to adjust a magnification ratio of the live image displayed by the display unit. The remote reality and control system according to claim 2, wherein the first sound pickup unit is disposed on the support arm; the first sound pickup unit includes a directional microphone. The remote reality and control system as claimed in claim 1, wherein the chair-shaped remote reality device includes a second radio unit signal-connected to the first processing unit, and the reality camera device includes a second speaker The sound unit signal is connected to the second processing unit. When the user emits a sound to the second sound pickup unit, the second sound pickup unit generates a user audio signal through the first processing unit, and transmits it to the network system through the network system. In the real-life photography device, the second processing unit controls the second speaker unit to play the user audio. A multi-person remote reality and control system, comprising: a plurality of chair-shaped remote reality devices as described in claim 1, each of the chair-shaped remote reality devices is individually ridden by a corresponding user; The chair-type remote reality device includes a second radio unit signal-connected to the first processing unit; a plurality of reality photography devices as described in claim 1 are installed in the same activity place; the reality photography device Including a second speaker unit signal connected to the second processing unit; wherein, each of the chair-shaped remote reality devices performs a rotating action, a tilting action or a combination thereof, and sends the control signal to the corresponding through the network system the reality photography device; each of the reality photography devices receives the corresponding control signal through the network system to imitate the action of the corresponding chair-type remote reality device and rotates synchronously; when the user responds to the second When the sound pickup unit emits sound, the second sound pickup unit generates a user audio through the first processing unit, and transmits it to the reality photography device through the network system, so that the second processing unit controls the second speaker unit Playing the user audio, and at the same time broadcasting the user audio by the first sound-receiving unit of the at least one other reality imaging device around the reality imaging device, and through the network system system, so that the first speaker unit of the chair-type remote reality device corresponding to the other at least one reality photography device emits the user audio; when each of the reality photography devices is controlled to rotate to another reality When the photographing device enters the field of view of the lens, the second processing unit identifies the user corresponding to the other reality photography device, and sends an identification signal to the chair-shaped remote end corresponding to the reality photography device through the network system A real-life device, enabling the first processing unit to control the display unit to display the live image from which the other real-life photographing device has been removed or to display the image that has been merged with the preset face of the user corresponding to the other real-life photographing device The live video. The multi-person remote reality and control system as claimed in claim 10, wherein each of the reality photography devices is individually installed on a virtual seat in the activity place, and the reality photography devices are located in the activity place arranged in an array. The multi-person remote reality and control system as claimed in claim 11, wherein the arrangement state of the reality photography devices includes a first row and a second row, the first row is closer than the second row An activity center of the activity place, and the setting height of the second row is greater than the setting height of the first row. The multi-person remote reality and control system as claimed in claim 10, wherein the live event includes a concert, a concert, a sports event, a product presentation or a press conference.

Images