TWM605560U - Analog panoramic system - Google Patents

Abstract

An analog panoramic system of the present invention includes at least one panoramic camera device, a cloud server, and at least one portable electronic device. The portable electronic device includes at least one application, at least one sensor and a display screen. The panoramic camera device is used to shoot a physical environment to obtain a panoramic image, and the cloud server is used to receive the panoramic image. The application includes an augmented reality unit. The augmented reality unit generates a panoramic simulation space based on the panoramic image, and the augmented reality unit generates a virtual camera device in the panoramic simulation space, and the virtual camera device captures the panoramic simulation space To produce a photographed image. When the sensor detects the movement or rotation of the portable electronic device, the virtual camera device moves or rotates correspondingly in the panoramic simulation space, and the display screen is used to display the photographed image.

Description

Analog panoramic system

The present invention provides an analog panoramic system, especially an analog panoramic system that is more convenient to watch and use and can be immersed in the environment.

Today's online live broadcast methods mostly use a camera to shoot the live broadcaster, and the live broadcaster can interact with viewers simply. However, with the progress of the times, photography methods have become more and more diverse, such as using virtual reality (VR) shooting to allow viewers to watch panoramic images. In detail, this kind of virtual reality technology needs to use multiple cameras at the same time to generate images in various directions in an interactive shooting manner, thereby forming the panoramic image. However, this method is more troublesome to use and greatly increases the cost of live broadcast.

In addition, the virtual reality technology needs to be combined with a head-mounted display to achieve a complete viewing effect. Therefore, the requirements for viewing equipment and the environment are high. In addition, when viewing a 360-degree panoramic photo, you can only rotate the photo or zoom the size of the photo by sliding, which cannot give the viewer an immersive visual effect.

Therefore, how to improve the above problems is worth considering for those with ordinary knowledge in this field.

The purpose of the present invention is to provide an analog panoramic system, which can greatly reduce the cost of the live broadcaster using the panoramic live broadcast, and also helps the viewer to have an immersive experience in the experience of watching the live broadcast.

An analog panoramic system of the present invention includes at least one panoramic camera device, a cloud server, and at least one portable electronic device. The cloud server is connected to the panoramic camera device and the portable electronic device. Wherein, the portable electronic device includes at least one application, at least one sensor and a display screen. In addition, the panoramic camera device is used to capture a physical environment to obtain a panoramic image, and the cloud server is used to receive the panoramic image. In addition, the application includes an augmented reality unit. The augmented reality unit simulates a panoramic simulation space based on the panoramic image. The augmented reality unit generates a virtual camera device in the panoramic simulation space, and the virtual camera device captures the panorama Simulate the space to produce a photographed image. Wherein, when the sensor detects the movement or rotation of the portable electronic device, the virtual camera device moves or rotates correspondingly in the panoramic simulation space, and the display screen is used to display the photographed image.

In the above-mentioned analog panoramic system, the panoramic image is a live image, a recorded image or a static image.

In the above-mentioned analog panoramic system, the portable electronic device is a smart phone, a smart watch, a tablet computer or a notebook computer.

In the aforementioned simulated panoramic system, the application program further includes a user sponsoring unit and a message input unit, the user sponsoring unit is used to accept sponsorship, and the message input unit is used to input a message.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, preferred embodiments are described in detail below in conjunction with the accompanying drawings.

10, 20: Analog panoramic system

12: Panoramic photography device

120: Panoramic image

121: sofa

122: round coffee table

123: Live host

13: Cloud server

14: Portable electronic devices

141: Display screen

141P: Shot image

142: Sensor

143, 243: Apps

1430: Augmented Reality Unit

243S: User Sponsorship Unit

243M: Message input unit

8: physical environment

81: sofa

82: Round coffee table

83: Live host

91: sofa

92: Round coffee table

93: Live host

94: Virtual Photography Installation

S1~S6: steps

FIG. 1 shows the simulated panoramic system 10 of this embodiment.

FIG. 2A shows a schematic diagram of the panoramic photographing device 12 photographing the physical environment 8.

FIG. 2B shows a schematic diagram of the panoramic image 120.

FIG. 3A shows a schematic diagram of the panoramic simulation space 9.

FIG. 3B shows a schematic diagram of the virtual camera 94 located in the panoramic simulation space 9.

FIG. 4 illustrates a schematic diagram of the display screen 141 displaying the captured image 141P.

FIG. 5A shows a schematic diagram of the virtual camera 94 moving to the vicinity of the sofa 91.

FIG. 5B shows a schematic diagram of a single sofa displayed on the display screen 141.

FIG. 6 shows a simulated panoramic system 20 according to another embodiment.

FIG. 7 shows a schematic diagram of the usage method of the simulated panoramic system 10.

Please refer to FIG. 1. FIG. 1 illustrates the simulated panoramic system 10 of this embodiment. The analog panoramic system 10 includes at least one panoramic camera device 12, a cloud server 13, and at least one portable electronic device 14. The cloud server 13 communicates with the panoramic camera device 12 and the portable electronic device 14. The portable electronic device 14 includes an application program 143, at least one sensor 142, and a display screen 141. The portable electronic device 14 is, for example, a smart phone, a smart watch, a tablet computer, or a notebook computer, and the sensor The sensor 142 is, for example, a gravity sensor (G-Sensor), an acceleration sensor (Accelerometer Sensor), a gyroscope (Gyroscope) or a GPS positioning device.

Please refer to FIGS. 2A and 2B. FIG. 2A is a schematic diagram of the panoramic camera 12 photographing the physical environment 8 and FIG. 2B is a schematic diagram of the panoramic image 120. The panoramic photographing device 12 is used to photograph a physical environment 8 to obtain a panoramic image 120. In FIG. 2A, the physical environment 8 is, for example, a living room scene, and the cloud server 13 is used to receive the panoramic image 120. It is worth noting that, compared with ordinary photography devices, the angles that the panoramic photography device 12 can capture will be more complete, and the entire living room scene can be recorded without blind spots, which can reduce the use of multiple photography devices.

In Figure 2A, the physical environment 8 includes a full set of sofas 81, a circular coffee table 82, and a live broadcast host 83, so the panoramic image 120 in Figure 2B will also include the full set of sofas 121 and a circular coffee table. 122 and live host 123. It is worth noting that in Figure 2B, the outlines of the sofa 121, the round coffee table 122 and the live broadcast host 123 are simply drawn. In fact, the appearance of the sofa 121, the round coffee table 122 and the live broadcast host 123 are the same as the sofa. 81. The appearance of the round coffee table 82 and the live broadcaster 83. In the above, the panoramic image 120 is, for example, a live image, a recorded image, or a still image.

Please refer to FIG. 1 again and FIG. 3A at the same time. FIG. 3A is a schematic diagram of the panoramic simulation space 9. The application program 143 includes an augmented reality unit 1430, and the augmented reality unit 1430 processes the panoramic image 120 through Augmented Reality technology. Specifically, the augmented reality unit 1430 simulates a panoramic simulation space 9 based on the panoramic image 120, so the panoramic simulation space 9 will also include a full set of sofas 91, a circular coffee table 92, and a live broadcast host 93, and the simulated The aspects of the sofa 91, the round coffee table 92 and the live broadcast host 93 are also the same as the aspects of the sofa 81, the round coffee table 82 and the live broadcast host 83. In the above, the augmented reality unit 1430 is, for example, ARKit software or Arcore software.

Please refer to FIG. 1 again and FIG. 3B at the same time. FIG. 3B shows a schematic diagram of the virtual camera 94 in the panoramic simulation space 9. The augmented reality unit 1430 generates a virtual camera 94 in the panoramic simulation space 9, and the virtual camera 94 is used to capture the panoramic simulation space 9 to generate a photographed image 141P. In detail, the virtual camera 94 can be located at any position in the panoramic simulation space 9. Therefore, the formed image 141P may be an image in any direction or any corner of the panoramic simulation space 9.

Please refer to FIG. 3B and FIG. 4 at the same time. FIG. 4 shows a schematic diagram of the display screen 141 displaying the captured image 141P. The captured image 141P is displayed on the display screen 141 of the portable electronic device 14. For example, the virtual camera 94 in FIG. 3B is close to the oblique front of the live broadcast host 93. Therefore, the photographed image 141P captured by it takes the live host 93 as the main body (please refer to FIG. 4), so the display screen 141 can clearly display the live host 93.

It is worth noting that when the sensor 142 detects that the portable electronic device 14 moves or rotates, the augmented reality unit 1430 also causes the virtual camera device 94 to move or rotate correspondingly in the panoramic simulation space 9 . In detail, if the portable electronic device 14 is moved by the user, the sensor 142 will sense the moving distance, position, and direction of the portable electronic device 14, and the virtual camera 94 is updated at any time. The captured image 141P is continuously updated and displayed on the display screen 141. In this way, the display screen 141 can display images in any direction or any corner of the panoramic simulation space 9.

For another example, please refer to FIGS. 5A and 5B. FIG. 5A is a schematic diagram of the virtual camera 94 moving to the vicinity of the sofa 91, and FIG. 5B is a schematic diagram of the display screen 141 displaying a single sofa. As shown in FIG. 5A, when the user of the portable electronic device 14 wants to watch the single sofa in the panoramic simulation space 9 at close range, the user can move the portable electronic device 14 so that the virtual camera 94 is also moved To the vicinity of the sofa 91, the display screen 141 can clearly display the sofa 91. In this way, the user of the mobile portable electronic device 14 seems to be in the live broadcast (living room) scene, can move freely in the living room scene, and watch the live broadcast host up close. Therefore, the simulated panoramic system 10 does not need to be viewed through any head-mounted display, allowing the user to achieve an immersive entertainment effect under relatively simple conditions.

Please refer to FIG. 6. FIG. 6 shows another embodiment of the simulated panoramic system 20. The difference between the simulated panoramic system 20 and the simulated panoramic system 10 is that the application 243 in the simulated panoramic system 20 also includes a user sponsoring unit 243S And a message input unit 243M, the user sponsoring unit 243S is used to accept sponsorship, and the message input unit 243M is used to input messages. In detail, when the user of the portable electronic device 14 can click on the user sponsoring unit 243S to generate a sponsorship icon, or input a message in the message input unit 243M, the message can be sent to the electronic device of the live broadcaster ( The electronic device is usually a smart phone), which greatly increases the interactivity and fun of watching live broadcasts.

In summary, the simulated panoramic system of this embodiment allows the user of the portable electronic device 14 to move in a simulated space similar to a live environment, and continuously update the image of the display screen 141, thereby allowing the user to feel directly Walk to the front of the object. In this way, the viewing angle that users can observe is broadened.

Please refer to FIG. 7. FIG. 7 is a schematic diagram of the usage method of the simulated panoramic system 10. The method of using the simulated panoramic system 10 of the present invention includes the following steps: First, referring to step S1, the physical environment 8 is photographed to obtain the panoramic image 120. In detail, after the physical environment 8 is photographed by the panoramic camera 12, the panoramic image 120 is obtained.

After that, referring to step S2, the panoramic image 120 is transmitted to the cloud server 13.

After that, referring to step S3, the panoramic image 120 is converted into a panoramic simulation space 9. In detail, the panoramic image 120 is converted into a panoramic simulation space through the augmented reality unit 1430.

After that, referring to step S4, a virtual camera 94 is generated in the panoramic simulation space 9. Specifically, the virtual camera 94 is generated in the panoramic simulation space 9 through the augmented reality unit 1430.

After that, referring to step S5, the panoramic simulation space is photographed by the virtual photographing device 94 to generate the photographed image 141P.

After that, referring to step S6, the photographed image 141P is displayed via the display screen 141. In this way, the user can view the image of the physical environment 8 when it was taken.

In the above, when the sensor 142 detects the movement or rotation of the portable electronic device 14, the virtual camera 94 performs corresponding movement or rotation in the panoramic simulation space 9. In this way, the user can see any position or any corner of the physical environment 8.

Although the present invention has been disclosed in the preferred embodiments as above, it is not intended to limit the present invention. Anyone with ordinary knowledge in the relevant technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of this new model shall be subject to the scope of the attached patent application.

10: Analog panoramic system

12: Panoramic photography device

120: Panoramic image

13: Cloud server

14: Portable electronic devices

141: Display screen

141P: Shot image

142: Sensor

143: Application

1430: Augmented Reality Unit

Claims (4)

An analog panoramic system includes: at least one panoramic camera device for shooting a physical environment to obtain a panoramic image; a cloud server connected to the panoramic camera device, and the cloud server receives the panoramic image; and at least one portable electronic device A device connected to the cloud server, the portable electronic device includes: an application program, the application program includes an augmented reality unit, the augmented reality unit simulates a panoramic simulation space according to the panoramic image, the augmented reality The reality unit generates a virtual camera device in the panoramic simulation space, and the virtual camera device shoots the panoramic simulation space to generate a photographed image; at least one sensor, when the sensor detects the portable electronic device When moving or rotating, the virtual camera device moves or rotates correspondingly in the panoramic simulation space; and a display screen displays the photographed image. Such as the analog panoramic system described in the first item of the scope of patent application, wherein the panoramic image is a live image, a recorded image or a static image. For example, in the analog panoramic system described in item 1 of the scope of patent application, the portable electronic device is a smart phone, a smart watch, a tablet computer, or a notebook computer. For example, in the analog panoramic system described in the first item of the patent application, the application program further includes a user sponsoring unit and a message input unit, the user sponsoring unit is used to accept sponsorship, and the message input unit is used to input information.

Images