TW202203646A - Analog panoramic system and method of used the same - Google Patents

Abstract

An analog panoramic system is provided. The analog panoramic system includes at least one panoramic photography device, a cloud server, at least one portable electronic device. The portable electronic device includes at least one application, at least one sensor and a display. The panoramic photography device is configured to shoot an area to form a panoramic image. The cloud server is configured to receive the panoramic image. The application includes an augmented reality unit. The augmented reality unit is based on the panoramic image to from a panoramic simulation space. A virtual photography device is generated by the augmented reality unit in the panoramic simulation space. The virtual photography device is configured to shoot the panoramic simulation space to form a captured image. When the movement or rotation of the portable electronic device is detected by the sensor, the virtual photography device in the panoramic simulation space performs the corresponding movement or rotation. The display is configured to display the captured image.

Description

Simulated panoramic system and method of using the same

The present invention provides a simulated panoramic system and a method thereof, in particular, a simulated panoramic system and a method which are more convenient to watch and use and can be immersed in the environment.

In today's online live broadcast methods, most of the live broadcasters use a camera to shoot the live broadcasters, and the live broadcasters can easily interact with the viewers. However, with the advancement of the times, photography methods are becoming more and more diverse. For example, the use of virtual reality (VR) shooting allows the audience to watch panoramic pictures. In detail, this kind of virtual reality technology needs to use a plurality of cameras at the same time to generate pictures of various orientations by means of interactive shooting, thereby forming the panoramic picture. However, this method is cumbersome to use and greatly increases the cost of live broadcast. In addition, virtual reality technology needs to be combined with a head-mounted display to achieve a complete viewing effect. Therefore, the requirements for viewing equipment and the environment in which it is located are relatively high. In addition, when viewing a 360-degree panorama photo, you can only rotate the photo or zoom in and out by sliding, which cannot give the viewer an immersive visual effect. Therefore, how to improve the above-mentioned problems is worth thinking about by those with ordinary knowledge in this field.

The purpose of the present invention is to provide a simulated panoramic system, which can greatly reduce the cost of live broadcasters using panoramic live broadcasts, and also helps viewers to feel immersed in the experience of watching live broadcasts. A simulated panoramic system of the present invention includes at least one panoramic photography device, a cloud server, and at least one portable electronic device. The cloud server is connected to the panoramic photography device and the portable electronic device. The portable electronic device includes at least one application program, at least one sensor and a display screen. In addition, the panoramic photographing device is used for photographing a physical environment to obtain a panoramic image, and the cloud server is used for receiving the panoramic image. In addition, the application program includes an augmented reality unit, the augmented reality unit simulates a panoramic simulation space according to the panoramic image, the augmented reality unit generates a virtual photography device in the panoramic simulation space, and the virtual photography device captures the panorama Simulate the space to produce a captured image. Wherein, when the sensor detects the movement or rotation of the portable electronic device, the virtual photographing device moves or rotates correspondingly in the panoramic simulation space, and the display screen is used to display the captured image. In the above-mentioned analog panoramic system, the panoramic image is a live image, a recorded image or a still image. In the above-mentioned analog panoramic system, the portable electronic device is a smart phone, a smart watch, a tablet computer or a notebook computer. In the above-mentioned simulated panoramic system, the application program further includes a user sponsorship unit and a message input unit, the user sponsorship unit is used for accepting sponsorship, and the message input unit is used for inputting a message. Another object of the present invention is to provide a method for using a simulated panoramic system, which can greatly reduce the cost of live broadcasters using panoramic live broadcasts, and also helps viewers to experience the experience of watching live broadcasts. feeling. A method of using a simulated panoramic system of the present invention, the simulated panoramic system includes at least one portable electronic device, the portable electronic device includes an application program, a sensor and a display screen, and the application program includes an augmented reality unit , the use of the simulated panoramic system includes the following steps: First, a physical environment is photographed to obtain a panoramic image. Afterwards, the panoramic image is transmitted to a cloud server. Afterwards, the augmented reality unit is used to transform the panoramic image into a panoramic simulation space. Afterwards, a virtual photographing device is generated in the panoramic simulation space using the augmented reality unit. Afterwards, the panoramic simulation space is photographed by the virtual photographing device to generate a photographed image. After that, the display screen shows the captured image. Wherein, when the sensor detects that the portable electronic device moves or rotates, the virtual photographing device moves or rotates correspondingly in the panoramic simulation space. In the above-mentioned method of using the simulated panoramic system, the panoramic image is obtained by photographing the physical environment through at least one panoramic photographing device. In the above-mentioned method of using the simulated panoramic system, the panoramic image is a live image, a recorded image or a still image. In the above-mentioned method of using the simulated panoramic system, the portable electronic device is a smart phone, a smart watch, a tablet computer or a notebook computer. In the above-mentioned method of using the simulated panoramic system, the application program further includes a user sponsorship unit and a message input unit, the user sponsorship unit is used for accepting sponsorship, and the message input unit is used for inputting a message. In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

Please refer to FIG. 1 . FIG. 1 shows the simulated panoramic system 10 of the present embodiment. The simulated panoramic system 10 includes at least one panoramic photography device 12 , a cloud server 13 , and at least one portable electronic device 14 . The cloud server 13 is a communication connection between the panoramic photography device 12 and the portable electronic device 14 . The portable electronic device 14 includes an application 143, at least one sensor 142, and a display screen 141. The portable electronic device 14 is, for example, a smart phone, a smart watch, a tablet computer, or a notebook computer. The sensor 142 is, for example, a gravity sensor (G-Sensor), an acceleration sensor (Accelerometer Sensor), a gyroscope (Gyroscope) or a GPS positioning device. Please refer to FIGS. 2A and 2B , FIG. 2A is a schematic diagram of the panoramic photographing device 12 photographing the physical environment 8 , and FIG. 2B is a schematic diagram of the panoramic image 120 . The panoramic photographing device 12 is used for photographing a physical environment 8 to obtain a panoramic image 120 . In FIG. 2A , the physical environment 8 is, for example, a living room scene, and the cloud server 13 is used for receiving the panoramic image 120 . It is worth noting that, compared with general photography devices, the angles that can be captured by the panoramic photography device 12 will be more complete, and the entire living room scene can be recorded without dead ends, which can reduce the use of multiple photography devices. In FIG. 2A , the physical environment 8 includes a whole group of sofas 81 , a round coffee table 82 and a live broadcaster 83 , so the panoramic image 120 in FIG. 2B also includes the whole group of sofas 121 and round coffee tables. 122 and live broadcaster 123. It is worth noting that in FIG. 2B , the outlines of the sofa 121 , the round coffee table 122 and the live broadcast host 123 are simply drawn. In fact, the appearance of the sofa 121 , the round coffee table 122 and the live broadcast host 123 is the same as the sofa. 81. The appearance of the round coffee table 82 and the live broadcaster 83. In the above, the panoramic image 120 is, for example, a live image, a recorded image or a still image. Please refer to FIG. 1 and FIG. 3A again. FIG. 3A is a schematic diagram of the panoramic simulation space 9 . The application program 143 includes an augmented reality unit 1430 , and the augmented reality unit 1430 processes the panoramic image 120 through augmented reality technology (Augmented Reality). Specifically, the augmented reality unit 1430 simulates a panoramic simulation space 9 according to the panoramic image 120 . Therefore, the panoramic simulation space 9 also includes the entire group of sofas 91 , round coffee tables 92 and live broadcast hosts 93 , and the simulated space 9 The appearances of the sofa 91 , the round coffee table 92 and the live broadcaster 93 are also the same as those of the sofa 81 , the round coffee table 82 and the broadcaster 83 . In the above, the augmented reality unit 1430 is, for example, ARKit software or Arcore software. Please refer to FIG. 1 and FIG. 3B again. FIG. 3B is a schematic diagram of the virtual camera 94 located in the panoramic simulation space 9 . The augmented reality unit 1430 generates a virtual photographing device 94 in the panoramic simulation space 9 , and the virtual photographing device 94 is used for photographing the panoramic simulation space 9 to generate a photographed image 141P. Specifically, the virtual photographing device 94 can be located at any position in the panoramic simulation space 9 . Therefore, the formed captured image 141P may be an image in any direction or any corner of the panoramic simulation space 9 . Please refer to FIG. 3B and FIG. 4 again. FIG. 4 shows a schematic diagram of the display screen 141 displaying the captured image 141P. The captured image 141P is displayed on the display screen 141 of the portable electronic device 14 . For example, the virtual camera 94 in FIG. 3B is close to the oblique front of the live broadcast host 93 . Therefore, the captured image 141P captured by the camera takes the live broadcast host 93 as the main body (please refer to FIG. 4 ), so the display screen 141 can clearly display the live broadcast host 93 . It is worth noting that when the sensor 142 detects that the portable electronic device 14 moves or rotates, the augmented reality unit 1430 also makes the virtual camera 94 move or rotate correspondingly in the panoramic simulation space 9 . Specifically, if the portable electronic device 14 is moved by the user, the sensor 142 will sense the moving distance, position and direction of the portable electronic device 14, and the virtual camera 94 is updated at any time when moving. The captured image 141P is continuously updated and displayed on the display screen 141 . In this way, the display screen 141 can display images in any direction or any corner of the panoramic simulation space 9 . For another example, please refer to FIGS. 5A and 5B . FIG. 5A shows a schematic diagram of the virtual camera 94 moving to the vicinity of the sofa 91 , and FIG. 5B shows a schematic diagram of the display screen 141 displaying a single-seat sofa. As shown in FIG. 5A , when the user of the portable electronic device 14 wants to view the single-seat sofa in the panoramic simulation space 9 at close range, the user can move the portable electronic device 14 so that the virtual photographing device 94 is also moved. It is near the sofa 91, so the display screen 141 can clearly display the sofa 91. In this way, the user of the mobile portable electronic device 14 seems to be at the scene of the live broadcast (living room), and can move freely in the living room scene to watch the live broadcaster at close range. Therefore, the analog panoramic system 10 does not need to be viewed through any head-mounted display, allowing the user to achieve an immersive entertainment effect under relatively simple conditions. Please refer to FIG. 6 . FIG. 6 shows a simulated panoramic system 20 according to another embodiment. The difference between the simulated panoramic system 20 and the simulated panoramic system 10 is that the application 243 in the simulated panoramic system 20 further includes a user sponsor unit 243S And a message input unit 243M, the user sponsorship unit 243S is used for accepting sponsorship, and the message input unit 243M is used for inputting messages. Specifically, when the user of the portable electronic device 14 can click the user sponsorship unit 243S to generate a sponsorship icon, or input a message in the message input unit 243M, the message can be sent to the electronic device of the live broadcaster ( The electronic device is usually a smartphone), which greatly increases the interactivity and fun when watching live broadcasts. To sum up, the simulated panoramic system of the present embodiment allows the user of the portable electronic device 14 to move in a simulated space similar to a live environment, and continuously update the image on the display screen 141 , thereby allowing the user to feel a direct Walk to the front of the object. In this way, the viewing angle that can be observed by the user is broadened. Please refer to FIG. 7 , which is a schematic diagram illustrating a method of using the simulated panoramic system 10 . The using method of the simulated panoramic system 10 of the present invention includes the following steps: First, referring to step S1 , the physical environment 8 is photographed to obtain the panoramic image 120 . Specifically, after the physical environment 8 is photographed by the panoramic photographing device 12 , the panoramic image 120 is obtained. After that, please refer to step S2 to transmit the panoramic image 120 to the cloud server 13 . After that, please refer to step S3 to convert the panoramic image 120 into a panoramic simulation space 9 . In detail, the panoramic image 120 is transformed into a panoramic simulation space through the augmented reality unit 1430 . After that, referring to step S4 , a virtual photographing device 94 is generated in the panoramic simulation space 9 . Specifically, the virtual camera 94 is generated in the panoramic simulation space 9 through the augmented reality unit 1430 . Afterwards, referring to step S5, the virtual camera 94 captures the panoramic simulation space to generate the captured image 141P. After that, referring to step S6 , the captured image 141P is displayed via the display screen 141 . In this way, the user can view the image of the physical environment 8 when it was photographed. In the above, when the sensor 142 detects that the portable electronic device 14 moves or rotates, the virtual camera 94 moves or rotates correspondingly in the panoramic simulation space 9 . In this way, the user can view any direction or any corner of the physical environment 8 . Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be determined by the scope of the appended patent application.

10, 20: Simulated panoramic system 12: Panoramic photography installation 120: Panoramic image 121: Sofa 122: Round coffee table 123: Live Master 13: Cloud server 14: Portable electronic device 141: Display screen 141P: subject to shooting images 142: Sensor 143, 243: Application 1430: Augmented Reality Unit 243S: User Sponsored Unit 243M: message input unit 8: Physical Environment 81: Sofa 82: Round coffee table 83: Live Master 91: Sofa 92: Round coffee table 93: Live Master 94:Virtual Photography Installation S1~S6: Steps

FIG. 1 shows the simulated panoramic system 10 of the present embodiment. FIG. 2A is a schematic diagram of the panoramic photographing device 12 photographing the physical environment 8 . FIG. 2B is a schematic diagram of the panoramic image 120 . FIG. 3A is a schematic diagram of the panoramic simulation space 9 . FIG. 3B is a schematic diagram of the virtual photographing device 94 located in the panoramic simulation space 9 . FIG. 4 is a schematic diagram of the display screen 141 displaying the captured image 141P. FIG. 5A is a schematic diagram of the virtual camera 94 moving to the vicinity of the sofa 91 . FIG. 5B is a schematic diagram showing the single-seat sofa displayed on the display screen 141 . FIG. 6 shows a simulated panoramic system 20 according to another embodiment. FIG. 7 is a schematic diagram illustrating a method of using the simulated panoramic system 10 .

10: Simulated panoramic system

12: Panoramic photography installation

120: Panoramic image

13: Cloud server

14: Portable electronic device

141: Display screen

141P: subject to shooting images

142: Sensor

143: Apps

1430: Augmented Reality Unit

Claims (9)

A simulated panoramic system including: at least one panoramic photographing device for photographing a physical environment to obtain a panoramic image; a cloud server connected to the panoramic photography device, and the cloud server receives the panoramic image; and At least one portable electronic device is connected to the cloud server, and the portable electronic device includes: an application program, the application program includes an augmented reality unit, the augmented reality unit simulates a panoramic simulation space according to the panoramic image, and the augmented reality unit generates a virtual photographing device in the panoramic simulation space, and the virtual photographing device photographs the panoramic simulation space to generate a photographed image; at least one sensor, when the sensor detects that the portable electronic device moves or rotates, the virtual camera device moves or rotates correspondingly in the panoramic simulation space; and a display screen to display the captured image. The analog panoramic system as described in item 1 of the patent application scope, wherein the panoramic image is a live image, a recorded image or a still image. The analog panoramic system according to item 1 of the scope of application, wherein the portable electronic device is a smart phone, a smart watch, a tablet computer or a notebook computer. The simulated panoramic system as described in claim 1, wherein the application further comprises a user sponsorship unit and a message input unit, the user sponsorship unit is used for accepting sponsorship, and the message input unit is used for inputting a message. A method of using a simulated panoramic system, the simulated panoramic system includes at least one portable electronic device, the portable electronic device includes an application program, a sensor and a display screen, the application program includes an augmented reality unit, The method of using the simulated panoramic system includes: (A) photographing a physical environment to obtain a panoramic image; (B) transmitting the panoramic image to a cloud server; (C) using the augmented reality unit to transform the panoramic image into a panoramic simulation space; (D) using the augmented reality unit to generate a virtual camera device within the panoramic simulation space; and (E) photographing the panoramic simulation space via the virtual camera device to generate a photographed image; (F) the display screen shows the captured image; Wherein, when the sensor detects that the portable electronic device moves or rotates, the virtual photographing device moves or rotates correspondingly in the panoramic simulation space. According to the method for using the simulated panoramic system as described in item 5 of the scope of application, in step (A), the physical environment is photographed by at least one panoramic photographing device to obtain the panoramic image. The method for using an analog panoramic system as described in item 5 of the scope of the patent application, wherein the panoramic image is a live image, a recorded image or a still image. The method for using an analog panoramic system as described in item 5 of the scope of the patent application, wherein the portable electronic device is a smart phone, a smart watch, a tablet computer or a notebook computer. The method for using a simulated panoramic system as described in item 5 of the scope of application, wherein the application further comprises a user sponsorship unit and a message input unit, the user sponsorship unit is used for accepting sponsorship, and the message input unit is used for inputting message.

Images