TWI740623B - Apparatus, method, and computer program product thereof for integrating videos - Google Patents

Abstract

An apparatus, method, and computer program product thereof for integrating videos are provided. The apparatus includes a processor and a transceiving interface, wherein the processor is electrically connected to the transceiving interface. The processor sets up a main virtual camera and a plurality of render objects in a three-dimensional virtual space, and the processor renders a plurality of video streams on the render objects one-to-one. The processor derives a main video stream by enabling the main virtual camera to video all of or a part of the render objects. The transceiving interface outputs the main video stream.

Description

Video integration device, method and computer program product

The invention relates to a video integration device, method and computer program product. Specifically, the present invention relates to a video integration device, method and computer program product that utilizes the feature that a host virtual camera can move freely in a three-dimensional virtual space.

With the rapid development of Internet and multimedia technology, the demand for using Push Technology to actively transmit video streams to users is increasing day by day. When video streams from multiple sources need to be played together, it is necessary to integrate these video streams to provide various viewing services (for example, services that switch between these video streams). However, the conventional video integration technology needs to re-encode and stitch the video streams before providing the integrated video stream to the user. However, this type of integration process requires a lot of calculations, which will cause the video stream to be pushed. Delay.

In view of this, it is very important in this field to provide a video integration technology to integrate video streams from multiple sources so that users can easily and freely operate to enhance the user’s viewing experience and ensure the interactive experience with users. Subject.

One objective of the present invention is to provide a video integration device. The video integration device includes a processor and a transceiver interface, wherein the processor is electrically connected to the transceiver interface. Where The processor sets up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, and presents the plurality of video streams on the imaging objects one-to-one. The processor enables the main virtual camera to shoot all or part of the imaging objects to obtain a main video stream. The transceiver interface outputs the main video stream.

Another object of the present invention is to provide a video integration method which is executed by an electronic device. The video integration method includes the following steps: setting up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, presenting the plurality of video streams on the imaging objects one-to-one, and making the main virtual camera shoot the imaging objects All or part of it can obtain a main video stream and output the main video stream.

Another object of the present invention is to provide a computer program product. After an electronic device loads the computer program product, the electronic device executes a plurality of program instructions included in the computer program product to realize a video integration method. The video integration method includes the following steps: setting up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, presenting the plurality of video streams on the imaging objects one-to-one, and making the main virtual camera shoot the imaging objects All or part of it can obtain a main video stream and output the main video stream.

The video integration technology (including devices, methods and computer program products) provided by the present invention will set up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, and use these imaging objects to display in the three-dimensional virtual space The characteristics of video and image content present a plurality of video streams on the imaging objects one-to-one. The video integration technology provided by the present invention reuses the feature that the virtual camera can move freely in a three-dimensional virtual space, so that the main virtual camera shoots all or part of the imaging objects, thereby obtaining a main video stream. The video integration technology provided by the present invention outputs the main video stream, for example, pushes the main video stream to the client. The video integration technology provided by the present invention uses three-dimensional object movement technology to move the mirror, so the main virtual The pseudo-camera can quickly switch pictures and integrate multiple pictures when moving in a three-dimensional virtual space, without recoding and stitching. Therefore, the video integration technology provided by the present invention can effectively reduce the computing cost without delaying the time of outputting the main video stream, thereby maintaining a good output quality and providing a good viewing experience for the audience.

The following describes the detailed technology and implementation of the present invention in conjunction with the drawings, so that those with ordinary knowledge in the technical field to which the present invention belongs can understand the features of the claimed invention.

1: Video integration device

11: processor

13: Transceiver interface

20: Three-dimensional virtual space

30: Main virtual camera

O1, O2, ..., O9: imaging objects

S1, S2, ..., S9: video stream

c1, c2,......, c9: center coordinates

VA: shooting range

VS: Main video stream

S201~S205: steps

FIG. 1A is a schematic diagram depicting the structure of the video integration device 1 according to the first embodiment of the present invention.

FIG. 1B is a schematic diagram depicting the main virtual camera 30 and the imaging objects O1, O2, ..., O9 set up by the video integration device 1 in the three-dimensional virtual space 20.

FIG. 1C depicts a schematic diagram of the video integration device 1 presenting the video streams S1, S2,..., S9 to the imaging objects O1, O2,..., O9 one-to-one.

FIG. 1D is a schematic diagram depicting the video integration device 1 focusing the main virtual camera 30 on the center coordinates of the imaging object O9.

FIG. 1E is a schematic diagram depicting the movement path of the main virtual camera 30 when the focus coordinate is changed.

FIG. 1F is a schematic diagram depicting the shooting range VA of the main virtual camera 30.

Figure 2 is a flowchart depicting the video integration method of the second embodiment of the present invention.

The following will explain the video integration device provided by the present invention through implementations, Method and its computer program product. However, these embodiments are not intended to limit the implementation of the present invention in any environment, application or method as described in these embodiments. Therefore, the description of the following embodiments is only for explaining the purpose of the present invention, rather than limiting the scope of the present invention. It should be understood that in the following embodiments and drawings, elements that are not directly related to the present invention have been omitted and are not shown, and the size of each element and the size ratio between elements in the drawings are only for ease of illustration and description, and It is not intended to limit the scope of the present invention.

The first embodiment of the present invention is the video integration device 1, and its schematic diagram is depicted in FIG. 1A. The video integration device 1 includes a processor 11 and a transceiver interface 13, and the processor 11 is electrically connected to the transceiver interface 13. The processor 11 may be a variety of processors, central processing units (CPU), microprocessors (MPU), digital signal processors (DSP), or common ones in the technical field of the present invention. Other computing devices known to the knowledgeable. The transceiver interface 13 can be any interface that can be used with the processor 11 and can receive and transmit signals, such as a universal serial bus interface, a network interface card, but not limited to this.

Please refer to Figures 1B to 1E together. In this embodiment, the video integration device 1 can integrate video streams from multiple sources in a three-dimensional virtual space 20, capture the integrated video streams through a master virtual camera 30, and output the content captured by the master virtual camera 30 . The video integration device 1 can utilize a three-dimensional engine (for example, the Unity engine developed by game engine developer Unity Technologies) or other technologies capable of projecting videos and images in a three-dimensional virtual space to integrate the video streams. The specific operation of the video integration device 1 will be described in detail below.

In this embodiment, the transceiver interface 13 of the video integration device 1 receives nine video streams S1, S2, ..., S9 to be integrated. It should be noted that the present invention does not limit the video integration device 1 The number, source and type of video streams to be integrated. In other words, the video integration device 1 can integrate other numbers of video streams. In addition, the video streams S1, S2, ..., S9 can each come from a real camera, a virtual camera, a video platform (such as a video platform), or other video sources. If a video stream comes from the video integration device 1 (for example, a virtual camera in the 3D engine executed by the video integration device 1), the video stream does not need to be received through the transceiver interface 13.

In addition, the processor 11 of the video integration device 1 sets up nine imaging objects O1, O2, ..., O9 in the three-dimensional virtual space 20 (see Figure 1B). It should be noted that the imaging objects O1, O2, ..., O9 are each an object capable of presenting video and image content in the three-dimensional virtual space 20, such as an imaging plane (render panel). The number of imaging objects can depend on the number of video streams (for example, the number of imaging objects can be greater than or equal to the number of video streams, so that each video stream has a corresponding imaging object). In this embodiment, the number of imaging objects O1, O2,..., O9 is the same as the number of video streams S1, S2,..., S9. In addition, it should be noted that the present invention does not limit the respective sizes and shapes of the imaging objects O1, O2, ..., O9, and does not limit the arrangement of the imaging objects O1, O2, ..., O9 in the three-dimensional virtual space 20.

In this embodiment, the processor 11 renders the video streams S1, S2,..., S9 one-to-one on the imaging objects O1, O2,..., O9 (see Figure 1C). For example, each of the video streams S1, S2, ..., S9 may include a plurality of frames (not shown), and the processor 11 may convert each frame into a render texture, and convert each of the converted frames into a render texture. The rendered texture is presented on the corresponding imaging object.

On the other hand, the processor 11 of the video integration device 1 will set up a main virtual camera 30 in the three-dimensional virtual space 20 (refer to Figures 1B and 1C), so that the main virtual camera 30 can shoot imaging objects O1, O2,..., All or part of O9 can obtain a main video stream VS. Those who need clarification, The position where the main virtual camera 30 is set up (that is, the range of the imaging objects O1, O2,..., O9 that can be photographed by the main virtual camera 30) may depend on the screen that the user wants to present.

In this embodiment, the main virtual camera 30 shoots all or part of the imaging objects O1, O2, ..., O9 to obtain the main video stream VS, and the transceiver interface 13 outputs the main video stream VS (for example: push to the client ). For example, the transceiver interface 13 can instantly output the pictures taken by the main virtual camera 30 during the shooting process of the main virtual camera 30, and these pictures form the aforementioned main video stream VS.

In some implementations, during the process of the main virtual camera 30 shooting in the three-dimensional virtual space 20, the processor 11 can move the main virtual camera 30 (for example, the processor 11 can follow a preset instruction or according to the user through sending and receiving A command input from the interface 13 or other interfaces determines a movement path, so that the main virtual camera 30 moves according to the movement path, so as to change the range captured by the main virtual camera 30. It should be noted that the video integration device 1 can use 3D Object Translation technology to move the lens (ie, move the main virtual camera 30). With the three-dimensional object movement technology, the main virtual camera 30 can quickly switch pictures and integrate multiple pictures when moving in the three-dimensional virtual space 20, so there is no need to re-encode and stitch. The following is a detailed description of how the processor 11 causes the main virtual camera 30 to move in the three-dimensional virtual space 20.

Specifically, the imaging objects O1, O2,..., O9 each have a world coordinate in the three-dimensional virtual space 20, and the processor 11 can move the main virtual camera 30 according to the world coordinates of the imaging objects O1, O2,..., O9 .

In the three-dimensional virtual space 20, the main virtual camera 30 will focus on a certain world coordinate for shooting. For example, when the main virtual camera 30 shoots all of the imaging objects O1, O2, ..., O9, the main virtual camera 30 focuses on the center coordinates of the imaging object O5 in the center, and The field of view (FOV) of the main virtual camera 30 can be set to be aligned with the outer frame formed by the imaging objects O1, O2,..., O9, as shown in FIG. 1C. For another example, when the main virtual camera 30 shoots the imaging object O9, the main virtual camera 30 focuses on the center coordinates of the imaging object O9, and can adjust the field of view of the main virtual camera 30 to be aligned with the outer frame of the imaging object O9. As shown in Figure 1D. The processor 11 can cause the main virtual camera 30 to focus on the world coordinates of a certain imaging object (for example, imaging object O5) to focus on the world coordinates of another imaging object (for example, imaging object O9), thereby making the main virtual The camera 30 moves in the three-dimensional virtual space 20 to change the image it captures. In addition, in order to provide users with a better viewing experience, after the processor 11 moves the main virtual camera 30 in the three-dimensional virtual space 20, it can further adjust the field of view of the main virtual camera 30, or further change the main virtual camera 30 and The distance between the imaging objects to avoid unneeded content (described later).

In some embodiments, the world coordinate representing an imaging object is the center coordinate of the imaging object. In these embodiments, the processor 11 adjusts the main virtual camera 30 from focusing on the world coordinates of a certain imaging object to focusing on the world coordinates of another imaging object.

In some embodiments, the world coordinates representing an imaging object are the coordinates of the upper left corner of the imaging object. In these embodiments, the processor 11 needs to first calculate the center coordinates of the imaging objects O1, O2,..., O9 in the three-dimensional virtual space 20. For each of the imaging objects O1, O2, ..., O9, the processor 11 calculates the world coordinates of the imaging object (that is, the upper-left coordinates), the length of the imaging object, and the height of the imaging object. Center coordinates. For example, for each of the imaging objects O1, O2, ..., O9, the processor 11 first calculates half the length of the imaging object and half the height of the imaging object, and then according to the world coordinates of the imaging object, Half of the length and half of the height calculate the center of the imaged object coordinate. As shown in FIG. 1C, the imaging objects O1, O2, ..., O9 have center coordinates c1, c2, ..., c9, respectively.

In order to understand how the processor 11 moves the main virtual camera 30, please refer to the specific example shown in FIG. 1E. In this specific example, the processor 11 wants the main virtual camera 30 to capture all of the imaging objects O1, O2, ..., O9, so the main virtual camera 30 is focused to the center coordinate c5 of the imaging object O5, and the main virtual camera The field of view of 30 is set to be aligned with the outer frame formed by the imaging objects O1, O2, ..., O9. To adjust the main virtual camera 30 from shooting all of the imaging objects O1, O2,..., O9 to only shooting the imaging object O9, the processor 11 will adjust the main virtual camera 30 from focusing to the center coordinate c5 of the imaging object O5 to Focus to the center coordinate c9 of the imaging object O9, so that the main virtual camera 30 moves in the three-dimensional virtual space 20 to focus to the center coordinate c9 of the imaging object O9, and then photograph the imaging object O9.

In some embodiments, during the process of the processor 11 moving the main virtual camera 30, the processor 11 may also adjust the distance between the main virtual camera 30 and the imaging objects O1, O2, ..., O9 (for example, if the imaging object O1 , O2,..., O9 are parallel to the xy plane, the main virtual camera 30 can move along the z-axis direction), thereby changing the range captured by the main virtual camera 30. Taking the specific example shown in Figure 1E as an illustration, after the processor 11 adjusts the main virtual camera 30 from focusing on the center coordinate c5 of the imaging object O5 to focusing on the center coordinate c9 of the imaging object O9, the main virtual camera 30 will Accordingly, it moves in the three-dimensional virtual space 20 in order to photograph the imaging object O9. However, if the distance between the main virtual camera 30 and the imaging objects O1, O2,..., O9 is not adjusted, the frame captured by the main virtual camera 30 will cover the range outside the imaging object O9. Therefore, the processor 11 also adjusts the distance between the main virtual camera 30 and the imaging object O9, so that the frame of the image captured by the main virtual camera 30 is aligned with the outer frame of the imaging object O9.

In addition, in some embodiments, during the process of the processor 11 moving the main virtual camera 30, the processor 11 may also reset the field of view of the main virtual camera 30, thereby changing the range captured by the main virtual camera 30. Taking the specific example shown in Fig. 1E as an illustration, after the processor 11 adjusts the main virtual camera 30 from focusing to the center coordinate c5 of the imaging object O5 to focusing on the center coordinate c9 of the imaging object O9, the main virtual camera 30 takes The resulting picture will cover the area outside the imaging object O9. In order to avoid this situation, the processor 11 can adjust the field of view of the main virtual camera 30 to be aligned with the outer frame of the imaging object O9, so that the main virtual camera 30 will not capture content other than the imaging object O9.

As mentioned above, the transceiver interface 13 will output the main video stream VS (for example, push broadcast to the client). In some embodiments, the video integration device 1 may further include a temporary memory (not shown), wherein the temporary memory is electrically connected to the processor 11. The temporary memory is used to store a plurality of images captured by the main virtual camera 30. In these embodiments, the transceiver interface 13 outputs the screens temporarily stored in the temporary memory (for example, pushes each screen temporarily stored in the temporary memory to the client), and these screens form the aforementioned The main video stream VS. It should be clarified that, according to the conventional push broadcast technology, a host does not push the picture taken by the virtual camera temporarily stored in the temporary storage memory, but pushes the picture displayed by the host, so the display of the host will be displayed. Other information (such as instant messages received by communication software) will be pushed out together. Since the video integration device 1 only stores the pictures taken by the main virtual camera 30 in the temporary memory, and directly pushes these pictures to the user, there is no conventional technology to push other information together. To go to the situation.

In some embodiments, the video integration device 1 can also dynamically turn off the imaging function of a certain (or some) imaging objects to avoid wasting display resources. For example, the processor 11 may use View frustum culling technology to turn off a certain (or some) imaging object. Imaging function. The processor 11 can determine whether the imaging objects O1, O2,..., O9 fall within the viewing angle of the main virtual camera 30. If the processor 11 determines that a subset of the imaging objects O1, O2, ..., O9 does not fall within the viewing angle of the main virtual camera 30, the processor 11 will stop the imaging function of at least one imaging object included in the subset. For ease of understanding, please refer to the specific example in Figure 1D. In this specific example, when the main virtual camera 30 photographs the imaging object O9, the processor 11 determines a subset of the imaging objects O1, O2, ..., O9 (ie, imaging objects O1, O2, ..., O8) It does not fall into the viewing angle of the main virtual camera 30, so the processor 11 will stop the imaging functions of the imaging objects O1, O2, ..., O8 included in the subset. By turning off the imaging function of the imaging objects O1, O2,..., O8 not captured by the main virtual camera 30, the consumption of display resources can be reduced.

In some embodiments, the video integration device 1 dynamically turns off the imaging function of the imaging object, and the fineness can reach a distance unit (for example, meters or centimeters) in the three-dimensional engine executed by the video integration device 1. In a specific example shown in Figure 1F, the angle of view of the main virtual camera 30 covers all of the imaging object O9 and a part of the imaging objects O5, O6, and O8 at a certain moment (that is, the shooting range VA in Figure 1F). ). In this specific example, the processor 11 regards the part of the imaging object not covered by the viewing angle of the main virtual camera 30 as a subset of the imaging function that needs to be turned off, and this subset includes all of the imaging objects O1, O2, O3, O4, and O7. And the respective parts of the imaging objects O5, O6, and O8. The processor 11 can turn off the imaging function corresponding to the subset.

In some embodiments, the processor 11 can also use the object superimposition feature in the three-dimensional virtual space 20 to create an insert object ( For example: text) to add other imaging effects. Specifically, the processor 11 can determine the range of the imaging object captured by the main virtual camera 30, and then determine the position (that is, between the main virtual camera 30 and the imaging object or objects) based on it. Establish The insert. For example, when the main virtual camera 30 will capture all of the imaging objects O1, O2, ..., O9, the processor 11 may establish the image between the main virtual camera 30 and the imaging objects O1, O2, ..., O9 Insert the object. For another example, when the main virtual camera 30 only captures the imaging object O9, the processor 11 may create the insertion object between the main virtual camera 30 and the imaging object O9.

In some embodiments, the processor 11 may also add a filter in front of the main virtual camera 30 so that the main video stream obtained by the main virtual camera 30 has the effects that the filter can present. Those with ordinary knowledge in the technical field to which the present invention pertains are familiar with the use of various filters, so they will not be described in detail.

In some embodiments, the processor 11 can also rotate all of the imaging objects O1, O2,..., O9 by an angle, or can rotate at least one of the imaging objects O1, O2,..., O9 by an angle , To provide different visual effects. Those skilled in the art to which the present invention pertains should understand how to rotate an imaging object in the three-dimensional virtual space 20, so it will not be described in detail.

To sum up, the video integration device 1 sets up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, and utilizes the characteristics of the imaging objects to present video and image content in the three-dimensional virtual space, and combine the plurality of videos The flow is presented one-to-one on the imaging objects. The video integration device 1 utilizes the feature that the virtual camera can move freely in a three-dimensional virtual space, so that the main virtual camera captures all or part of the imaging objects, thereby obtaining a main video stream, and then outputting the main video stream. Through the foregoing operations, the video integration device 1 can integrate the video streams through the main virtual camera and the imaging objects, thereby achieving the integration and viewing effects required by the user. In addition, since the video integration device 1 uses a three-dimensional object movement technology to move the lens, the main virtual camera can quickly switch pictures and integrate multiple pictures when moving in a three-dimensional virtual space, without recoding and stitching. Therefore, the video integration device 1 can effectively reduce the computing cost without delay. Delay the output of the main video stream, thereby maintaining good output (for example: push) quality, and providing users with a good viewing experience.

The second embodiment of the present invention is a video integration method, the flowchart of which is depicted in FIG. 2A. The video integration method is suitable for an electronic device, such as the video integration device described in the first embodiment.

In this embodiment, the video integration method executes steps S201, S203, and S205. In step S201, the electronic device sets up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space. In step S203, the electronic device presents a plurality of video streams on the imaging objects one-to-one. Then, in step S205, the electronic device causes the main virtual camera to capture all or part of the imaging objects to obtain a main video stream, and output the main video stream. Specifically, in step S205, the main virtual camera will capture all or part of the imaging objects to obtain a plurality of pictures, and output the pictures as the main video stream.

Each of the video streams processed in step S203 includes a plurality of pictures. In some embodiments, in step S203, the electronic device executes a step to convert each image into a rendering texture, and then executes a step to present each rendering texture to the corresponding imaging object.

In addition, in some embodiments, in the process of performing step S205 in the video integration method, the electronic device may also perform a step to move the main virtual camera.

In some embodiments, each of the imaging objects has a world coordinate in the three-dimensional virtual space, and the imaging objects include a first imaging object (for example, the imaging object O1 shown in Figure 1C) and a second The imaging object (for example: the imaging object O9 shown in Figure 1C). In these embodiments, in the process of moving the master virtual camera by the electronic device, the video integration method further includes a step for enabling the master virtual camera to follow the world coordinates of the first imaging object The focus adjustment is based on the world coordinate of the second imaging object.

Furthermore, in some embodiments, the world coordinate representing an imaging object is the center coordinate of the imaging object. In these embodiments, the video integration method adjusts the main virtual camera from focusing on the world coordinate of the first imaging object to focusing on the world coordinate of the second imaging object.

In some embodiments, the world coordinates representing an imaging object are the coordinates of the upper left corner of the imaging object. In these embodiments, the video integration method further includes the following steps: the electronic device calculates a first center coordinate of the first imaging object according to the world coordinates, a length, and a width of the first imaging object, Calculate a second center coordinate of the second imaging object based on the world coordinates, a length, and a width of the second imaging object, and adjust the main virtual camera from focusing to the first center coordinate to focusing to the first center coordinate 2. Center coordinates.

In some embodiments, the video integration method further includes a step of adjusting a distance between the main virtual camera and the second imaging object by the electronic device. In these embodiments, the video integration method can adjust the distance between the main virtual camera and the second imaging object according to a viewing angle of the main virtual camera.

In some embodiments, the electronic device also stores a plurality of frames of the main virtual camera, for example, stored in a temporary memory of the electronic device. In these embodiments, in step S205, the electronic device outputs the images in the temporary memory as the main video stream.

In some embodiments, the video integration method further executes the following steps by the electronic device: determining that a subset of the imaging objects does not fall within a viewing angle of the main virtual camera, and stopping at least the subset included The imaging function of an imaging object. Virtual photography The imaging objects not covered by the camera's viewing angle are turned off, which can reduce the consumption of display resources.

In some embodiments, the video integration method further executes the following steps by the electronic device: creating an insert object between the main virtual camera and one of the imaging objects. In addition, in some embodiments, the video integration method further executes the following steps by the electronic device: rotating at least one of the imaging objects by an angle. Through these steps, the video integration method can add other imaging effects to the main video stream.

In addition to the above steps, the second embodiment can also perform all the operations and steps described in the first embodiment, have the same functions, and achieve the same technical effects. Those with ordinary knowledge in the technical field to which the present invention pertains can directly understand how the second embodiment performs these operations and steps based on the above-mentioned first embodiment, has the same functions, and achieves the same technical effects, so it will not be repeated.

The video integration method described in the second embodiment can be implemented by a computer program product containing a plurality of program instructions. The computer program product can be a file that can be transmitted over the network, and can also be stored in a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium may be an electronic product, such as: a read only memory (ROM), a flash memory, a floppy disk, a hard disk, and a compact disk (Compact Disk; CD), a Digital Versatile Disc (DVD), a flash drive, or any other storage medium with the same functions known to those skilled in the art to which the present invention belongs. After the program instructions included in the computer program product are loaded into an electronic device (for example, the video integration device 1), the computer program executes the video integration method as described in the second embodiment.

It should be clarified that in the specification of the present invention and in the scope of the patent application, certain terms (including: imaging objects, center coordinates) are preceded by "first" and "second". "One" and "second" are only used to distinguish different terms.

In summary, the video integration technology provided by the present invention (including at least devices, methods and computer program products) will set up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, and use these imaging objects in the The characteristics of video and image content can be presented in the three-dimensional virtual space, and multiple video streams are presented one-to-one on the imaging objects. The video integration technology provided by the present invention uses the main virtual camera to shoot all or part of the imaging objects, thereby obtaining a main video stream. The video integration technology provided by the present invention also outputs the main video stream (for example, pushes the main video stream to the client). The video integration technology provided by the present invention uses a three-dimensional object moving technology to move the mirror, so the main virtual camera can quickly switch pictures and integrate multiple pictures when moving in a three-dimensional virtual space, without recoding and stitching. Therefore, the video integration technology provided by the present invention can effectively reduce the computing cost without delaying the time of outputting the main video stream, thereby maintaining a good output quality and providing a good viewing experience for the audience.

The above-mentioned embodiments are only used to exemplify part of the implementation aspects of the present invention and to explain the technical features of the present invention, and are not used to limit the protection scope and scope of the present invention. Any change or equal arrangement that can be easily accomplished by a person with ordinary knowledge in the technical field of the present invention belongs to the scope of the present invention, and the protection scope of the present invention is subject to the scope of the patent application.

20: Three-dimensional virtual space

30: Main virtual camera

c1, c2,......, c9: center coordinates

Claims (10)

A video integration device, including: A processor sets up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space, presents the plurality of video streams on the imaging objects one-to-one, and makes the main virtual camera capture all or the imaging objects Part of it to get a main video stream; and A transceiver interface is electrically connected to the processor and outputs the main video stream. The video integration device according to claim 1, wherein the processor also moves the main virtual camera in the process of shooting by the main virtual camera. The video integration device according to claim 2, wherein the imaging objects include a first imaging object and a second imaging object, each of the imaging objects has a world coordinate in the three-dimensional virtual space, and the processor is borrowed The main virtual camera is moved by the following operations: The main virtual camera is adjusted from focusing based on the world coordinate of the first imaging object to focusing based on the world coordinate of the second imaging object. The video integration device according to claim 3, wherein the process of moving the main virtual camera by the processor further adjusts a distance between the main virtual camera and the second imaging object. The video integration device according to claim 1, wherein each of the video streams includes a plurality of pictures, and the processor converts each of the pictures into a render texture, and presents each of the render textures to the corresponding Imaging objects. A video integration method is executed by an electronic device. The video integration method includes the following steps: (a) Set up a main virtual camera and a plurality of imaging objects in a three-dimensional virtual space; (b) Present a plurality of video streams on the imaging objects one-to-one; (c) enabling the main virtual camera to shoot all or part of the imaging objects to obtain a main video stream; and (d) Output the main video stream. The video integration method according to claim 6, wherein the imaging objects include a first imaging object and a second imaging object, each of the imaging objects has a world coordinate in the three-dimensional virtual space, and further includes the following steps: (e) In performing the process of step (c), the main virtual camera is adjusted from focusing according to the world coordinate of the first imaging object to focusing according to the world coordinate of the second imaging object. The video integration method according to claim 6, wherein the electronic device stores a plurality of frames of the main virtual camera, and the step (d) is to output the frames as the main video stream. The video integration method according to claim 6, wherein each of the video streams includes a plurality of A screen, and this step (b) includes the following steps: Convert each of the images into a rendering texture; and Present each of the rendering textures to the corresponding imaging object. A computer program product. After the computer program product is loaded by an electronic device, the electronic device executes a plurality of program instructions included in the computer program product to realize a video integration method. The video integration method includes the following steps: Set up a main virtual camera and multiple imaging objects in a three-dimensional virtual space; Present a plurality of video streams on the imaging objects one-to-one; Enable the main virtual camera to shoot all or part of the imaging objects to obtain a main video stream; and Output the main video stream.

Images