TWI828091B - System for transmitting panorama image and method thereof and computer program product - Google Patents

Abstract

A system for transmitting a panorama image and a method thereof and a computer program product are provided. First, the panoramic image is cut into multiple block images according to a terminal resolution. Next, the multiple block images are stitched according to a maximum resolution supported by codec to produce a stitched image, and a description file is then created corresponding to the stitched image, and the stitched image is encoded afterwards. Finally, the encoded stitched image and the description file corresponding to the stitched image are transmitted via streaming. After receiving the encoded stitched image and the description file, the encoded stitched image is decoded to obtain the stitched image. Next, the stitched image is split into multiple split images according to the description file, and then the multiple split images are stitched back together to obtain the panoramic image. Lastly, the panoramic image is played to a terminal device with multiple playback blocks in a manner that the multiple block images correspond to the multiple playback blocks.

Description

Panoramic image transmission system, method and computer program product

The present invention relates to an image transmission technology, specifically, to a panoramic image encoding and decoding transmission technology.

With the advent of the 5G era, there are market opportunities for related applications such as panoramic imaging and/or ultra-wide viewing angle imaging. Regarding the presentation of panoramic images and/or ultra-wide-angle images, it is often necessary to use multiple cameras to capture images from multiple angles, then correct the overlapping areas to stitch them into a panoramic image, and then encode and stream the output to the terminal device for viewing. However, The following problems usually arise during the aforementioned processing.

For example, the stitched panoramic image is too wide and cannot be directly encoded and output as a stream. In this regard, if the panoramic image is limited to a specified resolution range during encoding, the video quality may be affected, and the image may be blurred and distorted. In addition, if the panoramic image is first segmented and then individually encoded and streamed for output, packet loss or delay may occur during the delivery process due to inconsistent network and processing speeds.

Therefore, how to propose a transmission technology for panoramic images to at least solve the above-mentioned problems is currently an urgent goal pursued by those skilled in the art.

In order to solve the above problems and other problems, the present invention discloses a panoramic image transmission system, method and computer program product.

The panoramic image transmission method disclosed by the present invention includes: cutting a panoramic image into a plurality of block images according to a terminal resolution; and splicing the plurality of block images according to a codec that can support the maximum resolution to generate a Stitching the image; based on the splicing image, correspondingly generates a description file including block coordinate information and block overlap information; and, after encoding the splicing image, output the encoded splicing image in a streaming manner, and output the same as the splicing image. The description file corresponding to the spliced image.

Secondly, the panoramic image transmission method disclosed in the present invention further includes: receiving the encoded spliced image and the description file; decoding the encoded spliced image to obtain the spliced image; analyzing the description file to obtain the spliced image. According to the coordinate information and/or the block overlap information of the description file, the spliced image is divided into multiple divided images; based on the coordinate information and/or the block overlap information of the description file, the multiple split images are restored and spliced Split the image to obtain the panoramic image; and play the panoramic image to the terminal device having the multiple playback blocks by using the multiple block images to correspond to multiple playback blocks with the terminal resolution.

In one embodiment, edge overlaps are retained in the stitched image, so that when the multiple segmented images are restored and spliced based on the coordinate information and/or the block overlap information of the description file, edge imaging is performed on the edge overlaps. Fusion.

In addition, before cutting the panoramic image into the plurality of block images according to the terminal resolution, the panoramic image transmission method disclosed in the present invention further includes: stitching a plurality of images from different angles into the panoramic image, wherein, in the When the panoramic image has an invalid range, the invalid range is removed.

In one embodiment, splicing the plurality of block images according to the maximum resolution supported by the codec includes: dividing the maximum resolution supported by the codec into a plurality of grids according to the terminal resolution to divide the Multiple block images are rearranged sequentially into the multiple grids.

In another embodiment, audio sources are added to the spliced image first and then encoded.

In yet another embodiment, performing border complementation on the stitched image is performed to complement the maximum resolution that the codec can support.

The computer program product disclosed in the present invention executes the panoramic image transmission method disclosed in the present invention after being loaded into the computer.

The panoramic image transmission system disclosed by the present invention includes: an image cutting and splicing encoding device, which cuts a panoramic image into a plurality of block images according to a terminal resolution, so as to splice the plurality of block images according to a codec that can support the maximum resolution. The block images are used to generate a spliced image, and the image cutting and splicing encoding device generates a description file including block coordinate information and block overlap information based on the spliced image, and then adds the audio source to the spliced image for encoding, wherein, The image cutting and splicing encoding device divides the maximum resolution supported by the codec into multiple grids according to the terminal resolution, so as to rearrange the multiple block images into the multiple grids in sequence; and transmit The device outputs the encoded spliced image in a streaming manner and outputs a description file corresponding to the spliced image.

Secondly, the panoramic image transmission system disclosed by the present invention further includes: a terminal device, which includes a plurality of playback blocks with the resolution of the terminal; and an image decoding and splicing playback device, which receives the encoded spliced image and the description. The file is decoded to obtain the spliced image by decoding the encoded spliced image. The image decoding splicing playback device analyzes the description file to convert the spliced image according to the coordinate information and/or the block overlap information of the description file. Divide it into multiple segmented images, restore and splice the multiple segmented images to obtain the panoramic image, and then use the multiple block images to correspond to the terminal analysis The panoramic image is played to the terminal device having the plurality of playback blocks in a manner of multiple playback blocks.

In one embodiment, the image cutting and splicing encoding device retains edge overlaps of the spliced image for the image decoding and splicing playback device to restore and splice the spliced image based on the coordinate information and/or the block overlap information of the description file. When there are multiple segmented images, edge image fusion is performed where the edges overlap.

Through the panoramic image transmission system, method and computer program product disclosed in the present invention, the stitched panoramic image is first cut according to the terminal resolution, then spliced according to the maximum resolution supported by the codec, and then output through the encoded stream , thereby retaining the quality of high-definition videos and making the images from various angles received by the terminal device synchronized with each other.

10, 10a: Image cutting and splicing encoding device

20:Transmission device

20a:Media Server

30, 30a: Image decoding and splicing playback device

40:Terminal device

40a: Curved/circular screen

100: Panoramic image

200:Multiple block images

300: Stitching images

301: Codec supports maximum resolution

302: Description file

400: Stitched image that complements the border

500: Decoded stitched image with complementary borders

600: Multiple segmented images

700: Restore spliced multiple segmented images

800: Panoramic image

A, B: overlap

S11~S15: Steps

S31~S35: steps

Figure 1 is a schematic block diagram of the basic architecture of the panoramic image transmission system of the present invention.

FIG. 2 is a schematic flowchart of an embodiment of the panoramic image transmission method of the present invention.

FIG. 3 is a schematic flowchart of another embodiment of the panoramic image transmission method of the present invention.

FIG. 4 is a block diagram of an embodiment of the panoramic image transmission system of the present invention.

Figure 5 is a panoramic image of one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 6 shows multiple block images of one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 7 is a spliced image of one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 8 is a description file corresponding to the spliced image of one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 9 is a spliced image with complementary frames according to one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 10 is a decoded complementary frame spliced image of one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 11 shows multiple segmented images of one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 12 shows multiple segmented images restored and spliced according to one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

Figure 13 is a panoramic image with multiple block images according to one embodiment of the panoramic image transmission system, method and computer program product of the present invention.

The following uses specific examples to illustrate the implementation of the present invention. People familiar with this art can easily understand other advantages and effects of the present invention from the content disclosed in this article. The structures, ratios, sizes, etc. shown in the drawings attached to this manual are only used to coordinate with the content disclosed in the manual for the understanding and reading of those familiar with this art. They are not used to limit the conditions for the implementation of this case. Therefore, any modification, change or adjustment, without affecting the effectiveness and purpose of this case, should still fall within the scope of the technical content disclosed in this case.

Please refer to Figure 1. The panoramic image transmission system of the present invention includes an image cutting and splicing encoding device 10 and a transmission device 20, and further includes an image decoding and splicing playback device 30 and a terminal device 40. Among them, the image cutting and splicing encoding device 10 has an image cutting and splicing encoding module, the image decoding and splicing and playing device 30 has an image decoding and splicing and playing module, and the transmission device 20 has a transmission module.

The image cutting, splicing and encoding device 10 sequentially performs image cutting, splicing and encoding.

First, the image cutting and splicing encoding device 10 cuts a panoramic image into multiple block images according to a terminal resolution. Prior to this, the image cutting and splicing encoding device 10 can first stitch multiple images from different angles into a panoramic image. If the panoramic image has invalid areas such as vignetting or edges, the invalid areas will be removed. In addition, the terminal resolution based on the image cutting and splicing encoding device 10 is obtained from the terminal resolution of each playback block of the terminal device, such as: 3840x2160 pixels (4K) or 8192x4320 pixels (8K). However, the specific implementation does not Limited to this.

Then, the image cutting and splicing encoding device 10 can support the maximum resolution according to a codec, for example: 8K=8192x4320, but the specific implementation is not limited to this, and splices the multiple block images to generate a spliced image. Specifically, the maximum resolution that the codec can support is divided into multiple grids according to the terminal resolution, so that the multiple block images are sequentially rearranged into the multiple grids, wherein for the Multiple block images preserve edge overlap. In addition, the image cutting and splicing encoding device 10 generates a description file based on the spliced image correspondence, wherein the description file includes block coordinate information and block overlap information, the block coordinate information includes the number and coordinate of the block image, and the area Block overlap information includes information about whether it overlaps with the next image.

Thereafter, the image cutting and splicing encoding device 10 encodes the spliced image, or adds the audio source first and then encodes it. Before that, frame filling can be performed on the stitched image so that the codec can support the maximum resolution. Finally, the encoded (frame-complementing) spliced image is streamed to the transmission device 20 , and the image cutting and splicing encoding device 10 also transmits the description file corresponding to the spliced image to the transmission device 20 .

The transmission device 20 transmits the received encoded spliced image and the description file corresponding to the spliced image to the image decoding and splicing playback device 30 . In one embodiment, the transmission device 20 is, for example, a media server. In another embodiment, the transmission device 20 uses a transmission module to transmit.

After receiving the spliced image transmitted in a streaming manner generated by the image cutting and splicing encoding device 10 and the description file corresponding to the spliced image, the image decoding and splicing playback device 30 sequentially performs image decoding, splicing and playback.

First, the image decoding and splicing playback device 30 decodes the encoded spliced image to obtain the spliced image.

Then, the image decoding and splicing playback device 30 analyzes the description file including coordinate information and block overlap information, and divides the spliced image into multiple segmented images based on the coordinate information and/or block overlap information of the description file, and then restores the spliced image. The plurality of segmented images are spliced, and during restoration and splicing, edge image fusion is performed on overlapping edges to obtain the panoramic image.

Finally, the image decoding and splicing playback device 30 plays the panoramic image to the terminal device 40 in such a manner that the plurality of block images correspond to the plurality of playback blocks with the terminal resolution.

The terminal device 40 has a plurality of playback blocks, and each playback block has the terminal resolution. In one embodiment, multiple playback blocks of the terminal device 40 may be configured to form an arc-shaped or ring-shaped display screen.

It should be noted that each module in Figure 1 can be software, hardware or firmware; if it is hardware, it can be a processing unit, processor, or computer with data processing and computing capabilities; if it is software or Firmware can include processing units, processors, and computer-executable instructions.

Please refer to Figure 2. The process of the panoramic image transmission method of the present invention schematically includes steps S11~S15. In one embodiment, the method shown in FIG. 2 can be executed by the image cutting and splicing encoding device 10 shown in FIG. 1 using the image cutting and splicing encoding module.

In step S11, the panoramic image is cut into multiple block images according to the terminal resolution. In one embodiment, the terminal resolution refers to the terminal resolution of each playback block of the terminal device. Previously, multiple cameras were used to shoot from multiple angles to produce multiple images from different angles. The shooting ranges of each camera overlapped with each other, so that when stitching into a panoramic image, the images shot by multiple cameras at the same time were combined. The images are corrected based on overlap to stitch them into a panoramic image. In another embodiment, if the stitched panoramic image has invalid areas such as vignetting or edges, these invalid areas are removed to leave a valid area. Then proceed to step S12.

In step S12, multiple block images are spliced according to the maximum resolution supported by the codec to generate a spliced image. In other words, according to the terminal resolution, first divide the maximum resolution that the codec can support into multiple grids, and then rearrange multiple block images into multiple grids sequentially, while retaining edge overlaps. Produce stitched images. Then proceed to step S13.

In step S13, a description file is generated according to the stitched image correspondence. The description file includes block coordinate information and block overlap information. The block coordinate information includes the number and coordinates of the block image, and the block overlap information includes information on whether this block image overlaps with the next block image. Then proceed to step S14.

In step S14, the stitched image is encoded. In one embodiment, the spliced image can be first supplemented with borders using, for example, zero-padding technology to supplement the maximum resolution that the codec can support, thereby avoiding possible corner missing phenomena in the future. In addition, the audio source is first added to the spliced image and then encoded. Then proceed to step S15.

In step S15, the encoded stitched image is output in a streaming manner, and a description file corresponding to the stitched image is output. In one embodiment, the encoded spliced image is output to the terminal device in a streaming manner through a transmission device such as a media server, and a description file corresponding to the spliced image is output to the terminal device. For example, HLS (HTTP Live Streaming) is used as the streaming protocol.

Please refer to Figure 3. The process of the panoramic image transmission method of the present invention schematically includes steps S31~S35. In one embodiment, the method shown in FIG. 2 can be executed by the image decoding and splicing playback device 30 shown in FIG. 1 using the image decoding and splicing playback module.

In step S31, the encoded spliced image and description file are received. Then proceed to step S32.

In step S32, the encoded spliced image is decoded to obtain the spliced image. Then proceed to step S33.

In step S33, the description file is analyzed to divide the spliced image into multiple segmented images based on the coordinate information and/or block overlap information in the description file. Then proceed to step S34.

In step S34, multiple segmented images are restored and spliced according to the coordinate information and/or block overlap information of the description file to obtain the panoramic image. In one embodiment, when performing restoration stitching, edge image fusion is performed on the overlapping edges. Then proceed to step S35.

In step S35, the panoramic image is played to the terminal device having the plurality of playback blocks in a manner in which the plurality of block images correspond to the plurality of playback blocks with terminal resolution.

The method of the present invention is executed in, for example, a server, a computer, or other equipment with functions of data processing, computing, storage, network communication, etc., in a single or multiple sets, wherein the server, computer, or equipment includes a central processing unit. drive, hard disk, memory, etc.

In addition, the computer program product of the present invention executes the method after loading the program through the computer, and the computer-readable recording medium (such as hard disk, floppy disk, optical disk, USB flash drive) of the present invention stores the computer program product . In addition, computer program products can also be directly transmitted and provided over the Internet. Therefore, computer program products are things that contain computer-readable programs and are not limited to external forms.

In addition, the present invention also provides a computer-readable medium, which is used in a computing device or computer with a processor and/or memory, and the computer-readable medium stores instructions, and can be used by the computing device or computer through the processor and/or the memory. /or the memory executes the computer-readable medium to execute the above methods and/or content when the computer-readable medium is executed.

The following illustrates specific embodiments of the panoramic image transmission system, method, computer program product and computer-readable recording medium of the present invention with reference to FIGS. 4 to 13 .

Please refer to Figure 4. In the block diagram of an embodiment of the panoramic image transmission system of the present invention, multi-angle images taken by multiple cameras are stitched into a panoramic image, and the image cutting and splicing encoding device 10a is used to generate a series of images. The streaming video and audio are transmitted to the media server 20a, and after receiving the stream from the media server 20a, the terminal restores the panoramic image through the image decoding and splicing playback device 30a, and can designate the corresponding arc/ring screen 40a to present the panorama. image.

Furthermore, for the image cutting and splicing encoding device 10a, it mainly cuts the panoramic image with reference to the terminal resolution of the terminal device to cut out multiple block images 200, and then performs the processing at the maximum resolution supported by the codec. Blocks are spliced to generate a spliced image 300, and the number, coordinates and overlapping information of each block image are recorded to form a description file 302. Furthermore, for the image decoding and splicing playback device 30a, it mainly decodes the received stream to obtain the decoded spliced image 500 with the supplementary frame (it may also be the decoded spliced image without the supplementary frame), and then Refer to the records in the description file 302 and perform restoration and stitching to obtain the panoramic image 800. In the description file 302 (its extension is, for example, info) , the block image numbers are 1, 2, 3, 4,...; the coordinate information of the block image is W1: H1: X1: Y1, W2: H2: Height,

As shown in FIG. 5 , a panoramic image 100 of the present invention is displayed. The dotted line in Figure 5 shows the resection line used to remove the invalid range. The invalid range here generally refers to the dark corners or edges in multiple panoramic images stitched from multiple angles at the same time.

As shown in FIG. 6 , the image cutting and splicing encoding device 10a cuts the panoramic image 100 into multiple block images 200 according to the terminal resolution of the multiple playback blocks of the terminal device (for example, 3840x2160 (4K)).

As shown in FIG. 7 , the image cutting and splicing encoding device 10a can support the maximum resolution (for example, 8192x4320 (8K)) according to the codec, and splices multiple block images 200 to generate a spliced image 300. Specifically, the codec can support a maximum resolution of 301 (WxH) and is divided into multiple grids (grid) according to the terminal specified resolution (BWxBH). The complete grid that can be divided is W/BW x H/BH. The panoramic images are sequentially rearranged into a complete grid. In addition, in order to facilitate encoding, decoding and subsequent image fusion processing, the edge overlap width n will be retained here, which is the dotted box on the right side of the image in Figure 7. That is, the width of the overlapped areas A and B in Figures 11 and 12, where n>=64 and is a multiple of 64, refers to the macroblock of H.265 (or High Efficiency Video Coding (HEVC)) ) encoding characteristics and the maximum block unit is 64x64.

As shown in Figure 8, the image cutting and splicing encoding device 10a generates a description file 302 corresponding to the spliced image 300, recording the number, coordinates (ex: width: height: X coordinate: Y coordinate) of each block and whether it is consistent with the next one. Image overlap (ex: Y/N) and other information. For example, for the block image numbered 1, the coordinates are 3840:2160:0:0, which does not overlap with the next image; for the block image numbered 2, the coordinates are 3904:2160:3840:0, which overlaps with the next image; for the block image numbered 3, the coordinates are 3804:2160:3840:2160, which does not overlap with the next image.

As shown in FIG. 9 , the image cutting and splicing encoding device 10 a executes frame complementing to generate a spliced image 400 that complements the frame. Since the spliced spliced image 300 may have missing corners, in order to consider the integrity of the image, zero padding (zero padding) may be used. padding) technology complements the codec to support the maximum resolution (ex: 8K=8192*4320).

Then, the image cutting and splicing encoding device 10a adds the audio source to the spliced image 400 that complements the frame to encode and output the stream together with the image, and transmits it together with the description file 302 to the media server 20a, and the media server 20a then transmits it to the image decoding Splicing playback device 30a. In one embodiment, HLS is used as the streaming transmission protocol, and corresponding .m3u8 and .ts files are generated.

As shown in FIG. 10 , the image decoding and splicing playback device 30a performs decoding to obtain a decoded spliced image 500 that complements the frame. It should be noted that the coding and segmentation lines displayed on the decoded frame-supplementing spliced image 500 are helpful for explanation and are for reference only. In another embodiment, the codes and dividing lines displayed on the decoded frame-supplementing stitched image 500 do not appear.

As shown in FIG. 11 , the image decoding and splicing playback device 30a divides the decoded frame-supplementing splicing image 500 into multiple segmented images 600 according to the content of the description file 302 . It should be noted that the numbers and dividing lines of the multiple segmented images 600 are helpful for explanation and are for reference only. In another embodiment, the numbers and dividing lines of the plurality of divided images 600 do not appear. In Figure 11, there are overlapping areas A and B on the images No. 2 and No. 4, and their width is the above-mentioned n, where n >= 64 and is a multiple of 64, refer to H.265 (or High Efficiency Video Coding) (HEVC))'s macroblock encoding characteristics and the maximum block unit are 64x64.

As shown in FIG. 12 , the image decoding and splicing playback device 30 a restores and splices the plurality of divided images 600 into the plurality of divided images 700 according to the content of the description file 302 .

For example, numbers 1 and 2 are connected, numbers 3 and 4 are connected, numbers 2 and 3 are separated, numbers 1 and 3 have the same X coordinate, numbers 2 and 4 have the same X coordinate, numbers 1 and 2 have the same Y coordinate, number 3 In the same way as the Y coordinate of 4, perform segmentation and restoration splicing.

In addition, image fusion is performed at the overlapping points A and B. The relevant expressions are as follows:

P(i,j)=(1-W(i,j))*PA(i,j)+W(i,j)*PB(i,j), where W is the weight, 0<=W< =1. P(i,j) is the result of image fusion of PA(i,j) and PB(i,j). PA and PB can also be exchanged in the formula. The corresponding figure can be understood as using the weight W to fuse the two images of the overlapping point A of number 2 and the overlapping point B of number 3 shown in the dotted box into one image, so as to produce a gradient effect in them, so that the stitching contact There will be no stitching lines or ghosting.

As shown in Figure 13, it is the restored panoramic image 800, which is played to the curved/ring-shaped screen 40a in a manner in which multiple block images correspond to multiple playback blocks, and the block image numbered 1 is played. to the block numbered 1 of the curved/annular screen 40a, and so on. In addition, the overlap between the block image numbered 4 and the block image numbered 1 can also be processed using weighted edge fusion.

To sum up, the panoramic image transmission system, method and computer program product disclosed in the present invention first cut the stitched high-quality panoramic images according to the terminal resolution, and then according to the codec to support the maximum resolution. Execute splicing, then output the spliced image through the encoding stream, and output the corresponding description file, thereby solving the image blur or distortion caused by direct encoding at a reduced resolution in the past, and the description file corresponding to the spliced image, After receiving the spliced image, the terminal is allowed to perform segmentation according to the description file first, and then stitch it back into a panoramic image. This ensures that the images received by the terminal from each angle are synchronized with each other, thereby solving the synchronization problem caused by transmitting multi-angle images separately. . In addition, after the terminal receives the stream, the present invention adopts edge fusion technology, so that when the spliced image is restored to a panoramic image, a gradient effect is produced at the splicing point to avoid splicing lines and ghosting problems in repeated blocks. appear.

The above-mentioned embodiments are only illustrative of the effects of the present invention and are not intended to limit the present invention. Anyone familiar with this art can modify and change the above-mentioned implementations without violating the spirit and scope of the present invention. Therefore, the scope of rights protection in this case should be as listed in the patent application scope described below.

10:Image cutting and splicing encoding device

20:Transmission device

30: Image decoding and splicing playback device

40:Terminal device

Claims (8)

A panoramic image transmission method includes: making the image cutting and splicing encoding device cut a panoramic image into multiple block images according to a terminal resolution; making the image cutting and splicing encoding device support the maximum resolution according to a codec, Splicing the plurality of block images to generate a spliced image; causing the image cutting and splicing encoding device to correspondingly generate a description file including block coordinate information and block overlapping information based on the spliced image; causing the transmission device to encode the spliced image Then, output the encoded spliced image in a streaming manner, and output a description file corresponding to the spliced image; cause the image decoding and splicing playback device to receive the encoded spliced image and the description file; cause the image to be decoded and spliced for playback The device decodes the encoded spliced image to obtain the spliced image; causes the image decoding and splicing playback device to analyze the description file to convert the spliced image based on the coordinate information and/or the block overlap information of the description file. Splitting the spliced image into multiple segmented images; causing the image decoding and splicing playback device to restore and splice the multiple segmented images to obtain the panoramic image based on the coordinate information and/or the block overlap information of the description file; and causing the image to be spliced into multiple segmented images. The decoding and splicing playback device uses the manner in which the plurality of block images correspond to the plurality of playback blocks with the terminal resolution to play the panoramic image to the terminal device having the plurality of playback blocks. The panoramic image transmission method as described in claim 1, wherein edge overlaps are retained in the spliced image, so that when the multiple segmented images are restored and spliced based on the coordinate information and/or the block overlap information of the description file, Perform edge image fusion on the overlapping edges. The panoramic image transmission method described in claim 1 further includes: before cutting the panoramic image into the plurality of block images according to the terminal resolution, causing the image cutting and splicing encoding device to stitch the plurality of images from different angles into In the panoramic image, when the panoramic image has an invalid range, the invalid range is removed. The panoramic image transmission method as described in claim 1, wherein splicing the plurality of block images according to the codec that can support the maximum resolution includes: according to the terminal resolution, dividing the codec that can support the maximum resolution into Multiple grids are used to rearrange the multiple block images into the multiple grids sequentially. The panoramic image transmission method as described in claim 1, wherein the audio source is first added to the spliced image and then encoded, and frame filling is performed on the spliced image to supplement the maximum resolution that the codec can support. A computer program product, which is loaded into the computer to execute the panoramic image transmission method described in any one of claims 1-5. A panoramic image transmission system includes: an image cutting and splicing encoding device, which cuts a panoramic image into multiple block images according to a terminal resolution, and splices the multiple block images according to a codec that can support maximum resolution. A spliced image is obtained, and the image cutting and splicing encoding device generates a description file including block coordinate information and block overlap information based on the spliced image, and then adds the audio source to the spliced image and then encodes it, wherein the image is cut The splicing encoding device divides the maximum resolution that the codec can support into multiple grids based on the terminal resolution, so as to rearrange the multiple block images into the multiple grids sequentially; the transmission device The encoded spliced image is output in a streaming manner, and a description file corresponding to the spliced image is output; The terminal device includes a plurality of playback blocks with the terminal resolution; and an image decoding and splicing playback device receives the encoded spliced image and the description file to decode the encoded spliced image. For the spliced image, the image decoding and splicing playback device analyzes the description file to divide the spliced image into multiple segmented images based on the coordinate information and/or the block overlap information of the description file, and then restores and splices the multiple segmented images. The panoramic image is obtained through the image, and then the panoramic image is played to the terminal device having the plurality of playback blocks by using the method that the plurality of block images correspond to the plurality of playback blocks with the terminal resolution. The panoramic image transmission system as described in claim 7, wherein the image cutting and splicing encoding device retains the edge overlap of the spliced image for the image decoding and splicing playback device to use the coordinate information and/or based on the description file. When the block overlap information is restored and spliced into the multiple segmented images, edge image fusion is performed on the overlapping edges.

Images