WO2018045571A1 - 图像编码方法及系统 - Google Patents

图像编码方法及系统 Download PDF

Info

Publication number
WO2018045571A1
WO2018045571A1 PCT/CN2016/098605 CN2016098605W WO2018045571A1 WO 2018045571 A1 WO2018045571 A1 WO 2018045571A1 CN 2016098605 W CN2016098605 W CN 2016098605W WO 2018045571 A1 WO2018045571 A1 WO 2018045571A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
source
source images
target
requirement
Prior art date
Application number
PCT/CN2016/098605
Other languages
English (en)
French (fr)
Inventor
宋亮
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2016/098605 priority Critical patent/WO2018045571A1/zh
Priority to CN201680002384.8A priority patent/CN107005703A/zh
Publication of WO2018045571A1 publication Critical patent/WO2018045571A1/zh
Priority to US16/294,295 priority patent/US10972681B2/en
Priority to US17/222,594 priority patent/US20210250522A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/56—Provisioning of proxy services
    • H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/12—Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal

Definitions

  • the present invention relates to the field of image coding technologies, and in particular, to an image coding method and system.
  • wireless image transmission systems In the field of aerial photography and entertainment of drones, wireless image transmission systems (referred to as wireless image transmission or image transmission) are increasingly becoming an integral part of drones.
  • two sets of completely independent image transmission systems are used to acquire, encode, transmit, receive, decode, display, store, etc. the images, and the two systems work independently without interference (except for wireless transmission and reception).
  • the technical problem to be solved by the present invention is to provide an image encoding method and system, which can achieve the purpose of simultaneously transmitting multiple images under the premise of limited wireless bandwidth, no reduction in image quality of the main stream, and no reduction in wireless transmission distance.
  • a technical solution adopted by the present invention is to provide an image encoding method, the method comprising: receiving at least two source images; respectively, each of the source images according to a pre-configured pre-processing requirement Preprocessing is performed; each source image after preprocessing is pasted together according to pre-configured texture requirements to obtain a target image; and the target image is encoded.
  • the at least two source images are respectively from at least two image sources.
  • the pre-processing includes at least one of a scaling process, a cropping process, and a scaling process.
  • the step of receiving at least two source images comprises storing each of the source images into a respective input buffer.
  • the step of pre-processing the source image according to the pre-configured pre-processing requirements further includes: storing each of the pre-processed source images into respective output buffers; and pre-processing Each source image is stitched together according to pre-configured texture requirements to obtain the target image.
  • the pre-configured texture requirements include a mapping order and a mapping coordinate.
  • the step of attaching each of the pre-processed source images to the pre-configured map requirements, and obtaining the target image includes: sequentially storing the pre-processed source images according to the map order and the map coordinates. Go to the target cache to form the target image in the target cache.
  • the step of arranging each of the pre-processed source images according to the pre-configured texture requirements to obtain the target image includes: at least partially overlapping or pre-screening the pre-processed source images.
  • the pre-processed each source image is pasted together according to a pre-configured mapping requirement
  • the step of obtaining the target image comprises: setting at least part of the pre-processed source image to a hidden mode or a semi-transparent manner .
  • the step of receiving the at least two source images includes: receiving a display request of the user; and setting the pre-processing request, the map request, and the activation identifier according to the display requirement.
  • the step of setting the pre-processing requirement, the mapping request, and the activation identifier according to the display requirement includes: managing an image input/output processing matrix table according to the display requirement, wherein the image input/output processing matrix table An image source identifier for distinguishing the image source, the pre-processing request associated with the image source identifier, the map request, and the launch identifier are included.
  • the step of receiving the at least two source images comprises receiving source images respectively from the image source specified by the activation identifier.
  • an image coding system comprising: a source image receiving module for receiving at least two source images; and a preprocessing module for Pre-processing requirements of the configuration, respectively pre-processing each of the source images; a target image obtaining module, configured to paste each pre-processed source image according to a pre-configured mapping requirement to obtain a target image; An encoding module for encoding the target image.
  • the at least two source images are respectively from at least two image sources.
  • the pre-processing includes at least one of a scaling process, a cropping process, and a scaling process.
  • the source image receiving module includes: a storage unit, configured to store each of the source images into a respective input buffer.
  • the system further includes: a storage module, configured to separately store each of the pre-processed source images into a respective output buffer.
  • the pre-configured texture requirements include a mapping order and a mapping coordinate.
  • the target image obtaining module is configured to sequentially store the preprocessed source image into a target cache according to the map order and the map coordinates, thereby forming the target image in the target cache.
  • the target image obtaining module is configured to at least partially overlap or arrange the pre-processed source images.
  • the target image obtaining module is configured to set at least part of the pre-processed source image to a hidden mode or a semi-transparent mode.
  • the system further includes: a display request receiving module, configured to receive a display request of the user; and a setting module, configured to set the pre-processing request, the map request, and the launch identifier according to the display requirement.
  • the setting module is configured to manage an image input/output processing matrix table according to the display requirement, wherein the image input/output processing matrix table includes an image source identifier for distinguishing the image source, and the image respectively The pre-processing requirement associated with the source identification, the mapping requirement, and the activation identification.
  • the source image receiving module is configured to receive source images respectively from the image source specified by the startup identifier.
  • an image coding system comprising: one or more processors and an encoder; and the one or more processors are configured to: receive at least Two source images; each of the source images are separately pre-processed according to pre-configured pre-processing requirements; and each pre-processed source image is pasted together according to pre-configured texture requirements to obtain a target image;
  • the encoder is for encoding the target image.
  • system further comprises at least two image sources, the at least two source images being respectively from the at least two image sources.
  • the pre-processing includes at least one of a scaling process, a cropping process, and a scaling process.
  • the one or more processors include an input buffer, an output buffer, and a target cache; each of the source images is stored into the respective input buffers; each of the pre-processed source images Stored in the respective output buffers; and the target image is stored in the target cache.
  • the pre-configured texture requirements include a mapping order and a mapping coordinate.
  • the one or more processors are configured to sequentially store the preprocessed source image into the target cache according to the map order and the map coordinates, thereby forming the target image in the target cache.
  • the one or more processors are configured to at least partially overlap or align the pre-processed source images.
  • the one or more processors are configured to set at least part of the pre-processed source image to a hidden mode or a semi-transparent mode.
  • the at least two image sources are at least two cameras.
  • the one or more processors are further configured to receive a display request of the user; and the one or more processors are further configured to set the pre-processing request, the map request, and the startup identifier according to the display requirement .
  • the one or more processors are configured to manage an image input/output processing matrix table according to the display requirement, wherein the image input/output processing matrix table includes image source identifiers for distinguishing the image sources, respectively
  • the image source identifies the pre-processing requirement associated with the map request and the launch identifier.
  • the image input/output processing matrix table further includes a startup identifier respectively associated with the image source identifier; the one or more processors for receiving a source respectively from the image source specified by the startup identifier image.
  • the present invention receives at least two source images; pre-processes each of the source images according to a pre-configured pre-processing requirement; The source images are stitched together according to pre-configured texture requirements to obtain a target image; and the target image is encoded. Since each source image is pre-processed, and then the pre-processed source image is pasted together to obtain a target image, and then the target image is encoded, in this way, the wireless bandwidth can be limited without reducing the main stream. Under the premise of reducing the image quality and reducing the wireless transmission distance, the purpose of simultaneously transmitting multiple images is achieved.
  • FIG. 1 is a flow chart of an embodiment of an image encoding method of the present invention
  • FIG. 2 is an overall architecture diagram of a picture transmission system in an embodiment of the image coding method of the present invention
  • FIG. 16 are schematic diagrams showing the arrangement of multi-path images finally demonstrated by the image coding method of the present invention in practical applications;
  • FIG. 17 is a schematic structural diagram of an embodiment of an image coding system according to the present invention.
  • Figure 18 is a block diagram showing an embodiment of an image coding system of the present invention.
  • the wireless image transmission system In the field of aerial photography and entertainment of drones, wireless image transmission systems (referred to as wireless image transmission or image transmission) are increasingly becoming an integral part of drones.
  • the wireless image transmission system generally includes an image transmitting end and an image receiving end, and the image transmitting end includes a camera, an encoder, a wireless transmitter, and a first memory, and the image receiving end includes a wireless receiver, a decoder, a display, and a second Part of the memory and so on.
  • One method is to use two completely independent picture transmission systems.
  • Another method is to use two encoders to independently encode the images of the two cameras, then use a multiplexer to alternately transmit the two streams, and pass the two streams through the same set of wireless transmitters/receivers. The data is transmitted to the peer.
  • the above two multi-path map transmission schemes have the following disadvantages: first, the system complexity is high, and the system cost increases; second, the bandwidth demand is increased, the external environment is easily interfered, and the effective transmission distance is reduced; and third, if the image quality is lowered In exchange for a lower code rate, the user experience is reduced.
  • each source image is pre-processed, and then the pre-processed source image is pasted together to obtain a target image, and then the target image is encoded, in this way, the wireless bandwidth is limited and the main image is not reduced.
  • the purpose of simultaneously transmitting multiple images is achieved.
  • FIG. 1 is a flowchart of an embodiment of an image encoding method according to the present invention. The method includes:
  • Step S101 Receive at least two source images.
  • the source image refers to an image that has not been preprocessed, for example, a source image from a camera, or a source image from a camera, and the like.
  • At least two source images are respectively from at least two image sources.
  • source images from at least two cameras or source images from at least two cameras, or source images from cameras and cameras, and the like.
  • Step S102 Preprocessing each source image separately according to pre-configured pre-processing requirements.
  • the requirements for pre-processing the source image are pre-configured. After receiving at least two source images, each source image is pre-processed according to pre-configured pre-processing requirements.
  • the pre-processing includes, but is not limited to, at least one of a scaling process, a cropping process, and a scaling process.
  • the scaling process refers to scaling and enlargement of the image in the X-axis direction and the Y-axis direction. Cropping is the process of cropping a portion of an image and leaving another part.
  • the telescopic processing refers to reduction and enlargement in the X-axis direction or the Y-axis direction of the image, or unequal scaling and enlargement in the X-axis direction and the Y-axis direction of the image.
  • Step S103 Each pre-processed source image is pasted together according to a pre-configured texture requirement to obtain a target image.
  • the texture requirement refers to the requirement to glue together at least two pre-processed source images, such as texture order, texture coordinates, transparency, and so on. Pre-configure the mapping requirements, and paste each pre-processed source image according to the pre-configured texture requirements to obtain the target image. That is to say, in one embodiment, at least two pre-processed source images may be pasted together to obtain a target image. In summary, after fitting, the number of target images is made smaller than the number of source images.
  • Step S104 Encoding the target image.
  • Embodiments of the present invention receive at least two source images; pre-process each of the source images according to a pre-configured pre-processing requirement; and paste each pre-processed source image according to a pre-configured texture requirement Obtaining a target image; and encoding the target image. Since each source image is pre-processed, and then the pre-processed source image is pasted together to obtain a target image, and then the target image is encoded, in this way, the wireless bandwidth can be limited without reducing the main stream. Under the premise of reducing the image quality and reducing the wireless transmission distance, the purpose of simultaneously transmitting multiple images is achieved.
  • step S101 may include: storing each source image into a respective input buffer.
  • the step S102 further includes: storing each of the pre-processed source images into respective output buffers; and pasting each of the pre-processed source images according to the pre-configured texture requirements to obtain the target image.
  • Each of the pre-processed source images is separately stored in a respective output buffer, so that the pre-processed source image is acquired again as needed.
  • the pre-configured texture requirements include mapping order and texture coordinates.
  • the texture order refers to the order of each source image after pre-processing
  • the texture coordinates refer to the pre-position
  • Maps are made according to the map order and texture coordinates, and the target image is obtained.
  • step S103 may include: sequentially storing the preprocessed source image into the target cache according to the map order and the map coordinates, thereby forming a target image in the target cache.
  • the pre-processed source image is sequentially stored in the target cache, and the target image is formed in the target cache, so that the bonding process can be made in an orderly manner, and the target image can be obtained again when necessary.
  • step S103 may further include: at least partially overlapping or pre-screening the pre-processed source images.
  • step S103 may further include: setting the at least partially pre-processed source image to a hidden mode or a semi-transparent mode.
  • the method may further include: receiving a display requirement of the user; and setting a pre-processing requirement, a mapping requirement, and a startup identifier according to the display requirement.
  • the step of setting the pre-processing requirement, the mapping requirement, and the activation indicator according to the display requirement includes: managing an image input/output processing matrix table according to the display requirement, wherein the image input/output processing matrix table includes an image source identifier for distinguishing the image source Pre-processing requirements, texture requirements, and startup identifiers associated with the image source identifier.
  • step S101 may include: receiving source images respectively from image sources specified by the startup identifier.
  • the image input/output processing matrix table may further include whether to store the source image and the preprocessed source image, and may also include display transparency, that is, hidden display, transparent display or translucent display, and the like.
  • the format of the image input and output processing matrix table may be as shown in Table 1.
  • the image source identifier is exemplified by a numbered camera, and the startup identifier is taken as an example.
  • the preprocessing requirements include source resolution, target resolution, and stretching.
  • the texture requires the mapping order and texture coordinates as an example.
  • the system For each display request sent by the user, the system manages a "picture" as shown in Table 1. Like input and output processing matrix table, this table specifies whether each camera is enabled, whether to store the encoded code stream separately, the source resolution, the target resolution, whether the image resolution is transformed, and the image after the resolution is converted. The order in which the textures are mapped in the target cache, the starting coordinates of the texture, and so on.
  • the apparatus for performing the method is referred to as a “multiple input and output image processor", and according to the information and operation steps recorded in the “image input and output processing matrix table”, “multiple input and output image processor”
  • the process and main work content are:
  • the “multiple-in-one image processor” receives the source image output of each camera in parallel and temporarily stores the source image in the input buffer;
  • the "Multiple Input Image Processor” is based on the pre-configured “Source Resolution”, “Target Resolution”, “Whether the image is scaled”
  • the project performs scaling, cropping, scaling, and the like on the input source image.
  • the pre-processed source image is temporarily stored in an output buffer independently opened by each camera;
  • Multiple-in-one image processor sends the target image in the target buffer to the encoder, and the subsequent encoding, transmitting, receiving, storing, decoding, displaying, etc. are not much different from the traditional image transmission system. Therefore, no details of other work are detailed.
  • the transmission system includes a transmitting end and a receiving end, and the transmitting end includes: a camera 20 (camera 1, camera... The camera n) multiplies the image processor 21, the encoder 22, the wireless transmitter 23, and the first memory 24; the receiving end includes a wireless receiver 25, a decoder 26, a display 27, and a second memory 28.
  • the receiving end user can transmit the display request to the multiplexed image processor 21 of the transmitting end so that the "image input/output processing matrix table" is managed according to the display request.
  • the "multiple-in-one image processor” may include one or more processors.
  • the first memory 24 may store the source image, the preprocessed source image, and the target image.
  • FIGS 3 through 16 illustrate the scaling, cropping, stretching/contracting processing of the multiplexed image and the manner in which the multi-way images are ultimately represented in accordance with the above workflow.
  • Example 1 According to the image input and output processing matrix table of Table 2, after preprocessing the camera 1 (resolution 3840*2160) and camera 2 (resolution 1280*720), the display effect is as shown in FIG. 3.
  • Example 2 According to the image input and output processing matrix table of Table 3, after preprocessing the camera 1 (resolution 3840*2160) and camera 2 (resolution 1280*720), the display effect is as shown in FIG. 5.
  • Example 3 according to the table 4 image input and output processing matrix table, after preprocessing the camera 1 (resolution 3840 * 2160) and camera 2, 3, 4 (resolution is 1280 * 720), the display effect is shown in Figure 6. .
  • the image input and output processing matrix table is shown in Table 2.
  • the camera 1 is enabled to store the source image and the preprocessed source image.
  • the source image has a source resolution of 3840*2160 and the target image has a target resolution of 1280*720.
  • Stretch processing the first texture, the texture coordinates are (0,0);
  • Camera 2 is enabled, the source image and the preprocessed source image are not stored, the source image has a source resolution of 1280*720, and the target image is resolved.
  • the rate is 427*240, no stretching process, the second texture, the texture coordinates are (0,0); neither camera 3 nor camera 4 are activated.
  • the display effect of Table 2 is as shown in FIG. 3.
  • the image of the camera 1 is displayed as a main image, and the image of the camera 2 is displayed as a sub-image.
  • a display effect as shown in FIG. 4 can be obtained.
  • the image of the camera 2 is displayed as a main image, and the image of the camera 1 is displayed as a sub-image.
  • the source images of the camera 1 and the camera 2 are contracted in the left-right direction (i.e., the X-axis direction) during the stretching pre-processing, and are bonded side by side at the time of bonding.
  • the display effect of Table 3 is shown in Fig. 5.
  • the image input and output processing matrix table is shown in Table 4.
  • the display effect of Table 4 is shown in Fig. 6.
  • the source image of the camera X is first cropped up and down.
  • the image of the camera X is displayed as a main image, and the images of the cameras a, b, and c are displayed as sub-images.
  • FIG. 7 shows that the source image of the camera X is reduced and displayed as a main image, and the images of the cameras a, b, and c are displayed as sub-images.
  • Fig. 8 is an image of an equal division screen of cameras a, b, c, d.
  • the image of camera X in Fig. 9 is displayed as a main image, and the images of other cameras (a, b, c) are hidden display or translucent display.
  • the image of the camera 1 in Fig. 10 is displayed as a main image, and the image of the camera 2 is hidden or semi-transparent.
  • Fig. 11 the image of the camera 2 in Fig.
  • the images of the cameras 1, 2 in Fig. 12 are displayed side by side.
  • the images of the cameras 1, 2 in Fig. 13 are displayed side by side.
  • the images of the cameras 1, 2 in Fig. 14 are each cut by the upper and lower portions of the image, and then displayed side by side.
  • the images of the cameras 1, 2 in Fig. 15 are each cropped to the left and right portions of the image, and then displayed side by side.
  • the images of the cameras 1, 2 in Fig. 16 are first contracted in the up and down direction, and then displayed side by side.
  • the image transmission system may include more than five cameras, and the input and output processing matrix is further Can include a field about transparency.
  • FIG. 17 is a schematic structural diagram of an embodiment of an image coding system according to the present invention.
  • the system in this embodiment may perform the steps in the foregoing method.
  • details of the related content refer to the method section above, which is not described herein.
  • the system includes a source image receiving module 101, a preprocessing module 102, a target image obtaining module 103, and an encoding module 104.
  • the source image receiving module 101 is configured to receive at least two source images.
  • the pre-processing module 102 is configured to pre-process each source image separately according to pre-configured pre-processing requirements.
  • the target image obtaining module 103 is configured to paste each pre-processed source image together according to a pre-configured texture requirement to obtain a target image.
  • the encoding module 104 is for encoding the target image.
  • Embodiments of the present invention receive at least two source images; pre-process each of the source images according to a pre-configured pre-processing requirement; and paste each pre-processed source image according to a pre-configured texture requirement Obtaining a target image; and encoding the target image. Since each source image is pre-processed, and then the pre-processed source image is pasted together to obtain a target image, and then the target image is encoded, in this way, the wireless bandwidth can be limited without reducing the main stream. Under the premise of reducing the image quality and reducing the wireless transmission distance, the purpose of simultaneously transmitting multiple images is achieved.
  • At least two source images are respectively from at least two image sources.
  • the preprocessing includes at least one of a scaling process, a cropping process, and a scaling process.
  • the source image receiving module 101 includes: a storage unit.
  • the storage unit is used to store each source image into a respective input buffer.
  • the system further includes: a storage module.
  • the storage module is configured to store each of the preprocessed source images into respective output buffers.
  • the pre-configured texture requirements include mapping order and texture coordinates.
  • the target image obtaining module 103 is configured to sequentially store the preprocessed source image into the target cache according to the mapping order and the mapping coordinates, thereby forming a target image in the target cache.
  • the target image obtaining module 103 is configured to at least partially overlap or arrange the pre-processed source images.
  • the target image obtaining module 103 is configured to set the at least partially preprocessed source image to a hidden mode or a semi-transparent mode.
  • the system further includes: a display request receiving module and a setting module.
  • the setup module is used to set pre-processing requirements, map requirements, and startup IDs according to display requirements.
  • the setting module is configured to manage an image input and output processing matrix table according to the display requirement, wherein the image input and output processing matrix table includes an image source identifier for distinguishing the image source, a preprocessing requirement respectively associated with the image source identifier, and a texture requirement. And the startup logo.
  • the source image receiving module 101 is configured to receive source images respectively from image sources specified by the startup identifier.
  • FIG. 18 is a schematic structural diagram of an embodiment of an image coding system according to the present invention.
  • the system in this embodiment may perform the steps in the foregoing method.
  • details of the related content refer to the method section above, which is not described herein.
  • the system comprises: one or more processors 1 and an encoder 2;
  • One or more processors 1 for: receiving at least two source images; preprocessing each source image separately according to pre-configured pre-processing requirements; and pre-configuring each source image according to a pre-configured map It is required to fit together to obtain the target image.
  • the encoder 2 is used to encode the target image.
  • Embodiments of the present invention receive at least two source images; pre-process each of the source images according to a pre-configured pre-processing requirement; and paste each pre-processed source image according to a pre-configured texture requirement Obtaining a target image; and encoding the target image. Since each source image is pre-processed, and then the pre-processed source image is pasted together to obtain a target image, and then the target image is encoded, in this way, the wireless bandwidth can be limited without reducing the main stream. Under the premise of reducing the image quality and reducing the wireless transmission distance, the purpose of simultaneously transmitting multiple images is achieved.
  • system further comprises at least two image sources, the at least two source images being respectively from at least two image sources.
  • the preprocessing includes at least one of a scaling process, a cropping process, and a scaling process.
  • the one or more processors 1 include an input buffer, an output buffer, and a target cache; each source image is stored into a respective allocated input buffer; each of the pre-processed source images is stored in a respective output buffer; And the target image is stored in the target cache.
  • the pre-configured texture requirements include mapping order and texture coordinates.
  • the one or more processors 1 are configured to sequentially store the preprocessed source images into the target cache according to the mapping order and the mapping coordinates, thereby forming a target image in the target cache.
  • the one or more processors 1 are configured to at least partially overlap or arrange the pre-processed source images.
  • the one or more processors 1 are configured to set the at least partially pre-processed source image to a hidden mode or a semi-transparent mode.
  • At least two image sources are at least two cameras.
  • the processor 1 or the processor 1 is further configured to receive a display request of the user; and is further configured to set a pre-processing requirement, a mapping requirement, and a startup identifier according to the display requirement.
  • the one or more processors 1 are configured to manage an image input and output processing matrix table according to the display requirement, wherein the image input/output processing matrix table includes an image source identifier for distinguishing the image source and a pre-associated with the image source identifier respectively. Processing requirements, map requirements, and startup ID.
  • the image input/output processing matrix table further includes a startup identifier respectively associated with the image source identifier; the one or more processors 1 are configured to receive the source images respectively from the image source specified by the startup identifier.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Image Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

公开了一种图像编码方法及系统，该方法包括：接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及将所述目标图像进行编码。通过这种方式，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。

Description

图像编码方法及系统 【技术领域】
本发明涉及图像编码技术领域，特别是涉及一种图像编码方法及系统。
【背景技术】
在无人机航拍和娱乐领域，无线图像传输系统(简称无线图传或者图传)日益成为无人机不可或缺的组成部分。
随着市场的发展以及需求的多样化，无人机上安装两个甚至更多相机，同时进行多路图像传输的需求越来越强烈。利用现有的技术条件，有以下方法可以比较容易地实现多路图传的需求(这里以两路图传的需求为例)：
例如：使用两套完全独立的图传系统，分别对图像进行采集、编码、发送、接收、解码、显示、存储等等，两套系统独立工作，互不干涉(无线发送和接收部分除外)。
又如：使用两个编码器对两个相机的图像独立进行编码，然后使用一个复用器将两路码流交替进行传输，通过同一套无线发送/接收器将两路码流的数据传输给对端，对端接收到数据后，再使用一个解复用器将数据恢复成两路独立的图像码流，然后再分别对两路码流进行解码、显示、存储等后续工作。
但是，上述两种多路图传的方案无法同时满足带宽不变、图像质量不变、有效传输距离不变的多重要求。
【发明内容】
本发明主要解决的技术问题是提供一种图像编码方法及系统，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。
为解决上述技术问题，本发明采用的一个技术方案是：提供一种图像编码方法，所述方法包括：接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及将所述目标图像进行编码。
其中，所述至少两个源图像分别来自至少两个图像源。
其中，所述预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
其中，所述接收至少两个源图像的步骤包括：将每一所述源图像存储到各自的输入缓存中。
其中，所述按照预先配置的预处理要求，分别对所述源图像进行预处理的步骤之后进一步包括：将预处理后的每个源图像分别存储到各自的输出缓存中；以及将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤。
其中，所述预先配置的贴图要求包括贴图顺序和贴图坐标。
其中，所述将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤包括：根据所述贴图顺序和贴图坐标将所述预处理后的源图像依次存储至目标缓存中，进而在所述目标缓存中形成所述目标图像。
其中，所述将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤包括：将所述预处理后的源图像至少部分重叠设置或分屏排列。
其中，所述将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤包括：将至少部分所述预处理后的源图像设置成隐藏方式或半透明方式。
其中，所述接收至少两个源图像的步骤之前，包括：接收用户的显示要求；以及按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识。
其中，所述按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识的步骤包括：根据所述显示要求管理一图像输入输出处理矩阵表，其中所述图像输入输出处理矩阵表中包括用于区分所述图像源的图像源标识、分别与所述图像源标识关联的所述预处理要求、所述贴图要求以及所述启动标识。
其中，所述接收至少两个源图像的步骤包括：接收分别来自所述启动标识所指定的所述图像源的源图像。
为解决上述技术问题，本发明采用的另一个技术方案是：提供一种图像编码系统，所述系统包括：源图像接收模块，用于接收至少两个源图像；预处理模块，用于按照预先配置的预处理要求，分别对每个所述源图像进行预处理；目标图像获得模块，用于将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及编码模块，用于将所述目标图像进行编码。
其中，所述至少两个源图像分别来自至少两个图像源。
其中，所述预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
其中，所述源图像接收模块包括：存储单元，用于将每一所述源图像存储到各自的输入缓存中。
其中，所述系统还包括：存储模块，用于将预处理后的每个源图像分别存储到各自的输出缓存中。
其中，所述预先配置的贴图要求包括贴图顺序和贴图坐标。
其中，所述目标图像获得模块用于根据所述贴图顺序和贴图坐标将所述预处理后的源图像依次存储至目标缓存中，进而在所述目标缓存中形成所述目标图像。
其中，所述目标图像获得模块用于将所述预处理后的源图像至少部分重叠设置或分屏排列。
其中，所述目标图像获得模块用于将至少部分所述预处理后的源图像设置成隐藏方式或半透明方式。
其中，所述系统还包括：显示要求接收模块，用于接收用户的显示要求；以及设置模块，用于按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识。
其中，所述设置模块用于根据所述显示要求管理一图像输入输出处理矩阵表，其中所述图像输入输出处理矩阵表中包括用于区分所述图像源的图像源标识、分别与所述图像源标识关联的所述预处理要求、所述贴图要求以及所述启动标识。
其中，所述源图像接收模块用于接收分别来自所述启动标识所指定的所述图像源的源图像。
为解决上述技术问题，本发明采用的又一个技术方案是：提供一种图像编码系统，所述系统包括：一个或多个处理器以及编码器；所述一个或多个处理器用于：接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；以及将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；所述编码器用于将所述目标图像进行编码。
其中，所述系统还包括至少两个图像源，所述至少两个源图像分别来自所述至少两个图像源。
其中，所述预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
其中，所述一个或多个处理器包括输入缓存、输出缓存及目标缓存；每一所述源图像被存储到各自分配的所述输入缓存中；预处理后的每一所述源图像 被存储到各自的所述输出缓存中；以及所述目标图像被存储到所述目标缓存中。
其中，所述预先配置的贴图要求包括贴图顺序和贴图坐标。
其中，所述一个或多个处理器用于根据所述贴图顺序和贴图坐标将所述预处理后的源图像依次存储至所述目标缓存中，进而在所述目标缓存中形成所述目标图像。
其中，所述一个或多个处理器用于将所述预处理后的源图像至少部分重叠设置或分屏排列。
其中，所述一个或多个处理器用于将至少部分所述预处理后的源图像设置成隐藏方式或半透明方式。
其中，所述至少两个图像源为至少两个相机。
其中，所述一个或多个处理器还用于接收用户的显示要求；以及所述一个或多个处理器还用于按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识。
其中，所述一个或多个处理器用于根据所述显示要求管理一图像输入输出处理矩阵表，其中所述图像输入输出处理矩阵表中包括用于区分所述图像源的图像源标识、分别与所述图像源标识关联的所述预处理要求、所述贴图要求以及所述启动标识。
其中，所述图像输入输出处理矩阵表中进一步包括分别与所述图像源标识关联的启动标识；所述一个或多个处理器用于接收分别来自所述启动标识所指定的所述图像源的源图像。
本发明的有益效果是：区别于现有技术的情况，本发明接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及将所述目标图像进行编码。由于对每个源图像先进行预处理，然后将预处理后的源图像贴合在一起获得目标图像，再对目标图像进行编码，通过这种方式，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。
【附图说明】
图1是本发明图像编码方法一实施方式的流程图；
图2是本发明图像编码方法在一实施方式中图传系统的整体架构图；
图3至图16是本发明图像编码方法经在实际应用中最终表现出的多路图像的排布方式示意图；
图17是本发明图像编码系统一实施方式的结构示意图；
图18是本发明图像编码系统一实施方式的结构示意图。
【具体实施方式】
在详细介绍本申请之前，先说明一下现有技术的情况。
在无人机航拍和娱乐领域，无线图像传输系统(简称无线图传或者图传)日益成为无人机不可或缺的组成部分。现有技术中无线图传系统一般包括图像发送端和图像接收端，图像发送端包括相机、编码器、无线发送器、第一存储器，图像接收端包括无线接收器、解码器、显示器、第二存储器等部分组成。
利用现有的技术条件，有以下方法可以比较容易地实现多路图传的需求(这里以两路图传的需求为例)：一种方法是：使用两套完全独立的图传系统。另一种方法是：使用两个编码器对两个相机的图像独立进行编码，然后使用一个复用器将两路码流交替进行传输，通过同一套无线发送/接收器将两路码流的数据传输给对端。
上述两种多路图传的方案有以下缺点：第一、系统复杂度高，系统成本增加；第二、带宽需求增加，容易受外界环境干扰，有效传输距离减少；第三、如果降低图像质量以换取更低的码率，会降低用户体验。
本发明由于对每个源图像先进行预处理，然后将预处理后的源图像贴合在一起获得目标图像，再对目标图像进行编码，通过这种方式，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。
下面结合附图和实施例对本发明进行详细说明。
参见图1，图1是本发明图像编码方法一实施方式的流程图，该方法包括：
步骤S101：接收至少两个源图像。
源图像是指没有经过预处理的图像，例如，来自相机的源图像，或者来自摄像机的源图像等等。
其中，至少两个源图像分别来自至少两个图像源。例如，来自至少两个相机的源图像，或者来自至少两个摄像机的源图像，或者来自相机和摄像机的源图像，等等。
步骤S102：按照预先配置的预处理要求，分别对每个源图像进行预处理。
预先配置好对源图像进行预处理的要求，当接收到至少两个源图像后，分别按照预先配置的预处理要求，对每个源图像进行预处理。
预处理包括但不限于：缩放处理、裁剪处理、伸缩处理中的至少一个。缩放处理是指在图像的X轴方向和Y轴方向等比例的缩小和放大。裁剪处理是指将图像的一部分裁剪掉，保留另外一部分。伸缩处理是指在图像的X轴方向或者Y轴方向进行缩小和放大，或者在图像的X轴方向和Y轴方向进行不等比例的缩小和放大。
步骤S103：将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像。
贴图要求是指将至少两个经过预处理后的源图像贴合在一起的要求，例如：贴图顺序、贴图坐标、透明度等等。预先配置好贴图要求，将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像。也即是说，在一个实施方式中，可以将至少两个经过预处理后的源图像贴合在一起，获得一个目标图像。总之，经过贴合后，使得目标图像的数量少于源图像的数量。
步骤S104：将目标图像进行编码。
本发明实施方式接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及将所述目标图像进行编码。由于对每个源图像先进行预处理，然后将预处理后的源图像贴合在一起获得目标图像，再对目标图像进行编码，通过这种方式，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。
其中，步骤S101可以包括：将每一源图像存储到各自的输入缓存中。
将源图像存储到各自的输入缓存中，以备需要时再次获取源图像。
其中，步骤S102之后进一步包括：将预处理后的每个源图像分别存储到各自的输出缓存中；以及将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤。
将预处理后的每个源图像分别存储到各自的输出缓存中，以备需要时再次获取预处理后的源图像。
其中，预先配置的贴图要求包括贴图顺序和贴图坐标。
贴图顺序是指预处理后的每个源图像在贴图时的顺序，贴图坐标是指预处 理后的每个源图像在贴图时的坐标位置。根据贴图顺序和贴图坐标即可进行贴图，并获得目标图像。
此时，步骤S103可以包括：根据贴图顺序和贴图坐标将预处理后的源图像依次存储至目标缓存中，进而在目标缓存中形成目标图像。
将预处理后的源图像依次存储至目标缓存中，在目标缓存中形成目标图像，可以让贴合处理有条不紊，且以备需要时再次获得目标图像。
在一实施方式中，步骤S103还可以包括：将预处理后的源图像至少部分重叠设置或分屏排列。
在另一实施方式中，步骤S103还可以包括：将至少部分预处理后的源图像设置成隐藏方式或半透明方式。
其中，步骤S101之前，还可以包括：接收用户的显示要求；以及按照显示要求设置预处理要求、贴图要求及启动标识。
此时，按照显示要求设置预处理要求、贴图要求及启动标识的步骤包括：根据显示要求管理一图像输入输出处理矩阵表，其中图像输入输出处理矩阵表中包括用于区分图像源的图像源标识、分别与图像源标识关联的预处理要求、贴图要求以及启动标识。
此时，步骤S101可以包括：接收分别来自启动标识所指定的图像源的源图像。
其中，图像输入输出处理矩阵表中还可以包括是否对源图像和预处理后的源图像进行存储，还可以包括显示透明度，即隐藏显示、透明显示或者半透明显示等等。
例如，图像输入输出处理矩阵表的格式可以如表1所示，图像源标识以编号相机为例，启动标识以是否启动为例，预处理要求包括以源分辨率、目标分辨率、是否拉伸为例，贴图要求以贴图顺序和贴图坐标为例。
表1图像输入输出处理矩阵表的格式
Figure PCTCN2016098605-appb-000001
对于每一种用户发送的显示要求，系统中都管理有一张如表1所示的“图 像输入输出处理矩阵表”，该表格规定了每个相机是否启用、是否单独存储编码码流、源分辨率、目标分辨率、图像分辨率变换时是否进行伸缩变形操作、变换分辨率后的图像在目标缓存中贴图的顺序，贴图的起始坐标等等。
在本实施方式中，将执行本方法的装置称呼为“多入一出图像处理器”，根据该“图像输入输出处理矩阵表”所记录的信息和操作步骤，“多入一出图像处理器”的流程和主要的工作内容有：
1)根据“图像输入输出处理矩阵表”决定是否启用并接收该相机的图像；
2)根据“图像输入输出处理矩阵表”决定是否对该路相机源图像单独进行压缩和存储；
3)对于配置为“启用”的所有相机，“多入一出图像处理器”并行地接收每个相机的源图像输出，并将源图像暂存在输入缓存中；
4)每接收到每个相机的一帧完整的源图像，“多入一出图像处理器”便根据预先配置的“源分辨率”、“目标分辨率”、“是否对图像进行伸缩变换”等项目对输入的源图像进行缩放、裁剪、伸缩等预处理，预处理完毕后，将预处理后的源图像暂存在为每个相机独立开辟的输出缓存中；
6)在对所有启用的相机进行帧同步后，根据配置表格中的贴图顺序以及贴图坐标，按顺序将每个相机的输出缓存中的预处理后的源图像拷贝到最终的目标缓存中，进而形成目标图像；
7)“多入一出图像处理器”将目标缓存中的目标图像发送给编码器，此后的编码、发送、接收、存储、解码、显示等工作与传统的图传系统并无太大不同，因此不再详述其它工作细节；
8)当用户希望改变多路图像在显示器中显示方式的时候，可以在接收端向发送端发送命令，选择另外一种预先规定好的显示格式，“多入一出图像处理器”收到该命令后，便可根据新的“图像输入输出处理矩阵表”对相机的源图像进行重新处理，从而按照用户希望的方式进行显示。
在一实施方式中，上述实施方式的图传系统的整体架构图请参见图2，该图传系统包括发送端和接收端，发送端包括：相机20(相机1、相机......，相机n)，多入一出图像处理器21、编码器22、无线发送器23以及第一存储器24；接收端包括：无线接收器25、解码器26、显示器27以及第二存储器28。接收端用户可以将显示要求发送给发送端的多入一出图像处理器21，以使得根据显示要求管理“图像输入输出处理矩阵表”。
在一实施方式中，所述“多入一处图像处理器”可以包括一个或多个处理器。
在一实施方式中，所述第一存储器24可以存储上述源图像、经过预处理后的源图像以及目标图像。
图3至图16展示了根据以上工作流程所进行的的多路图像的缩放、裁剪、拉伸/收缩处理方式以及最终表现出的多路图像的排布方式。
举例说明：
示例一、根据表2的图像输入输出处理矩阵表，对相机1(分辨率3840*2160)和相机2(分辨率1280*720)预处理后，显示效果如图3所示。
示例二、根据表3的图像输入输出处理矩阵表，对相机1(分辨率3840*2160)和相机2(分辨率1280*720)预处理后，显示效果如图5所示。
示例三、根据表4图像输入输出处理矩阵表，对相机1(分辨率3840*2160)和相机2，3，4(分辨率均为1280*720)预处理后，显示效果如图6所示。
图3～图16的具体内容如下：
图像输入输出处理矩阵表如表2所示，相机1启用，存储源图像和预处理后的源图像，源图像的源分辨率为3840*2160，目标图像的目标分辨率为1280*720，不拉伸处理，第1个贴图，贴图坐标为(0，0)；相机2启用，不存储源图像和预处理后的源图像，源图像的源分辨率为1280*720，目标图像的目标分辨率为427*240，不拉伸处理，第2个贴图，贴图坐标为(0，0)；相机3和相机4均不启动。表2的显示效果如图3所示，在目标图像中，相机1的图像显示为主图像，相机2的图像显示为副图像。在另一实施方式中，改变表2，可以获得如图4所示的显示效果，此时，在目标图像中，相机2的图像显示为主图像，相机1的图像显示为副图像。
表2图像输入输出处理矩阵表示例一
Figure PCTCN2016098605-appb-000002
图像输入输出处理矩阵表如表3所示，在拉伸预处理时，分别对相机1和相机2的源图像进行左右方向(即X轴方向)收缩，在贴合时，左右并排贴合。表3的显示效果如图5所示。
表3图像输入输出处理矩阵表示例二
Figure PCTCN2016098605-appb-000003
图像输入输出处理矩阵表如表4所示。表4的显示效果如图6所示。预处理时，先对相机X的源图像进行上下裁剪，在目标图像中，相机X的图像显示为主图像，相机a、b、c的图像显示为副图像。
表4图像输入输出处理矩阵表示例三
Figure PCTCN2016098605-appb-000004
参见图7，图7是先对相机X的源图像进行缩小后显示为主图像，相机a、b、c的图像显示为副图像。参见图8，图8是对相机a、b、c、d的图像等分屏幕进行显示的。参见图9，图9中相机X的图像显示为主图像，其它相机(a、b、c)的图像为隐藏显示或者半透明显示。参见图10，图10中相机1的图像显示为主图像，相机2的图像隐藏显示或者半透明显示。参见图11，图11中相机2的图像显示为主图像，相机1的图像隐藏显示或者半透明显示。参见图12，图12中相机1、2的图像左右并排显示。参见图13，图13中相机1、2的图像上下并排显示。参见图14，图14中相机1、2的图像各自先裁剪上下部分图像，然后上下并排显示。参见图15，图15中相机1、2的图像各自先裁剪左右部分图像，然后左右并排显示。参见图16，图16中相机1、2的图像各自先进行上下方向的收缩，然后上下并排显示。
值得注意的是，以上描述中的相机的数量及其配置方式，以及图像的排列及显示方式，仅为了便于理解本发明，不应被认为是本发明唯一的实施方式。对本领域的普通技术人员来说，可在理解本发明的基础上对本发明的形式、数量及内容上做出一些修改及变换，但所述修改及变换仍在本发明的保护范围之内。例如：所述图传系统可以包括五个以上相机，所述输入输出处理矩阵表还 可以包括一个关于透明度的字段。
参见图17，图17是本发明图像编码系统一实施方式的结构示意图，本实施方式的系统可以执行上述方法中的步骤，相关内容的详细说明请参见上述方法部分，在此不再赘叙。
该系统包括：源图像接收模块101、预处理模块102、目标图像获得模块103以及编码模块104。
源图像接收模块101用于接收至少两个源图像。
预处理模块102用于按照预先配置的预处理要求，分别对每个源图像进行预处理。
目标图像获得模块103用于将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像。
编码模块104用于将目标图像进行编码。
本发明实施方式接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及将所述目标图像进行编码。由于对每个源图像先进行预处理，然后将预处理后的源图像贴合在一起获得目标图像，再对目标图像进行编码，通过这种方式，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。
其中，至少两个源图像分别来自至少两个图像源。
其中，预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
其中，源图像接收模块101包括：存储单元。
存储单元用于将每一源图像存储到各自的输入缓存中。
其中，该系统还包括：存储模块。
存储模块用于将预处理后的每个源图像分别存储到各自的输出缓存中。
其中，预先配置的贴图要求包括贴图顺序和贴图坐标。
其中，目标图像获得模块103用于根据贴图顺序和贴图坐标将预处理后的源图像依次存储至目标缓存中，进而在目标缓存中形成目标图像。
其中，目标图像获得模块103用于将预处理后的源图像至少部分重叠设置或分屏排列。
其中，目标图像获得模块103用于将至少部分预处理后的源图像设置成隐藏方式或半透明方式。
其中，该系统还包括：显示要求接收模块和设置模块。
显示要求接收模块用于接收用户的显示要求；以及
设置模块用于按照显示要求设置预处理要求、贴图要求及启动标识。
其中，设置模块用于根据显示要求管理一图像输入输出处理矩阵表，其中图像输入输出处理矩阵表中包括用于区分图像源的图像源标识、分别与图像源标识关联的预处理要求、贴图要求以及启动标识。
其中，源图像接收模块101用于接收分别来自启动标识所指定的图像源的源图像。
参见图18，图18是本发明图像编码系统一实施方式的结构示意图，本实施方式的系统可以执行上述方法中的步骤，相关内容的详细说明请参见上述方法部分，在此不再赘叙。
该系统包括：一个或多个处理器1以及编码器2；
一个或多个处理器1用于：接收至少两个源图像；按照预先配置的预处理要求，分别对每个源图像进行预处理；以及将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像。
编码器2用于将目标图像进行编码。
本发明实施方式接收至少两个源图像；按照预先配置的预处理要求，分别对每个所述源图像进行预处理；将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及将所述目标图像进行编码。由于对每个源图像先进行预处理，然后将预处理后的源图像贴合在一起获得目标图像，再对目标图像进行编码，通过这种方式，能够在无线带宽有限、不降低主码流的图像质量、不缩减无线传输距离的前提下，达到同时传输多路图像的目的。
其中，该系统还包括至少两个图像源，至少两个源图像分别来自至少两个图像源。
其中，预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
其中，一个或多个处理器1包括输入缓存、输出缓存及目标缓存；每一源图像被存储到各自分配的输入缓存中；预处理后的每一源图像被存储到各自的输出缓存中；以及目标图像被存储到目标缓存中。
其中，预先配置的贴图要求包括贴图顺序和贴图坐标。
其中，一个或多个处理器1用于根据贴图顺序和贴图坐标将预处理后的源图像依次存储至目标缓存中，进而在目标缓存中形成目标图像。
其中，一个或多个处理器1用于将预处理后的源图像至少部分重叠设置或分屏排列。
其中，一个或多个处理器1用于将至少部分预处理后的源图像设置成隐藏方式或半透明方式。
其中，至少两个图像源为至少两个相机。
其中，一个或多个处理器1还用于接收用户的显示要求；以及还用于按照显示要求设置预处理要求、贴图要求及启动标识。
其中，一个或多个处理器1用于根据显示要求管理一图像输入输出处理矩阵表，其中图像输入输出处理矩阵表中包括用于区分图像源的图像源标识、分别与图像源标识关联的预处理要求、贴图要求以及启动标识。
其中，图像输入输出处理矩阵表中进一步包括分别与图像源标识关联的启动标识；一个或多个处理器1用于接收分别来自启动标识所指定的图像源的源图像。
以上所述仅为本发明的实施方式，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。

Claims (36)

  1. 一种图像编码方法，其特征在于，所述方法包括：
    接收至少两个源图像；
    按照预先配置的预处理要求，分别对每个所述源图像进行预处理；
    将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及
    将所述目标图像进行编码。
  2. 根据权利要求1所述的方法，其特征在于，所述至少两个源图像分别来自至少两个图像源。
  3. 根据权利要求1所述的方法，其特征在于，所述预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
  4. 根据权利要求1所述的方法，其特征在于，所述接收至少两个源图像的步骤包括：
    将每一所述源图像存储到各自的输入缓存中。
  5. 根据权利要求1所述的方法，其特征在于，所述按照预先配置的预处理要求，分别对所述源图像进行预处理的步骤之后进一步包括：
    将预处理后的每个源图像分别存储到各自的输出缓存中；以及
    将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤。
  6. 根据权利要求1所述的方法，其特征在于，所述预先配置的贴图要求包括贴图顺序和贴图坐标。
  7. 根据权利要求6所述的方法，其特征在于，所述将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤包括：
    根据所述贴图顺序和贴图坐标将所述预处理后的源图像依次存储至目标缓 存中，进而在所述目标缓存中形成所述目标图像。
  8. 根据权利要求1所述的方法，其特征在于，所述将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤包括：
    将所述预处理后的源图像至少部分重叠设置或分屏排列。
  9. 根据权利要求1所述的方法，其特征在于，所述将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像的步骤包括：
    将至少部分所述预处理后的源图像设置成隐藏方式或半透明方式。
  10. 根据权利要求2所述的方法，其特征在于，所述接收至少两个源图像的步骤之前，包括：
    接收用户的显示要求；以及
    按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识。
  11. 根据权利要求10所述的方法，其特征在于，所述按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识的步骤包括：
    根据所述显示要求管理一图像输入输出处理矩阵表，其中所述图像输入输出处理矩阵表中包括用于区分所述图像源的图像源标识、分别与所述图像源标识关联的所述预处理要求、所述贴图要求以及所述启动标识。
  12. 根据权利要求11所述的方法，其特征在于，所述接收至少两个源图像的步骤包括：
    接收分别来自所述启动标识所指定的所述图像源的源图像。
  13. 一种图像编码系统，其特征在于，所述系统包括：
    源图像接收模块，用于接收至少两个源图像；
    预处理模块，用于按照预先配置的预处理要求，分别对每个所述源图像进行预处理；
    目标图像获得模块，用于将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；以及
    编码模块，用于将所述目标图像进行编码。
  14. 根据权利要求13所述的系统，其特征在于，所述至少两个源图像分别来自至少两个图像源。
  15. 根据权利要求13所述的系统，其特征在于，所述预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
  16. 根据权利要求13所述的系统，其特征在于，所述源图像接收模块包括：
    存储单元，用于将每一所述源图像存储到各自的输入缓存中。
  17. 根据权利要求13所述的系统，其特征在于，所述系统还包括：
    存储模块，用于将预处理后的每个源图像分别存储到各自的输出缓存中。
  18. 根据权利要求13所述的系统，其特征在于，所述预先配置的贴图要求包括贴图顺序和贴图坐标。
  19. 根据权利要求18所述的系统，其特征在于，所述目标图像获得模块用于根据所述贴图顺序和贴图坐标将所述预处理后的源图像依次存储至目标缓存中，进而在所述目标缓存中形成所述目标图像。
  20. 根据权利要求13所述的系统，其特征在于，所述目标图像获得模块用于将所述预处理后的源图像至少部分重叠设置或分屏排列。
  21. 根据权利要求13所述的系统，其特征在于，所述目标图像获得模块用于将至少部分所述预处理后的源图像设置成隐藏方式或半透明方式。
  22. 根据权利要求14所述的系统，其特征在于，所述系统还包括：
    显示要求接收模块，用于接收用户的显示要求；以及
    设置模块，用于按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识。
  23. 根据权利要求22所述的系统，其特征在于，所述设置模块用于根据所述显示要求管理一图像输入输出处理矩阵表，其中所述图像输入输出处理矩阵表中包括用于区分所述图像源的图像源标识、分别与所述图像源标识关联的所述预处理要求、所述贴图要求以及所述启动标识。
  24. 根据权利要求23所述的系统，其特征在于，所述源图像接收模块用于接收分别来自所述启动标识所指定的所述图像源的源图像。
  25. 一种图像编码系统，其特征在于，所述系统包括：一个或多个处理器以及编码器；
    所述一个或多个处理器用于：
    接收至少两个源图像；
    按照预先配置的预处理要求，分别对每个所述源图像进行预处理；以及
    将预处理后的每个源图像按照预先配置的贴图要求贴合在一起，获得目标图像；
    所述编码器用于将所述目标图像进行编码。
  26. 根据权利要求25所述的系统，其特征在于，所述系统还包括至少两个图像源，所述至少两个源图像分别来自所述至少两个图像源。
  27. 根据权利要求25所述的系统，其特征在于，所述预处理包括缩放处理、裁剪处理、伸缩处理中的至少一个。
  28. 根据权利要求25所述的系统，其特征在于，所述一个或多个处理器包括输入缓存、输出缓存及目标缓存；
    每一所述源图像被存储到各自分配的所述输入缓存中；
    预处理后的每一所述源图像被存储到各自的所述输出缓存中；以及
    所述目标图像被存储到所述目标缓存中。
  29. 根据权利要求28所述的系统，其特征在于，所述预先配置的贴图要求包括贴图顺序和贴图坐标。
  30. 根据权利要求29所述的系统，其特征在于，所述一个或多个处理器用于根据所述贴图顺序和贴图坐标将所述预处理后的源图像依次存储至所述目标缓存中，进而在所述目标缓存中形成所述目标图像。
  31. 根据权利要求25所述的系统，其特征在于，所述一个或多个处理器用于将所述预处理后的源图像至少部分重叠设置或分屏排列。
  32. 根据权利要求25所述的系统，其特征在于，所述一个或多个处理器用于将至少部分所述预处理后的源图像设置成隐藏方式或半透明方式。
  33. 根据权利要求26所述的系统，其特征在于，所述至少两个图像源为至少两个相机。
  34. 根据权利要求26所述的系统，其特征在于，
    所述一个或多个处理器还用于接收用户的显示要求；以及
    所述一个或多个处理器还用于按照所述显示要求设置所述预处理要求、所述贴图要求及启动标识。
  35. 根据权利要求34所述的系统，其特征在于，所述一个或多个处理器用于根据所述显示要求管理一图像输入输出处理矩阵表，其中所述图像输入输出处理矩阵表中包括用于区分所述图像源的图像源标识、分别与所述图像源标识关联的所述预处理要求、所述贴图要求以及所述启动标识。
  36. 根据权利要求35所述的系统，其特征在于，所述图像输入输出处理矩阵表中进一步包括分别与所述图像源标识关联的启动标识；
    所述一个或多个处理器用于接收分别来自所述启动标识所指定的所述图像源的源图像。
PCT/CN2016/098605 2016-09-09 2016-09-09 图像编码方法及系统 WO2018045571A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/CN2016/098605 WO2018045571A1 (zh) 2016-09-09 2016-09-09 图像编码方法及系统
CN201680002384.8A CN107005703A (zh) 2016-09-09 2016-09-09 图像编码方法及系统
US16/294,295 US10972681B2 (en) 2016-09-09 2019-03-06 Image encoding method and system
US17/222,594 US20210250522A1 (en) 2016-09-09 2021-04-05 Image encoding method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/098605 WO2018045571A1 (zh) 2016-09-09 2016-09-09 图像编码方法及系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/294,295 Continuation US10972681B2 (en) 2016-09-09 2019-03-06 Image encoding method and system

Publications (1)

Publication Number Publication Date
WO2018045571A1 true WO2018045571A1 (zh) 2018-03-15

Family

ID=59431762

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/098605 WO2018045571A1 (zh) 2016-09-09 2016-09-09 图像编码方法及系统

Country Status (3)

Country Link
US (2) US10972681B2 (zh)
CN (1) CN107005703A (zh)
WO (1) WO2018045571A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018045571A1 (zh) * 2016-09-09 2018-03-15 深圳市大疆创新科技有限公司 图像编码方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100157017A1 (en) * 2008-12-23 2010-06-24 Tandberg Telecom As Method, device and computer system for processing images in a conference between a plurality of video conferencing terminals
CN102098443A (zh) * 2010-12-28 2011-06-15 华为终端有限公司 一种摄像设备、通信系统和相应的图像处理方法
CN102724433A (zh) * 2012-06-18 2012-10-10 深圳锐取信息技术股份有限公司 一种实现多种视频信号画面合成的方法与装置
CN103024363A (zh) * 2013-01-10 2013-04-03 深圳市长江力伟股份有限公司 一种多路视频拼接方法、系统及电子装置
CN104661085A (zh) * 2013-11-22 2015-05-27 中兴通讯股份有限公司 多路无线显示方法及装置
CN204887208U (zh) * 2015-09-07 2015-12-16 深圳六滴科技有限公司 一种拼接视频数据的系统以及装置

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6937755B2 (en) * 2000-06-27 2005-08-30 Rami Orpaz Make-up and fashion accessory display and marketing system and method
US8605983B2 (en) * 2007-08-17 2013-12-10 Renishaw Plc Non-contact probe
US9237317B2 (en) * 2009-05-02 2016-01-12 Steven J. Hollinger Throwable camera and network for operating the same
CN101702305B (zh) 2009-10-23 2012-06-06 广东威创视讯科技股份有限公司 多屏图像转换传输处理方法和装置
US8874090B2 (en) * 2010-04-07 2014-10-28 Apple Inc. Remote control operations in a video conference
CN101938623A (zh) * 2010-09-09 2011-01-05 宇龙计算机通信科技(深圳)有限公司 一种基于视频通话的多路图像传输方法及终端
CN101984463A (zh) * 2010-11-02 2011-03-09 中兴通讯股份有限公司 全景图合成方法及装置
US10841508B2 (en) * 2011-06-10 2020-11-17 Flir Systems, Inc. Electrical cabinet infrared monitor systems and methods
KR20140133351A (ko) * 2013-05-10 2014-11-19 삼성전자주식회사 원격 제어 장치, 디스플레이 장치 및 이들의 제어 방법
US9438794B2 (en) * 2013-06-25 2016-09-06 Omnivision Technologies, Inc. Method and apparatus for distributed image processing in cameras for minimizing artifacts in stitched images
CN103595896B (zh) * 2013-11-19 2017-06-09 广东威创视讯科技股份有限公司 超高清分辨率图像同步显示方法和系统
US9558536B2 (en) * 2015-04-01 2017-01-31 Apple Inc. Blur downscale
CN105282597B (zh) 2015-10-17 2018-12-07 浙江宇视科技有限公司 一种视频流缩放装置和方法
CN105898384B (zh) * 2016-04-26 2019-03-22 广州盈可视电子科技有限公司 一种流媒体视频混合帧率控制的方法和装置
WO2018045571A1 (zh) * 2016-09-09 2018-03-15 深圳市大疆创新科技有限公司 图像编码方法及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100157017A1 (en) * 2008-12-23 2010-06-24 Tandberg Telecom As Method, device and computer system for processing images in a conference between a plurality of video conferencing terminals
CN102098443A (zh) * 2010-12-28 2011-06-15 华为终端有限公司 一种摄像设备、通信系统和相应的图像处理方法
CN102724433A (zh) * 2012-06-18 2012-10-10 深圳锐取信息技术股份有限公司 一种实现多种视频信号画面合成的方法与装置
CN103024363A (zh) * 2013-01-10 2013-04-03 深圳市长江力伟股份有限公司 一种多路视频拼接方法、系统及电子装置
CN104661085A (zh) * 2013-11-22 2015-05-27 中兴通讯股份有限公司 多路无线显示方法及装置
CN204887208U (zh) * 2015-09-07 2015-12-16 深圳六滴科技有限公司 一种拼接视频数据的系统以及装置

Also Published As

Publication number Publication date
US10972681B2 (en) 2021-04-06
CN107005703A (zh) 2017-08-01
US20190208138A1 (en) 2019-07-04
US20210250522A1 (en) 2021-08-12

Similar Documents

Publication Publication Date Title
CN100459674C (zh) 一种视频通信画面显示控制装置及方法
CN102637120B (zh) 一种控制拼接屏幕同步显示的系统及方法
CN106063261A (zh) 增强信息显示
CN101742221B (zh) 一种会议电视系统中的多画面合成方法及装置
CN103763556B (zh) 视频图像编解码装置及其方法、传输系统及其方法
US20190313075A1 (en) Methods and apparatus for capturing, processing and/or communicating images
WO2022166521A1 (zh) 跨设备的协同拍摄方法、相关装置及系统
WO2016197308A1 (zh) 一种高清摄像系统及高分辨率图像的获取方法
CN102572463A (zh) 视频信号处理装置、视频信号处理方法和计算机程序
US20200029068A1 (en) Method and apparatus for dual-screen display, video glasses, chip and processor
JP5188051B2 (ja) 表示制御装置及び表示装置
WO2022191070A1 (ja) ３ｄオブジェクトのストリーミング方法、装置、及びプログラム
WO2018045571A1 (zh) 图像编码方法及系统
WO2024055844A1 (zh) 用于多路数据流的传输的方法、装置、设备和介质
US20130336381A1 (en) Video transmission system and transmitting device and receiving device thereof
CN102426829A (zh) 双画面显示装置及实现方法
JP6808419B2 (ja) 画像処理システム及びその制御方法
US20230326050A1 (en) Computer-implemented method of generating augmented image data, computer-implemented streaming method, image streaming system, and augmented image data stream
CN208623757U (zh) 一种图像拼接融合系统
US11758101B2 (en) Restoration of the FOV of images for stereoscopic rendering
CN101520719A (zh) 画面分享系统以及画面分享方法
CN108353195A (zh) 发送设备、发送方法、接收设备、接收方法和发送/接收系统
CN205754674U (zh) 一种多个视频图像在任意位置叠加的投影融合系统
CN111935471B (zh) 基于云服务的远程立体图形生成系统及方法
JP2014041455A (ja) 画像処理装置、画像処理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16915505

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16915505

Country of ref document: EP

Kind code of ref document: A1