WO2020207403A1 - 一种图像获取方法及装置 - Google Patents

一种图像获取方法及装置 Download PDF

Info

Publication number
WO2020207403A1
WO2020207403A1 PCT/CN2020/083707 CN2020083707W WO2020207403A1 WO 2020207403 A1 WO2020207403 A1 WO 2020207403A1 CN 2020083707 W CN2020083707 W CN 2020083707W WO 2020207403 A1 WO2020207403 A1 WO 2020207403A1
Authority
WO
WIPO (PCT)
Prior art keywords
track
buffer area
image
image data
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/083707
Other languages
English (en)
French (fr)
Inventor
王厚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Publication of WO2020207403A1 publication Critical patent/WO2020207403A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • This application relates to the field of image processing technology, and in particular to an image acquisition method and device.
  • the way to obtain a frame of image from real-time stream or video is to capture the picture.
  • the snapshot is to capture a complete frame of image YUV data from real-time stream or video, where Y represents brightness , U means chromaticity, V means density.
  • encode the captured YUV data into the required image format, such as JPEG format, RGB format, etc.
  • each camera corresponds to a transmission channel, and the captured video data can be transmitted in the form of a code stream through the transmission channel.
  • the snapshot can only be captured in one transmission channel. Therefore, when multiple cameras are shooting at the same time, it is necessary to capture the image from the video captured by each camera, and then use the large-screen splicing technology to capture the captured image. Multiple images are stitched together to form a complete image.
  • each transmission channel corresponds to a decoder
  • each decoder corresponds to a display channel.
  • Each camera transmits the captured video data to the decoder through the transmission channel.
  • the decoder decodes the video data in the transmission channel and transmits the decoded data to the large display screen through the display channel.
  • each The image represented by the data in the display channel is only part of the image to be captured.
  • the large display screen splices each part of the image through the large screen splicing technology to obtain the spliced image, and screenshots the spliced image to obtain the image to be captured.
  • each camera in the current solution for capturing images needs to have a corresponding transmission channel.
  • the transmission channel needs to be increased accordingly. The more cameras, the more transmission channel resources are required.
  • the purpose of the embodiments of the present application is to provide an image acquisition method and device to solve the problem of waste of transmission channel resources in the case of multiple camera devices.
  • the specific technical solutions are as follows:
  • an image acquisition method which includes:
  • the acquired image data of each track is stored in the buffer area corresponding to each track to obtain the image of the picture to be captured.
  • the step of obtaining the code streams of the preset frames of the multiple tracks transmitted by the preset transmission channel includes:
  • the method before the step of storing the acquired image data of each track in the buffer area corresponding to each track according to the corresponding relationship between the track and the buffer area to obtain the image of the picture to be captured, the method further includes:
  • a corresponding buffer area is allocated to each track, where the buffer area is used to store image data in the track corresponding to the buffer area.
  • the step of allocating a corresponding buffer area for each track includes:
  • the step of storing the acquired image data of each track in the buffer area corresponding to each track to obtain the image of the picture to be captured includes:
  • the image data stored in each buffer area is combined to obtain the image of the picture to be captured.
  • the method further includes:
  • the stored image data is encoded to obtain the image of the to-be-captured picture that meets the preset format.
  • an image acquisition device which includes:
  • the first acquisition module is configured to acquire the code streams of the preset frames of multiple tracks transmitted by the preset transmission channel, wherein each track corresponds to at least one camera device;
  • the second acquisition module is used to acquire image data corresponding to the code stream of each track
  • the storage module is used to store the acquired image data of each track in the buffer area corresponding to each track according to the corresponding relationship between the track and the buffer area to obtain the image of the picture to be captured.
  • the first obtaining module is specifically used for:
  • the device further includes:
  • the third acquiring module is used to acquire the track quantity of multiple tracks
  • the determination module is used to determine the number of buffer areas to be allocated based on the number of tracks;
  • the allocation module is used to allocate a corresponding buffer area for each track, where the buffer area is used to store image data of the track corresponding to the buffer area.
  • the allocation module is specifically used for:
  • the storage module is specifically used for:
  • the image data stored in each buffer area is combined to obtain the image of the picture to be captured.
  • the device further includes:
  • the encoding module is used to perform encoding processing on the stored image data after the storage of the image data of each track is completed, to obtain an image of the picture to be captured that meets a preset format.
  • an embodiment of the present application provides an electronic device, including a processor and a memory, where:
  • Memory used to store computer programs
  • the processor is used to implement any of the above-mentioned image acquisition methods when executing the computer program stored in the memory.
  • an embodiment of the present application provides a machine-readable storage medium, and a computer program is stored in the machine-readable storage medium.
  • the computer program is executed by a processor, any one of the aforementioned image acquisition methods is implemented.
  • an embodiment of the present application provides an application program for executing at runtime: any of the above-mentioned image acquisition methods.
  • the code streams of the preset frames of the multiple tracks transmitted by the preset transmission channel are obtained, and each track corresponds to at least one camera device, and the image data corresponding to the code streams of each track is obtained.
  • the corresponding relationship with the buffer area the acquired image data of each track is stored in the buffer area corresponding to each track to obtain the image of the picture to be captured.
  • the code stream of the preset frame of each track is transmitted through the preset transmission channel, and the image data corresponding to the code stream of each track is obtained in the preset transmission channel, and then The image of the screen to be captured.
  • the above process is completed in one transmission channel, even if the camera equipment is increased, there is no need to increase the transmission channel, saving transmission channel resources.
  • the image data is obtained in one transmission channel, and the image data is correspondingly stored in the buffer area to obtain the image of the picture to be captured, without the need for image splicing processing, which saves image splicing resources.
  • FIG. 1 is a flowchart of an image acquisition method provided by an embodiment of the application
  • FIG. 2(a) is a schematic diagram of a determined buffer area according to an embodiment of the application.
  • Fig. 2(b) is an image of a picture to be captured obtained based on the determined buffer area according to an embodiment of the application;
  • FIG. 2(c) is a schematic diagram of a picture to be captured obtained based on the determined buffer area according to an embodiment of the application;
  • FIG. 3(a) is another schematic diagram of the determined buffer area according to an embodiment of this application.
  • FIG. 3(b) is another schematic diagram of the determined buffer area according to an embodiment of this application.
  • FIG. 4 is a schematic diagram of a structure of an image acquisition device provided by an embodiment of the application.
  • FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the application.
  • embodiments of the present application provide an image acquisition method and device, wherein the image acquisition method includes:
  • the acquired image data of each track is stored in the buffer area to obtain the image of the picture to be captured.
  • the code stream of the preset frame of each track is transmitted through the preset transmission channel, and the image data corresponding to the code stream of each track is obtained in the preset transmission channel, and then The image of the screen to be captured.
  • the above process is completed in one transmission channel, even if the camera equipment is increased, there is no need to increase the transmission channel, saving transmission channel resources.
  • the image data is obtained in one transmission channel, and the image data is correspondingly stored in the buffer area to obtain the image of the picture to be captured, without the need for image splicing processing, which saves image splicing resources.
  • An image acquisition method provided by an embodiment of the application can be applied to a video processing device.
  • the video processing device can be connected to one or more camera devices, and each camera device can send the captured video data to the video processing device for processing. deal with.
  • the video processing device receives the bit stream sent by the camera device, it can decode the received bit stream to obtain the video image taken by the camera device.
  • an image acquisition method provided by an embodiment of the present application includes the following steps.
  • S101 Obtain code streams of preset frames of multiple tracks transmitted by a preset transmission channel.
  • each track corresponds to at least one camera device.
  • the track corresponding to camera device 1 is track 1
  • the code stream output by camera device 1 is the code stream of track 1.
  • a multi-eye camera includes multiple sensors, and one track can correspond to one sensor.
  • a transmission channel can transmit the code stream of multiple tracks.
  • the transmission channel is the physical channel that actually transmits the code stream (for example, a bus).
  • the track represents the camera equipment of the terminal.
  • a camera equipment has at least one track.
  • multiple tracks transmit code streams to the video processing device through the same transmission channel.
  • the code streams of multiple tracks are transmitted in the preset transmission channel, the code streams of the preset frames of multiple tracks can be packaged into one data packet for transmission.
  • the pre-determined data of multiple tracks can also be transmitted by sub-packet transmission. Set the code stream of the frame.
  • the preset frame may be a frame with the same identifier, or may be a frame with a time stamp within a certain error range.
  • the identifier mentioned here refers to the label of the frame, for example, the first frame code stream collected by the camera device 1, the first frame code stream collected by the camera device 2, and the first frame code stream collected by the camera device 3.
  • the time stamp of a frame refers to the time when the frame is collected.
  • the preset frame can be a frame with the same time stamp, for example, a frame at 12 o’clock by camera 1, a frame at 12 o’clock by camera 2 and a frame at 12 o’clock by camera 3 A frame at 12 o'clock; due to the difference in the acquisition frequency of different camera equipment, a certain error in the time stamp is allowed. Therefore, the preset frame can also be a frame with a time stamp within a certain error range, and the certain error range can be microseconds. , Millisecond level, second level, etc. The specific settings are related to accuracy requirements.
  • S101 may specifically be: acquiring a data packet of a picture to be captured transmitted by a preset transmission channel, where the data packet carries a code stream of a preset frame of multiple tracks.
  • the code stream included in a data packet can be only the code stream of one frame of image.
  • the first data packet includes the code stream of the first frame of each camera device
  • the second data packet includes the first frame of each camera device.
  • the code streams of different camera devices in a data packet can be distinguished by using a preset start mark and end mark.
  • the code stream included in a data packet can also include the code stream of multiple frames of images. In this case, the data packet can have the start and end marks of each frame of code stream to distinguish the code of each frame. flow.
  • the picture to be captured can be customized.
  • the currently displayed screen can be used as the screen to be captured.
  • the currently displayed picture can be used as the picture to be captured during the playback process. It is also possible to determine the picture of the first frame image of the currently played video as the picture to be captured.
  • any frame of the video can be determined as the frame to be captured. Therefore, the frame to be captured can be determined according to user instructions, and the frame to be captured can be obtained from the replayed video Take an image of the screen.
  • the preset transmission channel can be customized, and the preset transmission channel is used to transmit the code streams of the connected multiple tracks of camera devices, that is, the multiple camera devices pass the preset The transmission channel transmits the code stream.
  • a transmission protocol is customized in advance, and each camera device encodes the acquired image information into a code stream according to the transmission protocol, and transmits the code stream obtained by encoding through a preset transmission channel.
  • the multi-track streaming protocol is the streaming protocol used for stream encoding and decoding, transmission, preview, video storage, etc.
  • the multi-track streaming includes multiple cameras based
  • the code streams of multiple tracks are encoded by the image information of the device.
  • the code streams of different tracks can be spliced and combined to form an image, and the code streams of multiple tracks can be transmitted, previewed, and recorded in one transmission channel. Storage and other processing.
  • the protocol header of the multi-track stream protocol may include information such as the number of tracks, the start and end marks of the code stream of each track in the data packet.
  • each camera device can be connected to a processing device, and each camera device can send the image information collected by each camera device to the processing device.
  • the processing device After the processing device receives the image information sent by each camera device, it can encode the image information into a code stream, and pack the code stream belonging to the same frame of image into a data packet, and transmit it through the preset transmission channel in the form of a data packet .
  • the processing device is connected to the camera device 1, the camera device 2, and the camera device 3.
  • the camera device 1, the camera device 2 and the camera device 3 respectively send the first frame of image information collected to the processing device, and the processing device responds to the received
  • the first frame of image information is encoded into a code stream for the first frame of image, and the code stream of the first frame image of the camera device 1, the code stream of the first frame image of the camera device 2 and the first frame of the camera device 3
  • the code stream of the image is packaged into a data packet, and the data packet is transmitted through a preset transmission channel. In this way, it is ensured that the first frame of images captured by the camera device 1, the camera device 2 and the camera device 3 are synchronized.
  • the code streams belonging to the same frame of image can be transmitted in the same data packet, thereby ensuring synchronization between various camera devices.
  • code stream information can also be obtained, such as MFI (Multiple Frame Indicator, composite frame information byte) information.
  • the code stream information can include the number of tracks, the information of each code stream in the data packet, The start and end of the code stream of each track, etc.
  • the code stream information can also be carried in the data packet to which the code stream belongs for transmission.
  • the code stream transmitted in the track is decoded image data
  • the image data can be directly obtained from each track.
  • the code stream transmitted in the track is coded image data
  • the code stream of each track can be decoded to obtain the image data of the track.
  • each track corresponds to a decoder, and the decoder can decode the code stream on the corresponding track, and the decoder corresponding to each track will not The code streams of tracks other than this track are decoded.
  • camera device 1 corresponds to track 1
  • camera device 2 corresponds to track 2
  • camera device 3 corresponds to track 3.
  • track 1 corresponds to decoder 1
  • track 2 corresponds to decoder 2
  • track 3 corresponds to decoder 3.
  • decoder 1 decodes the code stream of track 1
  • decoder 2 decodes the code stream of track 2
  • decoder 3 decodes the code stream of track 3.
  • the image data is data used to represent an image
  • the image data may be YUV data, RGB data, and so on.
  • YUV data is taken as an example for introduction.
  • the YUV data can be used to represent an image.
  • the image represented by the YUV data is the image captured by the imaging device 1.
  • the corresponding relationship between the track and the buffer area can be preset or determined according to the code stream, which is not limited here.
  • the corresponding relationship between the track and the buffer area is used to determine the storage location of the image data of each track. After the image data of each track are stored in the corresponding buffer area, that is, after the corresponding image data has been stored in each buffer area, all the stored image data are combined to form an image, which is the waiting area. Grab the image of the screen.
  • the camera device includes camera device 1, camera device 2, and camera device 3.
  • the buffer area includes buffer area 1, buffer area 2 and buffer area 3, as shown in Figure 2(a), where camera device 1 corresponds to buffer area 1.
  • Camera device 2 corresponds to buffer area 2
  • camera device 3 corresponds to buffer area 3.
  • the YUV data obtained by decoding the code stream output by camera device 1 is stored in buffer 1
  • the YUV data obtained by decoding the code stream output by camera device 2 is stored in buffer 2
  • the code output by camera device 3 The YUV data obtained after the stream is decoded is stored in the buffer area 3.
  • the YUV data in the three buffer areas are combined together to obtain a combined image, as shown in Figure 2(b).
  • the two vertical lines of is added for the convenience of comparison with Figure 2(a), and the final image is the image to be captured, as shown in Figure 2(c).
  • the buffer area is preset.
  • the number of buffer areas is consistent with the number of tracks, and each track corresponds to a buffer area, which can be in a one-to-one correspondence.
  • the buffer area is determined, the corresponding relationship between each track and the buffer area is determined in advance. In the subsequent process of image acquisition, the corresponding relationship remains unchanged, that is, the image data transmitted in each track is fixedly stored in the corresponding buffer area.
  • buffer area 1 and buffer area 2 are preset, and track 1 corresponds to buffer area 1, and track 2 corresponds to buffer area 2.
  • track 1 corresponds to buffer area 1
  • track 2 corresponds to buffer area 2.
  • the image data transmitted in track 1 is stored in the buffer area.
  • the image data transmitted in track 2 is stored in buffer 2.
  • the buffer area can be adjusted, and the correspondence between the track and the buffer area can be adjusted again.
  • the buffer area corresponding to each track may be a custom-set buffer area, and the buffer area corresponding to each track may be continuous or non-continuous.
  • the image data in each track can be stored in the corresponding buffer area.
  • the stored image data can be obtained from each buffer area, and the obtained image data can be combined according to a preset arrangement rule, that is, the image of the picture to be captured can be obtained.
  • format conversion, scaling, etc. can be performed to obtain an image of the screen to be captured that meets the requirements.
  • the preset arrangement rules can be customized.
  • the image data in track 1 is captured by camera 1
  • the image data in track 2 is captured by camera 2
  • the image data in track 3 is captured by camera 3.
  • the preset arrangement rules are: The image data in track 1 is located on the leftmost side, the image data in track 2 is located in the middle, and the image data in track 3 is located on the far right.
  • the image taken by the camera device 1 is located On the far left, the picture taken by the imaging device 2 is in the middle, and the picture taken by the imaging device 3 is on the far right.
  • the acquired image data of each track is stored in the buffer area corresponding to each track, and before the step of obtaining the image of the picture to be captured (S103), it may further include The steps are as follows: Obtain the track number of multiple tracks; determine the number of buffer areas that need to be allocated based on the number of tracks; allocate a corresponding buffer area for each track, where the buffer area is used to store the track in the corresponding buffer area Image data.
  • the number of tracks of multiple tracks can also be obtained. Based on the number of tracks, the number of buffer areas can be determined, and the number of buffer areas is consistent with the number of tracks. Specifically, the number of tracks can be carried in a data packet for transmission. For example, if the track number information carried in the data packet is 4, it means that the data packet carries a code stream of 4 tracks, and the number of buffer areas can be determined to be 4.
  • the available storage space of each cache area can be allocated, and the available storage space of each cache area can be customized. That is to say, the available storage space of each buffer area can be greater than or equal to the data amount of the image data in the track corresponding to the buffer area. In this case, the image data in the track can be directly stored in the corresponding buffer area. in. The available storage space of each buffer area can be smaller than the data amount of the image data in the track corresponding to the buffer area. In this case, before storing, the image data in the track can be scaled to make the image data The amount is less than or equal to the available storage space of the corresponding buffer area.
  • the available storage space allocated for each buffer area may be greater than or equal to the buffer area.
  • the data volume of the image data of the track corresponding to the area can be considered that the available storage space of each buffer area is greater than or equal to the data volume of the code stream of the track corresponding to the buffer area. In this way, even the image data of the track can be stored in the corresponding buffer area without scaling.
  • the data packet may carry the target data amount required for the image of the picture to be captured.
  • the target data amount of the image can be customized, that is, the size of the generated image can be set. For example, if the target data amount is set to 5M, it means that the image of the screen to be captured is 5M.
  • the data packet can also carry the width and height information required for the image of the image to be captured.
  • the width and height information includes the preset width and the preset height, that is to say, the required width of the image of the image to be captured is the preset width ,
  • the height is the preset height.
  • the preset width and the preset height can be customized settings, for example, the preset width is 800 pixels, and the preset height is 480 pixels, which means that the resolution width of the image generated by the image to be captured is 800 Pixels, the resolution height is 480 pixels.
  • the step of allocating a buffer area for each track may specifically include the following steps:
  • a total buffer area can be allocated first, and the total buffer area is used to store the image data of each track in the data packet after decoding processing.
  • the available storage space of the total buffer area can be customized according to the target data volume required by the image of the picture to be captured, that is, the available storage space of the total buffer area should at least not be less than the target data volume.
  • the width of the total buffer area is not less than the preset width, and the height is not less than the preset height.
  • the preset width and the preset height are the width and height required by the image of the image to be captured, and the preset width and the preset height can be customized.
  • the preset width of the total buffer area can be divided equally to obtain multiple sub-widths with the same length.
  • the number of divided sub-widths is the same as the number of tracks. For example, if the number of camera devices is 4, the number of tracks is also 4.
  • the preset width of the total buffer area is 800 pixels, the preset width can be divided into 4 sub-widths, each of which is 200 pixels.
  • the area formed by each sub-width and preset height is determined as a buffer area, that is, the total buffer area includes multiple buffer areas of the same size.
  • the width of each buffer area is the sub-width, and the height is the preset height.
  • the preset width of the total buffer area is W
  • the preset height is H
  • there are T1 tracks then the preset width W is equally divided into T1 equal parts
  • each sub-width is W/T1 .
  • the area formed by each sub-width W/T1 and the preset height H is determined as a buffer area, such as the first buffer area, the second buffer area...the T1 buffer area in the figure.
  • the determined buffer area and the track may have a one-to-one correspondence, that is, each buffer area corresponds to a track, and the image data of the track is stored in the buffer area corresponding to the track.
  • the step of obtaining the image of the picture to be captured may include the following steps :
  • the image data with the image width as the sub-width and the image height as the preset height is obtained; according to the one-to-one correspondence between the buffer area and the track, the acquired image data of each track is respectively stored in The buffer area corresponding to each track; after the image data of each track is stored, the image data stored in each buffer area is combined to obtain the image of the picture to be captured.
  • image data with an image width of a sub-width and an image height of a preset height can be obtained.
  • the image data can be directly stored in the corresponding buffer area.
  • the image data in the track can be scaled first, so that the width and height of the image data after the scaling process are the same as the width and height of the corresponding buffer area. High is consistent.
  • VGS Video Graphics Sub-System, video graphics subsystem
  • VGS may be used to compress image data of each track respectively, where VGS may perform processing such as scaling, format conversion, and decoding on the image.
  • the scaled image data of each track can be stored in the corresponding track of each track according to the one-to-one correspondence between the buffer area and the track. Cache area.
  • T1 tracks there are T1 tracks, among which, the first track corresponds to the first buffer area, the second track corresponds to the second buffer area... the T1th track corresponds to the T1th buffer area, then the Store the zoomed image data of one track in the first buffer area, store the zoomed image data of the second track in the second buffer area, and store the zoomed image data of the T1 track in T1 buffer area.
  • the entire buffer area will be filled with image data, and the image data in the buffer area can represent a Images.
  • the zoomed image data of each track in the buffer area corresponding to each track when storing the zoomed image data of each track in the buffer area corresponding to each track, it can be stored in multiple buffer areas at the same time, or can be stored sequentially in a custom order. For example, in Figure 3(a), storage is performed in the order of identification from small to large, that is, storage is performed for the first buffer area, then for the second buffer area, and finally for the T1th buffer area. After the storage of the buffer area is completed, the storage of the entire total buffer area is completed.
  • the combination method may be to directly obtain an image from the image data stored in each buffer area, and the image is the image of the picture to be captured.
  • the image of the picture to be captured is a YUV image
  • the buffer is divided into three parts Y, U, and V for storage
  • a YUV image can be directly obtained at this time, that is, the image of the picture to be captured.
  • the combination method can also perform data conversion processing on the image data in each buffer area to obtain image data that meets the requirements of image format and other requirements.
  • the image obtained from the image data after the data conversion processing is the image of the picture to be captured. .
  • the total buffer area is divided into T1 buffer areas on average, and the divided T1 buffer areas are shown in Figure 3(a). After each buffer area is determined, the head of each buffer area is determined. Address, as shown in Figure 3(b). Two adjacent cache areas are adjacent, that is, the first address of the cache area is continuous with the last address of the previous adjacent cache area. For example, the first address of the second buffer area is the last address of the first buffer area.
  • the storage is performed in the order of identification from small to large, that is, first storage is performed in the first buffer area, then the second buffer area is stored, and finally the T1 buffer area is stored.
  • image data is stored in the T1 buffer area, it means that the current T1 buffer areas have stored image data.
  • the image data stored in each buffer area is combined to obtain the image of the picture to be captured .
  • the image acquisition method may further include: after the image data of each track is stored, encoding the stored image data to obtain an image of the to-be-captured picture that meets the preset format .
  • the encoding process includes data processing of image data.
  • the stored image data can also be scaled so that the width and height of the obtained image are preset width and height. .
  • the preset format may be self-defined.
  • the preset format may be JPEG (Joint Photographic Experts Group) format, PNG (Portable Network Graphics, portable network graphics) format, etc.
  • the preset format can be customized.
  • the data packet may carry information in a preset format.
  • the preset format information can be obtained, and an encoder for the preset format can be created according to the preset format information, and the encoder is used to convert the image input to the encoder into an image of the preset format .
  • the image data of each track is stored, the image data stored in the buffer area is input to the encoder, the image in the preset format is generated by the encoder, and the generated image in the preset format is stored and displayed.
  • the data packet carries JPEG format information
  • the JPEG format information indicates that the format of the image to be generated is the JPEG format.
  • the encoder created based on the JPEG format information is a JPEG encoder. After the image data of each track is stored, the image data stored in the buffer area is input to the JPEG encoder to generate an image in JPEG format.
  • the preset format is the RGB format
  • TDE Tro Dimensional Engine, two-dimensional data processing tool
  • OSD On Screen Display, screen display overlay
  • GUI Graphic User Interface, graphical user interface
  • the code stream of the preset frame of the camera equipment of each track is transmitted through the preset transmission channel, and the image data corresponding to the code stream of each track is obtained in the preset transmission channel , And then get the image of the screen to be captured.
  • the above process is completed in one transmission channel, even if the camera equipment is increased, there is no need to increase the transmission channel, saving transmission channel resources.
  • the image data is obtained in one transmission channel, and the image data is correspondingly stored in the buffer area to obtain the image of the picture to be captured, without the need for image splicing processing, which saves image splicing resources.
  • an embodiment of the present application also provides an image acquisition device.
  • the image acquisition device includes:
  • the first acquiring module 410 is configured to acquire the code streams of preset frames of multiple tracks transmitted by a preset transmission channel, wherein each track corresponds to at least one camera device;
  • the second acquisition module 420 is configured to acquire image data corresponding to the code streams of each track;
  • the storage module 430 is configured to store the acquired image data of each track in the buffer area corresponding to each track according to the corresponding relationship between the track and the buffer area to obtain the image of the picture to be captured.
  • the first acquisition module may be specifically used for:
  • the image acquisition device may further include:
  • the third acquiring module is used to acquire the track quantity of multiple tracks
  • the determination module is used to determine the number of buffer areas to be allocated based on the number of tracks;
  • the allocation module is used to allocate a corresponding buffer area for each track, where the buffer area is used to store image data of the track corresponding to the buffer area.
  • the allocation module is specifically used for:
  • the storage module 430 is specifically used for:
  • the image data stored in each buffer area is combined to obtain the image of the picture to be captured.
  • the image acquisition device may further include:
  • the encoding module is used to perform encoding processing on the stored image data after the image data storage of each track is completed to obtain the image of the to-be-captured picture that meets the preset format.
  • the code stream of the preset frame of each track is transmitted through the preset transmission channel, and the image data corresponding to the code stream of each track is obtained in the preset transmission channel, and then The image of the screen to be captured.
  • the above process is completed in one transmission channel, even if the camera equipment is increased, there is no need to increase the transmission channel, saving transmission channel resources.
  • the image data is obtained in one transmission channel, and the image data is correspondingly stored in the buffer area to obtain the image of the picture to be captured, without the need for image splicing processing, which saves image splicing resources.
  • an embodiment of the present application also provides an electronic device, as shown in FIG. 5, including a processor 510 and a memory 520, wherein,
  • the memory 520 is used to store computer programs
  • the processor 510 is configured to execute the computer program stored in the memory 520 to implement the following steps:
  • the acquired image data of each track is stored in the buffer area corresponding to each track to obtain the image of the picture to be captured.
  • the code stream of the preset frame of each track is transmitted through the preset transmission channel, and the image data corresponding to the code stream of each track is obtained in the preset transmission channel, and then The image of the screen to be captured.
  • the above process is completed in one transmission channel, even if the camera equipment is increased, there is no need to increase the transmission channel, saving transmission channel resources.
  • the image data is obtained in one transmission channel, and the image data is correspondingly stored in the buffer area to obtain the image of the picture to be captured, without the need for image splicing processing, which saves image splicing resources.
  • the memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage.
  • NVM non-Volatile Memory
  • the memory may also be at least one storage device located far away from the foregoing processor.
  • the above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processing, DSP), a dedicated integrated Circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • CPU central processing unit
  • NP Network Processor
  • DSP Digital Signal Processing
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • the embodiment of the present application also provides a machine-readable storage medium in which a computer program is stored, and when the computer program is executed by a processor, any one of the above-mentioned image acquisition methods is implemented .
  • the embodiment of the present application also provides an application program, which is used to execute any of the above-mentioned image acquisition methods at runtime.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

本申请实施例提供了一种图像获取方法及装置，包括：获取预设传输通道传输的多个轨道的预设帧的码流，获取各轨道的码流对应的图像数据，按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。通过本方案，各轨道的预设帧的码流通过预设传输通道进行传输，且在该预设传输通道中得到各轨道的码流对应的图像数据，进而得到待抓取画面的图像。上述过程在一个传输通道中完成，即使摄像设备增加的情况下，也无需增加传输通道，节省了传输通道资源。并且，在一个传输通道中得到图像数据，将图像数据对应存储至缓存区即可得到待抓取画面的图像，无需进行图像拼接处理，节省了图像拼接资源。

Description

一种图像获取方法及装置
本申请要求于2019年4月10日提交中国专利局、申请号为201910283294.6发明名称为“一种图像获取方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及图像处理技术领域，特别是涉及一种图像获取方法及装置。
背景技术
在摄像机拍摄并传输的实时码流或者已存储的录像中，当出现目标物、目标对象或者发生预设事件等时，需要获取目标物、目标对象出现或者预设事件发生时的一帧或者多帧图像，以针对所获取的图像进行后续处理。
目前，从实时码流或者录像中获取一帧图像的方式是通过抓图的方式获取的，抓图是从实时码流或者录像中抓取完整的一帧图像YUV数据，其中，Y表示明亮度，U表示色度，V表示浓度。再将所抓取的YUV数据编码成所要求的图像格式，例如JPEG格式，RGB格式等。
在有多个摄像机同时采集视频数据时，每一个摄像机对应有一个传输通道，且通过该传输通道可以将所拍摄的视频数据以码流的形式进行传输。抓图只能在一个传输通道中进行抓取，因此，在有多个摄像机同时进行拍摄时，需要从每一个摄像机所拍摄的视频中抓取图像，再利用大屏拼接技术将所抓取的多个图像拼接成为一个完整的图像。
具体地，每一传输通道对应有一个解码器，每一解码器对应有一个显示通道。每个摄像机将拍摄的视频数据通过传输通道传输至解码器，解码器对传输通道中的视频数据进行解码处理，并将解码处理后的数据通过显示通道传输至显示大屏，此时，每个显示通道中的数据所表示的图像仅是所需抓取图像中的部分图像。显示大屏将各部分图像通过大屏拼接技术进行拼接，得到拼接后的图像，对该拼接后的图像进行截图，即得到所需抓取的图像。
然而，目前实现抓图的方案中每一个摄像机需对应有一个传输通道，当摄像机增加时，需相应地增加传输通道，摄像机越多，所需的传输通道资源 越多。
发明内容
本申请实施例的目的在于提供一种图像获取方法及装置，以解决在多个摄像设备的情况下传输通道资源浪费的问题。具体技术方案如下：
第一方面，本申请实施例提供了一种图像获取方法，该方法包括：
获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对应至少一个摄像设备；
获取各轨道的码流对应的图像数据；
按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。
可选的，获取预设传输通道传输的多个轨道的预设帧的码流的步骤，包括：
获取预设传输通道传输的待抓取画面的数据包，其中，数据包携带多个轨道的预设帧的码流。
可选地，在按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像的步骤之前，该方法还包括：
获取多个轨道的轨道数量；
基于轨道数量，确定所需分配的缓存区的数量；
为每一轨道分配对应的缓存区，其中，缓存区用于存储该缓存区对应的轨道中的图像数据。
可选地，为每一轨道分配对应的缓存区的步骤，包括：
分配可用存储空间不小于目标数据量、且宽度不小于预设宽度、高度不小于预设高度的总缓存区，其中，目标数据量为待抓取画面的图像所需的数据量，预设宽度和预设高度分别为待抓取画面的图像所需的宽度和高度；
将总缓存区的预设宽度进行平均划分，得到长度相同的多个子宽度，其 中，多个子宽度的数量与轨道数量相同；
将每个子宽度与预设高度所形成的区域确定为缓存区，其中，所确定出的缓存区与轨道为一一对应关系；
按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像的步骤，包括：
基于所获取的各轨道的图像数据，得到图像宽度为子宽度以及图像高度为预设高度的图像数据；
按照缓存区与轨道的一一对应关系，将所获取的各轨道的图像数据分别存储至各轨道对应的缓存区；
在各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，得到待抓取画面的图像。
可选地，该方法还包括：
在各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到满足预设格式的待抓取画面的图像。
第二方面，本申请实施例提供了一种图像获取装置，该装置包括：
第一获取模块，用于获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对应至少一个摄像设备；
第二获取模块，用于获取各轨道的码流对应的图像数据；
存储模块，用于按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。
可选的，第一获取模块具体用于：
获取预设传输通道传输的待抓取画面的数据包，其中，数据包携带多个轨道的预设帧的码流。
可选地，该装置还包括：
第三获取模块，用于获取多个轨道的轨道数量；
确定模块，用于基于轨道数量，确定所需分配的缓存区的数量；
分配模块，用于为每一轨道分配对应的缓存区，其中，缓存区用于存储该缓存区对应的轨道的图像数据。
可选地，分配模块具体用于：
分配可用存储空间不小于目标数据量、且宽度不小于预设宽度、高度不小于预设高度的总缓存区，其中，目标数据量为待抓取画面的图像所需的数据量，预设宽度和预设高度分别为待抓取画面的图像所需的宽度和高度；
将总缓存区的预设宽度进行平均划分，得到长度相同的多个子宽度，其中，多个子宽度的数量与轨道数量相同；
将每个子宽度与预设高度所形成的区域确定为缓存区，其中，所确定出的缓存区与轨道为一一对应关系；
存储模块具体用于：
基于所获取的各轨道的图像数据，得到图像宽度为子宽度以及图像高度为预设高度的图像数据；
按照缓存区与轨道的一一对应关系，将所获取的各轨道的图像数据分别存储至各轨道对应的缓存区；
在各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，得到待抓取画面的图像。
可选地，该装置还包括：
编码模块，用于在所述各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到满足预设格式的待抓取画面的图像。
第三方面，本申请实施例提供了一种电子设备，包括处理器和存储器，其中，
存储器，用于存放计算机程序；
处理器，用于执行存储器上所存放的计算机程序时，实现上述任一图像获取方法。
第四方面，本申请实施例提供了一种机器可读存储介质，机器可读存储介质内存储有计算机程序，计算机程序被处理器执行时实现上述任一图像获取方法。
第五方面，本申请实施例提供了一种应用程序，用于在运行时执行：上述任一图像获取方法。
本申请实施例提供的技术方案中，获取预设传输通道传输的多个轨道的预设帧的码流，每个轨道对应至少一个摄像设备，获取各轨道的码流对应的图像数据，按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。通过本申请实施例提供的技术方案，对于各轨道的预设帧的码流，通过预设传输通道进行传输，且在该预设传输通道中得到各轨道的码流对应的图像数据，进而得到待抓取画面的图像。上述过程在一个传输通道中完成，即使摄像设备增加的情况下，也无需增加传输通道，节省了传输通道资源。并且，在一个传输通道中得到图像数据，将图像数据对应存储至缓存区即可得到待抓取画面的图像，无需再进行图像拼接处理，节省了图像拼接资源。
附图说明
为了更清楚地说明本申请实施例和现有技术的技术方案，下面对实施例和现有技术中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的图像获取方法的一种流程图；
图2(a)为本申请实施例的所确定的缓存区的一种示意图；
图2(b)为本申请实施例的基于所确定的缓存区得到的待抓取画面的图像；
图2(c)为本申请实施例的基于所确定的缓存区得到的待抓取画面的一种示意图；
图3(a)为本申请实施例的所确定的缓存区的另一种示意图；
图3(b)为本申请实施例的所确定的缓存区的另一种示意图；
图4为本申请实施例提供的图像获取装置的一种结构示意图；
图5为本申请实施例提供的电子设备的一种结构示意图。
具体实施方式
为使本申请的目的、技术方案、及优点更加清楚明白，以下参照附图并举实施例，对本申请进一步详细说明。显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
为了解决在多个摄像设备的情况下传输通道资源浪费的问题，本申请实施例提供了一种图像获取方法及装置，其中，该图像获取方法包括：
获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对应至少一个摄像设备；
获取各轨道的码流对应的图像数据；
按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至缓存区，得到待抓取画面的图像。
通过本申请实施例提供的技术方案，对于各轨道的预设帧的码流，通过预设传输通道进行传输，且在该预设传输通道中得到各轨道的码流对应的图像数据，进而得到待抓取画面的图像。上述过程在一个传输通道中完成，即使摄像设备增加的情况下，也无需增加传输通道，节省了传输通道资源。并且，在一个传输通道中得到图像数据，将图像数据对应存储至缓存区即可得到待抓取画面的图像，无需再进行图像拼接处理，节省了图像拼接资源。
下面首先对本申请实施例提供的图像获取方法进行介绍。本申请实施例提供的一种图像获取方法，可以应用于视频处理设备，该视频处理设备可以与一个或多个摄像设备连接，各摄像设备可以将所拍摄的视频数据发送至该视频处理设备进行处理。另外，视频处理设备接收摄像设备发送的码流时， 可以对所接收的码流进行解码处理，得到该摄像设备所拍摄的视频图像。
如图1所示，本申请实施例提供的一种图像获取方法，包括如下步骤。
S101，获取预设传输通道传输的多个轨道的预设帧的码流。
其中，每个轨道对应至少一个摄像设备。例如，摄像设备1对应的轨道为轨道1，摄像设备1输出的码流即为该轨道1的码流。针对多目摄像机，一个多目摄像机包括多个传感器，一个轨道可对应一个传感器。一个传输通道中可以传输多个轨道的码流，传输通道为实际传输码流的物理通道(例如是一条总线)，轨道表示终端的摄像设备，一般情况下，一个摄像设备有至少一个轨道，在本申请中，多个轨道通过同一个传输通道向视频处理设备传输码流。在预设传输通道中传输多个轨道的码流时，可以将多个轨道的预设帧的码流打包为一个数据包传输，当然，也可以以分包传输的方式传输多个轨道的预设帧的码流。
其中，预设帧可以为具有相同标识的帧，也可以为时间戳在一定误差范围内的帧。
这里所提及的标识是指帧的标号，例如，摄像设备1采集的第1帧码流、摄像设备2采集的第1帧码流和摄像设备3采集的第1帧码流。一个帧的时间戳是指采集该帧的时刻，预设帧可以为时间戳相同的帧，例如，摄像设备1在12点的一帧、摄像设备2在12点的一帧和摄像设备3在12点的一帧；由于不同摄像设备的采集频率可能有差异，允许时间戳存在一定误差，因此，预设帧也可以为时间戳在一定误差范围内的帧，一定误差范围可以是微秒级、毫秒级、秒级等，具体的设置与精度要求有关。
一种实现方式中，S101具体可以为：获取预设传输通道传输的待抓取画面的数据包，其中，数据包携带多个轨道的预设帧的码流。
一个数据包中所包括的码流可以仅为一帧图像的码流，例如，第一个数据包包括各摄像设备的第一帧图像的码流，第二个数据包包括各摄像设备的第二帧图像的码流。其中，一个数据包中不同摄像设备的码流可以利用预设的开始标记和结束标记来区分。一个数据包中所包括的码流还可以包括多帧图像的码流，这种情况下，数据包中可以有每一帧码流的开始和结束的标记， 以用于区分每一帧的码流。
其中，待抓取画面可以是自定义设定的。例如，在实时播放摄像设备拍摄的视频画面的场景下，可以将当前显示的画面作为待抓取画面。在对已存储的视频进行回放的场景下，可以在回放过程中将当前显示的画面作为待抓取画面。还可以将当前所播放视频的第一帧图像的画面确定为待抓取画面。
在对已存储的视频进行回放的场景下，可以将视频中的任一帧的画面确定为待抓取画面，因此，可以根据用户指令确定待抓取画面，并从回放的视频中获取待抓取画面的图像。
其中，预设传输通道可以是自定义设定的，该预设传输通道用于对所连接的多个轨道的摄像设备的码流进行传输，也就是说，该多个摄像设备通过该预设传输通道传输码流。
一种实现方式中，预先自定义一种传输协议，每个摄像设备根据该传输协议将所获取的图像信息编码成为码流，并将编码所得到的码流通过预设传输通道进行传输。
以自定义的协议为多轨流协议为例进行说明，多轨流协议为用于码流编解码、传输、预览、录像存储等的码流协议，多轨流码流包括了基于多个摄像设备的图像信息所编码而成的多个轨道的码流，不同轨道的码流之间可以拼接组合成一个图像，并且，多个轨道的码流可以在一个传输通道中进行传输、预览、录像存储等处理。该多轨流协议的协议头中可以包括轨道数量、各轨道的码流在数据包中的开始、结束标记等信息。
另一种实现方式中，各摄像设备可以与一个处理设备连接，各摄像设备可以将各自采集的图像信息发送至该处理设备。处理设备接收到各摄像设备发送的图像信息后，可以对图像信息进行编码成为码流，并将属于同一帧图像的码流打包成为一个数据包，以数据包的形式通过预设传输通道进行传输。
例如，处理设备分别连接摄像设备1、摄像设备2和摄像设备3，摄像设备1、摄像设备2和摄像设备3分别将各自采集的第一帧图像信息发送至处理设备，处理设备对所接收的第一帧图像信息进行编码成为针对第一帧图像的码流，并将摄像设备1的第一帧图像的码流、摄像设备2的第一帧图像的码流以及摄 像设备3的第一帧图像的码流打包成为一个数据包，将该数据包通过预设传输通道进行传输。这样，保证了摄像设备1、摄像设备2和摄像设备3所拍摄的第一帧图像是同步的。
通过上述任一种实现方式，均可以使得属于同一帧图像的码流在同一个数据包中进行传输，进而保证了各摄像设备之间的同步。
除了预设帧码流以外，还可以获取到码流信息，例如MFI(Multiple Frame Indicator，合成帧信息字节)信息，码流信息中可以包括轨道数量、该数据包中各码流的信息、各轨道的码流开始和结束的标识等。码流信息也可以携带在码流所属的数据包中传输。
S102，获取各轨道的码流对应的图像数据。
其中，若轨道中传输的码流为解码后的图像数据，则可以直接从各轨道获取图像数据。若轨道中传输的码流为编码后的图像数据，则可以对每一轨道的码流进行解码处理，得到该轨道的图像数据。
在获取到多个轨道的码流之后，分别对每一轨道的码流进行解码处理。对每一轨道的码流进行解码处理的一种实施方式中，每一轨道对应有解码器，解码器可以对所对应轨道上的码流进行解码，且每个轨道对应的解码器不会对该轨道以外的其他轨道的码流进行解码。
例如，摄像设备1对应轨道1，摄像设备2对应轨道2，摄像设备3对应轨道3，其中，轨道1对应解码器1，轨道2对应解码器2，轨道3对应解码器3。那么，解码器1对轨道1的码流进行解码处理，解码器2对轨道2的码流进行解码处理，解码器3对轨道3的码流进行解码处理。
其中，图像数据为用于表示图像的数据，图像数据可以是YUV数据、RGB数据等。本申请实施例中以YUV数据为例进行介绍。也就是说，若获取到的图像数据为YUV数据，该YUV数据可以用来表示一张图像。例如，当YUV数据来源于摄像设备1时，该YUV数据所表示的图像即为摄像设备1所拍摄的图像。
S103，按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。
其中，轨道与缓存区的对应关系可以是预设的，还可以是根据码流确定的，在此不作限定。轨道与缓存区的对应关系用于确定每一轨道的图像数据的存储位置。在各轨道的图像数据均存储至对应的缓存区之后，也就是说，各缓存区中均已存储对应的图像数据后，所有存储图像数据组合起来，即形成一张图像，该图像即为待抓取画面的图像。
例如，摄像设备包括摄像设备1、摄像设备2和摄像设备3，缓存区包括缓存区1、缓存区2和缓存区3，如图2(a)所示，其中，摄像设备1对应缓存区1，摄像设备2对应缓存区2，摄像设备3对应缓存区3。摄像设备1输出的码流经过解码处理后得到的YUV数据存储至缓存区1中，摄像设备2输出的码流经过解码处理后得到的YUV数据存储至缓存区2中，摄像设备3输出的码流经过解码处理后得到的YUV数据存储至缓存区3中。在上述3个缓存区均存储所对应摄像设备的YUV数据之后，3个缓存区中的YUV数据组合在一起，可以得到一张组合而成的图像，如图2(b)所示，图中的两条竖线是为了便于与图2(a)进行比对而加的，最终得到图像，即待抓取画面的图像，如图2(c)所示。
一种实施方式中，缓存区是预先设定的。缓存区的数量与轨道数量一致，每一个轨道与一个缓存区相对应，可以是一一对应关系。在缓存区确定的情况下，预先确定每一轨道与缓存区的对应关系。在后续进行图像获取的过程中，该对应关系保持不变，也就是说，每个轨道中传输的图像数据固定存储至对应的缓存区中。
例如，缓存区1和缓存区2是预设的，且预先设定轨道1对应缓存区1，轨道2对应缓存区2，则在进行图像获取时，轨道1中传输的图像数据存储至缓存区1中，轨道2中传输的图像数据存储至缓存区2中。
在该实施方式中，可以对缓存区进行调整，并重新对轨道与缓存区的对应关系进行调整。
一种实施方式中，每一轨道所对应的缓存区可以是自定义设置的缓存区，各轨道对应的缓存区可以是连续的，也可以是非连续的。基于轨道与缓存区的对应关系，可以将各轨道中的图像数据存储至对应的缓存区中。在需要生成图像时，可以从各缓存区中获取所存储的图像数据，并将所获取的图像数据按照预设排列规则组合，即可以得到待抓取画面的图像。其中，在对各图 像数据进行组合后，可以进行格式转换、缩放处理等，进而得到符合要求的待抓取画面的图像。
其中，预设排列规则可以是自定义的。例如，轨道1中的图像数据是摄像设备1拍摄得到的，轨道2中的图像数据是摄像设备2拍摄得到的，轨道3中的图像数据是摄像设备3拍摄得到的，预设排列规则是：轨道1中的图像数据位于最左侧、轨道2中的图像数据位于中间、轨道3中的图像数据位于最右侧，则所得到的待抓取画面的图像中摄像设备1所拍摄的画面位于最左侧，摄像设备2所拍摄的画面位于中间，摄像设备3所拍摄的画面位于最右侧。
一种实施方式中，按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像的步骤(S103)之前，还可以包括如下步骤：获取多个轨道的轨道数量；基于轨道数量，确定所需分配的缓存区的数量；为每一轨道分配对应的缓存区，其中，缓存区用于存储该缓存区对应的轨道中的图像数据。
本申请中，还可以获取到多个轨道的轨道数量，基于轨道数量，即可以确定缓存区的数量，缓存区的数量与轨道数量一致。具体的，轨道数量可以携带在数据包中传输，例如，数据包携带的轨道数量信息为4，则表示该数据包中携带有4个轨道的码流，且可以确定缓存区的数量为4。
在确定缓存区的数量之后，可以对各缓存区的可用存储空间进行分配，每一缓存区的可用存储空间可以是自定义设定的。也就是说，各缓存区的可用存储空间可以大于或等于该缓存区所对应的轨道中的图像数据的数据量，在这种情况下，可以将轨道中的图像数据直接存储至对应的缓存区中。各缓存区的可用存储空间可以小于该缓存区所对应的轨道中的图像数据的数据量，在这种情况下，在存储之前，可以对轨道中的图像数据进行缩放处理，使得图像数据的数据量小于或等于所对应的缓存区的可用存储空间。
一种实现方式中，为了保证每个缓存区有足够的可用存储空间来存储所对应轨道的图像数据，在进行缓存区分配时，可以为每一缓存区分配的可用存储空间大于或者等于该缓存区所对应轨道的图像数据的数据量，即可以认为，每一缓存区的可用存储空间大于或者等于该缓存区所对应轨道的码流的数据量。这样，即使轨道的图像数据在未进行缩放的情况下也可以存储在对 应的缓存区中。
一种实施方式中，数据包可以携带待抓取画面的图像所需的目标数据量。其中，可以自定义设定图像的目标数据量，即设定所生成的图像的大小，例如，目标数据量设定为5M，则表示待抓取画面的图像为5M。
另外，数据包还可以携带待抓取画面的图像所需的宽高信息，宽高信息包括预设宽度和预设高度，也就是说，待抓取画面的图像所需的宽度为预设宽度，高度为预设高度。其中，预设宽度和预设高度均可以是自定义设定的，例如，预设宽度为800像素，预设高度为480像素，则表示待抓取画面所生成的图像的分辨率宽度为800像素，分辨率高度为480像素。
在上述实施方式的基础上，为每一轨道分配缓存区的步骤，可以具体包括如下步骤：
分配可用存储空间不小于目标数据量、且宽度不小于预设宽度、高度不小于预设高度的总缓存区，其中，目标数据量为待抓取画面的图像所需的数据量，预设宽度和所述预设高度分别为图像所需的宽度和高度；将总缓存区的预设宽度进行平均划分，得到长度相同的多个子宽度，其中，多个子宽度的数量与轨道数量相同；将每个子宽度与预设高度所形成的区域确定为缓存区，其中，所确定出的缓存区与轨道为一一对应关系。
可以先分配一个总缓存区，该总缓存区用于存储数据包中各轨道的码流经过解码处理后的图像数据。其中，总缓存区的可用存储空间可以根据待抓取画面的图像所需的目标数据量自定义分配，也就是说，总缓存区的可用存储空间至少应不小于该目标数据量。另外，总缓存区的宽度不小于预设宽度，且高度不小于预设高度。其中，预设宽度和预设高度为待抓取画面的图像所需的宽度和高度，该预设宽度和预设高度可以是自定义设定的。
在分配总缓存区之后，可以将该总缓存区的预设宽度进行平均划分，得到长度相同的多个子宽度。其中，所划分的子宽度的数量与轨道数量相同。例如，摄像设备的数量为4，则轨道数量也为4，当总缓存区的预设宽度为800像素时，可以将该预设宽度平均划分为4个子宽度，每个子宽度为200像素。
将每个子宽度与预设高度所形成的区域确定为缓存区，也就是说，总缓 存区包括多个相同大小的缓存区。每个缓存区的宽度为子宽度，高度为预设高度。如图3(a)所示，总缓存区的预设宽度为W，预设高度为H，有T1个轨道，则将预设宽度W平均划分为T1等分，每个子宽度为W/T1。将每个子宽度W/T1与预设高度H所形成的区域确定为缓存区，如图中的第一缓存区、第二缓存区……第T1缓存区。
其中，所确定出的缓存区与轨道可以为一一对应关系，也就是说，每一缓存区对应一个轨道，该轨道的图像数据存储至该轨道对应的缓存区中。
在确定缓存区之后，按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像的步骤(S103)，可以包括如下步骤：
基于所获取的各轨道的图像数据，得到图像宽度为子宽度以及图像高度为预设高度的图像数据；按照缓存区与轨道的一一对应关系，将所获取的各轨道的图像数据分别存储至各轨道对应的缓存区；在各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，得到待抓取画面的图像。
基于所获取的各轨道的图像数据，可以得到图像宽度为子宽度以及图像高度为预设高度的图像数据。其中，当各轨道的图像数据的宽和高与所对应的缓存区的宽和高是一致的，则可以将该图像数据直接存储至所对应的缓存区中，当轨道中的图像数据的宽和高与所对应的缓存区的宽和高不一致时，则可以先对该轨道中的图像数据进行缩放处理，使得经过缩放处理后的图像数据的宽和高与所对应的缓存区的宽和高是一致的。一种实现方式中，可以利用VGS(Video Graphics Sub-System，视频图形子系统)分别对各轨道的图像数据进行压缩处理，其中，VGS可以对图像进行缩放、格式转换、解码等处理。
在各轨道的图像数据经过缩放处理成子宽度和预设高度的图像数据后，可以按照缓存区与轨道的一一对应关系，将各轨道的经过缩放处理后的图像数据分别存储至各轨道对应的缓存区。
以图3(a)为例，有T1个轨道，其中，第一轨道和第一缓存区对应，第二轨道和第二缓存区对应……第T1轨道和第T1缓存区对应，则将第一轨道的 经过缩放处理后的图像数据存储至第一缓存区，将第二轨道的经过缩放处理后的图像数据存储至第二缓存区，将第T1轨道的经过缩放处理后的图像数据存储至第T1缓存区。
基于经过缩放处理后的图像数据和缓存区的宽和高均相同，在将图像数据存储至缓存区后，整个缓存区会被图像数据填满，则该缓存区中的图像数据可以表示出一张图像。
其中，将各轨道的经过缩放处理后的图像数据分别存储至各轨道对应的缓存区时，可以针对多个缓存区同时进行存储，还可以按照自定义的顺序依次进行存储。例如，图3(a)中按照标识从小到大的顺序进行存储，即先针对第一缓存区进行存储，再针对第二缓存区进行存储，最后针对第T1缓存区进行存储，当针对第T1缓存区的存储完成后，即整个总缓存区的存储完成。
在各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，可以得到待抓取画面的图像。其中，组合的方式可以是由各缓存区中存储的图像数据直接得到一张图像，该图像即为待抓取画面的图像。例如，待抓取画面的图像为一张YUV图像，缓存区分为Y、U、V三部分分别进行存储，则此时可以直接得到一张YUV图像，即待抓取画面的图像。又例如，待抓取画面的图像为一张比特图像，缓存区为连续的，则可以直接得到待抓取画面的图像。另外，组合的方式还可以对各缓存区中的图像数据进行数据转换处理，得到符合图像格式等要求的图像数据，由数据转换处理后的图像数据所得到的图像即为待抓取画面的图像。
一种实现方式中，总缓存区平均划分为T1个缓存区，所划分的T1个缓存区如图3(a)所示，在确定出每个缓存区之后，确定出每个缓存区的首地址，如图3(b)所示。相邻两个缓存区是相接的，也就是说，缓存区的首地址与该缓存区相邻的上一个缓存区的末地址是连续的。例如，第二缓存区的首地址为第一缓存区的末地址。
针对图3(b)中的缓存区，按照标识从小到大的顺序依次进行存储，即先针对第一缓存区进行存储，再针对第二缓存区进行存储，最后针对第T1缓存区进行存储，当检测到第T1缓存区中存储有图像数据时，即表示当前T1个缓存区均已存储图像数据，此时，将各缓存区中存储的图像数据进行组合， 即得到待抓取画面的图像。
在本申请的一种实施方式中，该图像获取方法还可以包括：在各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到满足预设格式的待抓取画面的图像。
可以对待抓取画面的图像进行图像格式设置。在各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到预设格式的图像。
其中，可以认为，编码处理的过程中包括了对图像数据的数据处理，另外，还可以对所存储的图像数据进行缩放处理，使得所得到的图像的宽度和高度为预先设定的宽度和高度。
其中，预设格式可以是自定义设定的，例如，预设格式可以是JPEG(Joint Photographic Experts Group，联合图像专家小组)格式，PNG(Portable Network Graphics，便携式网络图形)格式等。
其中，预设格式可以是自定义设定的。一种实现方式中，数据包中可以携带预设格式的信息。当获取到数据包之后，可以获取到预设格式信息，根据该预设格式信息可以创建针对该预设格式的编码器，该编码器用于将输入该编码器的图像转换成预设格式的图像。在各轨道的图像数据存储完成后，将缓存区中存储的图像数据输入至编码器中，通过该编码器生成预设格式的图像，将所生成的预设格式的图像进行存储并显示。
例如，预设格式为JPEG格式，则数据包中携带JPEG格式信息，该JPEG格式信息表示所需生成的图像的格式为JPEG格式。根据JPEG格式信息创建的编码器为JPEG编码器，在各轨道的图像数据存储完成后，将缓存区中存储的图像数据输入至JPEG编码器，生成JPEG格式的图像。
一种实现方式中，预设格式为RGB格式，则可以利用TDE(Two Dimensional Engine，二维数据处理工具)对缓存区中存储的图像数据进行图像处理，得到RGB格式的图像。其中，TDE设备可以提供OSD(On Screen Display，屏幕显示叠加)和GUI(Graphical User Interface，图形用户界面)方面的图形绘制功能。
通过本申请实施例提供的技术方案，对于各轨道的摄像设备的预设帧的 码流，通过预设传输通道进行传输，且在该预设传输通道中得到各轨道的码流对应的图像数据，进而得到待抓取画面的图像。上述过程在一个传输通道中完成，即使摄像设备增加的情况下，也无需增加传输通道，节省了传输通道资源。并且，在一个传输通道中得到图像数据，将图像数据对应存储至缓存区即可得到待抓取画面的图像，无需再进行图像拼接处理，节省了图像拼接资源。
相应于上述图像获取方法实施例，本申请实施例还提供一种图像获取装置，如图4所示，该图像获取装置包括：
第一获取模块410，用于获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对应至少一个摄像设备；
第二获取模块420，用于获取各轨道的码流对应的图像数据；
存储模块430，用于按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。
一种实施方式中，第一获取模块具体可以用于：
获取预设传输通道传输的待抓取画面的数据包，其中，数据包携带多个轨道的预设帧的码流。
一种实施方式中，该图像获取装置还可以包括：
第三获取模块，用于获取多个轨道的轨道数量；
确定模块，用于基于轨道数量，确定所需分配的缓存区的数量；
分配模块，用于为每一轨道分配对应的缓存区，其中，缓存区用于存储该缓存区对应的轨道的图像数据。
一种实施方式中，分配模块具体用于：
分配可用存储空间不小于目标数据量、且宽度不小于预设宽度、高度不小于预设高度的总缓存区，其中，目标数据量为待抓取画面的图像所需的数据量，预设宽度和预设高度为待抓取画面的图像所需的宽度和高度；
将总缓存区的预设宽度进行平均划分，得到长度相同的多个子宽度，其中，多个子宽度的数量与轨道数量相同；
将每个子宽度与预设高度所形成的区域确定为缓存区，其中，所确定出的缓存区与轨道为一一对应关系；
存储模块430具体用于：
基于所获取的各轨道的图像数据，得到图像宽度为子宽度以及图像高度为所述预设高度的图像数据；
按照缓存区与轨道的一一对应关系，将所获取的各轨道的图像数据分别存储至各轨道对应的缓存区；
在各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，得到待抓取画面的图像。
一种实施方式中，该图像获取装置还可以包括：
编码模块，用于在各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到满足预设格式的待抓取画面的图像。
通过本申请实施例提供的技术方案，对于各轨道的预设帧的码流，通过预设传输通道进行传输，且在该预设传输通道中得到各轨道的码流对应的图像数据，进而得到待抓取画面的图像。上述过程在一个传输通道中完成，即使摄像设备增加的情况下，也无需增加传输通道，节省了传输通道资源。并且，在一个传输通道中得到图像数据，将图像数据对应存储至缓存区即可得到待抓取画面的图像，无需再进行图像拼接处理，节省了图像拼接资源。
相应于上述图像获取方法实施例，本申请实施例还提供了一种电子设备，如图5所示，包括处理器510和存储器520，其中，
存储器520，用于存放计算机程序；
处理器510，用于执行存储器520上所存放的计算机程序时，实现如下步骤：
获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对 应至少一个摄像设备；
获取各轨道的码流对应的图像数据；
按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至各轨道对应的缓存区，得到待抓取画面的图像。
通过本申请实施例提供的技术方案，对于各轨道的预设帧的码流，通过预设传输通道进行传输，且在该预设传输通道中得到各轨道的码流对应的图像数据，进而得到待抓取画面的图像。上述过程在一个传输通道中完成，即使摄像设备增加的情况下，也无需增加传输通道，节省了传输通道资源。并且，在一个传输通道中得到图像数据，将图像数据对应存储至缓存区即可得到待抓取画面的图像，无需再进行图像拼接处理，节省了图像拼接资源。
存储器可以包括随机存取存储器(Random Access Memory，RAM)，也可以包括非易失性存储器(Non-Volatile Memory，NVM)，例如至少一个磁盘存储器。可选的，存储器还可以是至少一个位于远离前述处理器的存储装置。
上述的处理器可以是通用处理器，包括中央处理器(Central Processing Unit，CPU)、网络处理器(Network Processor，NP)等；还可以是数字信号处理器(Digital Signal Processing，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。
相应于上述图像获取方法实施例，本申请实施例还提供了一种机器可读存储介质，该机器可读存储介质内存储有计算机程序，计算机程序被处理器执行时实现上述任一图像获取方法。
本申请实施例还提供了一种应用程序，用于在运行时执行：上述任一图像获取方法。
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要 素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
本说明书中的各个实施例均采用相关的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于装置、电子设备、机器可读存储介质以及应用程序实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。
以上所述仅为本申请的较佳实施例而已，并不用以限制本申请，凡在本申请的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本申请保护的范围之内。

Claims (13)

  1. 一种图像获取方法，其特征在于，所述方法包括：
    获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对应至少一个摄像设备；
    获取各轨道的码流对应的图像数据；
    按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至所述各轨道对应的缓存区，得到待抓取画面的图像。
  2. 根据权利要求1所述的方法，其特征在于，所述获取预设传输通道传输的多个轨道的预设帧的码流的步骤，包括：
    获取预设传输通道传输的待抓取画面的数据包，其中，所述数据包携带多个轨道的预设帧的码流。
  3. 根据权利要求1所述的方法，其特征在于，在所述按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至所述各轨道对应的缓存区，得到待抓取画面的图像的步骤之前，所述方法还包括：
    获取所述多个轨道的轨道数量；
    基于所述轨道数量，确定所需分配的缓存区的数量；
    为每一轨道分配对应的缓存区，其中，所述缓存区用于存储该缓存区对应的轨道中的图像数据。
  4. 根据权利要求3所述的方法，其特征在于，所述为每一轨道分配对应的缓存区的步骤，包括：
    分配可用存储空间不小于目标数据量、且宽度不小于预设宽度、高度不小于预设高度的总缓存区，其中，所述目标数据量为待抓取画面的图像所需的数据量，所述预设宽度和所述预设高度分别为所述图像所需的宽度和高度；
    将所述总缓存区的所述预设宽度进行平均划分，得到长度相同的多个子宽度，其中，所述多个子宽度的数量与所述轨道数量相同；
    将每个子宽度与所述预设高度所形成的区域确定为缓存区，其中，所确 定出的缓存区与轨道为一一对应关系；
    所述按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至所述各轨道对应的缓存区，得到待抓取画面的图像的步骤，包括：
    基于所获取的各轨道的图像数据，得到图像宽度为子宽度以及图像高度为所述预设高度的图像数据；
    按照缓存区与轨道的一一对应关系，将所获取的各轨道的图像数据分别存储至所述各轨道对应的缓存区；
    在所述各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，得到待抓取画面的图像。
  5. 根据权利要求1-4任一项所述的方法，其特征在于，所述方法还包括：
    在所述各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到满足预设格式的待抓取画面的图像。
  6. 一种图像获取装置，其特征在于，所述装置包括：
    第一获取模块，用于获取预设传输通道传输的多个轨道的预设帧的码流，其中，每个轨道对应至少一个摄像设备；
    第二获取模块，用于获取各轨道的码流对应的图像数据；
    存储模块，用于按照轨道与缓存区的对应关系，将所获取的各轨道的图像数据存储至所述各轨道对应的缓存区，得到待抓取画面的图像。
  7. 根据权利要求6所述的装置，其特征在于，所述第一获取模块，具体用于：
    获取预设传输通道传输的待抓取画面的数据包，其中，所述数据包携带多个轨道的预设帧的码流。
  8. 根据权利要求6所述的装置，其特征在于，所述装置还包括：
    第三获取模块，用于获取所述多个轨道的轨道数量；
    确定模块，用于基于所述轨道数量，确定所需分配的缓存区的数量；
    分配模块，用于为每一轨道分配对应的缓存区，其中，所述缓存区用于存储该缓存区对应的轨道的图像数据。
  9. 根据权利要求8所述的装置，其特征在于，所述分配模块，具体用于：
    分配可用存储空间不小于目标数据量、且宽度不小于预设宽度、高度不小于预设高度的总缓存区，其中，所述目标数据量为待抓取画面的图像所需的数据量，所述预设宽度和所述预设高度分别为所述图像所需的宽度和高度；
    将所述总缓存区的所述预设宽度进行平均划分，得到长度相同的多个子宽度，其中，所述多个子宽度的数量与所述轨道数量相同；
    将每个子宽度与所述预设高度所形成的区域确定为缓存区，其中，所确定出的缓存区与轨道为一一对应关系；
    所述存储模块，具体用于：
    基于所获取的各轨道的图像数据，得到图像宽度为子宽度以及图像高度为所述预设高度的图像数据；
    按照缓存区与轨道的一一对应关系，将所获取的各轨道的图像数据分别存储至所述各轨道对应的缓存区；
    在所述各轨道的图像数据存储完成后，将各缓存区中存储的图像数据进行组合，得到待抓取画面的图像。
  10. 根据权利要求6-9任一项所述的装置，其特征在于，所述装置还包括：
    编码模块，用于在所述各轨道的图像数据存储完成后，对所存储的图像数据进行编码处理，得到满足预设格式的待抓取画面的图像。
  11. 一种电子设备，其特征在于，包括处理器和存储器，其中，
    所述存储器，用于存放计算机程序；
    所述处理器，用于执行所述存储器上所存放的计算机程序时，实现权利要求1-5任一项所述的方法。
  12. 一种机器可读存储介质，其特征在于，所述机器可读存储介质内存储有计算机程序，所述计算机程序被处理器执行时实现权利要求1-5任一项所 述的方法。
  13. 一种应用程序，其特征在于，用于在运行时执行：权利要求1-5任一项所述的方法。
PCT/CN2020/083707 2019-04-10 2020-04-08 一种图像获取方法及装置 Ceased WO2020207403A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910283294.6A CN111818295B (zh) 2019-04-10 2019-04-10 一种图像获取方法及装置
CN201910283294.6 2019-04-10

Publications (1)

Publication Number Publication Date
WO2020207403A1 true WO2020207403A1 (zh) 2020-10-15

Family

ID=72752131

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/083707 Ceased WO2020207403A1 (zh) 2019-04-10 2020-04-08 一种图像获取方法及装置

Country Status (2)

Country Link
CN (1) CN111818295B (zh)
WO (1) WO2020207403A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114928730A (zh) * 2022-06-23 2022-08-19 湖南国科微电子股份有限公司 图像处理方法和图像处理装置
CN117499601A (zh) * 2024-01-02 2024-02-02 上海励驰半导体有限公司 用于SoC的调用多摄像头数据的方法

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112565627B (zh) * 2020-11-30 2023-02-03 天津津航计算技术研究所 一种基于位图叠加的多路视频集中显示设计方法
CN113068024B (zh) * 2021-03-19 2024-04-16 瑞芯微电子股份有限公司 一种实时抓图分析方法及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060168350A1 (en) * 2005-01-25 2006-07-27 Shingo Ishiyama Image processing apparatus
US20080107334A1 (en) * 2006-10-03 2008-05-08 Quanta Computer Inc. Image processing apparatus and method
CN103260011A (zh) * 2013-05-16 2013-08-21 杭州巨峰科技有限公司 一种利用网络硬盘录像机实现更多路数的监视系统及方法
CN105306837A (zh) * 2015-10-27 2016-02-03 浙江宇视科技有限公司 多图像拼接方法及装置
CN109120867A (zh) * 2018-09-27 2019-01-01 乐蜜有限公司 视频合成方法及装置
CN109429037A (zh) * 2017-09-01 2019-03-05 杭州海康威视数字技术股份有限公司 一种图像处理方法、装置、设备及系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070022215A1 (en) * 2005-07-19 2007-01-25 Singer David W Method and apparatus for media data transmission
US20070056001A1 (en) * 2005-08-24 2007-03-08 Hules Frank J Dual channel video and audio data for DBS receivers
WO2008048065A1 (en) * 2006-10-19 2008-04-24 Lg Electronics Inc. Encoding method and apparatus and decoding method and apparatus
CN102497527B (zh) * 2011-12-16 2013-11-27 杭州海康威视数字技术股份有限公司 多处理器视频处理系统及其中的视频图像同步传输与显示方法
CN104050092B (zh) * 2013-03-15 2018-05-01 上海芯豪微电子有限公司 一种数据缓存系统及方法
US10708328B2 (en) * 2014-03-17 2020-07-07 Intel Corporation Hardware assisted media playback and capture synchronization
KR101560727B1 (ko) * 2014-04-07 2015-10-15 네이버 주식회사 멀티트랙 비디오 컨텐츠의 제공을 위한 멀티트랙 비디오 컨텐츠 서비스 방법 및 시스템

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060168350A1 (en) * 2005-01-25 2006-07-27 Shingo Ishiyama Image processing apparatus
US20080107334A1 (en) * 2006-10-03 2008-05-08 Quanta Computer Inc. Image processing apparatus and method
CN103260011A (zh) * 2013-05-16 2013-08-21 杭州巨峰科技有限公司 一种利用网络硬盘录像机实现更多路数的监视系统及方法
CN105306837A (zh) * 2015-10-27 2016-02-03 浙江宇视科技有限公司 多图像拼接方法及装置
CN109429037A (zh) * 2017-09-01 2019-03-05 杭州海康威视数字技术股份有限公司 一种图像处理方法、装置、设备及系统
CN109120867A (zh) * 2018-09-27 2019-01-01 乐蜜有限公司 视频合成方法及装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114928730A (zh) * 2022-06-23 2022-08-19 湖南国科微电子股份有限公司 图像处理方法和图像处理装置
CN114928730B (zh) * 2022-06-23 2023-08-22 湖南国科微电子股份有限公司 图像处理方法和图像处理装置
CN117499601A (zh) * 2024-01-02 2024-02-02 上海励驰半导体有限公司 用于SoC的调用多摄像头数据的方法
CN117499601B (zh) * 2024-01-02 2024-04-05 上海励驰半导体有限公司 用于SoC的调用多摄像头数据的方法

Also Published As

Publication number Publication date
CN111818295B (zh) 2022-02-01
CN111818295A (zh) 2020-10-23

Similar Documents

Publication Publication Date Title
CN110868600B (zh) 目标跟踪视频推流方法、显示方法、装置和存储介质
WO2020207403A1 (zh) 一种图像获取方法及装置
CN110784718B (zh) 视频数据编码方法、装置、设备和存储介质
US11638066B2 (en) Method, device and computer program for encapsulating media data into a media file
US12526438B2 (en) Video transcoding and video display method, apparatus, and electronic device
CN103929657B (zh) 视频复用设备和方法、复用视频解码设备和方法
CN109429037B (zh) 一种图像处理方法、装置、设备及系统
CN111479162B (zh) 直播数据传输方法、装置以及计算机可读存储介质
WO2021147702A1 (zh) 一种视频处理方法及其装置
CN107155093B (zh) 一种视频预览方法、装置及设备
CN105306837A (zh) 多图像拼接方法及装置
CN112511896A (zh) 一种视频渲染方法及装置
CN111757121A (zh) 视频流倒放方法及装置
CN114830674A (zh) 发送装置和接收装置
CN115426501A (zh) 一种音视频码流时间校准方法及电子设备
CN115695883A (zh) 一种视频数据处理方法、装置、设备以及存储介质
CN112911299B (zh) 一种视频码率控制方法、装置、电子设备和存储介质
TW201519641A (zh) 資料處理裝置、資料處理方法、程式、記錄媒體及資料處理系統
WO2021114305A1 (zh) 视频处理方法、装置及计算机可读存储介质
CN107580228A (zh) 一种监控视频处理方法、装置及设备
CN115460369B (zh) 视频录像设备、离线视频分析方法、电子设备及存储介质
CN117041685A (zh) 道路病害展示方法、系统、装置、设备及可读存储介质
WO2024002264A1 (zh) 视频处理设备、进度条时间更新方法及装置、电子设备
CN116781913A (zh) 点云媒体的编解码方法及相关产品
CN109495793B (zh) 一种弹幕写入方法、装置、设备及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20786765

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20786765

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/05/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20786765

Country of ref document: EP

Kind code of ref document: A1