WO2023109867A1 - Camera image transmission method and apparatus, and camera - Google Patents

Camera image transmission method and apparatus, and camera Download PDF

Info

Publication number
WO2023109867A1
WO2023109867A1 PCT/CN2022/139015 CN2022139015W WO2023109867A1 WO 2023109867 A1 WO2023109867 A1 WO 2023109867A1 CN 2022139015 W CN2022139015 W CN 2022139015W WO 2023109867 A1 WO2023109867 A1 WO 2023109867A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
partial
image
full
group
Prior art date
Application number
PCT/CN2022/139015
Other languages
French (fr)
Chinese (zh)
Inventor
匡小冬
刘琳
白涛
许俊峰
闫冬升
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202111645121.8A external-priority patent/CN116347020A/en
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023109867A1 publication Critical patent/WO2023109867A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/917Television signal processing therefor for bandwidth reduction

Definitions

  • the invention relates to camera technology, in particular to a camera image sending method.
  • the camera converts the optical signal into visualized images and videos through photoelectric conversion, and the visualized images and videos can be recorded on the storage medium for easy retrospective, so it is widely used in intersections, airports and other fields that require camera monitoring.
  • the network camera adds a network coding module and a network port on the basis of the traditional camera.
  • the network encoding module compresses and encodes the collected data, and uses the network port to transmit through the network, and the remote storage server stores the encoded data after receiving it. It is used to view or process data on the storage server.
  • the capture network camera installed at the intersection as an example, it will frequently capture the vehicles passing through the shooting range of the network camera.
  • the captured image is called a full image, and a partial image (such as a vehicle partial image) is extracted from the full image. If multiple images of the same vehicle are captured in the video stream captured by the same camera, the partial image with the highest recognition degree of the vehicle and the corresponding full image are selected for transmission, and the rest of the images are not transmitted.
  • the network camera will generate a large number of partial and full images that need to be transmitted.
  • a large number of network cameras work in parallel at the same time, so a large number of images will be generated. Transmitting these images to the storage server undoubtedly poses a huge challenge to both the network transmission capability and the storage capacity of the storage server.
  • a camera image transmission method comprising: extracting multiple full images recorded with multiple targets from a video stream, wherein each full image records at least one target; obtaining a first group of partial images according to the multiple full images, The first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images are obtained from the same full image in the plurality of full images; Sending the first group of partial images and the full images corresponding to each partial image in the first group of partial images to a storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
  • part of the local images jointly correspond to the same full image, so the number of full images sent by the camera to the storage device is less than the number of partial images. Therefore, the number of full images to be sent is reduced, and the occupation of network bandwidth and storage space of the storage device is reduced.
  • the first group of partial maps includes a first partial map, and the first partial map is used to record a first target object, wherein the best image quality of the The first object is located in a second ensemble different from said first ensemble. It can be seen from this scheme that we do not use the best quality of the partial graph as the standard when we choose the partial graph.
  • the image quality of the first partial image meets a preset quality requirement.
  • a camera image sending device including: a full image acquisition module, configured to extract multiple full images recorded with multiple targets from a video stream, wherein each full image records at least one target; a partial image acquisition module, It is used to obtain a first group of partial images based on the plurality of full images, the first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images
  • the picture is obtained according to the same full picture in the plurality of full pictures;
  • the sending module is configured to send the first group of partial pictures and the full picture corresponding to each partial picture in the first group of partial pictures to a storage device, wherein , the number of sent full images is less than the number of the plurality of partial images.
  • a video camera including: a lens for receiving light; a sensor for photoelectric conversion to generate an original image; a processor system for processing the original image, and: how many records are extracted from the video stream A plurality of full images of a target, wherein each full image records at least one target; a first group of partial images is obtained according to the plurality of full images, and the first group of partial images has multiple partial images, wherein different partial images are recorded with different
  • the goal is that at least two partial images in the first group of partial images are obtained from the same full image in the plurality of full images; the first group of partial images and each partial image in the first group of partial images correspond to The full images of are sent to the storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
  • a program product which can be run in the processor of the camera.
  • the camera can perform: extract multiple full pictures with multiple targets recorded from the video stream, wherein each full picture is recorded with at least A target; a first group of partial images is obtained according to the plurality of full images, the first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two of the first group of partial images
  • the partial image is obtained according to the same full image in the plurality of full images; the first group of partial images and the full images corresponding to each partial image in the first group of partial images are sent to the storage device, wherein the sent The number of full images is smaller than the number of the plurality of partial images.
  • FIG. 1 is a structural diagram of an embodiment of components of a camera.
  • Fig. 2 is a flow chart of the camera sending images.
  • Fig. 3 is a schematic diagram of an embodiment of an image sent by a camera.
  • Fig. 4 is a flow chart of the camera sending images.
  • Fig. 5 is a schematic diagram of an embodiment of an image sent by a camera.
  • Fig. 6 is a schematic diagram of an embodiment where the camera is an image sending device.
  • a video camera is an electronic device that can take pictures and record video.
  • components constituting a camera according to an embodiment of the present invention include a lens 11 (lens), a sensor (sensor) 12 and a system on chip (SoC) 13 .
  • the lens 11 is used to pass light;
  • the sensor 12 is used to convert the optical signal from the lens into an electrical signal, and record it in the form of an original image;
  • the system-on-chip 13 can encode the original image, such as converting RAW Images are encoded into JPEG images, HEIF images, H.264 videos, H.265 videos, etc. that are easily recognized by human eyes.
  • the images involved in the embodiments of the present invention may be photos or frames in a video stream.
  • the function of the lens 11 is to present the light image of the observed object on the sensor of the camera.
  • the lens combines various optical parts (mirrors, transmissive mirrors, prisms) of different shapes and media (plastic, glass or crystal) in a certain way, so that after the light is transmitted or reflected by these optical parts, according to people's It is necessary to change the transmission direction of the light to be received by the receiving device to complete the optical imaging process of the object.
  • the lens is composed of multiple groups of lenses with different curvatures at different pitches. The selection of spacing, lens curvature, light transmittance and other indicators determine the focal length of the lens.
  • the main parameters of the lens include: effective focal length, aperture, field of view, distortion, relative illuminance, etc. The values of each index determine the overall performance of the lens.
  • the sensor 12 is a device that converts optical images into electronic signals, and is widely used in cameras and other electronic optical devices.
  • Common sensors include: charge-coupled device (CCD) and complementary metal-oxide semiconductor (complementary MOS, CMOS). Both CCD and CMOS have a large number (for example, tens of millions) of photodiodes, and each photodiode is called a photosensitive unit, and each photosensitive unit corresponds to a pixel. During exposure, the photosensitive diode converts the light signal into an electrical signal including brightness (or brightness and color) after being irradiated by light, and the image is reconstructed accordingly.
  • the Bayer array is a common image sensor technology.
  • the Bayer array uses a Bayer filter to make different pixels sensitive to one of the three primary colors of red, blue, and green. These pixels are interleaved and then demosaiced (demosaicing) interpolation algorithm to get the original image.
  • the Bayer array can be applied to CCD or CMOS, and the sensor using the Bayer array is also called a Bayer sensor.
  • the same camera can be provided with multiple sensors, such as a dual-lens dual-sensor camera, a single-lens dual-sensor camera, and a single-lens triple-sensor camera. These sensors are used to image the same object to be photographed.
  • a beam splitter can also be set between the lens and the sensor, so that the light entering from one lens can be split to multiple sensors to ensure that each sensor can receive light.
  • the processor system is specifically a combination of multiple separate chips, or an integration of multiple chips (such as the system on chip 13).
  • the image signal processor (ISP) 131 is used for performing image signal processing on the image, improving image contrast, saturation, gain and other image parameters for adjustment.
  • the image signal processor 132 can fuse images, for example, fuse a frame of grayscale image and a frame of color image to generate a frame of high-quality color image to improve the image effect.
  • the encoder 133 is used to encode images into images available for playback. For example, YUV data is generated into H.264 or H.265 frames. Images can be played on a display or stored. Multiple images can be played continuously to form a dynamic video. In some embodiments, these chips may not be integrated together, but are independent.
  • the camera may also have other components, such as optical filters, network interfaces, encoders, etc., which will not be described in detail here.
  • step S11 the camera shoots a video stream, and the camera extracts a plurality of frames from the captured video stream.
  • the frames captured by the camera in sequence include: image 21 (full image), image 22 (full image) and image 23 (full image).
  • the objects recorded in image 21 include: vehicle A, vehicle B, and vehicle C;
  • the objects recorded in image 22 include: vehicle B and vehicle C,
  • the vehicles recorded in image 23 include vehicle C, and no vehicle is recorded in image 24.
  • vehicle B has the highest quality in image 22
  • vehicle C has the highest quality in image 23 .
  • Step S12 the camera extracts partial images of the vehicle from the full image according to the image quality of the target, and obtains image 211 (partial image), image 212 (partial image), and image 231 (partial image).
  • Step S13 the camera sends all the partial images and the full images where all the partial images are extracted to the storage server.
  • the number of partial images in FIG. 1 is 3, and the corresponding number of full images is also 3. Therefore, a total of 6 images need to be sent to the storage server, and the 6 images are: image 211 , image 221 , image 231 , and image 21 , image 22 and image 23 .
  • the storage server After the storage server receives the image sent by the camera, it can cache or persistently store the received image.
  • the storage server also has functions such as image optimization and image recognition.
  • a single camera needs to send a total of 6 images (3 full images + 3 partial images) to the storage server based on a short video stream.
  • the present invention further provides an embodiment in which the camera sends images. After the camera captures the image, when the same image appears in multiple vehicles, it can only send the partial images and a single full image of these vehicles instead of Send the full graph for each partial graph. It is equivalent to "sharing" the same full image with multiple partial images. As a result, the number of partial images and full images no longer maintains a 1:1 relationship, but the number of full images is less than the number of partial images, thereby reducing the number of full images sent.
  • Step S21 the video camera shoots the video stream in real time, and saves the video stream in a local storage (internal memory, memory card, SSD or hard disk).
  • the camera extracts an image (also called a frame) from the captured video stream.
  • the complete image extracted in this step is called a full image.
  • the extracted full images are shown in Fig. 21, Fig. 22 and Fig. 23 in descending order according to the shooting time.
  • Step S22 extracting the area where the target is located from the plurality of full images (big images) to generate a partial image (small image), and putting the partial image into a cache queue.
  • the target is the target that needs to be observed or analyzed in the frame, such as moving objects such as cars, pedestrians, and animals.
  • the camera extracts an image from every two images in the video, obtains the multiple images, and detects the target in the extracted image (specifically, the area where the target is located in the image, for convenience) description, referred to here as the image quality of the target), for the same target appearing in different images, the following operations are performed:
  • Each target can have an optimal cache queue for storing optimal local graphs. Put the full image (best full image) of the best quality partial image into the best cache queue, or put it into a separately set full image queue.
  • the quality of the target can be judged from multiple dimensions, such as one of the following items: the pose of the target in the image, the image resolution of the area where the target is located, the display rate of key points of the target, or the recognition rate when recognizing the target, etc.
  • the target quality does not meet expectations, it will not be placed in the suboptimal cache queue.
  • the images extracted from the video stream are image 21, image 22, image 23 and image 24 respectively. From these four images, it can be seen that as time goes by, vehicle A, vehicle B.
  • vehicle C drives out of the shooting range of the camera in sequence.
  • the image quality of each vehicle in different images is different, and the quality scores describing the quality are in brackets (the quality threshold is 50 points, and the task quality below 50 points does not meet expectations).
  • the distribution is shown in Table 1 below, and the target and target scores described by the local graph are in parentheses.
  • image 21 If there is no record about vehicle A, vehicle B, and vehicle C in the optimal cache queue at this time, then directly extract image 211 (partial image), image 212 (partial image), image 212 (partial image), regardless of the quality of the target 213 (partial diagram), all three are put into the optimal cache queues corresponding to the vehicles respectively. Among them, each vehicle has a corresponding optimal cache queue and a second-best cache queue.
  • image 221 is of higher quality than image 212, so image 221 is placed in the vehicle B optimal cache queue, covering image 212.
  • the image 222 has a quality score of 40, so no extraction is required.
  • image 23 cut out image 231 (partial image), because the quality of image 231 is higher than that of image 213, therefore put image 231 into the optimal cache queue of vehicle C, and cover image 213.
  • Table 2 is a description of the images in the cache queue for each vehicle pair.
  • Step S23 according to the partial images stored in the cache queue, select the partial images and provide the full images of the partial images to send to the storage device, and use the frame number queue to record the sent full images. This step can be executed after detecting that the vehicle disappears.
  • the strategy for selecting a partial image is: for any vehicle, if it is determined through the records in the frame number queue that a full image with this vehicle has been sent, and the quality of the vehicle in the previously sent full image meets the quality threshold (The judgment quality threshold is an optional condition). Then, from the second-best queue, find the partial graph that satisfies the quality threshold and send it. For any vehicle mentioned above, no other full image can be transmitted additionally.
  • the camera has not sent the full image of the vehicle A before, so the image 211 and the image 21 are directly selected and sent to the storage device. And, record the frame number of the selected full picture (that is, the image 21) into the full picture frame number queue. In addition, the corresponding relationship between the image 211 and the image 21 is also sent to the storage device.
  • image 21 For vehicle B, it is known from the queue of frame numbers of the whole image that the image 21 has been sent.
  • image 21 there is a partial view of vehicle B (image 212 ), and in image 21 the quality score of vehicle B is higher than 50 points.
  • image 212 is directly selected from the suboptimal cache and sent to the storage device (instead of Send the image 221 and the full image 22) where the image 221 is located, and send the correspondence between the image 212 and the image 21 to the storage device. That is to say, the two partial images (image 212 and image 211 ) correspond to the same full image (image 21 ).
  • image 21 For vehicle C, it is known from the queue of frame numbers of the whole image that the image 21 has been sent. In image 21 there is a partial view of vehicle C (image 212 ), however in image 21 the quality score of vehicle C is below 50 points. However, the quality score of the image 231 is higher than the threshold, so for the vehicle C, the selected image 231 and the full image 23 corresponding to the image 231 are sent to the storage device. In addition, the corresponding relationship between the image 231 and the image 23 is also sent to the storage device.
  • the camera sends a total of 5 images to the storage device (3 partial images + 2 full images).
  • the image quality is not considered. It is known from the frame number queue of the whole image that the image 21 has been sent, so the image 213 is directly sent (and the association between the image 213 and the image 21 is sent), and the image 231 and the image 23 are not selected for sending. In this case, the camera sends a total of 4 full images to the storage device (3 partial images + 1 full image).
  • step 22 is executed first, and then step 23 is executed.
  • step 23 is executed.
  • the operation of extracting images and sending images is actually performed continuously.
  • the partial images sent to the storage device may be referred to as the first group of partial images
  • the partial images in the cache queue may be referred to as the second group of partial images.
  • some partial graphs record the same target
  • different partial graphs record different targets.
  • the first set of partial maps is part of the second set of partial maps, the number of partial maps in the first set of partial maps being less than the number of partial maps in the second set of partial maps.
  • the present invention also provides a camera image sending device, which can execute the above method.
  • the device is, for example, a camera, or a software module in the camera, and the software module can be run by an image signal processor (ISP) 131 .
  • ISP image signal processor
  • the image sending device includes a full image acquisition module 31 , a partial image acquisition module 32 and a sending module 33 .
  • the full image acquisition module 31 may execute step S21, and the partial image acquisition module 32 is configured to extract multiple full images recorded with multiple objects from the video stream, wherein each full image records at least one object.
  • the partial image acquisition module 32 can perform the process of selecting partial images and full images in step S22 and step S23, the partial image acquisition module 32 is used to obtain a first group of partial images according to the multiple full images, and the first group of partial images has multiple Partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images are obtained from the same full image among the plurality of full images.
  • the sending module 33 may execute the sending process in step S23, for sending the first group of partial images and the full images corresponding to each partial image in the first group of partial images to the storage device, wherein the sent full The number of graphs is smaller than the number of the plurality of partial graphs.
  • the sending module 33 is further configured to, in the image sent to the storage device, establish a corresponding relationship between a partial image in the first group of partial images and a full image having the partial image.
  • the partial image acquisition module 32 can specifically be used to: obtain a second group of partial images according to the plurality of full images, and some partial images in the second group of partial images record the same target, wherein the partial images recording the same target come from Different full maps; selecting the first group of partial maps according to the second group of partial maps, where different partial maps record different targets in the first group of partial maps.
  • the present invention also provides a program product that can run in the video camera and is used to execute the aforementioned method steps S21-S23.
  • One or more of the above modules or units may be realized by software, hardware or a combination of both.
  • the software exists in the form of computer program instructions and is stored in the memory, and the processor can be used to execute the program instructions and realize the above method flow.
  • the processor may include but not limited to at least one of the following: a central processing unit (central processing unit, CPU), a microprocessor, a digital signal processor (DSP), a microcontroller (microcontroller unit, MCU), or artificial intelligence
  • a central processing unit central processing unit, CPU
  • a microprocessor central processing unit
  • DSP digital signal processor
  • MCU microcontroller unit
  • artificial intelligence Various types of computing devices that run software such as processors, each computing device may include one or more cores for executing software instructions to perform calculations or processing.
  • the processor can be built into SoC (system on chip) or application specific integrated circuit (ASIC), or it can be an independent semiconductor chip.
  • SoC system on chip
  • ASIC application specific integrated circuit
  • the core of the processor is used to execute software instructions for calculation or processing, and can further include necessary hardware accelerators, such as field programmable gate array (field programmable gate array, FPGA), PLD (programmable logic device) , or a logic circuit that implements a dedicated logic operation.
  • necessary hardware accelerators such as field programmable gate array (field programmable gate array, FPGA), PLD (programmable logic device) , or a logic circuit that implements a dedicated logic operation.
  • the present invention also provides an embodiment of a camera, including: a lens 11 for receiving light; a sensor 12 for photoelectric conversion to generate an original image; and a processor system 13 .
  • the processor system 13 is used to process the original image and execute the above-mentioned method embodiments.
  • the method of the processor system 13 includes, for example: extracting a plurality of full images recorded with multiple targets from the video stream, wherein each full image records at least one target; obtaining a first group of partial images according to the plurality of full images, and the first group Partial graphs Multiple partial graphs, wherein different partial graphs record different targets, and at least two partial graphs in the first group of partial graphs are obtained from the same full graph in the multiple full graphs;
  • the group of partial images and the full images corresponding to each partial image in the first group of partial images are sent to the storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
  • the hardware can be CPU, microprocessor, DSP, MCU, artificial intelligence processor, ASIC, SoC, FPGA, PLD, dedicated digital circuit, hardware accelerator or non-integrated discrete device Any one or any combination of them, which can run necessary software or not depend on software to execute the above method flow.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

Provided is a camera image transmission method, comprising: extracting a plurality of whole images from a video stream photographed by a camera, wherein the plurality of whole images record a plurality of targets; extracting a plurality of local images from the plurality of whole images, wherein there are a plurality of local images extracted from at least one whole image; and transmitting the extracted local images to a storage device, and transmitting, to the storage device, a whole image corresponding to the transmitted local images, wherein a plurality of whole images for local images correspond to a same whole image.

Description

摄像机图像传输方法装置以及摄像机Camera image transmission method device and camera
本申请要求于2021年12月16日提交中国国家知识产权局、申请号为202111540940.6、申请名称为“摄像机图像传输方法”的中国专利申请的优先权,以及要求于2021年12月30日提交中国国家知识产权局、申请号为202111645121.8、申请名称为“摄像机图像传输方法装置以及摄像机”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202111540940.6 and the title of "camera image transmission method" filed with the State Intellectual Property Office of China on December 16, 2021, and claims to be filed in China on December 30, 2021 The State Intellectual Property Office, the priority of the Chinese patent application with the application number 202111645121.8 and the application name "camera image transmission method device and camera", the entire content of which is incorporated in this application by reference.
技术领域technical field
本发明涉及摄像机技术,尤其涉及摄像机图像发送方法。The invention relates to camera technology, in particular to a camera image sending method.
背景技术Background technique
摄像机通过光电转换把光信号转化为可视化的图像和视频,可视化的图像和视频可以在存储介质上记录下来以便于进行回溯,因此在路口、机场等需要摄像机监控的领域得到广泛应用。The camera converts the optical signal into visualized images and videos through photoelectric conversion, and the visualized images and videos can be recorded on the storage medium for easy retrospective, so it is widely used in intersections, airports and other fields that require camera monitoring.
网络摄像机(IP camera,IPC)在传统摄像机的基础上增加了网络编码模块和网口。网络编码模块将采集的数据进行压缩编码,使用网口通过网络进行传输,远端的存储服务器接收到编码数据后进行存储。用于可以对存储服务器上的数据或者查看或者进行数据加工。The network camera (IP camera, IPC) adds a network coding module and a network port on the basis of the traditional camera. The network encoding module compresses and encodes the collected data, and uses the network port to transmit through the network, and the remote storage server stores the encoded data after receiving it. It is used to view or process data on the storage server.
以安装在十字路口的抓拍网络摄像机为例,它会频繁对经过网络摄像机拍摄范围的车辆进行抓拍。抓拍到的图像称为全图,从全图中抠取局部图(例如车辆局部图)。如果同一个摄像机拍摄的视频流中有多张图像都拍摄到相同的车辆,则选取对这位车辆识别度最高的局部图以及与之对应的全图进行传输,其余的图像不传输。Take the capture network camera installed at the intersection as an example, it will frequently capture the vehicles passing through the shooting range of the network camera. The captured image is called a full image, and a partial image (such as a vehicle partial image) is extracted from the full image. If multiple images of the same vehicle are captured in the video stream captured by the same camera, the partial image with the highest recognition degree of the vehicle and the corresponding full image are selected for transmission, and the rest of the images are not transmitted.
对于是繁忙的十字路口,在经过长时间拍摄后,网络摄像机会生成大量需要传输的局部图和全图。而在城市道路网上,同时有大量网络摄像机并行工作,因此会产生海量的图像。把这些图像传输给存储服务器,这无疑对网络传输能力和存储服务器的存储容量都带来巨大的挑战。For a busy intersection, after a long time of shooting, the network camera will generate a large number of partial and full images that need to be transmitted. On the urban road network, a large number of network cameras work in parallel at the same time, so a large number of images will be generated. Transmitting these images to the storage server undoubtedly poses a huge challenge to both the network transmission capability and the storage capacity of the storage server.
因此,如何尽量减少需要传输的图像数量是当前亟需解决的问题。Therefore, how to minimize the number of images to be transmitted is an urgent problem to be solved at present.
发明内容Contents of the invention
第一方面,提供一种摄像机图像发送方法,包括:从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。In a first aspect, a camera image transmission method is provided, comprising: extracting multiple full images recorded with multiple targets from a video stream, wherein each full image records at least one target; obtaining a first group of partial images according to the multiple full images, The first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images are obtained from the same full image in the plurality of full images; Sending the first group of partial images and the full images corresponding to each partial image in the first group of partial images to a storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
应用第一方面提供的方案,部分局部图共同对应同一个全图,因此摄像机发送给存储设备的全图少于局部图的数量。从而减少了发送的全图的数量,减少了对网络带宽的占用,以及对存储设备存储空间的占用。Applying the solution provided in the first aspect, part of the local images jointly correspond to the same full image, so the number of full images sent by the camera to the storage device is less than the number of partial images. Therefore, the number of full images to be sent is reduced, and the occupation of network bandwidth and storage space of the storage device is reduced.
在第一方面的第一种可能实现方式中,所述第一组局部图中包括第一局部图,所述第一 局部图用于记录第一目标对象,其中,最佳图像质量的所述第一目标位于不同于所述第一全图的第二全图。该方案可以看出,我们选择局部图时不是依据局部图的最佳质量作为标准。可选的,所述第一局部图的图像质量满足符合预设质量要求。In a first possible implementation manner of the first aspect, the first group of partial maps includes a first partial map, and the first partial map is used to record a first target object, wherein the best image quality of the The first object is located in a second ensemble different from said first ensemble. It can be seen from this scheme that we do not use the best quality of the partial graph as the standard when we choose the partial graph. Optionally, the image quality of the first partial image meets a preset quality requirement.
第二方面,提供一种摄像机图像发送装置,包括:全图获取模块,用于从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;局部图获取模块,用于根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;发送模块,用于将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。In a second aspect, a camera image sending device is provided, including: a full image acquisition module, configured to extract multiple full images recorded with multiple targets from a video stream, wherein each full image records at least one target; a partial image acquisition module, It is used to obtain a first group of partial images based on the plurality of full images, the first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images The picture is obtained according to the same full picture in the plurality of full pictures; the sending module is configured to send the first group of partial pictures and the full picture corresponding to each partial picture in the first group of partial pictures to a storage device, wherein , the number of sent full images is less than the number of the plurality of partial images.
第二方面,提供一种摄像机,包括:镜头,用于接收光线;传感器,用于光电转换,生成原始图像;处理器系统,用于对原始图像处理,以及:从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。In the second aspect, a video camera is provided, including: a lens for receiving light; a sensor for photoelectric conversion to generate an original image; a processor system for processing the original image, and: how many records are extracted from the video stream A plurality of full images of a target, wherein each full image records at least one target; a first group of partial images is obtained according to the plurality of full images, and the first group of partial images has multiple partial images, wherein different partial images are recorded with different The goal is that at least two partial images in the first group of partial images are obtained from the same full image in the plurality of full images; the first group of partial images and each partial image in the first group of partial images correspond to The full images of are sent to the storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
第四方面,提供一种程序产品,可以运行在摄像机的处理器中,通过运行该程序产品,摄像机可以执行:从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。In the fourth aspect, a program product is provided, which can be run in the processor of the camera. By running the program product, the camera can perform: extract multiple full pictures with multiple targets recorded from the video stream, wherein each full picture is recorded with at least A target; a first group of partial images is obtained according to the plurality of full images, the first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two of the first group of partial images The partial image is obtained according to the same full image in the plurality of full images; the first group of partial images and the full images corresponding to each partial image in the first group of partial images are sent to the storage device, wherein the sent The number of full images is smaller than the number of the plurality of partial images.
附图说明Description of drawings
图1是摄像机的组件的实施例结构图。FIG. 1 is a structural diagram of an embodiment of components of a camera.
图2是摄像机发送图像的流程图。Fig. 2 is a flow chart of the camera sending images.
图3是摄像机发送图像的实施例示意图。Fig. 3 is a schematic diagram of an embodiment of an image sent by a camera.
图4是摄像机发送图像的流程图。Fig. 4 is a flow chart of the camera sending images.
图5是摄像机发送图像的实施例示意图。Fig. 5 is a schematic diagram of an embodiment of an image sent by a camera.
图6是摄像机是图像发送装置实施例示意图。Fig. 6 is a schematic diagram of an embodiment where the camera is an image sending device.
具体实施方式Detailed ways
摄像机是可以用于拍照以及录制视频的电子设备。参见图1,构成本发明实施例摄像机的组件包括镜头11(lens)、传感器(sensor)12和片上系统(SoC)13。所述镜头11用于通过光线;所述传感器12用于把来自镜头的光信号转换成电信号,以原始图像的方式记录下来;所述片上系统13可以对原始图像进行编码处理,例如把RAW图像编码成易于被人眼识别的JPEG图像、HEIF图像、H.264视频、H.265视频等。本发明实施例中涉及的图像,可以是照片,也可以是视频流中的帧。A video camera is an electronic device that can take pictures and record video. Referring to FIG. 1 , components constituting a camera according to an embodiment of the present invention include a lens 11 (lens), a sensor (sensor) 12 and a system on chip (SoC) 13 . The lens 11 is used to pass light; the sensor 12 is used to convert the optical signal from the lens into an electrical signal, and record it in the form of an original image; the system-on-chip 13 can encode the original image, such as converting RAW Images are encoded into JPEG images, HEIF images, H.264 videos, H.265 videos, etc. that are easily recognized by human eyes. The images involved in the embodiments of the present invention may be photos or frames in a video stream.
镜头11的作用是把被观察目标的光像呈现在摄像机的传感器上。镜头通过将各种不同形状、不同介质(塑料、玻璃或晶体)的光学零件(反射镜、透射镜、棱镜)按一定方式组合起来,使得光线经过这些光学零件的透射或反射以后,按照人们的需要改变光线的传输方向 而被接收器件接收,完成物体的光学成像过程。一般来说镜头都由多组不同曲面曲率的透镜按不同间距组合而成。间距和镜片曲率、透光系数等指标的选择决定了该镜头的焦距。镜头主要的参数指标包括:有效焦距、光圈、视场角、畸变、相对照度等,各项指标数值决定了镜头的综合性能。The function of the lens 11 is to present the light image of the observed object on the sensor of the camera. The lens combines various optical parts (mirrors, transmissive mirrors, prisms) of different shapes and media (plastic, glass or crystal) in a certain way, so that after the light is transmitted or reflected by these optical parts, according to people's It is necessary to change the transmission direction of the light to be received by the receiving device to complete the optical imaging process of the object. Generally speaking, the lens is composed of multiple groups of lenses with different curvatures at different pitches. The selection of spacing, lens curvature, light transmittance and other indicators determine the focal length of the lens. The main parameters of the lens include: effective focal length, aperture, field of view, distortion, relative illuminance, etc. The values of each index determine the overall performance of the lens.
传感器12,是一种将光学影像转换成电子信号的器件,广泛应用在摄像机和其他电子光学设备中。常见的传感器包括:感光耦合元件(charge-coupled device,CCD)和互补式金属氧化物半导体(complementary MOS,CMOS)。CCD和CMOS均拥有大量(例如数千万个)感光二极管(photodiode),每个感光二极管称为一个感光基元,每个感光基元对应一个像素。曝光时,该感光二极管在接受光线照射之后,把光信号转化成包含了亮度(或者亮度与颜色)的电信号,影像就随之被重新构建起来。拜尔(Bayer)阵列是一种常见的图像传感器技术,拜耳阵列使用拜尔滤色镜让不同的像素对红、蓝、绿三原色光中的其中一种感光,这些像素交织在一起,然后通过去马赛克(demosaicing)插值算法来得到原始影像。拜耳阵列可以应用于CCD或者CMOS中,应用了拜耳阵列的传感器又称为拜耳传感器。The sensor 12 is a device that converts optical images into electronic signals, and is widely used in cameras and other electronic optical devices. Common sensors include: charge-coupled device (CCD) and complementary metal-oxide semiconductor (complementary MOS, CMOS). Both CCD and CMOS have a large number (for example, tens of millions) of photodiodes, and each photodiode is called a photosensitive unit, and each photosensitive unit corresponds to a pixel. During exposure, the photosensitive diode converts the light signal into an electrical signal including brightness (or brightness and color) after being irradiated by light, and the image is reconstructed accordingly. The Bayer array is a common image sensor technology. The Bayer array uses a Bayer filter to make different pixels sensitive to one of the three primary colors of red, blue, and green. These pixels are interleaved and then demosaiced (demosaicing) interpolation algorithm to get the original image. The Bayer array can be applied to CCD or CMOS, and the sensor using the Bayer array is also called a Bayer sensor.
在一些情况下,同一个摄像机可以设置多个传感器,例如双镜头双传感器的摄像机,以及单镜头双传感器的摄像机,单镜头三传感器的摄像机,这些传感器用于对相同的被拍摄物体成像。当镜头数目少于传感器数目时,在镜头和传感器之间还可以设置分光器,以便把一个镜头进入的光线分解到多个传感器上,确保每个传感器都能接收到光线。In some cases, the same camera can be provided with multiple sensors, such as a dual-lens dual-sensor camera, a single-lens dual-sensor camera, and a single-lens triple-sensor camera. These sensors are used to image the same object to be photographed. When the number of lenses is less than the number of sensors, a beam splitter can also be set between the lens and the sensor, so that the light entering from one lens can be split to multiple sensors to ensure that each sensor can receive light.
处理器系统,其具体是多个分离芯片的组合,或者是多个芯片的集成(例如片上系统13)。图像信号处理器(ISP)131用于对图像进行图像信号处理,改善图像的对比度,饱和度,增益等图像参数进行调整。图像信号处理器132,可以对图像进行融合,例如将一帧灰度图像和一帧彩色图像,融合生成一帧高质量的彩色图像,提升图像效果。编码器133用于对图像编码成可供播放的图像。例如把YUV数据生成H.264或者H.265的帧。图像可以供显示器播放,也可以进行存储。多个图像连续播放即可组成动态的视频。在一些实施例中,这些芯片可以不集成在一起,分别独立。The processor system is specifically a combination of multiple separate chips, or an integration of multiple chips (such as the system on chip 13). The image signal processor (ISP) 131 is used for performing image signal processing on the image, improving image contrast, saturation, gain and other image parameters for adjustment. The image signal processor 132 can fuse images, for example, fuse a frame of grayscale image and a frame of color image to generate a frame of high-quality color image to improve the image effect. The encoder 133 is used to encode images into images available for playback. For example, YUV data is generated into H.264 or H.265 frames. Images can be played on a display or stored. Multiple images can be played continuously to form a dynamic video. In some embodiments, these chips may not be integrated together, but are independent.
此外,摄像机还可以有其他组件,例如滤光片、网络接口、编码器等,此处不再详述。In addition, the camera may also have other components, such as optical filters, network interfaces, encoders, etc., which will not be described in detail here.
摄像机在拍摄到图像后,需要把全图以及目标所在区域的局部图一起发送给存储服务器。下面结合图2和流程图3对一种方案进行更具体的介绍。After the camera captures the image, it needs to send the full image and the partial image of the area where the target is located to the storage server. A solution will be described in more detail below in conjunction with FIG. 2 and flowchart 3 .
步骤S11,摄像机拍摄视频流,摄像机从拍摄的视频流中提取多个帧。In step S11, the camera shoots a video stream, and the camera extracts a plurality of frames from the captured video stream.
摄像机依次拍摄到帧包括:图像21(全图)、图像22(全图)以及图像23(全图)。图像21中记录的目标包括:车辆A,车辆B以及车辆C;图像22中记录的目标包括:车辆B和车辆C,图像23中记录的车辆包括车辆C,图像24中未记录车辆。其中,车辆B在图像22中的质量最高,车辆C在图像23中的质量最高。The frames captured by the camera in sequence include: image 21 (full image), image 22 (full image) and image 23 (full image). The objects recorded in image 21 include: vehicle A, vehicle B, and vehicle C; the objects recorded in image 22 include: vehicle B and vehicle C, the vehicles recorded in image 23 include vehicle C, and no vehicle is recorded in image 24. Among them, vehicle B has the highest quality in image 22 , and vehicle C has the highest quality in image 23 .
步骤S12,摄像机根据目标的图像质量从全图中分别抠取车辆的局部图,得到图像211(局部图)、图像212(局部图)、和图像231(局部图)。Step S12 , the camera extracts partial images of the vehicle from the full image according to the image quality of the target, and obtains image 211 (partial image), image 212 (partial image), and image 231 (partial image).
步骤S13,摄像机发送抠取的所有局部图和所有局部图所在的全图给存储服务器,图1中的局部图的数量是3,相应的全图数量也是3。因此需要一共发送6张图像给存储服务器,这6张图像分别是:图像211、图像221、图像231,以及图像21、图像22和图像23。存储服务器接收到摄像机发送的图像后,可以缓存或者持久化存储收到的图像。可选的,存储服务器还拥有图像优化、图像识别等功能。Step S13 , the camera sends all the partial images and the full images where all the partial images are extracted to the storage server. The number of partial images in FIG. 1 is 3, and the corresponding number of full images is also 3. Therefore, a total of 6 images need to be sent to the storage server, and the 6 images are: image 211 , image 221 , image 231 , and image 21 , image 22 and image 23 . After the storage server receives the image sent by the camera, it can cache or persistently store the received image. Optionally, the storage server also has functions such as image optimization and image recognition.
需要说明的是,在这种方案中,技术多个局部图来自于同一个全图,那么针对每个局部图仍然需要单独发送全图,因此存在相同的全图重复发送的情况。It should be noted that, in this solution, multiple partial images come from the same full image, and each partial image still needs to be sent separately for the full image, so there is a case where the same full image is sent repeatedly.
上述实施例中,单个摄像机基于一小段的视频流一共需要发送6张图像(3全图+3局部图)给存储服务器。当多个摄像机长时间拍摄时,需要发送的图像总量将非常巨大。因此,本发明进一步提供一种摄像机发送图像的实施方式,摄像机在拍摄到图像后,当同一个图像中出现在多个车辆中,那么可以仅发送这些车辆的局部图以及单张全图,而不再针对每个局部图发送全图。相当于多张局部图“共享”同一张全图。从而让局部图和全图的数量不再保持1:1的关系,而是全图数量少于局部图数量,从而减少全图的发送数量。In the above embodiment, a single camera needs to send a total of 6 images (3 full images + 3 partial images) to the storage server based on a short video stream. When multiple cameras are shooting for a long period of time, the total amount of images that need to be sent can be enormous. Therefore, the present invention further provides an embodiment in which the camera sends images. After the camera captures the image, when the same image appears in multiple vehicles, it can only send the partial images and a single full image of these vehicles instead of Send the full graph for each partial graph. It is equivalent to "sharing" the same full image with multiple partial images. As a result, the number of partial images and full images no longer maintains a 1:1 relationship, but the number of full images is less than the number of partial images, thereby reducing the number of full images sent.
下面的流程结合图4和图5对该实施方式进行具体说明。The following process will specifically describe this embodiment with reference to FIG. 4 and FIG. 5 .
步骤S21,摄像机实时拍摄视频流,把视频流在本地存储器(内存、存储卡、SSD或者硬盘)中进行保存。摄像机从拍摄的视频流中提取图像(也称为帧),为了和局部图进行区分,把本步骤中提取的完整图像称为全图。提取到的全图按照拍摄的时间由远及近的顺序是图21、图22和图23。Step S21, the video camera shoots the video stream in real time, and saves the video stream in a local storage (internal memory, memory card, SSD or hard disk). The camera extracts an image (also called a frame) from the captured video stream. In order to distinguish it from a partial image, the complete image extracted in this step is called a full image. The extracted full images are shown in Fig. 21, Fig. 22 and Fig. 23 in descending order according to the shooting time.
步骤S22,从所述多个全图(大图)中把目标所在区域抠取出来从而生成局部图(小图),把局部图放入缓存队列。目标是帧中需要观测或者分析的目标,例如是车、行人、动物等移动物体。Step S22, extracting the area where the target is located from the plurality of full images (big images) to generate a partial image (small image), and putting the partial image into a cache queue. The target is the target that needs to be observed or analyzed in the frame, such as moving objects such as cars, pedestrians, and animals.
摄像机从视频中每间隔两幅图像提取出一个图像,获得所述多个图像,对所述多个图像分别检测提取到的图像中目标(具体而言是目标在图像中所在的区域,为了方便描述,此处简称为目标)的图像质量,对于出现在不同图像中的相同目标,进行如下操作:The camera extracts an image from every two images in the video, obtains the multiple images, and detects the target in the extracted image (specifically, the area where the target is located in the image, for convenience) description, referred to here as the image quality of the target), for the same target appearing in different images, the following operations are performed:
(1)对质量最高的目标进行局部图抠取,获得最佳质量局部图,存入最佳缓存队列。因此,当首次拍摄到目标时,直接从帧中抠取局部图存入最佳缓存队列。对于非首次拍摄到的目标,如果在后拍摄的帧中,目标的质量高于在先拍摄的帧中目标的质量,则从在后拍摄的帧中抠取目标的局部图,覆盖最佳队列中已有的局部图。(1) Cut out the partial image of the object with the highest quality, obtain the best quality partial image, and store it in the best cache queue. Therefore, when the target is photographed for the first time, the partial image is directly extracted from the frame and stored in the optimal cache queue. For a target that is not captured for the first time, if the quality of the target in the later captured frame is higher than the quality of the target in the earlier captured frame, the partial map of the target is extracted from the later captured frame to cover the best queue Existing local graphs in .
每个目标可以有一个用于存储最佳局部图的最佳缓存队列。把最佳质量局部图的全图(最佳全图)也放入最佳缓存队列,或者放入单独设置的全图队列。Each target can have an optimal cache queue for storing optimal local graphs. Put the full image (best full image) of the best quality partial image into the best cache queue, or put it into a separately set full image queue.
把最佳全图的帧号(或者其他可以区分不同全图的标记)放入帧号队列。Put the frame number of the best full image (or other marks that can distinguish different full images) into the frame number queue.
(2)对于在大图中的图像,如果目标的质量合格,但是如果这个目标不是质量最高的目标,则抠取局部图存入次优队列。因此,如果在后抠取的局部图的质量低于在先抠取的局部图的质量,并且质量合格,则把在后抠取的局部图放入次优队列。(2) For the image in the large image, if the quality of the object is qualified, but if the object is not the highest quality object, the local image is cut out and stored in the suboptimal queue. Therefore, if the quality of the partial image extracted later is lower than that of the partial image extracted earlier, and the quality is qualified, the partial image extracted later will be put into the suboptimal queue.
判断目标的质量可以从多个维度出发,例如如下多项中一项:目标在图像中的姿态、目标所在区域的图像分辨率、目标关键点展示率或者对目标进行识别时的识别率等。当目标质量没有达到预期,不放入次优缓存队列。The quality of the target can be judged from multiple dimensions, such as one of the following items: the pose of the target in the image, the image resolution of the area where the target is located, the display rate of key points of the target, or the recognition rate when recognizing the target, etc. When the target quality does not meet expectations, it will not be placed in the suboptimal cache queue.
按照视频流中图像的排列顺序,先后从视频流中提取的图像分别是图像21、图像22、图像23和图像24,从这4个图像可以看出,随着时间的流逝,车辆A、车辆B、车辆C依次驶出摄像机的拍摄范围。According to the arrangement order of the images in the video stream, the images extracted from the video stream are image 21, image 22, image 23 and image 24 respectively. From these four images, it can be seen that as time goes by, vehicle A, vehicle B. The vehicle C drives out of the shooting range of the camera in sequence.
各个车辆在不同图像中的图像质量不同,括号内是描述质量高低的质量分数(质量阈值为50分,低于50分任务质量未达到预期)。分布如下面的表1,括号内是局部图所描述的目标以及目标的分数。The image quality of each vehicle in different images is different, and the quality scores describing the quality are in brackets (the quality threshold is 50 points, and the task quality below 50 points does not meet expectations). The distribution is shown in Table 1 below, and the target and target scores described by the local graph are in parentheses.
Figure PCTCN2022139015-appb-000001
Figure PCTCN2022139015-appb-000001
Figure PCTCN2022139015-appb-000002
Figure PCTCN2022139015-appb-000002
表1Table 1
对于图像21:如果此时最佳缓存队列中没有关于车辆A、车辆B和车辆C的记录,那么不用考虑目标的质量,直接抠取图像211(局部图),图像212(局部图),图像213(局部图),三者全部放入车辆各自对应的最佳缓存队列。其中,每个车辆有对应的最佳缓存队列和次佳缓存队列。For image 21: If there is no record about vehicle A, vehicle B, and vehicle C in the optimal cache queue at this time, then directly extract image 211 (partial image), image 212 (partial image), image 212 (partial image), regardless of the quality of the target 213 (partial diagram), all three are put into the optimal cache queues corresponding to the vehicles respectively. Among them, each vehicle has a corresponding optimal cache queue and a second-best cache queue.
对于图像22:图像221的质量高于图像212,因此把图像221放入车辆B最佳缓存队列,覆盖图像212。图像222的质量分数为40分,因此不用进行抠取。For image 22: image 221 is of higher quality than image 212, so image 221 is placed in the vehicle B optimal cache queue, covering image 212. The image 222 has a quality score of 40, so no extraction is required.
对于图像23:抠取图像231(局部图),由于图像231的质量高于图像213,因此把图像231放入车辆C的最佳缓存队列,并且覆盖图像213。For image 23: cut out image 231 (partial image), because the quality of image 231 is higher than that of image 213, therefore put image 231 into the optimal cache queue of vehicle C, and cover image 213.
对于图像24:由于没有记录任何目标(车辆),因此不做图像抠取。For image 24: Since no target (vehicle) is recorded, image extraction is not done.
表2是对各个车辆对于的缓存队列中图像的描述。Table 2 is a description of the images in the cache queue for each vehicle pair.
Figure PCTCN2022139015-appb-000003
Figure PCTCN2022139015-appb-000003
表2Table 2
步骤S23,根据缓存队列中存储的局部图,选择局部图和提供局部图的全图发送给存储设备,使用帧号队列记录已发送的全图。本步骤可以在检测到车辆消失后开始执行。Step S23, according to the partial images stored in the cache queue, select the partial images and provide the full images of the partial images to send to the storage device, and use the frame number queue to record the sent full images. This step can be executed after detecting that the vehicle disappears.
选择局部图的策略是:对于任意一个车辆,如果通过帧号队列中的记录,确定曾经发送过记录有这个车辆的全图,并且在曾经发送的全图中,这个车辆的质量满足质量阈值(判断质量阈值是可选条件)。则从次佳队列中,查找这个满足质量阈值的局部图进行发送。对于所述任意车辆,可以不再额外发送其他全图。The strategy for selecting a partial image is: for any vehicle, if it is determined through the records in the frame number queue that a full image with this vehicle has been sent, and the quality of the vehicle in the previously sent full image meets the quality threshold ( The judgment quality threshold is an optional condition). Then, from the second-best queue, find the partial graph that satisfies the quality threshold and send it. For any vehicle mentioned above, no other full image can be transmitted additionally.
下面基于表1所涉及的四张图像,结合表2,介绍描述摄像机在不同时间点所发送的图像。Based on the four images involved in Table 1, combined with Table 2, the images sent by the camera at different time points are described below.
(i)当摄像机从视频流中提取到图像22时,会检测到相对于前图像(图像21是图像22的前图像,图像22是图像21的后图像)而言,车辆A消失。因此,把车辆A消失作为触发条件,在这个时刻,选择涉及车辆A的图像进行发送。(i) When the camera extracts image 22 from the video stream, it detects that vehicle A has disappeared relative to the previous image (image 21 is the image before image 22, and image 22 is the image after image 21). Therefore, the disappearance of vehicle A is taken as a trigger condition, and at this moment, an image related to vehicle A is selected for transmission.
可知,对于车辆A,最佳缓存队列中有图像211,图像211对应的全图是图像21。根据全图帧号队列(此时帧号队列空白)可知,在此之前摄像机没有发送过记录了车辆A的全图,因此直接选择图像211以及图像21发送给所述存储设备。并且,把选中的全图(也就是图像21)的帧号记入全图帧号队列。此外,还把图像211与图像21的对应关系发送给所述存储设备。It can be known that, for vehicle A, there is image 211 in the optimal cache queue, and the full image corresponding to image 211 is image 21 . According to the frame number queue of the whole image (the frame number queue is blank at this time), the camera has not sent the full image of the vehicle A before, so the image 211 and the image 21 are directly selected and sent to the storage device. And, record the frame number of the selected full picture (that is, the image 21) into the full picture frame number queue. In addition, the corresponding relationship between the image 211 and the image 21 is also sent to the storage device.
(ii)当摄像机从视频流中提取到图像23时,会检测到相对于前图像(图像22)而言,车辆B消失,因此需要对涉及车辆B的图像进行发送。(ii) When the camera extracts image 23 from the video stream, it detects that vehicle B has disappeared relative to the previous image (image 22), so an image related to vehicle B needs to be sent.
对于车辆B,从全图帧号队列中可知已经发送过图像21。图像21中有车辆B的局部图(图像212),并且在图像21中,车辆B的质量分高于50分。虽然图像22中车辆B的质量分低于图像21中车辆B的质量分,但是出于“复用”全图的考虑,直接从次优缓存中选择图像212发送给所述存储设备(而不是发送图像221以及图像221所在的全图22),以及发送图像 212与图像21之间的对应关系给所述存储设备。也就是说2个局部图(图像212与图像211)共同对应同一个全图(图像21)。For vehicle B, it is known from the queue of frame numbers of the whole image that the image 21 has been sent. In image 21 there is a partial view of vehicle B (image 212 ), and in image 21 the quality score of vehicle B is higher than 50 points. Although the quality score of vehicle B in image 22 is lower than that of vehicle B in image 21, for the consideration of "multiplexing" the whole image, image 212 is directly selected from the suboptimal cache and sent to the storage device (instead of Send the image 221 and the full image 22) where the image 221 is located, and send the correspondence between the image 212 and the image 21 to the storage device. That is to say, the two partial images (image 212 and image 211 ) correspond to the same full image (image 21 ).
与步骤S11-S13所介绍的流程相比,具有这样的区别:由于图22中车辆B的质量高于图21中车辆B的质量。因此,需要发送车辆B的是最佳局部图221以及最佳局部图221所属于的图像22。可以看出,本实施例和步骤S11-S13所介绍的实施例相比,少发送了一张全图(图像22)。减少了网络负担,以及对所述存储设备空间的占用。Compared with the process described in steps S11-S13, there is such a difference: because the quality of vehicle B in FIG. 22 is higher than that of vehicle B in FIG. 21 . Therefore, what needs to be sent to the vehicle B is the best partial image 221 and the image 22 to which the best partial image 221 belongs. It can be seen that, compared with the embodiment described in steps S11-S13, this embodiment sends one less full image (image 22). The network load and the space occupation of the storage device are reduced.
(iii)当摄像机提取图像24时,会检测到相对于前图像(图像23)而言,车辆C消失,因此触发对涉及车辆C的图像进行发送。(iii) When the camera captures the image 24 , it detects that the vehicle C disappears relative to the previous image (image 23 ), thus triggering the transmission of an image related to the vehicle C.
对于车辆C,从全图帧号队列中可知已经发送过图像21。图像21中有车辆C的局部图(图像212),然而在图像21中,车辆C的质量分低于50分。而图像231的质量分高于阈值,因此对于车辆C,选择图像231和与图像231对应的全图23发送给所述存储设备。此外,还把图像231与图像23的对应关系发送给所述存储设备。For vehicle C, it is known from the queue of frame numbers of the whole image that the image 21 has been sent. In image 21 there is a partial view of vehicle C (image 212 ), however in image 21 the quality score of vehicle C is below 50 points. However, the quality score of the image 231 is higher than the threshold, so for the vehicle C, the selected image 231 and the full image 23 corresponding to the image 231 are sent to the storage device. In addition, the corresponding relationship between the image 231 and the image 23 is also sent to the storage device.
可以看出,本实施例中摄像机一共发送5张图像给存储设备(3张局部图+2张全图)。It can be seen that, in this embodiment, the camera sends a total of 5 images to the storage device (3 partial images + 2 full images).
需要说明的是,对于车辆C,另外一种可选的情况是不考虑图像质量。从全图帧号队列中可知已经发送过图像21,于是直接发送图像213(以及发送图像213与图像21之间的关联关系),不选择发送图像231和图像23。这种情况下,摄像机一共发送4张全图给存储设备(3张局部图+1张全图)。It should be noted that, for vehicle C, another optional situation is that the image quality is not considered. It is known from the frame number queue of the whole image that the image 21 has been sent, so the image 213 is directly sent (and the association between the image 213 and the image 21 is sent), and the image 231 and the image 23 are not selected for sending. In this case, the camera sends a total of 4 full images to the storage device (3 partial images + 1 full image).
在实际使用中,对于某一个具体的车辆而言,先执行步骤22,然后执行步骤23。考虑到摄像会不断的从视频流中提取出大量的图像,因此实际上是在不断的执行提取图像和发送图像的操作。In actual use, for a specific vehicle, step 22 is executed first, and then step 23 is executed. Considering that the camera will continuously extract a large number of images from the video stream, the operation of extracting images and sending images is actually performed continuously.
本实施例中,发送给存储设备的局部图可以称为第一组局部图,缓存队列中的局部图可以称为第二组局部图。第二组局部图中有部分局部图是记录相同的目标,第二组局部图中,不同的局部图记录的目标不同。因此第一组局部图是第二组局部图的一部分,第一组局部图中局部图的数量少于第二组局部图中局部图的数量。In this embodiment, the partial images sent to the storage device may be referred to as the first group of partial images, and the partial images in the cache queue may be referred to as the second group of partial images. In the second group of partial graphs, some partial graphs record the same target, and in the second group of partial graphs, different partial graphs record different targets. Thus the first set of partial maps is part of the second set of partial maps, the number of partial maps in the first set of partial maps being less than the number of partial maps in the second set of partial maps.
本发明还提供一种摄像机图像发送装置,可以执行上述方法。该装置例如是摄像机,或者摄像机中的软件模块,软件模块可以由图像信号处理器(ISP)131运行。The present invention also provides a camera image sending device, which can execute the above method. The device is, for example, a camera, or a software module in the camera, and the software module can be run by an image signal processor (ISP) 131 .
图像发送装置包括全图获取模块31,局部图获取模块32和发送模块33。The image sending device includes a full image acquisition module 31 , a partial image acquisition module 32 and a sending module 33 .
全图获取模块31可以执行步骤S21,局部图获取模块32用于从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标。局部图获取模块32可以执行步骤S22以及步骤S23中选择局部图和全图的过程,局部图获取模块32用于根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的。发送模块33可以执行步骤S23中的发送过程,用于将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。The full image acquisition module 31 may execute step S21, and the partial image acquisition module 32 is configured to extract multiple full images recorded with multiple objects from the video stream, wherein each full image records at least one object. The partial image acquisition module 32 can perform the process of selecting partial images and full images in step S22 and step S23, the partial image acquisition module 32 is used to obtain a first group of partial images according to the multiple full images, and the first group of partial images has multiple Partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images are obtained from the same full image among the plurality of full images. The sending module 33 may execute the sending process in step S23, for sending the first group of partial images and the full images corresponding to each partial image in the first group of partial images to the storage device, wherein the sent full The number of graphs is smaller than the number of the plurality of partial graphs.
发送模块33,还用于在发送给所述存储设备的图像中,建立所述第一组局部图中的局部图与拥有该局部图的全图之间的对应关系。The sending module 33 is further configured to, in the image sent to the storage device, establish a corresponding relationship between a partial image in the first group of partial images and a full image having the partial image.
局部图获取模块32,具体可以用于:根据所述多张全图获得第二组局部图,所述第二组局部图中有部分局部图记录相同的目标,其中,记录相同目标的局部图来自于不同的全图;根据所述第二组局部图中选择所述第一组局部图,所述第一组局部图中,不同局部图记录不同的目标。The partial image acquisition module 32 can specifically be used to: obtain a second group of partial images according to the plurality of full images, and some partial images in the second group of partial images record the same target, wherein the partial images recording the same target come from Different full maps; selecting the first group of partial maps according to the second group of partial maps, where different partial maps record different targets in the first group of partial maps.
本发明还提供一种程序产品,可以运行在摄像机中,用于执行前述的方法步骤S21-S23。以上模块或单元的一个或多个可以软件、硬件或二者结合来实现。当以上任一模块或单元以软件实现的时候,所述软件以计算机程序指令的方式存在,并被存储在存储器中,处理器可以用于执行所述程序指令并实现以上方法流程。所述处理器可以包括但不限于以下至少一种:中央处理单元(central processing unit,CPU)、微处理器、数字信号处理器(DSP)、微控制器(microcontroller unit,MCU)、或人工智能处理器等各类运行软件的计算设备,每种计算设备可包括一个或多个用于执行软件指令以进行运算或处理的核。该处理器可以内置于SoC(片上系统)或专用集成电路(application specific integrated circuit,ASIC),也可是一个独立的半导体芯片。该处理器内处理用于执行软件指令以进行运算或处理的核外,还可进一步包括必要的硬件加速器,如现场可编程门阵列(field programmable gate array,FPGA)、PLD(可编程逻辑器件)、或者实现专用逻辑运算的逻辑电路。The present invention also provides a program product that can run in the video camera and is used to execute the aforementioned method steps S21-S23. One or more of the above modules or units may be realized by software, hardware or a combination of both. When any of the above modules or units is implemented by software, the software exists in the form of computer program instructions and is stored in the memory, and the processor can be used to execute the program instructions and realize the above method flow. The processor may include but not limited to at least one of the following: a central processing unit (central processing unit, CPU), a microprocessor, a digital signal processor (DSP), a microcontroller (microcontroller unit, MCU), or artificial intelligence Various types of computing devices that run software such as processors, each computing device may include one or more cores for executing software instructions to perform calculations or processing. The processor can be built into SoC (system on chip) or application specific integrated circuit (ASIC), or it can be an independent semiconductor chip. The core of the processor is used to execute software instructions for calculation or processing, and can further include necessary hardware accelerators, such as field programmable gate array (field programmable gate array, FPGA), PLD (programmable logic device) , or a logic circuit that implements a dedicated logic operation.
参见图1,本发明还提供一种摄像机的实施例,包括:镜头11,用于接收光线;传感器12,用于光电转换,生成原始图像;还包括处理器系统13。Referring to FIG. 1 , the present invention also provides an embodiment of a camera, including: a lens 11 for receiving light; a sensor 12 for photoelectric conversion to generate an original image; and a processor system 13 .
处理器系统13用于对原始图像处理,以及执行上述的方法实施例。处理器系统13的方法例如包括:从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。The processor system 13 is used to process the original image and execute the above-mentioned method embodiments. The method of the processor system 13 includes, for example: extracting a plurality of full images recorded with multiple targets from the video stream, wherein each full image records at least one target; obtaining a first group of partial images according to the plurality of full images, and the first group Partial graphs Multiple partial graphs, wherein different partial graphs record different targets, and at least two partial graphs in the first group of partial graphs are obtained from the same full graph in the multiple full graphs; The group of partial images and the full images corresponding to each partial image in the first group of partial images are sent to the storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
当以上模块或单元以硬件实现的时候,该硬件可以是CPU、微处理器、DSP、MCU、人工智能处理器、ASIC、SoC、FPGA、PLD、专用数字电路、硬件加速器或非集成的分立器件中的任一个或任一组合,其可以运行必要的软件或不依赖于软件以执行以上方法流程。When the above modules or units are implemented in hardware, the hardware can be CPU, microprocessor, DSP, MCU, artificial intelligence processor, ASIC, SoC, FPGA, PLD, dedicated digital circuit, hardware accelerator or non-integrated discrete device Any one or any combination of them, which can run necessary software or not depend on software to execute the above method flow.

Claims (14)

  1. 一种摄像机图像发送方法,包括:A camera image sending method, comprising:
    从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;extracting multiple full images recorded with multiple targets from the video stream, wherein each full image records at least one target;
    根据所述多张全图获得第一组局部图,所述第一组局部图包括多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中的至少两张局部图是根据所述多张全图中的同一张全图获得的;Obtain a first group of partial images according to the multiple full images, the first group of partial images includes multiple partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images The figure is obtained from the same full picture of said multiple full pictures;
    将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。Sending the first group of partial images and the full images corresponding to each partial image in the first group of partial images to a storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
  2. 根据权利要求1所述的方法,其特征在于:The method according to claim 1, characterized in that:
    所述第一组局部图包括第一局部图和第二局部图,发送的全图包括第一全图,其中,所述第一局部图和所述第二局部图来源于所述第一全图。The first group of partial images includes a first partial image and a second partial image, and the sent full image includes a first full image, wherein the first partial image and the second partial image are derived from the first full image picture.
  3. 根据权利要求1所述的方法,其特征在于,根据所述多张全图获得第一组局部图还包括:The method according to claim 1, wherein obtaining the first group of partial images according to the plurality of full images further comprises:
    基于图像质量确定所述第一组局部图。The first set of partial maps is determined based on image quality.
  4. 根据权利要求1所述的方法,其特征在于,所述图像质量与下述至少一项相关:The method of claim 1, wherein the image quality is related to at least one of the following:
    图像中目标的姿态;The pose of the target in the image;
    图像分辨率;Image Resolution;
    图像中目标关键点展示率;Display rate of target key points in the image;
    图像中目标识别率。The target recognition rate in the image.
  5. 根据权利要求1所述的方法,其特征在于,发送第一组局部图具体包括:The method according to claim 1, wherein sending the first group of partial images specifically comprises:
    按时序对提取的所述多张全图进行检测,对于每一个目标,当检测到有目标消失时,触发获得消失的目标的局部图并发送给所述存储设备。The plurality of extracted full images are detected in time sequence, and for each target, when it is detected that a target disappears, it is triggered to obtain a partial image of the disappeared target and send it to the storage device.
  6. 根据权利要求1所述的方法,其特征在于:The method according to claim 1, characterized in that:
    在发送给所述存储设备的图像中,建立所述第一组局部图中的局部图与拥有该局部图的全图之间的对应关系。In the images sent to the storage device, a correspondence relationship between the partial images in the first group of partial images and the full image owning the partial images is established.
  7. 根据权利要求1所述的方法,其特征在于,所述根据所述多张全图获得第一组局部图包括:The method according to claim 1, wherein said obtaining the first group of partial images according to said multiple full images comprises:
    根据所述多张全图获得第二组局部图,所述第二组局部图中有部分局部图记录相同的目标,其中,记录相同目标的局部图来自于不同的全图;Obtaining a second group of partial images according to the plurality of full images, wherein some partial images in the second group of partial images record the same target, wherein the partial images recording the same target come from different full images;
    根据所述第二组局部图中选择所述第一组局部图,所述第一组局部图中,不同局部图记录不同的目标。The first group of partial maps is selected according to the second group of partial maps, and in the first group of partial maps, different partial maps record different targets.
  8. 一种摄像机图像发送装置,其特征在于,包括:A camera image sending device is characterized in that it comprises:
    全图获取模块,用于从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;A full image acquisition module, configured to extract multiple full images recorded with multiple targets from the video stream, wherein each full image records at least one target;
    局部图获取模块,用于根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;A partial image acquisition module, configured to obtain a first group of partial images according to the plurality of full images, wherein the first group of partial images has multiple partial images, wherein different partial images record different targets, and the first group of partial images At least two of the partial images are obtained from the same full image in the plurality of full images;
    发送模块,用于将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。A sending module, configured to send the first group of partial images and the full images corresponding to each partial image in the first group of partial images to a storage device, wherein the number of sent full images is smaller than the number of partial images in the first group The number of graphs.
  9. 根据权利要求8所述的摄像机图像发送装置,其特征在于:The camera image sending device according to claim 8, characterized in that:
    所述第一组局部图包括第一局部图和第二局部图,所述发送模块发送的全图包括第一全图,所述第一局部图和所述第二局部图均与所述第一全图对应,其中,所述第一局部图和所述第二局部图来源于所述第一全图。The first group of partial images includes a first partial image and a second partial image, the full image sent by the sending module includes the first full image, and both the first partial image and the second partial image are consistent with the first partial image A full graph corresponds, wherein the first partial graph and the second partial graph are derived from the first full graph.
  10. 根据权利要求8所述的摄像机图像发送装置,其特征在于,所述局部图获取模块用于:The camera image sending device according to claim 8, wherein the partial image acquisition module is used for:
    基于图像质量确定所述第一组局部图。The first set of partial maps is determined based on image quality.
  11. 根据权利要求9或10所述的摄像机图像发送装置,其特征在于所述第一组局部图中,有部分局部图的图像质量不是所述目标在所述多张全图中的最佳图像质量。The camera image sending device according to claim 9 or 10, characterized in that in the first group of partial images, the image quality of some partial images is not the best image quality of the target in the plurality of full images.
  12. 根据权利要求8所述的摄像机图像发送装置,其特征在于,所述局部图获取模块还用于:The camera image sending device according to claim 8, wherein the partial image acquisition module is also used for:
    在发送给所述存储设备的图像中,建立所述第一组局部图中的局部图与拥有该局部图的全图之间的对应关系。In the images sent to the storage device, a correspondence relationship between the partial images in the first group of partial images and the full image owning the partial images is established.
  13. 根据权利要求8所述的摄像机图像发送装置,其特征在于,所述局部图获取模块具体用于:The camera image sending device according to claim 8, wherein the partial image acquisition module is specifically used for:
    根据所述多张全图获得第二组局部图,所述第二组局部图中有部分局部图记录相同的目标,其中,记录相同目标的局部图来自于不同的全图;Obtaining a second group of partial images according to the plurality of full images, wherein some partial images in the second group of partial images record the same target, wherein the partial images recording the same target come from different full images;
    根据所述第二组局部图中选择所述第一组局部图,所述第一组局部图中,不同局部图记录不同的目标。The first group of partial maps is selected according to the second group of partial maps, and in the first group of partial maps, different partial maps record different objects.
  14. 一种摄像机,包括:A camera comprising:
    镜头,用于接收光线;lens for receiving light;
    传感器,用于光电转换,生成原始图像;Sensors for photoelectric conversion to generate raw images;
    处理器系统,用于对原始图像处理,以及:processor system for processing raw images, and:
    从视频流中提取记录有多个目标的多张全图,其中,每张全图记录有至少一个目标;extracting multiple full images recorded with multiple targets from the video stream, wherein each full image records at least one target;
    根据所述多张全图获得第一组局部图,所述第一组局部图多张局部图,其中,不同的局部图记录有不同的目标,所述第一组局部图中至少两张局部图是根据所述多张全图中的同一张全图获得的;A first group of partial images is obtained according to the plurality of full images, the first group of partial images has multiple partial images, wherein different partial images record different targets, and at least two partial images in the first group of partial images are Obtained from the same full image of the plurality of full images;
    将所述第一组局部图,以及所述第一组局部图中各个局部图对应的全图发送给存储设备,其中,被发送的全图的数量小于所述多张局部图的数量。Sending the first group of partial images and the full images corresponding to each partial image in the first group of partial images to a storage device, wherein the number of the sent full images is smaller than the number of the plurality of partial images.
PCT/CN2022/139015 2021-12-16 2022-12-14 Camera image transmission method and apparatus, and camera WO2023109867A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111540940 2021-12-16
CN202111540940.6 2021-12-16
CN202111645121.8 2021-12-30
CN202111645121.8A CN116347020A (en) 2021-12-16 2021-12-30 Video camera image transmission method and device and video camera

Publications (1)

Publication Number Publication Date
WO2023109867A1 true WO2023109867A1 (en) 2023-06-22

Family

ID=86774843

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/139015 WO2023109867A1 (en) 2021-12-16 2022-12-14 Camera image transmission method and apparatus, and camera

Country Status (1)

Country Link
WO (1) WO2023109867A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249808A1 (en) * 2011-03-30 2012-10-04 Panasonic Corporation Image sending apparatus, image recording apparatus and image recording method
CN104980697A (en) * 2015-04-28 2015-10-14 杭州普维光电技术有限公司 Video transmission method for web camera
CN112135092A (en) * 2020-09-03 2020-12-25 杭州海康威视数字技术股份有限公司 Image processing method
CN113191210A (en) * 2021-04-09 2021-07-30 杭州海康威视数字技术股份有限公司 Image processing method, device and equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249808A1 (en) * 2011-03-30 2012-10-04 Panasonic Corporation Image sending apparatus, image recording apparatus and image recording method
CN104980697A (en) * 2015-04-28 2015-10-14 杭州普维光电技术有限公司 Video transmission method for web camera
CN112135092A (en) * 2020-09-03 2020-12-25 杭州海康威视数字技术股份有限公司 Image processing method
CN113191210A (en) * 2021-04-09 2021-07-30 杭州海康威视数字技术股份有限公司 Image processing method, device and equipment

Similar Documents

Publication Publication Date Title
US8497897B2 (en) Image capture using luminance and chrominance sensors
US9025871B2 (en) Image processing apparatus and method of providing high sensitive color images
CN107124604B (en) A kind of method and device for realizing 3-D image using dual camera
US9491440B2 (en) Depth-sensing camera system
CN102892008B (en) Dual image capture processes
US9681057B2 (en) Exposure timing manipulation in a multi-lens camera
JP4469019B2 (en) Apparatus, method and program for generating image data
WO2021047345A1 (en) Image noise reduction method and apparatus, and storage medium and electronic device
US20100141770A1 (en) Imaging apparatus and imaging method
US8614746B2 (en) Image processing apparatus and method of noise reduction
US9961272B2 (en) Image capturing apparatus and method of controlling the same
US11394902B2 (en) Sparse infrared pixel design for image sensors
US8798369B2 (en) Apparatus and method for estimating the number of objects included in an image
CN107613216A (en) Focusing method, device, computer-readable recording medium and electronic equipment
CN107704798B (en) Image blurring method and device, computer readable storage medium and computer device
WO2020062393A1 (en) Initial data processing method and system based on machine learning
CN110191287A (en) Focusing method and device, electronic equipment, computer readable storage medium
WO2023109867A1 (en) Camera image transmission method and apparatus, and camera
CN111783563A (en) Double-spectrum-based face snapshot and monitoring method, system and equipment
CN107454319A (en) Image processing method, device, mobile terminal and computer-readable recording medium
CN116347020A (en) Video camera image transmission method and device and video camera
Hu et al. Gray spot detection in surveillance video using convolutional neural network
WO2022156763A1 (en) Target object detection method and device thereof
CN112241735A (en) Image processing method, device and system
JP2024051145A (en) Electronics

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22906612

Country of ref document: EP

Kind code of ref document: A1