TW202129597A - Image capturing method and electronic device - Google Patents

Abstract

An image capturing method is provided. The method includes: performing shooting operation on a monitoring scene aat the same time to capture, at the same time point, a plurality of images corresponding to a plurality of focal lengths; identifying, according to a plurality of focal sections, a target area of each of the captured images; keeping a plurality of target sub-images in the target areas if the images, wherein a plurality of object image in the target sub-images are focused; directly generating a single reconstructed image corresponding to the time point according to the target sub-images; and outputting the reconstructed image.

Description

Image capturing method and electronic device

The present invention relates to an image capturing method, and more particularly to an image capturing method and an electronic device using the image capturing method.

The traditional image recognition operation requires that the image of the target object in the recognized image (for example, the face image used for the face recognition operation) is clear. In order to obtain a clear image of the target object, the image capture device needs to scan/align the target object so that the focal length can be accurately located on the target object, thereby obtaining a clear focused image The image of the target object.

However, in a situation where the total number of multiple target objects is large (more than two), in order to obtain a clear image of each target object, it is often costly due to the need to focus and shoot each target object. A large amount of time and resources result in low efficiency of the corresponding image capturing operation, and the subsequent image recognition operation requires time and computing resources to receive and synthesize multiple images of the multiple target objects.

The present invention provides an image capturing method and electronic device, which can capture multiple images according to multiple focal lengths and identify multiple target regions corresponding to the multiple focal lengths in the multiple images to obtain the multiple targets A plurality of target sub-images in the area are further generated according to the plurality of target sub-images to generate a single reconstructed image corresponding to the time point, wherein the plurality of object images in the reconstructed image are all in focus.

An embodiment of the present invention provides an image capturing method suitable for electronic devices. The electronic device includes a plurality of image capturing devices, wherein the plurality of image capturing devices use different focal lengths to shoot. The method includes: simultaneously shooting a monitoring scene through the plurality of image capturing devices corresponding to the plurality of focal lengths, so as to capture a plurality of images corresponding to the plurality of focal lengths at the same time point. Image, wherein the total number of the plurality of images is equal to the total number of the plurality of focal lengths; according to the plurality of focal lengths, the respective target regions of the captured images are identified, wherein the plurality of target regions correspond to The multiple focal lengths, and the multiple focal lengths respectively correspond to the multiple focal lengths; multiple target sub-images retained in the multiple target regions of the multiple images, wherein the multiple target sub-images Multiple object images in the image are all in focus; directly generate a single reconstructed image corresponding to the time point according to the multiple target sub-images; and output the reconstructed image.

An embodiment of the present invention provides an image capturing method suitable for an electronic device, wherein the electronic device includes a zoomable image capturing device. The method includes: using the image capturing device to sequentially take multiple shots of the monitoring scene according to multiple focal lengths to capture multiple images corresponding to the multiple focal lengths, wherein the multiple images The total number of is the same as the total number of the multiple focal lengths, and the multiple time points of the multiple images are continuous; according to the multiple focal lengths, the respective target regions of the captured multiple images are identified, wherein The multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths respectively correspond to the multiple focal lengths; multiple target sub-images retained in the multiple target regions of the multiple images, wherein Multiple object images in the multiple target sub-images are all focused; directly output the sub-image; directly generate a single reconstructed image based on the multiple target sub-images; and output the reconstructed image.

An embodiment of the invention provides an electronic device. The electronic device includes: a plurality of image capturing devices with a fixed focal length, a storage device, and a processor. The multiple image capturing devices are used for shooting with different multiple focal lengths respectively. The storage device is used for storing data, wherein the data includes a plurality of codes. The processor is used for accessing and executing the multiple program codes to realize the image capturing method. In addition, the multiple image capturing devices are used to simultaneously shoot the monitoring scene to capture multiple images corresponding to the multiple focal lengths at the same time point, wherein the total number of the multiple images is the same Equal to the total number of the multiple focal lengths. The processor is used for identifying respective target regions of the captured images according to multiple focal lengths, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths correspond to the multiple focal lengths respectively. Focal lengths. The processor is further configured to retain a plurality of target sub-images in the plurality of target regions of the plurality of images, wherein the plurality of object images in the plurality of target sub-images are all in focus. The processor is further used to directly generate a single reconstructed image corresponding to the time point according to the multiple target sub-images, and the processor is further used to output the reconstructed image.

An embodiment of the invention provides an electronic device. The electronic device includes: a zoomable image capturing device, a storage device, and a processor. The image capturing device is used for selecting one of a plurality of focal lengths for shooting. The storage device is used for storing data, wherein the data includes a plurality of codes. The processor is used for accessing and executing the multiple program codes to realize the image capturing method. In addition, the image capturing device is used to sequentially take multiple shots of the monitoring scene according to the multiple focal lengths, so as to capture multiple images corresponding to the multiple focal lengths, wherein the total number of the multiple images The target is the same as the total number of the multiple focal lengths, and the multiple time points of the multiple images are continuous. The processor is further configured to identify respective target regions of the captured images according to the multiple focal lengths, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths are respectively Corresponding to the multiple focal lengths. The processor is further configured to retain a plurality of target sub-images in the plurality of target regions of the plurality of images, wherein the plurality of object images in the plurality of target sub-images are all in focus. The processor is further used to directly generate a single reconstructed image based on the multiple target sub-images. The processor is further used to output the reconstructed image.

Based on the above, the image capturing method and the electronic device provided by the embodiments of the present invention can shoot a monitoring scene according to multiple focal lengths to capture multiple images, according to multiple focal lengths corresponding to the multiple focal lengths. The target sub-images of each of the multiple images are retained to directly generate and output reconstructed images based on the multiple target sub-images. In this way, without analyzing the multiple images and not fitting/stitching the multiple target sub-images, multiple images located at multiple depths in the generated reconstructed image can be quickly and efficiently made. Each object image is focused and clear, thereby improving the accuracy of the image recognition operation using the reconstructed image.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail in conjunction with the accompanying drawings.

The foregoing and other technical content, features, and effects of the present invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the drawings. The directional terms mentioned in the following embodiments, for example: up, down, left, right, front or back, etc., are only directions for referring to the attached drawings. Therefore, the directional terms used are used to illustrate but not to limit the present invention.

[First Embodiment]

Fig. 1 is a schematic diagram of a monitoring scene according to the first embodiment of the present invention. Please refer to Figure 1. Suppose that the image recognition device wants to recognize images of multiple specific objects in a scene (such as the surveillance scene SC1 shown in Figure 1) (such as the faces of users U1~U4 in the surveillance scene SC1). The images FC1~FC4). The monitoring scene SC1 is, for example, a conference room, and the users U1 to U4 are participants, for example, but the present invention does not limit the types of the monitoring scene SC1 and specific objects. For example, the monitoring scene SC1 may also be a classroom, and the users U1 to U4 are, for example, students.

Generally, the image recognition device needs to perform image recognition operations on the obtained multiple images through multiple images of the monitoring scene SC1 including images FC1 to FC4 of multiple specific objects provided by the image capturing device. The plurality of specific objects (also known as target objects) are located at different positions in the monitoring scene SC1, and the distance between the plurality of target objects and the image capturing device used to shoot the monitoring scene SC1 is different. If the image capture device shoots the surveillance scene SC1 without performing focusing, the multiple images FC1 to FC4 of multiple target objects captured in the image will be blurred, and the multiple targets Multiple images FC1~FC4 of the object cannot be effectively performed corresponding image recognition operations.

In order to capture multiple images FC1~FC4 of multiple target objects clearly, the general traditional method is that the image capture device uses a distance detection device (such as an infrared distance measurement device or a laser distance measurement device) to detect The multiple distances between the image capturing device and the multiple target objects are used to focus on the multiple target objects according to the multiple distances. Whenever one of the multiple target objects is focused, the image capturing device captures the monitoring scene SC1 once to obtain an image with the focused target object. In other words, in this scenario, the traditional method requires at least four ranging operations, four focusing operations, and four shooting operations to obtain four qualified images for image recognition operations. Then the four qualified images are sent to the image recognition device. In addition, the image recognition device further needs to perform an image recognition operation on each of the four qualified images (a total of four image recognition operations are performed) to obtain the recognition results of the images of all the target objects. In other words, for the above example of the surveillance scene SC1 with only four target objects, in order to output qualified images for image recognition operations, the image capture device needs to consume a lot of time and resources (such as computing resources, storage space). ) In the detection, capture and transmission of the image of the target object. If the surveillance scene SC1 has more target objects, the overall time and resources consumed will increase greatly.

In order to solve the technical problems faced by the above-mentioned traditional practices, the image capturing method and electronic device provided by various embodiments of the present invention can generate a single reconstruction of images with all target objects in the monitoring scene for image recognition An image, wherein the images of the recognizable target object in the reconstructed image are all clear or focused (in addition, the reconstructed image is a qualified image). In this way, in addition to increasing the speed of obtaining the reconstructed image, the image recognition device can also perform image recognition through a single reconstructed image, thereby improving the overall efficiency of the image recognition operation. Hereinafter, the specific details of the image capturing method and the electronic device of the present invention will be described with reference to FIGS. 2, 3 and the first embodiment.

FIG. 2 is a block diagram of the image recognition system according to the first embodiment of the present invention. Please refer to FIG. 2, the image recognition system 1 of this embodiment includes an electronic device 10 and an artificial intelligence (AI) image recognition device 20. The electronic device 10 includes a processor 110, a main memory 120, a communication circuit unit 130, a storage device 140, and an image capture device array 150. The processor 110 is electrically connected to the main memory 120, the communication circuit unit 130, the storage device 140, and the image capturing device array 150.

The AI image recognition device 20 includes a processor 210, a main memory 220, a communication circuit unit 230, and a storage device 240. The processor 210 is electrically connected to the main memory 220, the communication circuit unit 230, and the storage device 240.

In this embodiment, the processor 110 and the processor 210 are hardware with computing capabilities. The processor 110 is used to access and execute one or more program codes to manage the overall operation of the electronic device 10; the processor 210 is used to execute one or more program codes to manage the overall operation of the AI image recognition device 20. In this embodiment, the processor 110 and the processor 210 are, for example, a central processing unit (CPU) with one core or multiple cores, or a programmable microprocessor (Micro-processor) , Digital Signal Processor (DSP), Programmable Controller, Application Specific Integrated Circuits (ASIC), Programmable Logic Device (PLD) or other similar devices.

The main memories 120 and 220 are used to receive instructions from the processors 110 and 210 to temporarily store data. For example, the main memory 120 can temporarily store image data captured by the image capturing device 150; the main memory 220 can temporarily store data transmitted from the electronic device 10 (eg, reconstructed images). The main memory 120, 220 is, for example, a dynamic random access memory or a static random access memory.

The communication circuit unit 130 establishes a network connection in a wireless or wired manner to connect to the communication circuit unit 230, and then uses the established network connection to transmit data. The communication circuit units 130 and 230 have, for example, a wireless communication circuit unit (not shown), and support the Global System for Mobile Communication (GSM) system and the Personal Handy-phone System (PHS) , Code Division Multiple Access (CDMA) system, Wireless Fidelity (WiFi) system, Worldwide Interoperability for Microwave Access (WiMAX) system, third-generation wireless communication technology ( 3G), fourth-generation wireless communication technology (4G), fifth-generation wireless communication technology (5G), Long Term Evolution (LTE), infrared transmission, bluetooth communication technology One or a combination thereof, and not limited thereto. In addition, the communication circuit units 130 and 230 may also have a wired communication circuit unit (not shown), and transmit or receive data through wired communication.

The storage devices 140 and 240 are used to record some data that needs to be stored for a long time through instructions from the processor 110 and the processor 210, respectively. The storage devices 140 and 240 can be any type of hard disk drive (HDD) or non-volatile memory storage device (eg, solid state drive (SSD)). The data stored in the storage device 140 is, for example, firmware or software used to manage the electronic device 10 (eg, code 143); and multiple databases (eg, monitoring scene database 141, lens specification database 142) Or other suitable database, etc...). The data stored in the storage device 240 is, for example, the firmware or software used to manage the AI image recognition device 20; and multiple databases (eg, target image sample database, AI image recognition model database or other suitable Database etc...).

In this embodiment, the processor 110 is used to access and load the program code 143 to perform an image capturing operation, thereby implementing the image capturing method provided by the present invention. In addition, the processor 210 is used to execute a plurality of program codes to perform an image recognition operation on the received reconstructed image.

The monitoring scene database 141 is used to record the spatial information of each of the multiple monitoring scenes. The spatial information includes, but is not limited to, the height, width, and depth of the monitoring scene. The lens specification database 142 is used to record the respective lens specifications of the plurality of image capturing devices 150(1)-150(N). The lens specifications are, for example, the focal length and effective field of view of the lens. It should be noted that the aforementioned multiple databases can also be updated via data transmitted via a network connection connected to the Internet or a local area network, or via data input from an input device.

The image capturing device array 150 includes a plurality of image capturing devices 150(1)-150(N). N is a positive integer greater than 1. Each of the plurality of image capturing devices 150(1) to 150(N) is, for example, a video camera or a camera with a function of capturing image data. The multiple image capturing devices 150(1)-150(N) are used to respectively photograph the surveillance scene SC1. Each image capturing device may include a lens, a photosensitive element, an aperture, and so on. The lens is, for example, a standard lens, a wide-angle lens, and a zoom lens. The photosensitive element is, for example, a Charge Coupled Device (CCD), a Complementary Metal-Oxide Semiconductor (CMOS) element, or other elements. The lens, the photosensitive element, or the combination thereof is not limited here. Each image capturing device can continuously capture (shoot) multiple images, that is, capture (shoot) a dynamic image (also known as Video Stream). The image capturing device can also capture (shoot) a single static image. The dynamic image or static image is temporarily stored in the main memory 120 so that the processor 110 can perform further processing on the dynamic image or static image.

FIG. 3 is a flowchart of the image capturing method according to the first embodiment of the present invention. Please refer to FIG. 3, in step S301, through multiple image capturing devices corresponding to multiple focal lengths, the monitoring scene is photographed at the same time, so as to capture multiple focal lengths corresponding to the multiple focal lengths at the same time point. image.

Specifically, in the first embodiment, the focal lengths of the plurality of image capturing devices 150(1)-150(N) are preset to different fixed focal lengths. The multiple image capturing devices 150(1)-150(N) will each use the preset fixed focal length to simultaneously capture the surveillance scene SC1. In other words, at each time point, N image capturing devices can simultaneously capture/output N images of the monitoring scene SC1. The N images will be temporarily stored in the main memory 120.

Then, in step S303, according to the multiple focal lengths, the processor 110 identifies the respective target regions of the multiple captured images, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths Correspond to the multiple focal lengths respectively.

Specifically, the multiple focal lengths are based on the respective focal lengths of the multiple image capturing devices 150(1) to 150(N), the multiple lens specifications, and the multiple image capturing devices 150 (1) Determined by the total number of ~150(N). In more detail, for the first focal length of the plurality of focal lengths corresponding to the first image capturing device, the starting point of the first focal length to the first image capturing of the plurality of image capturing devices The first focal length before the first focal length of the device and the first focal length from the end point of the first focal length to the first focal length are based on the first lens specification of the first image capturing device and the Determined by the total number of multiple image capturing devices.

4A is a schematic diagram of multiple focal lengths corresponding to multiple focal lengths according to the first embodiment or the second embodiment of the present invention. Please refer to FIG. 4A. For the convenience of description, N is set to 4 in the following embodiment. For example, suppose that each image capturing device 150(1)~150(4) has the same depth of field FVL (which can be known according to each image capturing device 150(1)~150(4)); The image capturing devices 150(1)~150(4) are respectively set to focal lengths FL1~FL4. In this embodiment, the sum of the respective focal lengths FS1 to FS4 of the image capturing devices 150(1) to 150(4) is set to be equal to the depth of view FVL. In addition, the distance FS1_F from the starting point of the focal length FS1 of the imaging device 150(1) to the focal length FL1 and the distance after the focal length FS1_B from the end point of the focal length FS1 of the imaging device 150(1) to the focal length FL1 are based on the image capturing device The lens specification of 150(1) is determined by the total number (eg, 4) of the plurality of image capturing devices 150. Similarly, the distance FS2_F from the start point of the focal length FS2 of the imaging device 150(2) to the focal length FL2 and the distance FS2_B from the end point of the focal length FS2 of the imaging device 150(2) to the focal length FL2 after the focal length FS2_B are based on image capture The lens specification of the device 150(2) is determined by the total number of the plurality of image capturing devices 150; the focal length FS3_F from the starting point of the focal length FS3 of the imaging device 150(3) to the focal length FL3 and the imaging device The back focal distance FS3_B from the end point of the focal length FS3 of 150(3) to the focal length FL3 is determined according to the lens specification of the image capturing device 150(3) and the total number of the plurality of image capturing devices 150; The distance FS4_F from the starting point of the focal length FS4 of the device 150(4) to the focal length FL4 before the focal length FS4_F and the distance FS4_B from the end point of the focal length FS4 of the imaging device 150(4) to the focal length FL4 after the focal length FS4_B are based on the image capturing device 150(4) ) Is determined by the lens specifications and the total number of the plurality of image capturing devices 150.

4B is a schematic diagram of a shooting area and corresponding multiple focal lengths of a surveillance scene according to the first embodiment of the present invention. Please refer to FIG. 4B. Specifically, as described above, the monitoring scene database records spatial information of the monitoring scene SC1. In addition, the spatial information includes the height, width, and depth of the surveillance scene SC1. The multiple images are determined according to the spatial information of the monitoring scene, the multiple focal lengths corresponding to the multiple image capturing devices, and the multiple lens specifications corresponding to the multiple image capturing devices The position, shape and size of the respective target area. For example, for the images captured by the image capturing device 150(1) among the plurality of images, the processor 110 according to the height, the width, and the height of the spatial information of the monitoring scene SC1 One or more of the depths, the focal length FS1 corresponding to the image capturing device 150(1), and the lens specifications corresponding to the image capturing device 150(1) determine the The position, shape, and multiple side lengths of the target area TA1. Wherein, the lens specification of the image capturing device 150(1) can determine the shooting area SA1 corresponding to the surveillance scene SC1, and the depth of the shooting area SA1 is the depth of view FVL. The range of the image captured by the image capturing device 150(1) is the range of the shooting area SA1.

Please return to FIG. 3 again. Next, in step S305, the processor 110 retains a plurality of target sub-images in the plurality of target regions of the plurality of images, wherein among the plurality of target sub-images Multiple object images are all in focus.

Specifically, for the image captured from the image capturing device, the processor 110 will only retain the image information in the target area (e.g., multi-pixel Pixel value), wherein the image information can be regarded as a target sub-image in the image. It should be noted that, in another embodiment, the image capturing device 150(1) can also recognize the target area TA1 by itself. In one embodiment, the processor 110 recognizes the removal area outside the target area according to the recognized target area in the image, so as to delete the image information in the removal area. The following uses Figures 5A to 5C, 6A to 6B, 7A to 7B, and 8A to 8B to illustrate.

FIG. 5A is a schematic diagram of the captured image IMG1 corresponding to the focal length FS1 according to the first embodiment of the present invention. FIG. 5B is a schematic diagram of the target area TA1 corresponding to the focal length FS1 in the recognition image IMG1 according to the first embodiment of the present invention. 5C is a schematic diagram of retaining the target sub-image TIMG1 in the target area TA1 corresponding to the focal length FS1 according to the first embodiment of the present invention.

Referring to FIG. 5A, for example, suppose that the image capturing device 150(1) has captured the image IMG1, the user U1 is located in the focal range FS1, and the image AFC1 of the face of the user U1 is a clear image that has been focused. In this embodiment, the image capturing device 150(1) can determine whether the currently captured image is in focus (also referred to as in focus) according to the contrast detection operation. For example, the image capturing device 150(1) can change the position of the lens group of the lens of the image capturing device 150(1) to correspond to different positions to be projected to the photosensitive element of the image capturing device 150(1). Find the target image with the highest contrast (contrast) among the different images on the above, and use the position of the lens group corresponding to the target image as the focus point (also known as the focus point) to use the focus point to capture the image, In turn, the image AFC1 of the face of the user U1 in the captured image IMG1 can be a clear and focused image.

Referring to FIG. 5B, the processor 110 may correspond to the image capturing device 150 according to one or more of the height, the width, and the depth of the spatial information of the monitoring scene SC1 (1) The focal length FS1 and the lens specifications corresponding to the image capturing device 150(1) determine the multiple vertices of the target area TA1 in the image (for example, points TA1(1)~TA1(4)) The coordinate position in the image IMG1 is used to determine the position of the target area TA1 (for example, the position of the corresponding focal segment FS1 at the bottom of the image IMG1), the shape (for example, a rectangle), and multiple side lengths. The area outside the target area TA1 in the image IMG1 will be regarded as the removal area EA1, and the image located in the removal area EA1 will not be retained.

Referring to FIG. 5C, after identifying the target area TA1 in the image IMG1, the processor 110 may retain the target sub-image TIMG1 in the target area TA1. Other sub-images in the removal area EA1 in the image IMG1 will not be retained or deleted. It should be noted that, as described above, in the another embodiment, the image capturing device 150(1) can recognize the target area TA1 by itself. In addition, the image capturing device 150(1) can only retain and transmit the target sub-image IMG1 located in the target area TA1 to the main memory 120, thereby reducing the space consumption of the main memory 120.

6A, similarly, assuming that at the same time point, the image capturing device 150(2) also captures the image IMG2, the user U2 is located in the focal range FS2, and the image AFC2 of the face of the user U2 is in focus Clear image. Referring to FIG. 6B, after identifying the target area TA2 in the image IMG2, the processor 110 may retain the target sub-image TIMG2 in the target area TA2. Referring to FIG. 7A, similarly, assuming that at the same time point, the image capturing device 150(3) also captures the image IMG3, the user U3 is located in the focal range FS3, and the image AFC3 of the face of the user U3 is in focus Clear image. Referring to FIG. 7B, after identifying the target area TA3 in the image IMG3, the processor 110 may retain the target sub-image TIMG3 in the target area TA3. Referring to FIG. 8A, similarly, assuming that at the same time point, the image capturing device 150(4) also captures the image IMG4, the user U4 is located in the focal range FS4, and the image AFC4 of the face of the user U4 is in focus Clear image. Referring to FIG. 8B, after identifying the target area TA4 in the image IMG4, the processor 110 may retain the target sub-image TIMG4 in the target area TA4.

Please return to FIG. 3 again. Next, in step S307, the processor 110 directly generates a single reconstructed image corresponding to the time point according to the multiple target sub-images. Specifically, in an embodiment, the processor 110 copies the multiple target sub-images to the background image according to the multiple focal lengths to generate the reconstructed image, wherein the multiple target sub-images do not overlap with each other.

FIG. 9 is a schematic diagram of a reconstructed image generated from multiple target sub-images according to the first embodiment of the present invention. Referring to FIG. 9, for example, the processor 110 may sequentially (eg, start from the bottom of the background image RIMG to the top of the background image RIMG) according to the sequence of the multiple focal lengths to convert the multiple target sub-images TIMG1 ~TIMG4 is copied to the background image RIMG (for example, the blank image RIMG) to generate the reconstructed image RIMG. It is worth mentioning that the images AFC1 to AFC4 of multiple target objects in the reconstructed image RIMG are all focused and clear images. In more detail, in one embodiment, the images AFC1 to AFC4 of the plurality of target objects are all greater than a predetermined pixel threshold. In addition, the predetermined pixel threshold value is correspondingly set according to the image recognition operation performed by the AI image recognition device.

In addition, in another embodiment, the processor 110 may not need to sequentially copy the multiple target sub-images TIMG1 to TIMG4 to the background image RIMG1 to generate the reconstructed image RIMG. For example, the processor 110 may randomly or use other rules to copy the multiple target sub-images TIMG1 to TIMG4 to the background image RIMG1 to generate the reconstructed image RIMG.

After the reconstructed image RIMG is generated, step S309 is continued, and the processor 110 outputs the reconstructed image RIMG. Specifically, the processor 110 may instruct the communication circuit unit 130 to transmit the reconstructed image RIMG to the AI image recognition device 20 via the established network connection (as shown by arrow A9), so that the The AI image recognition device 20 can perform image recognition operations on the reconstructed image RIMG.

FIG. 10 is a schematic diagram of a sequence of multiple image capturing operations according to the first embodiment of the present invention. 10, at time T1, the processor 110 obtains the target sub-image TIMG1 (1) captured by the image capturing device 150(1) and the target sub-image captured by the image capturing device 150(2) TIMG2(1), the target sub-image TIMG3(1) captured by the image capturing device 150(3), and the target sub-image TIMG4(1) captured by the image capturing device 150(4); at time point T2 , The processor 110 obtains the target sub-image TIMG1(2) captured by the image capturing device 150(1), the target sub-image TIMG2(2) captured by the image capturing device 150(2), and the image capturing device The target sub-image TIMG3(2) captured by 150(3) and the target sub-image TIMG4(2) captured by the image capturing device 150(4), the processor 110 according to the target sub-image IMG1(1) ~IMG4(1) generates a reconstructed image RIMG(1) corresponding to time point T1, and the reconstructed image RIMG(1) is transmitted to the AI image recognition device 20; at time point T3, the processor 110 obtains the image capture The target sub-image TIMG1(3) captured by the capture device 150(1), the target sub-image TIMG2(3) captured by the image capture device 150(2), and the target subimage TIMG2(3) captured by the image capture device 150(3) The target sub-image TIMG3(3) and the target sub-image TIMG4(3) captured by the image capturing device 150(4), the processor 110 generates the corresponding time according to the target sub-images IMG1(2)~IMG4(2) The reconstructed image RIMG(2) at point T2, and the reconstructed image RIMG(2) is transmitted to the AI image recognition device 20; at time point T4, the processor 110 obtains the image captured by the image capturing device 150(1) The captured target sub-image TIMG1(4), the target sub-image TIMG2(4) captured by the image capture device 150(2), the target sub-image TIMG3(4) captured by the image capture device 150(3), And the target sub-image TIMG4(4) captured by the image capturing device 150(4), the processor 110 generates a reconstructed image RIMG(3) corresponding to the time point T3 according to the target sub-images IMG1(3)~IMG4(3) ), and the reconstructed image RIMG(3) is sent to the AI image recognition device 20, and so on.

In other words, assuming that each of the multiple time points T1 to T4 corresponds to a time frame (Time Frame), the first embodiment only needs two time frames to output the first reconstructed image to AI. Image recognition device 20. In particular, the first embodiment only needs one time frame to output the successive reconstructed images to the AI image recognition device 20 (as shown in FIG. 10, the time interval between two adjacent reconstructed images is a time frame ). In this way, it can be proved that the electronic device provided by the present invention and the image capturing method used in it can quickly and efficiently generate reconstructed images for image recognition operations compared to traditional methods.

[Second Embodiment]

Most of the hardware components of the second embodiment are the same as those of the first embodiment, and the details of the same hardware components will not be repeated.

FIG. 11 is a block diagram of the image recognition system according to the second embodiment of the present invention. Referring to FIG. 11, the difference between the second embodiment and the first embodiment is that in the second embodiment, the electronic device 10 only includes a zoomable image capturing device 150(1). In other words, the image capturing device 150 in the second embodiment needs to quickly switch the focal length to capture the surveillance scene.

FIG. 12 is a flowchart of the image capturing method according to the second embodiment of the present invention. 12, the process steps of the image capturing method provided in the second embodiment are mostly similar to the process steps of the image capturing method provided in the first embodiment (eg, step S1203 to step S1209 are the same as step S303 ~S309), where step S1201 is different from step S301.

In step S1201, through the zoomable image capturing device, the surveillance scene is sequentially shot multiple times according to multiple focal lengths to capture multiple images corresponding to the multiple focal lengths.

Specifically, for the convenience of description, it is assumed that the image capturing device 150 has a focal length FL1 to a focal length FL4 (as shown in FIG. 4A). The image capturing device 150 can first use the focal length FL1 to shoot the surveillance scene SC1 to obtain the image IMG1, and then use the focal length FL2 to shoot the surveillance scene SC1 to obtain the image IMG2, and then use the focal length FL3 to monitor the surveillance scene according to the sequence of the focal length FL1 to the focal length FL4. The scene SC1 is shot to obtain the image IMG3, and finally the focal length FL4 is used to shoot the monitoring scene SC1 to obtain the image IMG4. In addition, the processor 110 may correspondingly obtain the target sub-images TIMG1~TIMG4 according to the corresponding focal lengths FS1~FS4 (steps S1203~1205), and generate and output the corresponding reconstructed image RIMG according to the target sub-images TIMG1~TIMG4 (step S1207 ~1209).

FIGS. 13A and 13B are schematic diagrams of the sequence of multiple image capturing operations according to the second embodiment of the present invention. 13A, at time T1, the processor 110 obtains the target sub-image TIMG1 (1) corresponding to the focal length FS1 captured by the image capturing device 150, and at the time T2, the processor 110 obtains the image capturing device The target sub-image TIMG2(1) corresponding to the focal length FS2 captured by 150. At time T3, the processor 110 obtains the target sub-image TIMG3(1) corresponding to the focal length FS3 captured by the image capturing device 150. At point T4, the processor 110 obtains the target sub-image TIMG4(1) corresponding to the focal length FS4 captured by the image capturing device 150; at the time point T5, the processor 110 obtains the target sub-images IMG1(1)~IMG4( 1) Generate the reconstructed image RIMG(1), and the processor 110 obtains the target sub-image TIMG1(2) corresponding to the focal length FS1 captured by the image capturing device 150. At the time point T6, the processor 110 obtains the image capture The target sub-image TIMG2(2) corresponding to the focal length FS2 captured by the device 150. At time T7, the processor 110 obtains the target sub-image TIMG3(2) corresponding to the focal length FS3 captured by the image capturing device 150. At time T8, the processor 110 obtains the target sub-image TIMG4(2) corresponding to the focal length FS4 captured by the image capturing device 150; at time T9, the processor 110 obtains the target sub-images IMG1(2)~IMG4 (2) Generate the reconstructed image RIMG(2), and the processor 110 obtains the target sub-image TIMG1(3) corresponding to the focal length FS1 captured by the image capture device 150. At time T10, the processor 110 obtains the image capture The target sub-image TIMG2(3) corresponding to the focal length FS2 captured by the capturing device 150. At time T11, the processor 110 obtains the target sub-image TIMG3(3) corresponding to the focal range FS3 captured by the image capturing device 150. At time T12, the processor 110 obtains the target sub-image TIMG4(3) corresponding to the focal length FS4 captured by the image capturing device 150; at time T9, the processor 110 obtains the target sub-image IMG1(3)~ IMG4(3) produces reconstructed image RIMG(3), and so on. Referring to FIG. 13B, the generated reconstructed images RIMG(1) to RIMG(3) can be output to the AI image recognition device 20 at time points T5, T9, and T13, respectively.

In other words, assuming that each of the multiple time points T1 to T4 corresponds to a time frame, the second embodiment only needs four time frames to output a reconstructed image to the AI image recognition device 20. Although the speed of generating reconstructed images in the second embodiment is one-fourth that of the first embodiment, the hardware cost for setting up the image capturing device in the second embodiment is also one-fourth of the first embodiment. On the whole, regardless of the first or second embodiment, compared with the traditional method, a large amount of time and resources for capturing qualified images can be saved, thereby improving the overall efficiency of the image recognition system.

In summary, the image capturing method and electronic device provided by the embodiments of the present invention can shoot a monitoring scene according to multiple focal lengths to capture multiple images, according to the multiple focal lengths corresponding to the multiple focal lengths. The focal length retains the target sub-images of each of the multiple images, so as to directly generate and output reconstructed images based on the multiple target sub-images. In this way, without analyzing the multiple images and not fitting/stitching the multiple target sub-images, multiple images located at multiple depths in the generated reconstructed image can be quickly and efficiently made. Each object image is focused and clear, thereby improving the accuracy of the image recognition operation using the reconstructed image.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the relevant technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The protection scope of the present invention shall be subject to those defined by the attached patent application scope.

SC1: Monitoring scene FC1~FC4, AFC1~AFC4: the image of the target object U1~U4: User 1: Image recognition system 10: Electronic device 20: AI image recognition device 110, 210: processor 120, 220: main memory 130, 230: communication circuit unit 140, 240: storage device 141: Surveillance Scene Database 142: Lens Specification Database 143: Code 150: Image capture device array/image capture device 150(1)~150(N): image capture device S301, S303, S305, S307, S309: the process steps of the image capturing method of the first embodiment and the second embodiment S1701, S1703, S1705, S1707, S1709: process steps of the image capturing method of the second embodiment FL1~FL4: Focal length FS1~FS4: focal length FS1_F~FS4_F, FS1_B~FS4_B: distance FVL: Depth of Field TA1~TA4: target area SA1: shooting area EA1~EA4: Remove area TA1(1)~TA(4): vertex TIMG1~TIMG4, TIMG1(1)~TIMG1(4), TIMG2(1)~TIMG2(4), TIMG3(1)~TIMG3(4), TIMG4(1)~TIMG4(4): target sub-image RIMG, RIMG(1)~RIMG(4): Rebuild the image T1~T13: time point

Fig. 1 is a schematic diagram of a monitoring scene according to the first embodiment of the present invention. FIG. 2 is a block diagram of the image recognition system according to the first embodiment of the present invention. FIG. 3 is a flowchart of the image capturing method according to the first embodiment of the present invention. 4A is a schematic diagram of multiple focal lengths corresponding to multiple focal lengths according to the first embodiment or the second embodiment of the present invention. 4B is a schematic diagram of a shooting area and corresponding multiple focal lengths of a surveillance scene according to the first embodiment of the present invention. FIG. 5A is a schematic diagram of the captured image IMG1 corresponding to the focal length FS1 according to the first embodiment of the present invention. FIG. 5B is a schematic diagram of the target area TA1 corresponding to the focal length FS1 in the recognition image IMG1 according to the first embodiment of the present invention. 5C is a schematic diagram of retaining the target sub-image TIMG1 in the target area TA1 corresponding to the focal length FS1 according to the first embodiment of the present invention. 6A is a schematic diagram of the captured image IMG2 corresponding to the focal length FS2 according to the first embodiment of the present invention. 6B is a schematic diagram of retaining the target sub-image TIMG2 in the target area TA2 corresponding to the focal length FS2 according to the first embodiment of the present invention. FIG. 7A is a schematic diagram of the captured image IMG3 corresponding to the focal length FS3 according to the first embodiment of the present invention. FIG. 7B is a schematic diagram of retaining the target sub-image TIMG3 in the target area TA3 corresponding to the focal length FS3 according to the first embodiment of the present invention. FIG. 8A is a schematic diagram of the captured image IMG4 corresponding to the focal length FS4 according to the first embodiment of the present invention. FIG. 8B is a schematic diagram of retaining the target sub-image TIMG4 in the target area TA4 corresponding to the focal length FS4 according to the first embodiment of the present invention. FIG. 9 is a schematic diagram of a reconstructed image generated from multiple target sub-images according to the first embodiment of the present invention. FIG. 10 is a schematic diagram of a sequence of multiple image capturing operations according to the first embodiment of the present invention. FIG. 11 is a block diagram of the image recognition system according to the second embodiment of the present invention. FIG. 12 is a flowchart of the image capturing method according to the second embodiment of the present invention. FIGS. 13A and 13B are schematic diagrams of the sequence of multiple image capturing operations according to the second embodiment of the present invention.

S301, S303, S305, S307, S309: Process steps of image recognition method

Claims (12)

An image capturing method is suitable for an electronic device, wherein the electronic device includes a plurality of image capturing devices with a fixed focal length, wherein the plurality of image capturing devices use different focal lengths for shooting, the Methods include: Simultaneously shoot a surveillance scene through the multiple image capturing devices corresponding to the multiple focal lengths to capture multiple images corresponding to the multiple focal lengths at the same time point, wherein the The total number of the multiple images is equal to the total number of the multiple focal lengths; Identifying respective target regions of the captured images according to multiple focal lengths, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths correspond to the multiple focal lengths respectively; Multiple target sub-images retained in the multiple target regions of the multiple images, wherein multiple object images in the multiple target sub-images are all in focus; Directly generating a single reconstructed image corresponding to the time point according to the multiple target sub-images; and Output the reconstructed image. The image capturing method according to claim 1, wherein the electronic device further includes a storage device, wherein the storage device stores a lens specification database, and the lens specification database records the plurality of images Multiple lens specifications of the capturing device, wherein the multiple focal lengths are based on the respective focal lengths of the multiple image capturing devices, the multiple lens specifications, and the total number of the multiple image capturing devices decided, The first focal length front distance from the starting point of the first focal length of the plurality of focal lengths to the first focal length of the first image capturing device of the plurality of image capturing devices and the end of the first focal length The first focal length from the point to the first focal length is determined according to the first lens specification of the first image capturing device and the total number of the plurality of image capturing devices. The image capturing method according to the second item of the scope of patent application, wherein the storage device stores a monitoring scene database, and the monitoring scene database records spatial information of the monitoring scene, wherein the spatial information includes The height, width and depth of the monitoring scene, wherein the step of identifying the respective target regions of the captured images includes: The multiple images are determined according to the spatial information of the monitoring scene, the multiple focal lengths corresponding to the multiple image capturing devices, and the multiple lens specifications corresponding to the multiple image capturing devices The position, shape and size of the respective target area, For the first image captured by the first image capturing device among the plurality of images, According to the depth and the width of the spatial information of the monitoring scene, the first focal length corresponding to the first image capturing device, and the first lens corresponding to the first image capturing device The specifications determine the first position, first shape, and multiple side lengths of the first target area in the first image. According to the image capturing method described in claim 1, wherein the step of directly generating the single reconstructed image corresponding to the time point according to the multiple target sub-images includes: Copying the multiple target sub-images to a background image according to the multiple focal lengths to generate the reconstructed image, The multiple target sub-images do not overlap with each other. According to the image capturing method described in the first item of the scope of patent application, the respective pixel amounts of one or more target objects in each of the plurality of images are greater than a predetermined pixel threshold value. An image capturing method suitable for an electronic device, wherein the electronic device includes an image capturing device capable of zooming, and the method includes: Through the image capturing device, the monitoring scene is sequentially shot multiple times according to multiple focal lengths to capture multiple images corresponding to the multiple focal lengths, wherein the total number of the multiple images is the same as The total number of the multiple focal lengths, and the multiple time points of the multiple images are continuous; Identifying respective target regions of the captured images according to multiple focal lengths, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths correspond to the multiple focal lengths respectively; Multiple target sub-images retained in the multiple target regions of the multiple images, wherein multiple object images in the multiple target sub-images are all in focus; Directly generating a single reconstructed image based on the multiple target sub-images; and Output the reconstructed image. According to the image capturing method described in claim 6, wherein the electronic device further includes a storage device, wherein the storage device stores a lens specification database, and the lens specification database records the image capture Multiple lens specifications corresponding to the multiple focal lengths of the device, wherein the multiple focal lengths are determined according to the multiple focal lengths, the multiple lens specifications, and the total number of the multiple image capturing devices, The first focal length front distance from the starting point of the first focal length of the plurality of focal lengths to the first focal length in the image capturing device and the end point of the first focal length to the first focal length of the first focal length A back-focus distance is determined according to the first lens specification of the image capturing device and the total number of the plurality of image capturing devices. The image capture method according to item 7 of the scope of patent application, wherein the storage device stores a monitoring scene database, and the monitoring scene database records spatial information of the monitoring scene, wherein the spatial information includes The height, width and depth of the monitoring scene, wherein the step of identifying the respective target regions of the captured images includes: According to the spatial information of the monitoring scene, the multiple focal lengths corresponding to the image capturing device, and the multiple lens specifications corresponding to the image capturing device to determine the respective of the multiple images The location, shape and size of the target area, For the first image in the plurality of images, According to the depth and width of the spatial information of the monitoring scene, the first focal length, and the first lens specification, the first position and the first position of the first target area in the first image are determined One shape and multiple side lengths. According to the image capturing method described in claim 6, wherein the step of directly generating the single reconstructed image corresponding to the time point according to the multiple target sub-images includes: Copying the multiple target sub-images to a background image according to the multiple focal lengths to generate the reconstructed image, The multiple target sub-images do not overlap with each other. According to the image capturing method described in item 6 of the scope of patent application, the respective pixel amounts of one or more target objects in each of the plurality of images are greater than a predetermined pixel threshold value. An electronic device, including: A plurality of image capturing devices with a fixed focal length, wherein the plurality of image capturing devices are used for shooting with different focal lengths respectively; A storage device for storing data, wherein the data includes a plurality of codes; and A processor, wherein the processor is used to access and execute the plurality of program codes to implement an image capturing method, wherein The multiple image capturing devices are used to simultaneously shoot a monitoring scene to capture multiple images corresponding to the multiple focal lengths at the same time point, wherein the total number of the multiple images is equal to The total number of said multiple focal lengths, The processor is used to identify the respective target regions of the captured images according to multiple focal lengths, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths correspond to the respective Multiple focal lengths, The processor is further configured to retain a plurality of target sub-images in the plurality of target regions of the plurality of images, wherein a plurality of object images in the plurality of target sub-images are all in focus, The processor is further configured to directly generate a single reconstructed image corresponding to the time point according to the multiple target sub-images, The processor is further used to output the reconstructed image. An electronic device, including: A zoomable image capture device, wherein the image capture device selects one of a plurality of focal lengths for shooting; A storage device for storing data, wherein the data includes a plurality of codes; and A processor, wherein the processor is used to access and execute the plurality of program codes to implement an image capturing method, The image capturing device is used to sequentially shoot multiple times of the monitoring scene according to the multiple focal lengths to capture multiple images corresponding to the multiple focal lengths, wherein the total number of the multiple images Is the same as the total number of the multiple focal lengths, and multiple time points of the multiple images are continuous, The processor is further configured to identify the respective target regions of the captured images according to the multiple focal lengths, wherein the multiple target regions correspond to the multiple focal lengths, and the multiple focal lengths Corresponding to the multiple focal lengths, The processor is further configured to retain a plurality of target sub-images in the plurality of target regions of the plurality of images, wherein a plurality of object images in the plurality of target sub-images are all in focus, The processor is further used to directly generate a single reconstructed image according to the multiple target sub-images, The processor is further used to output the reconstructed image.

Images