TWI502980B - Image capture methods and systems based on object detection technologies, and computer program products thereof - Google Patents

Description

Image capturing method and system based on object detection technology, and computer program product thereof

The invention relates to an image capturing method and system, and particularly to a method for performing a photographing operation based on the object detecting technology, thereby simultaneously capturing a complete image and a partial image of at least one object in the corresponding complete image. And system.

In recent years, portable devices such as electronic devices, such as handheld devices, have become more advanced and more functional. For example, a handheld device can have the function of an image capture (digital camera). At present, taking photos has become a common way people use to record their daily lives.

Conventionally, a user can only take a photo of a single scene at a time. However, as the protagonist of the event, people naturally become the focus of the shooting. At the moment of taking a photo, the photographer often wants not only to take a full picture of the entire event, but also to capture the expression on each participant's face. In addition, when browsing photos, when the user is particularly interested in a certain part of the photo, such as the smile of a small baby in a family gathering scene, the user naturally wants to perform a partial zooming action on the part. The clarity of the photo of the local area after enlargement and otherwise will be limited by the resolution of the photo itself, and often there will be ambiguity.

As mentioned earlier, the user can only take a single photo of a single scene at a time. When the user wants to capture the panoramic image and the partial image, the user must perform the relevant zoom control and repeat the photographing operation to complete the capturing operation of the plurality of images. The above procedure is very inconvenient and complicated for the user. In addition, since it takes several seconds or more to complete a photographing operation, it is difficult for the user to grasp the time of different photographing operations, and it is difficult to photograph the desired image.

In view of this, the present invention provides an image capturing method and system based on object detection technology to overcome the aforementioned problems.

An image capturing method based on object detection technology is provided in an embodiment of the present invention. First, a preview image is captured by at least one image capturing unit of the electronic device. Then, at least one object detection technology is used to detect at least one object in the preview image. Then, the electronic device is caused to perform at least one photographing operation by the at least one image capturing unit, thereby obtaining a complete image of the corresponding preview image and a partial image of the corresponding at least one object. There is a correlation between the complete image and the partial image. Then, the complete image is displayed through a viewing interface. Determine if the corresponding selection of this complete image is received. When the corresponding image of the complete image is received, the partial image of the corresponding complete image is captured according to the association, and the partial image is displayed in the viewing interface.

An image capturing system based on the object detection technology includes at least one image capturing unit and a processing unit. The at least one image capturing unit captures a preview image. The processing unit detects at least one object in the preview image by using at least one object detection technology, and causes the at least one image capturing unit to perform at least one photographing operation, thereby obtaining a complete image of the corresponding preview image and corresponding at least one object A partial image. There is a correlation between the complete image and the partial image. The processing unit displays the complete image through a viewing interface and determines whether a corresponding selection of the complete image is received. When receiving the corresponding selection of the complete image, the processing unit captures the partial image of the corresponding complete image according to the association, and displays the partial image in the viewing interface.

An image capturing system based on object detection technology includes an image capturing unit and a processing unit. The image capturing unit captures a preview image. The processing unit detects at least one object in the preview image by using at least one object detection technology, and causes the image capturing unit to perform a first photographing operation and a second photographing operation, thereby respectively obtaining a complete image of the corresponding preview image and correspondingly A partial image of one of the at least one object. There is a correlation between the complete image and the partial image. The processing unit displays the complete image through a viewing interface and determines whether a corresponding selection of the complete image is received. When receiving the corresponding selection of the complete image, the processing unit captures the partial image of the corresponding complete image according to the association, and displays the partial image in the viewing interface.

An image capturing system based on the object detection technology includes a first image capturing unit, a second image capturing unit, and a processing unit. The first image capturing unit captures a preview image. The processing unit detects at least one object in the preview image by using at least one object detection technology. The processing unit causes the first image capturing unit to perform a first photographing operation to obtain a complete image of the corresponding preview image. The processing unit causes the second image capturing unit to perform a second photographing operation to obtain a partial image of the at least one object. There is a correlation between the complete image and the partial image. The processing unit displays the complete image through a viewing interface and determines whether a corresponding selection of the complete image is received. When receiving the corresponding selection of the complete image, the processing unit captures the partial image of the corresponding complete image according to the association, and displays the partial image in the viewing interface.

In some embodiments, the processing unit may cause the at least one image capturing unit to focus on the object, and obtain a partial image in the photographing operation.

In some embodiments, the processing unit may cause the at least one image capturing unit to close the object to obtain a partial image during the photographing operation.

In some embodiments, it may be determined whether the at least one item conforms to at least one particular item. When the at least one object meets the at least one specific object, the electronic device obtains a partial image of the corresponding at least one object by the at least one image capturing unit.

The above method of the present invention can exist in a coded manner. When the code is loaded and executed by the machine, the machine becomes the means for practicing the invention.

The above described objects, features, and advantages of the invention will be apparent from the description and appended claims appended claims

Figure 1 shows an image capture system based on object detection technology in accordance with an embodiment of the present invention. The image capturing system 100 based on the object detection technology according to the embodiment of the present invention can be applied to an electronic device having an image capturing function, such as a digital camera, and a handheld device having a camera function, such as a mobile phone, and wisdom. Mobile phones, personal digital assistants (PDAs) and global positioning system (GPS) devices.

The image capturing system 100 based on the object detection technology may include an image capturing unit 110, a display unit 120, a processing unit 130, and a storage unit 140. The image capturing unit 110 may be a Charge Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS), which is placed at an imaging position inside the electronic device to perform imaging. Sensing work. The display unit 120 can display related icons and interfaces, and related materials, such as preview images continuously captured by the image capturing unit 110, images captured by the photographing operation, and the like. It is to be noted that the preview image means that the image captured by the image capturing unit 110 is not actually stored in the storage unit 140. It should be noted that in some embodiments, display unit 120 can be coupled to a screen of a touch sensing device (not shown). The touch sensing device has a touch surface including at least one dimensional sensor for detecting contact and movement of an input tool such as a finger or a stylus on its surface. In other words, the user can directly input relevant materials through the display unit 120. The processing unit 130 can control the related components of the image capturing system 100 based on the object detection technology, and can capture the image data captured by the image capturing unit 110, such as the preview image continuously captured by the image capturing unit 110. The image processing method based on the image captured by the photographing operation and the image capturing method based on the object detecting technique of the present invention will be described later. It is to be noted that the image capture system 100 based on the object detection technology may also include a focus unit (not shown in FIG. 1). The processing unit 130 may control the focusing unit to perform a focusing operation of the object in the photographing job. The image data captured by the image capturing unit 110 may be permanently or temporarily stored in the storage unit 140. The storage unit 140 may be a built-in memory or an external memory card of the image capturing system 100 based on the object detection technology.

FIG. 2 shows an image capture method based on object detection technology according to an embodiment of the invention. The image capturing method based on the object detecting technology according to the embodiment of the present invention can be applied to an electronic device having an image capturing function, such as a digital camera, and a handheld device having a photographing function, such as a mobile phone, and a smart type. Mobile phones, personal digital assistants and GPS devices.

In step S210, a preview image is captured by the image capturing unit 110. After the preview image is obtained, in step S220, at least one object in the preview image is detected by using at least one object detection technology. It should be noted that in some embodiments, the object detection technology may be a face detection technology for detecting at least one face in the preview image. In some embodiments, object detection techniques can be used to identify a text, a landmark, and/or a human visual attention zone. Then, in step S230, the image capturing unit 110 is caused to perform at least one photographing operation, thereby obtaining a complete image of the corresponding preview image and a partial image of the corresponding one of the at least one object. It should be noted that, in some embodiments, after the object is detected from the preview image, it may be determined whether the detected object meets at least one specific object. When the detected object meets the specific object, the image capturing unit 110 can be caused to obtain a partial image of the corresponding object. It is reminded that in some embodiments, the specific item may be set in advance in the electronic device.

It is reminded that in some embodiments, the photographing job may include performing an auto focus job to set a focus point in the preview image. The photographing operation can be performed according to the focus point to obtain an image of the corresponding preview image. In addition, in some embodiments, before the partial image of the corresponding object is obtained, the image capturing unit 110 may be caused to focus on the object through the focusing unit, and a partial image is obtained in the photographing operation. In some embodiments, the electronic device causes the image capturing unit 110 to close the object to obtain a partial image during the photographing operation. It is to be noted that, in some embodiments, the image of the corresponding preview image obtained by the photographing operation and the partial image of the corresponding object may have the same file size and/or resolution. It must be noted that in addition to the focusing operation during the photographing process, there are related exposure and compensation calculations. The invention can be applied to any focusing, exposure and compensation operations.

Figure 3 shows an image capture system based on object detection technology in accordance with another embodiment of the present invention. The image capturing system 300 based on the object detecting technology according to another embodiment of the present invention can be applied to an electronic device having an image capturing function, such as a digital camera, and a handheld device having a photographing function, such as a mobile phone. , smart phones, personal digital assistants and GPS devices.

The image capturing system 300 based on the object detection technology may include a plurality of image capturing units 311, such as a first image capturing unit 311 and a second image capturing unit 312. In other words, the electronic device can have multiple lenses. The image capturing system 300 based on the object detection technology may further include a display unit 320, a processing unit 330, and a storage unit 340. Similarly, the first image capturing unit 311 and/or the second image capturing unit 312 may be a charge coupled device or a complementary metal oxide semiconductor, which is placed at an imaging position of the object to be photographed inside the electronic device to perform image processing. Sensing the job. The display unit 320 can display related icons and interfaces, and related materials, such as preview images continuously captured by the image capturing unit, images captured by the photographing operation, and the like. It is worth noting that one of the image capturing units can be preset to continuously capture the preview image. It is reminded that the preview image means that the image captured by the image capturing unit is not actually stored in the storage unit 340. It should be noted that in some embodiments, display unit 320 can be coupled to a screen of a touch sensing device (not shown). The touch sensing device has a touch surface including at least one dimensional sensor for detecting contact and movement of an input tool such as a finger or a stylus on its surface. In other words, the user can directly input relevant materials through the display unit 320. The processing unit 330 can control related components of the image capturing system 300 based on the object detection technology, and can capture the image data captured by the image capturing unit, such as the preview image continuously captured by the image capturing unit, and/ The image captured by the photographing operation is subjected to related processing, and the image capturing method based on the object detecting technology of the present invention is executed, and the details thereof will be described later. It is to be noted that the image capture system 300 based on the object detection technology may also include a focus unit (not shown in FIG. 3). The processing unit 330 may control the focusing unit to perform a focusing operation of the object in the photographing job. The image data captured by the individual image capturing unit may be permanently or temporarily stored in the storage unit 340. The storage unit 340 can be a memory card or a memory card built into the image capture system 300 based on the object detection technology.

FIG. 4 shows an image capture method based on object detection technology according to another embodiment of the present invention. The image capturing method based on the object detecting technology according to another embodiment of the present invention can be applied to an electronic device having an image capturing function, such as a digital camera, and a handheld device having a photographing function, such as a mobile phone. Smart phones, personal digital assistants and GPS devices.

In step S410, a preview image is captured by one of the plurality of image capturing units. After the preview image is obtained, in step S420, at least one object in the preview image is detected by using at least one object detection technology. Similarly, in some embodiments, the object detection technology can be a face detection technology for detecting at least one face in the preview image. In some embodiments, object detection techniques can be used to identify a text, a landmark, and/or a human visual attention zone. Then, in step S430, the individual image capturing units respectively perform a photographing operation, so that a complete image of the corresponding preview image and a partial image of the corresponding one of the objects are obtained through different image capturing units. For example, a photographing operation is performed by the first image capturing unit 311 to obtain a complete image of the corresponding preview image, and a photographing operation is performed by the second image capturing unit 312 to obtain a partial image of the corresponding object. Similarly, in some embodiments, after the object is detected from the preview image, it can be determined whether the detected object meets at least one specific object. When the detected object conforms to a specific object, it may cause a partial image of the corresponding object to be obtained through one of the image capturing units. It is reminded that in some embodiments, the specific item may be set in advance in the electronic device.

Similarly, in some embodiments, the photographing job may include performing an auto focus job to set a focus point in the preview image. The photographing operation can be performed according to the focus point to obtain an image of the corresponding preview image. In addition, in some embodiments, before the partial image of the corresponding object is obtained, one of the image capturing units may be caused to focus on the object through the focusing unit, and a partial image is obtained in the photographing operation. In some embodiments, the electronic device causes one of the image capturing units to close the object to obtain a partial image during the photographing operation. Similarly, in some embodiments, the image of the corresponding preview image obtained by the photographing job and the partial image of the corresponding object may have the same file size and/or resolution. Similarly, in addition to the focusing operation during the photographing process, there are related exposure and compensation calculations and the like. The invention can be applied to any focusing, exposure and compensation operations.

Figures 5A and 5B show images taken simultaneously in accordance with an embodiment of the present invention. For example, when the user captures the preview image by using the electronic device and presses the shooting button to shoot, the image 500 of the corresponding preview image can be obtained in the photographing operation, as shown in FIG. 5A. Since an object DO, such as a face, can be recognized in the preview image, a partial image 510 of the corresponding object can also be obtained in the photographing operation, as shown in FIG. 5B.

Figure 6 shows an image viewing method in accordance with an embodiment of the present invention. The image viewing method according to the embodiment of the present invention can be applied to an electronic device such as a digital camera and a handheld device such as a mobile phone, a smart phone, a personal digital assistant, and a global positioning system device. It should be noted that in this embodiment, there may be an association between the complete image of the corresponding preview image obtained by the at least one image capturing unit and the partial image of at least one object in the corresponding preview image.

First, in step S610, a viewing interface is displayed through the display unit of the electronic device. The at least one complete image in the electronic device is displayed in the viewing interface. In step S620, it is determined whether a selection of one of the at least one complete image is received. It should be noted that in some embodiments, the display unit can be a touch screen. The user can select a complete image directly through the touch screen. When the selection of the corresponding complete image is not received (NO in step S620), the determination in step S620 is continued. When the selection of the corresponding specific complete image is received (Yes in step S620), in step S630, according to the association of the corresponding complete image, a specific partial image corresponding to the specific complete image is captured, and in step S640, through The view interface displays this particular partial image. For example, the user can view the complete image through the viewing interface. The user can select this particular complete image when the user is interested in a particular object in a particular complete image, such as a character. Corresponding to the user's selection, a partial image of a particular object in the particular complete image will be displayed in the viewing interface to provide a user view.

In addition, it is worth noting that in some embodiments, the local image obtained by the UI can be used in related applications. Since the partial photos provide better resolution for the subject matter itself, it can be used to link to the social networking site and compare it with the photos on the website to integrate the social networking services. For example, a close-up photo of the corresponding face can be used to compare against a photo of a person page on a social networking site. When the comparison is successful, the relevant information, such as the name of the person, can be automatically marked in the close-up photo, the close-up photo can be automatically uploaded to the corresponding personal webpage, or the user can be actively recommended/notified to the corresponding face. know. It is reminded that the application of the corresponding partial image described above is only an example of the present case, and the present invention is not limited thereto.

Therefore, the image capturing method and system based on the object detecting technology in the present case can perform a photographing operation based on the object detecting technology, thereby simultaneously capturing a complete image and a partial image of at least one object in the corresponding complete image.

The method of the invention, or a particular type or portion thereof, may exist in the form of a code. The code may be included in a physical medium such as a floppy disk, a CD, a hard disk, or any other machine readable (such as computer readable) storage medium, or is not limited to an external computer program product, wherein When the code is loaded and executed by a machine, such as a computer, the machine becomes a device for participating in the present invention. The code can also be transmitted via some transmission medium, such as a wire or cable, fiber optics, or any transmission type, where the machine becomes part of the program when it is received, loaded, and executed by a machine, such as a computer. Invented device. When implemented in a general purpose processing unit, the code combination processing unit provides a unique means of operation similar to application specific logic.

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

100. . . Image capture system based on object detection technology

110. . . Image capture unit

120. . . Display unit

130. . . Processing unit

140. . . Storage unit

S210, S220, S230. . . step

300. . . Image capture system based on object detection technology

311. . . First image capturing unit

312. . . Second image capturing unit

320. . . Display unit

330. . . Processing unit

340. . . Storage unit

S410, S420, S430. . . step

500. . . Full image

510. . . Partial image

DO. . . object

S610, S620, S630, S640. . . step

1 is a schematic diagram showing an image capture system based on object detection technology in accordance with an embodiment of the present invention.

2 is a flow chart showing an image capturing method based on object detection technology according to an embodiment of the present invention.

Figure 3 is a schematic diagram showing an image capture system based on object detection technology in accordance with another embodiment of the present invention.

Figure 4 is a flow chart showing an image capture method based on object detection technology according to another embodiment of the present invention.

5A and 5B are schematic views showing images simultaneously taken in accordance with an embodiment of the present invention.

Figure 6 is a flow chart showing an image viewing method in accordance with an embodiment of the present invention.

S210, S220, S230. . . step

Claims (13)

An image capturing method based on the object detecting technology is applicable to an electronic device, comprising the steps of: capturing a preview image through at least one image capturing unit of the electronic device; and identifying the image by using at least one object detecting technology Previewing at least one object in the image, the object may be a text, a landmark, or a human visual attention area; causing the electronic device to perform at least one photographing operation by the at least one image capturing unit, thereby obtaining one of the corresponding preview images a complete image and a partial image of the at least one object, wherein the complete image has an association with the partial image; displaying the complete image through a viewing interface; determining whether a corresponding image is received; and receiving the phase When the complete image is selected, the partial image corresponding to the complete image is captured according to the association, and the partial image is displayed in the viewing interface. The method for image capture based on the object detection technology of claim 1, further comprising causing the at least one image capturing unit to focus on the object, and obtaining the image in the at least one photographing operation Partial image. The method for image capture based on the object detection technology of claim 1, further comprising causing the at least one image capturing unit to close the object, thereby obtaining the at least one photographing operation The partial image. Based on object detection technology as described in item 1 of the patent application scope The image capturing method is further configured to detect at least one face in the preview image. The image capturing method based on the object detecting technology described in claim 1 further includes the following steps: determining whether the at least one object meets at least one specific object; and when the at least one object meets the at least one When the specific object is used, the electronic device obtains the partial image of the at least one object by the at least one image capturing unit. An image capturing system based on object detection technology, which is applicable to an electronic device, comprising at least: at least one image capturing unit for capturing a preview image; and a processing unit for utilizing at least one object to detect The at least one object in the preview image is identified by the measurement technique, wherein the object can be a text, a landmark, or a human visual attention area, and the at least one image capturing unit performs at least one photographing operation to obtain the corresponding preview image. a complete image and a partial image corresponding to the at least one object, wherein the complete image has an association with the partial image, and the complete image is displayed through a viewing interface to determine whether the corresponding image is received, and when received Corresponding to the selection of the complete image, the partial image corresponding to the complete image is captured according to the association, and the partial image is displayed in the viewing interface. The image capture system based on the object detection technology of claim 6 , wherein the processing unit further causes the at least one image capturing unit to focus on the object, and in the at least one photographing operation撷 Get the partial image. Based on object detection technology as described in item 6 of the patent application scope The image capturing system further causes the at least one image capturing unit to close the object to obtain the partial image in the at least one photographing operation. The image capture system based on the object detection technology described in claim 6 wherein the at least one object detection technology is a face detection technology for detecting at least at least one of the preview images. A face. The image capture system based on the object detection technology of claim 6, wherein the processing unit further determines whether the at least one object meets at least one specific object, and when the at least one object meets the at least When the specific object is used, the electronic device obtains the partial image of the at least one object by the at least one image capturing unit. An image capturing system based on object detection technology, which is applicable to an electronic device, comprising at least: an image capturing unit for capturing a preview image; and a processing unit for detecting at least one object The technology identifies at least one object in the preview image, wherein the object can be a text, a landmark, or a human visual attention area, and causes the image capturing unit to perform a first photographing operation and a second photographing operation, thereby obtaining respectively Corresponding to a complete image of the preview image and a partial image of the at least one object, wherein the complete image has an association with the partial image, and the complete image is displayed through a viewing interface to determine whether the corresponding image is received. And receiving the corresponding partial image of the complete image according to the association, and displaying the partial image in the viewing interface. Image capture system based on object detection technology, applicable The at least one electronic device includes: a first image capturing unit for capturing a preview image; a second image capturing unit for previewing the image; and a processing unit for identifying the image by using at least one object detecting technology Previewing at least one object in the image, wherein the object can be a text, a landmark, or a human visual attention area, so that the first image capturing unit performs a first photographing operation to obtain a complete image of the preview image. And causing the second image capturing unit to perform a second photographing operation, so as to obtain a partial image of the at least one object, wherein the complete image has an association with the partial image, and the complete image is displayed through a viewing interface. Whether the selection of the corresponding complete image is received, and when the selection of the corresponding complete image is received, the partial image corresponding to the complete image is captured according to the association, and the partial image is displayed in the viewing interface. A computer program product for being loaded by a machine and performing an image capture method based on object detection technology, the computer program product comprising: a first code for transmitting at least one image capture unit Taking a preview image; a second code for identifying at least one object in the preview image by using at least one object detection technology, wherein the object may be a text, a landmark or a human visual attention zone; a third program a code for causing the at least one image capturing unit to perform at least one photographing operation, thereby obtaining a complete image of the corresponding preview image and a partial image of the corresponding at least one object, wherein the complete image has an association with the partial image ; a fourth code for displaying the complete image through a viewing interface; a fifth code for determining whether a corresponding image is received; and a sixth code for receiving the corresponding image When the complete image is selected, the partial image corresponding to the complete image is captured according to the association, and the partial image is displayed in the viewing interface.