TWI658429B - Image combination method and image combination system - Google Patents

Abstract

The invention provides an image combining method and an image combining system. The image combining method includes: shooting a first image by a first electronic device, and receiving an image of an object from a second electronic device, wherein the first electronic device has a first lateral resolution and The first vertical resolution and the second electronic device have a second horizontal resolution and a second vertical resolution; if the first vertical ratio of the second vertical resolution to the first vertical resolution is smaller than the second horizontal resolution and the first horizontal resolution The first horizontal ratio of resolution, the first electronic device scales the object image according to the first vertical ratio and displays the scaled object image in combination with the first image on the first electronic device.

Description

Image combining method and image combining system

The invention relates to an image combining method and an image combining system, and in particular to an image combining method and an image combining system capable of using two electronic devices to instantly combine respective captured images at different locations.

There are already many applications in Virtual Reality (VR) and Augmented Reality (AR). Now people can enjoy various immersive experiences, but the main applications are still around a single Personally. When people travel to see the beautiful scenery but their friends are not around, they can only modify the photos through the post-production method of the picture so that they and their friends can be presented in the beautiful scenery, which limits the user's ability to take pictures.

In view of this, the present invention provides an image combining method and an image combining system, so that two electronic devices located at different locations can combine the images on both sides in real time and make a virtual interaction, so as to immediately take a picture desired by the user.

The invention provides an image combining method, which comprises: shooting a first image by a first electronic device, and receiving an image of an object from a second electronic device, wherein the first electronic device has a first horizontal resolution and a first vertical resolution, and The second electronic device has a second horizontal resolution and a second vertical resolution; if the first longitudinal ratio of the second vertical resolution to the first vertical resolution is smaller than the first horizontal resolution of the second horizontal resolution and the first horizontal resolution Ratio, the first electronic device scales the object image according to the first vertical ratio and displays the scaled object image in combination with the first image on the first electronic device; and if the second vertical resolution and the first vertical resolution of the first vertical resolution If the ratio is greater than the first horizontal ratio of the second horizontal resolution to the first horizontal resolution, the first electronic device scales the object image according to the first horizontal ratio and displays the scaled object image in combination with the first image on the first electronic device.

In an embodiment of the present invention, the image combining method further includes: positioning the second center point of the zoomed object image on the first center point of the first image by the first electronic device; The device receives a drag operation to drag the object image to generate an object displacement amount; and the first electronic device displays the scaled object image on the first electronic device according to the first center point and the object displacement amount.

In an embodiment of the present invention, the first center point is a center point of the horizontal axis and the vertical axis of the first image, and the second center point is a center point of the horizontal axis and the vertical axis of the zoomed object image.

The invention provides an image combining method, which comprises: shooting a second image by a second electronic device and capturing an image of an object from the second image, and receiving the first image from the first electronic device, wherein the second electronic device has a first Second horizontal resolution and the first Two vertical resolutions and the first electronic device has a first horizontal resolution and a first vertical resolution; if the second vertical ratio of the first vertical resolution to the second vertical resolution is greater than the first horizontal resolution and the second horizontal resolution A second horizontal ratio of degrees, the second electronic device scales the first image according to the second vertical ratio and displays the scaled first image in combination with the object image on the second electronic device; and if the first vertical resolution and the second vertical ratio The second vertical ratio of the resolution is smaller than the second horizontal ratio of the first horizontal resolution and the second horizontal resolution, the second electronic device scales the first image according to the second horizontal ratio and combines the scaled first image with the image of the object Displayed on the second electronic device.

In an embodiment of the present invention, the image combining method further includes: positioning a first center point of the scaled first image on a second center point of the object image by a second electronic device; The device receives a drag operation to drag the first image to generate a background displacement amount; and the second electronic device displays the first image on the second electronic device according to the second center point and the background displacement amount.

The present invention provides an image combining system including a first electronic device and a second electronic device. The second electronic device is coupled to the first electronic device. The first electronic device captures a first image and receives an object image from a second electronic device, wherein the first electronic device has a first lateral resolution and a first vertical resolution and the second electronic device has a second lateral resolution and a second Vertical resolution. If the first vertical ratio between the second vertical resolution and the first vertical resolution is smaller than the first horizontal ratio between the second horizontal resolution and the first horizontal resolution, the first electronic device scales the image of the object according to the first vertical ratio and The scaled object image is displayed on the first electronic device in combination with the first image. If the first vertical ratio of the second vertical resolution to the first vertical resolution is greater than the second horizontal resolution A first lateral ratio between the first horizontal resolution and the first horizontal resolution, the first electronic device scales the object image according to the first horizontal ratio and displays the scaled object image in combination with the first image on the first electronic device.

In an embodiment of the present invention, the first electronic device locates the second center point of the zoomed object image on the first center point of the first image. The first electronic device receives a drag operation to drag an object image to generate an object displacement amount. The first electronic device displays the scaled object image on the first electronic device according to the first center point and the amount of object displacement.

In an embodiment of the present invention, the first center point is a center point of the horizontal axis and the vertical axis of the first image, and the second center point is a center point of the horizontal axis and the vertical axis of the zoomed object image.

In an embodiment of the invention,. The second electronic device captures the second image and captures an image of the object from the second image, and receives the first image from the first electronic device. If the second vertical ratio between the first vertical resolution and the second vertical resolution is greater than the second horizontal ratio between the first horizontal resolution and the second horizontal resolution, the second electronic device scales the first image according to the second vertical ratio and The scaled first image is displayed on the second electronic device in combination with the image of the object. If the second vertical ratio between the first vertical resolution and the second vertical resolution is smaller than the second horizontal ratio between the first horizontal resolution and the second horizontal resolution, the second electronic device scales the first image according to the second horizontal ratio and The scaled first image is displayed on the second electronic device in combination with the image of the object.

In an embodiment of the present invention, the second electronic device positions the first center point of the scaled first image on the second center point of the object image. Second electricity The sub-device receives a drag operation to drag the first image to generate a background displacement amount. The second electronic device displays the first image on the second electronic device according to the second center point and the background displacement amount.

Based on the above, the image combining method and the image combining system of the present invention capture a first image (for example, a main scene) in a first electronic device and capture a second image in a second electronic device and extract an object image from the second image ( (For example, people). When the first electronic device receives an object image from the second electronic device, the object image is scaled according to the smaller horizontal and vertical ratios of the resolutions of the two electronic devices, and the scaled object image is displayed in combination with the first image. On the first electronic device. When the second electronic device receives the first image from the first electronic device, the first electronic image is scaled according to the larger horizontal ratio and vertical ratio of the resolution of the two electronic devices, and the scaled first image is combined with the object The image is displayed on the second electronic device. In this way, images of different resolutions can be combined with each other at an appropriate ratio. In addition, the user can also use the first electronic device to drag the received image of the object, or use the second electronic device to drag the received first image to achieve a better image combining effect.

In order to make the above features and advantages of the present invention more comprehensible, embodiments are hereinafter described in detail with reference to the accompanying drawings.

100‧‧‧Image combination system

110‧‧‧The first electronic device

120‧‧‧Second electronic device

S201, S203, S205, S207, S209, S211‧‧‧ Steps of image combination method

300‧‧‧ first image

400‧‧‧Second image

Xa‧‧‧first horizontal resolution

Ya‧‧‧first vertical resolution

Xb‧‧‧second horizontal resolution

Yb‧‧‧second vertical resolution

500‧‧‧ object image

600‧‧‧ zoomed object image

S901, S903, S905, S907, S909, S911‧‧‧ Steps of image combination method

1000‧‧‧ first image after zooming

1200‧‧‧ full image

FIG. 1 is a block diagram of an image combining system according to an embodiment of the present invention.

FIG. 2 is a flowchart of an image combining method according to an embodiment of the present invention.

3 to 8 are examples of an image combining method according to an embodiment of the present invention.

FIG. 9 is a flowchart of an image combining method according to another embodiment of the present invention.

10 to 12 are examples of an image combining method according to another embodiment of the present invention.

FIG. 1 is a block diagram of an image combining system according to an embodiment of the present invention.

Referring to FIG. 1, the image combining system 100 of the present invention includes a first electronic device 110 and a second electronic device 120. The second electronic device 120 may be coupled to the first electronic device 110 by a wired or wireless manner. Both the first electronic device 110 and the second electronic device 120 may include a communication chip (not shown in the figure), a storage device (not shown in the figure), and a processor (not shown in the figure), where the storage device A photographing application program can be stored, which can provide the first electronic device 110 and the second electronic device 120 to instantly transfer photos or videos taken by each other to each other.

The communication chip can support Global System for Mobile communication (GSM), Personal Handy-phone System (PHS), Code Division Multiple Access (CDMA) system, wideband code division Multiple Access (Wideband Code Division Multiple Access (WCDMA) system, Long Term Evolution (LTE) system, Worldwide Interoperability for Microwave Access (WiMAX) system, Wireless Fidelity, Wi-Fi) system or Bluetooth signal transmission components.

The storage device can be any type of fixed or removable Random Access Memory (RAM), Read-Only Memory (ROM), flash memory, hard disk ( Hard Disk Drive (HDD), Solid State Drive (SSD) or similar components or a combination of the above components.

The processor may be a central processing unit (CPU), or other programmable general purpose or special purpose microprocessor (Microprocessor), digital signal processor (DSP), programmable Controller, Application Specific Integrated Circuit (ASIC) or other similar components or a combination of the above components.

FIG. 2 is a flowchart of an image combining method according to an embodiment of the present invention.

Please refer to FIG. 2. In step S201, a first electronic device 110 captures a first image and receives an object image from a second electronic device 120. The first electronic device 110 has a first horizontal resolution and a first vertical resolution. The second electronic device 120 has a second horizontal resolution and a second vertical resolution. For example, the first image 300 of FIG. 3 can be captured by the first electronic device 110. The first image 300 has a first horizontal resolution Xa and a first vertical resolution Ya of the first electronic device 110. The second image 400 of FIG. 4 can be captured by the second electronic device 120. The second image 400 has a second horizontal resolution Xb and a second vertical resolution Yb of the second electronic device 120. After the second electronic device 120 captures the second image 400, the second electronic device 120 may remove the background of the second image 400 by using any background removal algorithm, so as to An object image 500 is generated. As shown in FIG. 5, the resolution of the object image 500 is the same as that of the second image 400. Therefore, the first electronic device 110 can receive the object image 500 from the second electronic device 120.

In step S203, it is determined whether a first longitudinal ratio of the second longitudinal resolution and the first longitudinal resolution is smaller than a first lateral ratio of the second lateral resolution and the first lateral resolution. For example, the first electronic device 110 may determine whether the first vertical ratio Yb / Ya is smaller than the first horizontal ratio Xb / Xa.

If the first vertical ratio is smaller than the first horizontal ratio, in step S205, the first electronic device 110 scales the image of the object according to the first vertical ratio.

If the first vertical ratio is greater than the first horizontal ratio, in step S207, the first electronic device 110 scales the image of the object according to the first horizontal ratio. For example, in this example, Yb is approximately equal to Ya but Xb is significantly smaller than Xa. Therefore, the first electronic device 110 determines that Yb / Ya is greater than Xb / Xa, and scales the object image 500 according to Xb / Xa. In this example, the first electronic device 110 divides the second horizontal resolution Xb and the second vertical resolution Yb of the object image 500 by Xb / Xa to obtain a scaled object image 600, as shown in FIG. 6. Therefore, the horizontal resolution of the scaled object image 600 is Xa, and the vertical resolution is Yb * Xa / Xb.

It is worth noting that when the first vertical ratio is equal to the first horizontal ratio, the first electronic device 110 may not perform the operation of zooming the image of the object.

In step S209, the second electronic point of the scaled object image is positioned on the first electronic point of the first image by the first electronic device 110. For example, in FIG. 7, the first electronic device 110 will center the center of the zoomed object image 600. The point is positioned on the center point of the first image 300 to combine the scaled object image 600 and the first image 300.

In step S211, the first electronic device 110 receives a drag operation to drag the object image to generate an object displacement amount, and the first electronic device combines the scaled object image with the first according to the first center point and the object displacement amount. The image is displayed on the first electronic device 110. For example, when the user moves the zoomed object image 600 from the position in FIG. 7 to the position in FIG. 8 through the (Mxb, Myb) displacement amount, the user is satisfied with the combined result and can control the first electron The device 110 stores the image combining result. The above example uses the displacement of the upper left corner of the scaled object image 600 as an illustration. It should be understood that the displacement of the upper left corner of the scaled object image 600 is equivalent to the displacement of its center point.

It is worth noting that after the user completes the displacement of the zoomed object image 600, in addition to storing the image as a photo, the image can also be recorded.

FIG. 9 is a flowchart of an image combining method according to another embodiment of the present invention.

Referring to FIG. 9, in step S901, a second electronic device 120 captures a second image and captures an object image from the second image, and receives a first image from the first electronic device 110. The second electronic device 120 The first electronic device 110 has a second horizontal resolution and a second vertical resolution. For example, the second image 400 of FIG. 4 can be captured by the second electronic device 120. The second image 400 has a second horizontal resolution Xb and a second vertical resolution Yb of the second electronic device 120. Photographing the second image 400 on the second electronic device 120 After that, the second electronic device 120 may remove the background of the second image 400 using any background removal algorithm to generate an object image 500. As shown in FIG. 5, the resolution of the object image 500 and the second image 400 are as follows. the same. The first image 300 of FIG. 3 can be captured by the first electronic device 110. The first image 300 has a first horizontal resolution Xa and a first vertical resolution Ya of the first electronic device 110. The second electronic device 120 may receive the first image 300 from the first electronic device 110.

In step S903, it is determined whether a second longitudinal ratio of the first longitudinal resolution and the second longitudinal resolution is greater than a second lateral ratio of the first lateral resolution and the second lateral resolution. For example, the second electronic device 120 may determine whether the second vertical ratio Xa / Xb is greater than the second horizontal ratio Ya / Yb.

If the second vertical ratio of the first vertical resolution and the second vertical resolution is greater than the second horizontal ratio of the first horizontal resolution and the second horizontal resolution, in step S905, the second electronic device 120 according to the second vertical ratio The first electronic image is scaled and displayed in combination with the object image on the second electronic device 120.

If the second vertical ratio of the first vertical resolution and the second vertical resolution is smaller than the second horizontal ratio of the first horizontal resolution and the second horizontal resolution, in step S907, the second electronic device 120 according to the second horizontal ratio The first electronic image is scaled and displayed in combination with the object image on the second electronic device 120. For example, in this example, Xa is significantly larger than Xb, but Ya is approximately equal to Yb. Therefore, the second electronic device 120 determines that Xa / Xb is larger than Ya / Yb, and scales the first image 300 according to Xa / Xb. In this example, the second electronic device 120 divides the first horizontal resolution Xa and the second vertical resolution Ya of the first image 300 by Xa / Xb to obtain A zoomed first image 1000 is obtained, as shown in FIG. 10. Therefore, the horizontal resolution of the scaled first image 1000 is Xb, and the vertical resolution is Ya * Xb / Xa.

In step S909, the second electronic device 120 is used to locate the first center point of the scaled first image on the second center point of the object image. For example, the second electronic device 120 combines and displays the scaled first image 1000 and the object image 500 at their respective center points and displays them on the second electronic device 120, as shown in FIG. 11.

In step S911, the second electronic device 120 receives the drag operation to drag the first image to generate a background displacement amount, and the second electronic device displays the first image on the second according to the second center point and the background displacement amount. Electronic device 120. For example, the second electronic device 120 may further provide a user to perform a drag operation on the zoomed first image 1000 to obtain a combined image desired by the user, as shown in FIG. 12.

It is worth noting that in the display range of the second electronic device 120, that is, the area corresponding to the object image 500, the area other than the scaled first image 1000 can be left black. When the user saves the image, the first The two electronic devices 120 may store only the portion of the scaled first image 1000 displayed on the second electronic device 120 and the portion of the object image 500 where the object overlaps with the scaled first image 1000 to obtain a complete image 1200.

In summary, the image combining method and image combining system of the present invention will capture a first image (eg, a main scene) on a first electronic device, and capture a second image on a second electronic device and extract an object from the second image. Images (for example, people). When the first electronic device receives the object image from the second electronic device, the object image is scaled according to the smaller horizontal ratio and vertical ratio of the resolution of the two electronic devices, and The scaled object image is displayed on the first electronic device in combination with the first image. When the second electronic device receives the first image from the first electronic device, the first electronic image is scaled according to the larger horizontal ratio and vertical ratio of the resolution of the two electronic devices, and the scaled first image is combined with the object The image is displayed on the second electronic device. In this way, images of different resolutions can be combined with each other at an appropriate ratio. In addition, the user can also use the first electronic device to drag the received image of the object, or use the second electronic device to drag the received first image to achieve a better image combining effect.

Although the present invention has been disclosed as above with the examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some modifications and retouching without departing from the spirit and scope of the present invention. The protection scope of the present invention shall be determined by the scope of the attached patent application.

Claims (10)

An image combining method includes: shooting a first image by a first electronic device, and receiving an image of an object from a second electronic device, wherein the first electronic device has a first horizontal resolution and a first vertical Resolution and the second electronic device has a second horizontal resolution and a second vertical resolution; if a first vertical ratio of the second vertical resolution to the first vertical resolution is smaller than the second horizontal resolution A first horizontal ratio to the first horizontal resolution, the first electronic device scales the image of the object according to the first vertical ratio and displays the scaled image of the object in combination with the first image on the first electronic device ; And if the first longitudinal ratio of the second longitudinal resolution and the first longitudinal resolution is greater than the first lateral ratio of the second lateral resolution and the first lateral resolution, the first electronic device is based on The first lateral ratio scales the image of the object and displays the scaled image of the object in combination with the first image on the first electronic device. The image combining method according to item 1 of the scope of patent application, further comprising: locating a second center point of the object image after zooming to a first center point of the first image by the first electronic device. ; Receiving a drag operation by the first electronic device to drag the object image to generate an object displacement amount; and using the first electronic device to scale the object image according to the first center point and the object displacement amount Displayed on the first electronic device. The image combining method according to item 2 of the scope of patent application, wherein the first center point is a center point of a horizontal axis and a vertical axis of the first image, and the second center point is a horizontal axis of the image of the object after scaling. The center point of the axis and the vertical axis. An image combining method includes: capturing a second image by a second electronic device and capturing an image of an object from the second image, and receiving a first image from a first electronic device, wherein the second electronic device The device has a second horizontal resolution and a second vertical resolution and the first electronic device has a first horizontal resolution and a first vertical resolution; if the first vertical resolution and the second vertical resolution If a second longitudinal ratio of is greater than a second lateral ratio of the first lateral resolution and the second lateral resolution, the second electronic device scales the first image according to the second longitudinal ratio and The first image is displayed on the second electronic device in combination with the object image; and if the second longitudinal ratio of the first vertical resolution to the second vertical resolution is smaller than the first horizontal resolution and the second horizontal resolution The second lateral ratio, the second electronic device scales the first image according to the second lateral ratio and displays the scaled first image in combination with the object image on the second electronic device. The image combining method according to item 4 of the scope of patent application, further comprising: positioning a first center point of the first image after scaling by a second electronic device on a second center point of the object image ; Receiving a drag operation by the second electronic device to drag the first image to generate a background displacement amount; and displaying the first image by the second electronic device according to the second center point and the background displacement amount At the second electronic device. An image combining system includes: a first electronic device; and a second electronic device coupled to the first electronic device, wherein the first electronic device captures a first image and receives a first image from the second electronic device. Object image, wherein the first electronic device has a first horizontal resolution and a first vertical resolution and the second electronic device has a second horizontal resolution and a second vertical resolution. A first vertical ratio between the first horizontal resolution and the first vertical resolution is smaller than a first horizontal ratio between the second horizontal resolution and the first horizontal resolution, the first electronic device scales the object according to the first vertical ratio Image and display the scaled image of the object in combination with the first image on the first electronic device, if the first vertical ratio of the second vertical resolution to the first vertical resolution is greater than the second horizontal resolution and The first lateral ratio of the first lateral resolution, the first electronic device scales the object image according to the first lateral ratio and combines the scaled object image with the first image Displaying the first electronic device. The image combining system according to item 6 of the patent application scope, wherein the first electronic device locates a second center point of the object image after zooming on a first center point of the first image, and the first The electronic device receives a drag operation to drag the object image to generate an object displacement amount. The first electronic device displays the scaled image of the object on the first electronic device according to the first center point and the object displacement amount. The image combining system according to item 7 of the scope of patent application, wherein the first center point is a center point of the horizontal axis and the vertical axis of the first image, and the second center point is a horizontal axis of the object image after scaling. The center point of the axis and the vertical axis. The image combining system according to item 6 of the patent application scope, wherein the second electronic device captures a second image and captures the object image from the second image, and receives the first image from the first electronic device If a second longitudinal ratio between the first vertical resolution and the second vertical resolution is greater than a second horizontal ratio between the first horizontal resolution and the second horizontal resolution, the second electronic device according to the The second longitudinal ratio scales the first image and displays the scaled first image in combination with the object image on the second electronic device. If the first longitudinal resolution and the second longitudinal resolution are the second longitudinal ratio Less than the second lateral ratio between the first lateral resolution and the second lateral resolution, the second electronic device scales the first image according to the second lateral ratio and combines the scaled first image with the object The image is displayed on the second electronic device. The image combining system according to item 9 of the scope of patent application, wherein the second electronic device locates a first center point of the first image after scaling on a second center point of the object image, and the second The electronic device receives a drag operation to drag the first image to generate a background displacement amount, and the second electronic device displays the first image on the second electronic device according to the second center point and the background displacement amount.