WO2017210905A1

WO2017210905A1 - Photomontage method, ultrasonic device, and terminal

Info

Publication number: WO2017210905A1
Application number: PCT/CN2016/085329
Authority: WO
Inventors: 廖怡白
Original assignee: 深圳迈瑞生物医疗电子股份有限公司
Priority date: 2016-06-08
Filing date: 2016-06-08
Publication date: 2017-12-14
Also published as: CN107708572A

Abstract

A photomontage method, ultrasonic device, and terminal. The photomontage method comprises: acquiring at least a first image (S11), wherein the first image is an ultrasonic image; acquiring at least a second image (S13). wherein the second image is generated by imaging using a photosensitive element; and performing image montage with the first image and the second image (S15). The first image, which is an ultrasonic image, is acquired and undergoes a photomontage process with a second image. The invention thereby realizes a technical effect where an unborn fetus can be added to a group photograph of other family members.

Description

Description: A photo synthesis method, an ultrasonic device, and a terminal

[0001] The present invention relates to the field of ultrasonic phase formation, and in particular to a photo synthesis method, an ultrasonic device, and a terminal.

BACKGROUND OF THE INVENTION

[0003] People's desire to leave happiness is through history. People used to use artificial painting to preserve the photos of themselves and their families. However, because of the high cost and lack of manpower, Has not been very popular. In 1826, French scientist Niepus took a photo in his home by exposing it on a piece of asphalt metal in a pinhole camera. This is the first photo in the modern sense. A new era of camera photography.

[0004] With the development of technology, people are now taking pictures more and more, especially with the emergence of mobile terminals with camera functions, such as smartphones and tablets. However, although the resolution of the terminal for photographing is getting higher and higher, and the image quality is getting better and better, it has not been able to solve a technical problem that the fetus cannot meet the requirements of the parents and their photographs before they are born in the mother's palace.

SUMMARY OF THE INVENTION

According to a first aspect, an embodiment provides a photo composition method, including:

Obtaining at least one first image, wherein the first image is an ultrasound image;

Obtaining at least one second image, wherein the second image is a photo imaged by the photosensitive element;

[0009] synthesizing at least one composite photo using the at least one first image and the at least one second image.

[0010] According to a second aspect, an embodiment provides an ultrasound apparatus, including:

[0011] an ultrasound apparatus body, configured to acquire at least one first image, wherein the first image is an ultrasound imaging image

[0012] a second image acquisition module, configured to acquire at least one second image, wherein the second image is a photo imaged by the photosensitive element;

And an image synthesizing module, configured to be coupled to the first image acquiring module and the second image acquiring module, to synthesize at least one composite photo using the at least one first image and the at least one second image.

[0014] According to a third aspect, a terminal is provided in an embodiment, including: [0015] a first image acquisition module, configured to acquire at least one first image, where the first image is an ultrasound image;

[0016] a second image acquisition module, configured to acquire at least one second image, wherein the second image is a photo imaged by the photosensitive element;

And an image synthesizing module, coupled to the first image acquiring module and the second image acquiring module, configured to synthesize at least one composite photo using the at least one first image and the at least one second image.

[0018] The photo composition method, the ultrasound apparatus, and the terminal according to the above embodiments, wherein the at least one first image is an ultrasound image, and the at least one first image is at least one The two images perform image synthesis, so that the technical effect of taking the unborn fetus and the fetus relatives together can be achieved.

BRIEF DESCRIPTION OF THE DRAWINGS

1 is a schematic flow chart of a photo synthesizing method according to an embodiment of the present application;

2 is a schematic structural view of an ultrasonic device according to an embodiment of the present application;

3 is a schematic structural view of an ultrasonic device according to another embodiment of the present application;

4 is a schematic structural diagram of a terminal according to an embodiment of the present application;

5 is a schematic structural diagram of a terminal according to another embodiment of the present application.

DETAILED DESCRIPTION

[0026] In some embodiments of the present application, an ultrasound device commonly used in medical diagnosis can be used to perform ultrasound imaging on a prenatal fetus, and a modern communication communication technology is used to transmit a prenatal fetal picture collected by the ultrasound device to, for example, an intelligent device. On the mobile phone, computer or tablet terminal, image processing technology is used to synthesize the photos of the fetal relatives (such as parents) on the terminal together with the pictures of the prenatal fetus to form a photo of the fetus and the parents. In addition, the terminal receives a fetal picture in a variety of ways, such as receiving a fetal photo transmitted by the ultrasonic device through wired or wireless communication, or copying the fetal photo of the ultrasonic device to a mobile storage device (such as a USB flash drive and an SD card). Etc.), the terminal reads the mobile storage device pre-stored with the fetal photo to obtain the fetal photo for subsequent image synthesis.

[0027] In some other technical solutions, the device for image synthesis may also be integrated into the ultrasound device, such that the ultrasound device utilizes a fetal photo image that is itself imaged, and a photo of the fetal relative obtained through wired or wireless communication, in the ultrasound Image synthesis is performed on a device for synthesizing related images in the device. Of course, ultrasound equipment There are various ways to obtain photos of the fetal relatives, such as the above-mentioned photos taken by a terminal (such as a smartphone, a computer, a tablet, etc.) with a camera function through wired or wireless communication, or a photo of a fetal relative of the terminal. Copying to the mobile storage device, the ultrasound device reads the mobile storage device pre-stored with the photo of the fetal relatives to obtain related photos, and even integrates the related camera function device on the ultrasonic device, so that the ultrasonic device itself can perform Ultrasound imaging generates prenatal photo of the fetus, and photos of the fetal relatives can also be generated by the associated integrated camera device.

[0028] The following is further illustrated by several embodiments and related drawings.

[0029]

[0030] Example 1 :

Referring to FIG. 1, this embodiment discloses a photo synthesizing method, which includes the following steps.

[0032] a first image obtaining step S11, acquiring at least one first image, wherein the first image is an ultrasound imaging image, for example, the first image may be an ultrasound image of an unborn fetus obtained by an ultrasound imaging technique; or In other embodiments, based on the image that the user desires to perform photo synthesis, the first image may also be any other ultrasound image obtained by ultrasound imaging techniques, eg, ultrasound and/or other forms of ultrasound other than the fetus. image. In a preferred embodiment, step S11 acquires a first image.

[0033] In an embodiment of the invention, the specific method of acquiring the first image may be a commonly used ultrasound imaging method. For example, the ultrasonic imaging system can transmit ultrasonic waves to the scanning object and receive ultrasonic echoes, obtain ultrasonic echo signals, and perform related processing on the obtained ultrasonic echo signals, thereby obtaining an ultrasonic image of the scanned object (for example, B). Images, color blood flow images, M-mode images, 3D images, etc.). At least a portion of these ultrasound images may be selected as the aforementioned first image. These specific methods are not further detailed here.

[0034] The second image obtaining step S13, acquiring at least one second image, wherein the second image is a photo imaged by the photosensitive element, for example, the second image may be a photo taken by the camera, which may be the above-mentioned fetus The photos of relatives (such as parents) can also be optical photos or optical images that any other user would like to use for photo synthesis. In a preferred embodiment, step S13 acquires a second image. It should be noted that step S11 and step S13 may be performed simultaneously or sequentially, and the sequence of the two may be exchanged. [0035] The image synthesis step S15: performing image synthesis using at least one first image acquired in step S11 and at least one second image acquired in step S13, to obtain at least one composite photo. The image synthesis technique used in step S15 may be an existing image synthesis technique. When the first image acquired in step S11 is an ultrasound image of an unborn fetus, step S13 is a photo of a fetal relative such as a parent, and the image synthesized in step S15 is a photograph of the fetus and its relatives.

In a preferred embodiment, the photo composition method of the present embodiment further includes a step S17, a synthetic image saving step, that is, the image synthesized in step S15 is saved.

[0037] The following is a few examples to further illustrate the photo composition method of the present embodiment.

[0038] In a specific embodiment, the photo composition method can be implemented on an ultrasound device.

[0039] the step S1 l of acquiring the first image is implemented. In an embodiment, the first image may be directly acquired by performing ultrasound imaging by the ultrasound device, and then the first image is directly applied to the image synthesis in step S15. For example, after receiving the instruction to obtain the first image, the ultrasound device activates the corresponding function to perform ultrasound imaging to generate a first image. In an embodiment, the ultrasound device may also store a plurality of super-images in advance, Before the image synthesizing step S15, the pre-stored first image is read, for example, after the ultrasound device receives the read pre-stored instruction, the first image is read therefrom for use in step S15.

[0040] The step S13 of acquiring the second image is implemented. In an embodiment, a module having an imaging function may be integrated on the ultrasound device, and the ultrasound device performs the photo by calling the camera in the module with the camera function. Shooting, thereby acquiring the second image to be directly applied to the subsequent image synthesizing step S15; in an embodiment, the ultrasonic device may also read the pre-stored in the mobile storage device (such as a USB flash drive and an SD card) connected thereto. The second image; in an embodiment, the ultrasonic device may also establish a communication connection with a camera having a camera function (such as a smart phone, a computer, a tablet, etc.), and receive the second transmission by the terminal through a wired or wireless communication. image.

[0041] The ultrasound device further synthesizes the acquired first image and the second image, for example, synthesizes the unborn fetal ultrasound photo with the photo of the parent, and synthesizes a photo with the fetus and its parents. In one embodiment, the ultrasound device can also save the picture for display by the parent who is exported to the fetus or for display on the display connected to the ultrasound device.

[0042] In a specific embodiment, the photo synthesizing method can be implemented on a terminal, and the terminal can be intelligent. Mobile phones, computers, tablets, etc., let's take a smartphone as an example.

[0043] implementing the step S1 l of acquiring the first image, in an embodiment, the smart phone may read the first image pre-stored in the mobile storage device (such as a USB flash drive and an SD card, etc.) connected thereto; In an embodiment, the smart phone can establish a communication connection with the ultrasound device, and receive the second image sent by the ultrasound device through wired or wireless communication, for example, the smart phone sends an instruction to the ultrasound device to retrieve the second image, the ultrasound device In response, return the requested second image.

[0044] The step S13 of acquiring the second image is implemented. In an embodiment, before the image synthesizing step S15, the smartphone calls the camera to perform photo shooting to obtain the second image. For example, the smart phone receives the photographing instruction. After that, the camera is called to take a photo; in another embodiment, the smart phone can also read the second picture stored in advance.

[0045] The smart phone further synthesizes the acquired first image and the second image, for example, synthesizes the unborn fetal ultrasound photo with the photo of the parent, and synthesizes a photo with the fetus and its parents. In one embodiment, the smartphone can also save the photo for the parent of the fetus to keep or for the smartphone to call for display.

The photo synthesizing method of the present embodiment is characterized in that, by acquiring at least one first image, wherein the first image is an ultrasound imaging image, and performing image synthesis on the at least one first image and the at least one second image, Achieve the technical effect of taking an unborn fetus and a fetus.

[0047]

Example 2:

2 and FIG. 3, the present embodiment discloses an ultrasound apparatus including an ultrasound apparatus body 101, a second image acquisition module 103, and an image synthesis module 105. In a preferred embodiment, An image saving module 107 is included. The details are described below.

[0050] The ultrasound apparatus body 101 is configured to acquire at least one first image, wherein the first image is an ultrasound imaging picture.

In an embodiment, the ultrasound apparatus body 101 can be a color Doppler ultrasound diagnostic apparatus.

[0051] The second image acquisition module 103 is configured to acquire at least one second image, wherein the second image is a photo imaged by the photosensitive element. In an embodiment, the second image acquisition module includes a camera module 103a and/or a communication module 103b and/or a read module 103c. The camera module 103a may include a camera, and the camera module 103a is used to call its camera to perform photo shooting to acquire a second image. The communication module 103b is used to pass The line or wireless communication receives the second image. For example, the communication module 103b on the ultrasound device establishes communication with a smartphone having an imaging function to receive the second image transmitted by the smartphone. The reading module 103c is configured to read a second image pre-stored in the mobile storage device connected to the ultrasound device, and the mobile storage device may be a USB flash drive, an SD card, or the like.

The image synthesizing module 105 is connected to the first image acquiring module 101 and the second image acquiring module 103 for performing image synthesizing on the at least one first image and the at least one second image.

[0053] The image saving module 107 is configured to save an image synthesized by the image synthesizing module 105. In one embodiment, the photos saved in the image saving module 107 can be exported by the user or can be called by the relevant display to display the viewing.

[0054] The operation method and function of the ultrasonic device will be described below by way of an example.

[0055] The ultrasound apparatus main body 101 ultrasonically images a mother to obtain an ultrasound photograph of the fetus in the uterus.

The second image acquisition module 103 acquires a photo of a relative of the fetus, such as a mother and a father. Specifically, the ultrasound device can activate the camera module 103a, and the camera module 103a invokes its camera to take a picture of the mother father to obtain a second image; or, the ultrasound device The communication module 103 can establish communication with the mother or the father's smart phone, receive the photo of the mother father sent from the smart phone, thereby obtaining the second image; or the mother or the father will have a mobile storage device such as a U disk with its own photo. The ultrasound device is inserted, and the ultrasound device reads the photo through the reading module 103c to obtain a second image. Finally, the image synthesizing module 105 synthesizes the fetus photo acquired by the ultrasound apparatus main body 101 and the mother father photo acquired by the second image acquisition module 103 to obtain a photograph of the mother's father and the unborn fetus. The image storage module 107 saves the combination. In one embodiment, the ultrasound device transmits the combination to the smartphone of the relative of the fetus via the associated mobile storage device or wired wireless communication.

[0056]

Example 3:

[0058] Referring to FIG. 4 and FIG. 5, this embodiment discloses a terminal, which includes a first image acquisition module 201, a second image acquisition module 203, and an image synthesis module 205. In a preferred embodiment, An image saving module 207 is also included. The details are described below.

[0059] The first image obtaining module 201 is configured to acquire at least one first image, wherein the first image is an ultrasound image. In an embodiment, the first image acquisition module 201 includes a communication module 201a and/or a first reading module 201b. The communication module 201a is configured to receive the first image by wired or wireless communication, for example, on the terminal The communication module 201a receives communication with the ultrasound device having the ultrasound imaging function to receive the first image transmitted by the ultrasound device. The first reading module 201b is configured to read a first image pre-stored in the mobile storage device connected to the terminal, and the mobile storage device may be a U disk and an SD card, for example, a U disk storing the first image and The terminal is connected, and the first reading module 201b thus reads the first image in the USB flash drive.

[0060] The second image acquisition module 203 is configured to acquire at least one second image, wherein the second image is a photo imaged by the photosensitive element. In an embodiment, the second image acquisition module 203 includes a camera module 203a and/or a second reader module 203b. The camera module 203a may include a camera, and the camera module 203a is configured to call its camera to perform photo shooting to acquire a second image. The second reading module 203b is configured to read a second image pre-stored in the mobile storage device connected to the terminal or the storage device built in the terminal. The mobile storage device may be a USB flash drive, an SD card, etc., for example, the SD card stores a second image, after the SD card is inserted into the terminal, the terminal reads the second image in the SD card through the second reading module 203b; or, the terminal stores the second image in advance, and when the image is synthesized, the terminal passes the The second reading module 203b reads the second image stored therein.

The image synthesizing module 205 is coupled to the first image acquiring module 201 and the second image acquiring module 203 for performing image synthesizing on the at least one first image and the at least one second image.

[0062] The image saving module 207 is for holding an image synthesized by the image synthesizing module 205. In one embodiment, the photos saved in the image saving module 207 can be exported by the user or can be called by the relevant display to display the viewing.

[0063] The terminal of this embodiment may be a smart phone, a computer or a tablet. Let's take an example of a smartphone as an example.

[0064] The smartphone acquires the first image, such as an ultrasound photo of the unborn fetus, by the first image acquisition module 201. Specifically, the smartphone establishes communication with the ultrasound device having the ultrasound imaging function through the communication module 201a, thereby receiving the fetus Alternatively, the user inserts a mobile storage device such as an SD card storing the ultrasound photos of the fetus into the smart phone, and the smart phone reads the ultrasonic photo through the first reading module 201b to obtain the first image. The second image acquisition module 203 acquires a second image, such as a photo of a relative of the fetus (such as a parent), and specifically, when the photo is to be synthesized, the smartphone takes a photo of the parent of the fetus through the camera module 203a to obtain a photo of the parent, used by the image synthesis module 205 to synthesize the image with the fetal ultrasound photo, to obtain a photo; or, there is a time, wisdom The mobile phone itself stores a photo of the parent of the fetus, and the smart phone can directly read the photo of the parent of the fetus through the second reading module 203b. Finally, the image synthesis module 205 synthesizes the fetal ultrasound photos acquired by the first image acquisition module 201 and the photos of the parents to obtain a photo of the fetus and its parents. The image saving module 207 saves the photos. In one embodiment, the smartphone calls the image saved by the image saving module 207 for display for viewing.

[0065]

The present invention has been described above with reference to specific examples, which are merely used to help the understanding of the invention and are not intended to limit the invention. Variations to the above specific embodiments may be made by those skilled in the art in light of the teachings of the present invention.

technical problem

Problem solution

Advantageous effects of the invention

Claims

claims

[Claim 1] A photo synthesis method, characterized in that it includes:

Acquire at least a first image, wherein the first image is an ultrasound imaging picture; Acquire at least a second image, wherein the second image is a photo imaged by a photosensitive element;

Composite at least one composite photo using the at least one first image and the at least one second image

[Claim 2] The photo synthesis method of claim 1, wherein obtaining the first image includes performing ultrasonic imaging with an ultrasonic device to obtain the first image; and/or reading the pre-stored image. first image; and/or,

The first image is received via wired or wireless communication.

[Claim 3] The photo synthesis method of claim 1, wherein acquiring the second image includes calling a camera to take photos to acquire the second image; and/or reading the pre-stored image. second image; and/or,

The second image is received via wired or wireless communication.

[Claim 4] The photo synthesis method according to any one of claims 1 to 3, characterized in that

, further comprising: saving the composite photo.

[Claim 5] An ultrasonic device, characterized in that it includes:

The main body of the ultrasound equipment is used to acquire at least a first image, where the first image is an ultrasound imaging picture;

A second image acquisition module, configured to acquire at least a second image, wherein the second image is a photo imaged by a photosensitive element;

An image synthesis module, connected to the first image acquisition module and the second image acquisition module, is used to synthesize at least one composite photo using the at least one first image and the at least one second image.

[Claim 6] The ultrasound equipment according to claim 5, characterized in that, the second image acquisition module include:

Camera module, the camera module includes a camera, the camera module is used to call its camera to take photos to obtain the second image; and/or, a communication module, used to receive the second image through wired or wireless communication. image; and/or, a reading module, configured to read the second image pre-stored in a mobile storage device connected to the ultrasound equipment.

[Claim 7] The ultrasound equipment according to claim 5 or 6, further comprising an image saving module

, used to save the composite photo.

[Claim 8] A terminal, characterized in that it includes:

A first image acquisition module, configured to acquire at least a first image, where the first image is an ultrasound imaging picture;

An image synthesis module, connected to the first image acquisition module and the second image acquisition module, is used to synthesize at least one composite photo of the at least one first image and the at least one second image.

[Claim 9] The terminal of claim 8, wherein the first image acquisition module includes a communication module for receiving the first image through wired or wireless communication; and/or, a first reading A retrieval module is configured to read the first image pre-stored in a mobile storage device connected to the terminal.

[Claim 10] The terminal according to claim 8 or 9, characterized in that the second image acquisition module includes:

Camera module, the camera module includes a camera, the camera module is used to call its camera to take photos to obtain the second image; and/or, a second reading module, used to read the data connected to the terminal. The second image is pre-stored in a mobile storage device or a storage device built into the terminal.

[Claim 11] The terminal according to any one of claims 8 to 10, further comprising: image saving A storage module is used to save the composite photo.

[Claim 12] The terminal according to any one of claims 8 to 11, characterized in that the terminal is a smart phone, a computer or a tablet.