WO2018119632A1 - 图像处理的方法、装置和设备 - Google Patents

图像处理的方法、装置和设备 Download PDF

Info

Publication number
WO2018119632A1
WO2018119632A1 PCT/CN2016/112302 CN2016112302W WO2018119632A1 WO 2018119632 A1 WO2018119632 A1 WO 2018119632A1 CN 2016112302 W CN2016112302 W CN 2016112302W WO 2018119632 A1 WO2018119632 A1 WO 2018119632A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
motion
light source
motion trajectories
frame image
Prior art date
Application number
PCT/CN2016/112302
Other languages
English (en)
French (fr)
Inventor
封旭阳
赵丛
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2016/112302 priority Critical patent/WO2018119632A1/zh
Priority to CN201680002775.XA priority patent/CN107077720A/zh
Publication of WO2018119632A1 publication Critical patent/WO2018119632A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformation in the plane of the image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces

Definitions

  • Embodiments of the present invention relate to the field of communications and, more particularly, to methods, apparatus, and devices for image processing.
  • Photographic photography is a photographic work obtained by taking a long exposure mode of a shooting device to capture the trajectory of a light source. Any light source can be used as part of the imaging effect. Photographic photography is usually taken at night or in darkroom conditions. The darker the ambient light, the better the shooting effect. At present, photographic photography requires certain photographic techniques, and the professional requirements of users are high. Users may need to perform repeated paintings to obtain The desired image; during the light painting process, the user cannot observe the position of the user in the shooting picture in real time. Therefore, in the shooting process, the user often moves outside the shooting screen; in addition, at present, the user only has After the end of the light painting, you can see the image you have drawn. You can't see the image you have drawn in real time during the drawing process. Therefore, the user is blindly drawing in the process of light painting.
  • Embodiments of the present invention provide a method, an apparatus, and a device for image processing, which enable a user to preview a drawn light drawing image and improve flexibility of light painting photography.
  • a method for image processing comprising: sequentially acquiring N frames of images, wherein the N frames of images are images obtained by a photographing device capturing a motion of a light source under a preset background, wherein the N is greater than or An integer equal to 2; when acquiring the ith frame image in the N frame image, the light source image information in the ith frame image and the light source image information extracted from each frame image in the previous i-1 frame image Performing fusion to obtain a first motion trajectory of the light source and displaying a first motion trajectory of the light source, where 1 ⁇ i ⁇ N.
  • an apparatus for image processing comprising: an acquiring module, configured to sequentially acquire an N-frame image, where the N-frame image is an image obtained by a photographing device capturing a motion of a light source under a preset background, The N is an integer greater than or equal to 2; the processing module is configured to: when the acquiring module acquires the ith frame image in the N frame image, the source image information in the ith frame image and the previous i- The light source image information extracted in each frame image of the one-frame image is fused to obtain a first motion trajectory of the light source, where 1 ⁇ i ⁇ N; a display module for displaying the light source obtained by the processing module The first motion trajectory.
  • a third aspect provides an apparatus for image processing, including a processor, a memory, and an interaction interface, wherein the memory is configured to store an instruction, the processor is configured to invoke the instruction, and perform the following operations: sequentially acquiring N frames of images,
  • the N frame image is an image obtained by the photographing device capturing the motion of the light source under a preset background, and the N is an integer greater than or equal to 2; when acquiring the ith frame image in the N frame image,
  • the light source image information in the ith frame image is fused with the light source image information extracted from each frame image of the previous i-1 frame image to obtain a first motion trajectory of the light source, and displayed on the interaction interface.
  • a first motion trajectory of the light source where 1 ⁇ i ⁇ N.
  • the photographing device captures the motion of the light source under the preset background, and the photographing device sends the photographed image to the image processing device, and the image processing device sequentially receives the N frames of images sent by the photographing device in time sequence. And when receiving the ith frame image, the i-1 light source image information extracted from the previous i-1 frame image is merged with the light source image information in the ith frame image to obtain a first motion trajectory of the light source, and The first motion trajectory of the light source indicated by the previous i-frame image is displayed on the ith frame image.
  • the image processing apparatus can display the image drawn by the user, and the user can preview the image drawn by himself in the process of light painting, realizing the effect of drawing while watching, and helping the user to control the drawing process.
  • it is convenient for the user to adjust the later drawing strategy, which reduces the professional requirements of the user and improves the flexibility of the light painting photography.
  • Figure 1 is a schematic illustration of a photoplotting system applied in accordance with an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a method for image processing according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of displaying M motion trajectories when receiving an Nth frame image in the image processing method according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of motion trajectories of M light sources extracted in the image processing method according to an embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a method for image processing according to another embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of a method for image processing according to another embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a motion trajectory synthesis of a first background image and a light source in a method of image processing according to an embodiment of the present invention.
  • FIG. 8 is a schematic block diagram of an apparatus for image processing according to an embodiment of the present invention.
  • FIG. 9 is a schematic block diagram of an apparatus for image processing according to an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of a photographic imaging system 100 provided by an embodiment of the present invention. Since in the photographic photography, the trajectory of the light source is photographed, it is necessary to shoot at night or in low light conditions. Before taking the film, the user can first select the preset background 104 of the photo-photographing, that is, what kind of scene the user needs to use as the shooting scene of the photo-photographing, and the user can select the preset background according to his own wishes, where the tree and the grass are selected.
  • the preset background is only a schematic description, and those skilled in the art may select other scenes as the preset background, and no specific limitation is made herein. It is worth noting that when the user selects the preset background, the light source device with higher brightness or moving state is not suitable in the preset background.
  • Photographic photography requires a stable shooting picture, and the shaking of the picture can seriously affect the effect of the photographic photography. Therefore, the shooting device 101 can be mounted on a tripod before shooting.
  • the photographing device 101 may be an imaging device configured with a pan/tilt, and in the case of no tripod, the handheld device may be used for shooting, because the imaging device is configured with a pan/tilt, and the lens disposed on the pan/tilt can be made. It is stable and ensures that the picture will not shake, which also meets the requirements of photographic photography.
  • the user handheld light source device 102 draws according to his own wishes or drawing requirements.
  • the motion track 105 of the light source is generated, and the motion track 105 is the light drawing image drawn by the motion.
  • the light source device 102 is preferably easy to operate, that is, the user can easily turn it on or off, so as to avoid unnecessary smear in the image, and
  • the light source emits the color and brightness of the light, and the user can select it according to his own wishes or drawing requirements. It is worth noting that, in order to ensure the effect of lithography, the user needs to wear dark clothes, preferably black or dark blue, so that the reflection of the light emitted by the light source device on the user's clothes can be reduced and the light can be drawn. There is an afterimage in the image.
  • the photographing device 101 performs photographing, and the photographing device 101 transmits a photographed series of images to the image processing device 103, and the image processing device 103 can perform real-time on the image sent by the photographing device 101.
  • the image processing device 103 can display the image drawn by the user, that is, the motion trajectory 105 of the light source, on the interactive interface of the image processing device 103, so that the user can preview the image drawn by himself or herself in real time.
  • the photographing device 101 and the image processing device 103 can be connected by wired communication, wherein the wired communication communication method can use various wired communication protocols, such as Universal Serial Bus (USB), CAN, Ethernet, RS232, RS458, etc., can also be connected by wireless communication, wherein the wireless communication mode can be WIFI, Bluetooth, Near Field Communication (NFC), Radio Frequency Identification (RFID), etc.
  • the image may be transmitted to the image processing apparatus by wired or wireless communication, and is not specifically limited herein.
  • the image processing device may be a terminal device, and the terminal device may be installed with an application for performing image processing, and the application may process an image sent by the photographing device 101; or the image processing device may be
  • the photographing device 101 has an image processing function, and can directly process the image acquired by the photographing, and display the image drawn by the user, that is, the motion track of the light source, on the interactive interface thereof, and the user can view the interaction of the photographing device 101.
  • the interface implements a preview drawn image, but the embodiment of the present invention is not limited thereto.
  • the terminal device may be any type of external device having image receiving and processing functions.
  • user terminals may include, but are not limited to, smart phones/mobile phones, tablets, personal digital assistants (PDAs), laptop computers, desktop computers, media content players, video game stations/systems, virtual reality systems, augmented reality systems
  • Wearable devices eg, watches, glasses, gloves, headwear (eg, hats, helmets, virtual reality headsets, augmented reality headsets, head mounted devices (HMD), headbands), pendants, armbands, Leg ring, shoes, vest), gesture recognition device, microphone, any electronic device capable of providing or rendering image data, Or any other type of device.
  • the user terminal can be a handheld object.
  • the user terminal can be portable.
  • the user terminal can be carried by a human user. In some cases, the user terminal can be remote from the human user and the user can control the user terminal using wireless and/or wired communication.
  • the user terminal can include an interactive interface.
  • the interactive interface can be a screen.
  • the interactive interface may or may not be a touch screen, and the display may be a light emitting diode (LED) screen, an OLED screen, a liquid crystal display (LCD) screen, a plasma screen, or any other type of screen for displaying information.
  • the interactive interface may further include an input device, such as a keyboard, a joystick, a dial, etc., for receiving corresponding control commands.
  • FIG. 2 is a flowchart of a method for image processing according to an embodiment of the present invention, where the method includes:
  • N frame image is an image obtained by the photographing device capturing a motion of the light source under a preset background, where N is an integer greater than or equal to 2.
  • the shooting device can be an imaging device configured with a pan/tilt, wherein imaging The photographing lens of the device is disposed on the pan/tilt head, and the photographing direction of the image forming apparatus can be adjusted by controlling the pan/tilt head.
  • the pan/tilt head can stabilize the photographing lens and prevent the photographing screen of the image forming apparatus from being shaken, thereby being overcome A defect in the quality of the captured image caused by the shake of the shooting screen, and a stable image can be taken without a tripod.
  • the photographing apparatus can transmit each frame image obtained by photographing to the image processing apparatus in real time, and the image processing apparatus can sequentially receive each frame image transmitted by the photographing apparatus in the order of shooting time.
  • the image processing device may also acquire an image of the number of frames each time the camera obtains an image of a certain number of frames.
  • the terminal device may receive an N frame image sequentially transmitted by the photographing device.
  • the image processing device when the image processing device receives the image of the first i-1 frame, the image information of the light source indicating the light source may be extracted from each frame image, so that the image information of the i-1 light source may be extracted from the image of the i-1 frame.
  • the processing device may save the extracted first i-1 light source image information.
  • the image processing device may extract the first i-1 light source image information from the previous i-1 frame image.
  • the first motion trajectory may indicate a motion trajectory formed by the light source moving under a preset background, that is, a stencil image formed by a user illuminating, displaying the first motion trajectory in
  • a preset background that is, a stencil image formed by a user illuminating
  • the motion trajectory of the light source indicated by the previous i frame image can be simultaneously displayed on the ith frame image, so that the user can draw the formed light source.
  • the motion trajectories are all retained and displayed in real time, the user can hold the image processing device on the hand, and can see the image drawn by himself in real time through the interactive interface of the image processing device.
  • the light source image information of the ith frame image may refer to information of the light source image included in the ith frame image, and is used to indicate all information of the light source in the image, wherein the information may include location information of the light source, One or more of the transparency information, the brightness information, and the size of the light-emitting area of the light source are not specifically limited in the embodiment of the present invention.
  • the photographing device captures the motion of the light source under the preset background, and the photographing device transmits the image of each frame obtained by the photographing to the image processing device, and the image processing device sequentially receives the N frames sent by the photographing device in time sequence.
  • the image processing device receives the ith frame image, the i-1 light source image information extracted from the previous i-1 frame image and the light source image information in the ith frame image are fused to obtain a first motion trajectory of the light source.
  • the first motion trajectory of the light source indicated by the image of the previous i frame is displayed on the image of the ith frame, and the user can preview the image drawn by himself in the process of light painting, thereby realizing the effect of drawing while viewing, and overcoming the During the process of light painting, the user cannot preview the drawn image in real time, causing the user to blindly draw in the shooting picture and the user to ran out of the shooting picture.
  • the source image information of the ith frame image is extracted, and the extracted source image information is fused with the source image information extracted from each frame image of the previous i-1 frame image to obtain the first A movement track.
  • the image processing device when receiving the image of the ith frame, extracts image information of the light source from the ith frame image, and extracts the light source image information in the ith frame image from the i-frame image extracted from the previous i-1 frame image.
  • One light source image is fused to obtain a first motion trajectory due to the motion of the light source.
  • the image information of the light source extracted from the image of the ith frame may be extracted in various manners, for example, by using a foreground extraction technique, which is not specifically limited herein.
  • the image processing apparatus extracts the image information of the light source in the image every time a frame image is received, and then fuses the extracted image information of the light source with the image information of the i-1 light sources that were previously extracted and saved. Processing, obtained by i The first motion trajectory of the light source composed of the light source image information.
  • the light source image information extracted from each of the first i-1 frame images and the ith frame image are combined to make the light source image information in the ith frame image.
  • the light source image information extracted from each frame image in the pre-i-1 frame image is fused.
  • the image processing apparatus when receiving the image of the ith frame, does not extract the light source image information in the ith frame image, but the i-1 frame image and the i-1 light sources extracted from the previous i-1 frame.
  • the image information is subjected to a synthesis process.
  • the i-1 light source image information extracted from the previous i-1 frame image is directly superimposed on the ith frame image, so that the light source image information of the ith frame image is extracted and extracted.
  • the i-1 light source image information is fused, so that the first motion trajectory generated by the light source motion can be directly obtained on the ith frame image, and when the ith frame image is displayed, the first motion trajectory is displayed in the ith frame image. on.
  • the light source image information in the image received by the image processing apparatus may be extracted in various manners.
  • the image processing apparatus may first determine background image information corresponding to the preset background, and extract source image information from the received image according to the background image information, and how to extract source image information in the image. Make a specific explanation.
  • a P frame image is acquired, where the P frame image is an image obtained by the photographing device by photographing the preset background, and P is an integer greater than or equal to 1; a P frame image, determining background image information of the preset background; extracting, according to the background image information, each frame image of the pre-i-1 frame image to obtain source image information extracted from each frame image .
  • the shooting device may capture the preset background to obtain the image of the P frame preset background.
  • the preset background no user is performing the light drawing, that is, the shooting device.
  • the captured image is a preset background image
  • the photographing device sends the P frame image to the image processing device, and the image processing device can extract the background image information corresponding to the preset background from the P frame image, and the processing image device can The background image information is saved to extract the source image information.
  • the image processing apparatus facilitates extracting the light source image information from any of the frame images with the background image information when receiving any one of the previous i-1 frame images.
  • the foreground image may be determined in any frame image using the background image information, and the light source image information belongs to the foreground information, and the light source image information may be extracted in the foreground region.
  • the background image information of the preset background may be one frame of the P frame image, or may be obtained by processing the multiple frames in the P frame image, which is not limited in this embodiment of the present invention.
  • background modeling is performed on one or more frames of the first i-1 frame image to obtain background image information corresponding to a preset background; according to the background image information, Each frame image in the first i-1 frame image is extracted, and the light source image information extracted from each frame image is obtained.
  • the image processing apparatus may perform background modeling on one or more frames of the image of the first i-1 frame to obtain background image information corresponding to the preset background, wherein the manner of background modeling may be selected in various manners.
  • mixed Gaussian modeling is not specifically limited in this embodiment.
  • the background image information of the preset background is obtained, it is convenient to use the background image information to extract corresponding image information of the light source from each frame image of the first i-1 frame image.
  • the shooting device continuously captures the motion of the light source under the preset background
  • the image processing device receives the multi-frame image captured by the photographing device, and obtains the light source in the preset background.
  • the motion track below and the obtained motion track can enable the user to see the drawn image in real time, which is beneficial to the user for subsequent operations.
  • the method further includes: extracting source image information in each of the N frames of images, and fusing the source image information to obtain a corresponding image of the N frames.
  • M motion trajectories wherein the motion trajectories of the M light sources include the first motion trajectory, and M is an integer greater than or equal to 1.
  • the user draws the light source device in a preset background, and when the image processing device receives the image of the Nth frame, the image processing device extracts the light source image from the previous N-1 frame image.
  • the information is merged with the image information of the light source in the image of the Nth frame, and the motion track of the light source corresponding to the image of the first N frames is displayed on the interactive interface, as shown in FIG. 3, when the image of the Nth frame is received.
  • the interactive interface displays the motion trajectory of the light source, that is, the user draws in the first N frames. display.
  • the three motion trajectories may include the first motion trajectory: the first motion trajectory may be a motion trajectory of a part of the M motion trajectories, or the first motion trajectory may be all motion trajectories of the M motion trajectories .
  • the first motion trajectory corresponding to the i-frame image obtained by the image processing apparatus may be a part of the motion trajectory corresponding to the N-frame image.
  • the first motion trajectory corresponding to the i-frame image may be “I”, And a part of the motion track in the "U".
  • each of the M motion trajectories is saved in the form of a layer.
  • the image processing apparatus may save the motion trajectory every time one of the M motion trajectories is obtained, and optionally, the image processing apparatus may save the motion trajectory in the form of a layer, as shown in FIG.
  • the three motion trajectories "I” drawn by the user can be And each of the "U” is saved in the form of a layer.
  • layer 1 saves the motion track "I”
  • layer 2 saves the motion track.
  • Layer 3 saves the motion track "U”. The layer is used to save each of the M motion trajectories, which is convenient for later image editing processing.
  • the user can operate one or more layers according to his or her own wishes to edit and edit the motion trajectories saved in the layer, so that The motion track saved in the layer is customized and edited without affecting other motion trajectories, including editing, deleting image parameters, moving, etc.
  • the specific editing operation will be described in detail below.
  • a plurality of motion tracks of the M motion trajectories are combined to obtain a composite image.
  • the image processing apparatus extracts M motion trajectories from the N frame images, and can save the M motion trajectories separately, and each of the saved M motion trajectories can be displayed through the interaction interface of the image processing device.
  • the user can combine and synthesize multiple of the M tracks according to his own wishes, and get the combination of the motion trajectories of the light source he wants. For example, suppose the M motion trajectories are specifically "I", And "U”, the image processing device can synthesize the three motion trajectories to obtain Composite image, the user can also pick "I", And in the "U” The synthesis process is performed with "U", but the embodiment of the present invention is not limited thereto.
  • the synthesizing the plurality of motion trajectories of the M motion trajectory includes: superimposing and saving a layer corresponding to each of the plurality of motion trajectories, and obtaining Composite image.
  • each one or more of the M motion trajectories are respectively saved in different layers.
  • the user may select a plurality of layers in which the motion trajectories are saved according to his or her own will, and after the user operation confirms, the image processing apparatus may The selected layers are superimposed, and the combined images can be obtained by superimposing the layers.
  • the image processing apparatus may perform a synthesis process on one or more of the M motion trajectories in a plurality of manners.
  • the M motion trajectories and the background image information of the preset background may be combined to obtain a composite image.
  • the image processing apparatus may save the extracted background image information of the preset background, and after acquiring and storing the M motion trajectories, the user may manually select and combine the M motion trajectories and the background image information; In addition, after extracting M motion trajectories, the image processing apparatus automatically synthesizes the M motion trajectories and the background image information to obtain a combined image; and the user may manually select one of the M motion trajectories. Or a plurality of are combined with the background image information to obtain a composite image.
  • one or more of the M motion trajectories are combined with the background image information to obtain a light-drawn image formed by the light source moving under a preset background, and the light-drawn image includes both Let the background also include the motion trajectory of the light source.
  • the method further includes: acquiring a first background image; synthesizing the first background image and one or more motion tracks of the M motion tracks Processing to obtain a composite image.
  • the user may select a first background image different from the preset background to perform a synthesis process with the M motion trajectories to obtain a synthesized image. For example, as shown in FIG. 7, before the synthesizing process, the user can download a desired picture from the Internet as a background image, that is, a first background, where the user downloads a night view of the Eiffel Tower as the first background image.
  • the user can save from "I", And the two layers of "U” are selected to have two layers of "I” and "U", namely, layer 1 and layer 3, and finally the user can input a composition command to the image processing device, and the The layer 4 of the Eiffel Tower night scene is combined with the two layers holding the "I” and "U", so that a composite image can be obtained, in which the image is in the background of the Eiffel Tower, "I” and "U” are located in the Eiffel, respectively.
  • the sides of the tower are used to save from "I", And the two layers of "U” are selected to have two layers of "I” and "U", namely, layer 1 and layer 3, and finally the user can input a composition command to the image processing device, and the The layer 4 of the Eiffel Tower night scene is combined with the two layers holding the "I” and "U", so that a composite image can be obtained, in which the image is in the background of the Eiffel Tower, "I” and “U” are located in the Eiffel, respectively.
  • other background images may be used as the background of the M motion trajectories, and the first background may be selected by the user according to his or her own desire, so that the user can use any picture as the background of the composite image, and the image is improved.
  • the flexibility of editing and operation improves the user experience.
  • the acquiring the first image includes: receiving a first instruction, and determining the preset image as the first background image according to the first instruction. And synthesizing the first background image and the one or more motion trajectories to obtain a composite image, comprising: synthesizing the first background image determined by the first instruction and the one or more motion trajectories, A composite image is obtained.
  • the image processing apparatus may display a plurality of images, and the user may input a first instruction to the image processing apparatus for selecting one image as the first background image, and after the first background image is determined, the image processing apparatus selects the user.
  • the image is used as a first background image, and the first background image is combined with one or more of the M motion trajectories to obtain a post-synthesized image.
  • the first background image may be acquired in various manners.
  • the image processing apparatus has a photographing function, and the first background image is obtained by photographing the image processing apparatus; or the first background image may be downloaded from the Internet by the image processing apparatus; or the first background
  • the image is received by the image processing device from an external device, which may be other terminal devices such as a smart phone, a tablet, a personal digital assistant (PDA), a laptop computer, a desktop computer, a wearable device (eg, a watch)
  • the image processing device may include a memory, the first background image being pre-stored in the memory; or the image processing device may obtain the first background image by other means, in the embodiment of the present invention This is not limited.
  • the user may display the M motion trajectories through the interaction interface of the image processing apparatus, and the user may also partially or collectively access the M motion trajectories.
  • the motion track is subjected to one-step editing processing, and the motion track after the editing process can be further synthesized, which will be specifically explained below in conjunction with the embodiment.
  • the user can set the position at which one or more of the M motion trajectories are located.
  • the method 100 further includes: receiving a second instruction; the second instruction is for indicating a preset position of one or more of the M motion trajectories in the composite image; and the one or more motion trajectories Moving to the preset position indicated by the second instruction in the composite image.
  • the user can change the position of one or more of the M motion trajectories in the composite image, for example, the user inputs a second instruction to the image processing apparatus, and the second instruction is used to indicate one or more of the M motion trajectories.
  • the second instruction Preset position of the trajectory in the composite image, image processing device Moving the one or more motion trajectories to a preset position of the composite image.
  • the second instruction may move the one or more trajectories to a preset position in the composite image while the one or more trajectories are selected, for example, the user uses a finger in the interaction interface of the image processing apparatus.
  • the method further includes deleting L motion trajectories of the M motion trajectories.
  • the user can display the M motion trajectories through the interactive interface of the image processing apparatus, and delete the L motion trajectories among the M motion trajectories according to their own wishes or according to some requirements.
  • L motion trajectories that do not meet the preset requirement among the M motion trajectories are deleted, 1 ⁇ L ⁇ M.
  • the image processing apparatus can detect and determine the characteristics of the M motion trajectories according to a preset requirement. When the L motion trajectories of the M motion trajectories do not meet the preset requirements, the image processing apparatus can automatically The L motion trajectories are deleted, or the image processing apparatus can display L motion trajectories that do not meet the preset requirements to the user, and the user operates and confirms, and the L motion trajectories are deleted.
  • the preset requirement may include at least one of the following: color requirement, transparency requirement, definition requirement, size requirement, and brightness requirement.
  • a third instruction is received, where the third instruction is used to indicate the preset requirement; and deleting the L motion trajectories that do not meet the preset requirement among the M motion trajectories includes: The preset request determines that the M motion trajectories do not satisfy the L motion trajectories of the preset requirement, and deletes the L motion trajectories.
  • the user may input a third instruction through an interaction interface of the image processing apparatus, and specify a preset requirement by using a third instruction, for example, the user inputs a certain brightness parameter through an interaction interface of the image processing apparatus, and the image processing apparatus receives the After the brightness parameter indicated by the three commands, the brightness of each of the M motion trajectories is determined according to the brightness parameter, and L motion trajectories whose brightness is smaller than the brightness parameter are determined, and L motion trajectories are performed. delete.
  • the brightness parameter is only a schematic description, and other parameters can be selected as a preset requirement by those skilled in the art.
  • the image processing apparatus displays M motion trajectories, and the user inputs a fourth instruction by using an interaction interface of the image processing apparatus, where the fourth instruction is used to select L motion trajectories to be deleted among the M motion trajectories, for example, the user uses The finger selects L motion trajectories in a frame selection manner on the interactive interface of the image processing device. After the motion track to be deleted is selected, a pop-up window may appear on the interaction interface of the image processing device, prompting the user whether the selected L pieces need to be selected. The motion track is deleted, the user continues to input the command, and the selected L motion tracks are deleted; in addition, after the L tracks are selected, the image processing device can directly delete the L motion tracks.
  • image synthesis processing is performed on the remaining (M-L) motion trajectories to obtain a composite image.
  • the user can still synthesize the remaining ML motion trajectories.
  • the user can follow the wishes or according to the preset. It is required to delete L motion trajectories in M motion trajectories, retain ML motion trajectories, and then synthesize the remaining ML motion trajectories.
  • one or more trajectories are unclear or trajectory
  • the brightness meets the requirements, the user can delete the one or more tracks, save other motion tracks that meet the requirements for the next operation, which can effectively improve the flexibility of image editing and provide more editing for the user. the way.
  • the method further includes: receiving a fifth instruction, where the fifth instruction is used to set a target value of an image parameter of one or more of the M motion trajectories;
  • the target value set by the five instructions modifies the image parameters of the one or more motion trajectories.
  • the user may set a target value of the image parameter of one or more of the M motion trajectories through an interaction interface of the image processing.
  • the image parameters include one or more of color, transparency, brightness, fill, and sharpness.
  • the image parameter may be a color
  • the user may input a fifth instruction to the image processing device, set the target value of the color to blue
  • the image processing device may set one or more of the M motion trajectories.
  • the color of the motion trajectory is modified to blue, wherein the image parameter is a color only a schematic description, and those skilled in the art can select other image parameters, for example, to change the brightness of one or more of the M motion trajectories.
  • the user can change the color, brightness, transparency, padding, and the like of any of the M motion trajectories by interaction with the image processing apparatus. Overcome the shortcomings that cannot be further edited in the past. Further, the user can synthesize the motion trajectory after modifying the image parameters, and combine the illuminating images that he wants.
  • the method may further include: displaying an image comparison interface, the image comparison interface including a preset trajectory indicating movement of the light source.
  • the image processing apparatus may display an image comparison interface, wherein the image comparison interface may have Instructing the user to move the trajectory of the light source, for example, an eigentrack of the Eiffel Tower is displayed in the interactive interface of the image display device. Since the image processing device is used, the user can see the trajectory of the light source and the position of the light source in the shooting screen in real time, the user can According to the preset trajectory in the image comparison interface, that is, the trajectory of the Eiffel Tower, the light source is moved, so that the user can draw the image he wants even if the user does not have any experience in photographic photography.
  • the image processing apparatus may also display the image comparison interface before executing S110 and S120, and the user draws according to the preset trajectory, so that the user can move the light source according to the preset motion trajectory, so that the light source is in the The motion in the preset background is more in line with the user's expectation, but the embodiment of the invention is not limited thereto.
  • the embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores program instructions, and the program may include some or all of the steps of the image processing method in the corresponding embodiment of FIG. 2 .
  • FIG. 8 is a schematic block diagram of an apparatus 800 for image processing according to an embodiment of the present invention.
  • the device 800 includes:
  • the obtaining module 810 is configured to sequentially acquire an N-frame image, where the N-frame image is an image obtained by the photographing device capturing a motion of the light source under a preset background, where the N is an integer greater than or equal to 2;
  • the processing module 820 is configured to: when the acquiring module 810 acquires the ith frame image in the N frame image, the source image information in the ith frame image and each frame image in the previous i-1 frame image The extracted image information of the light source is fused to obtain a first motion trajectory of the light source, wherein 1 ⁇ i ⁇ N;
  • the display module 830 is configured to display a first motion trajectory of the light source obtained by the processing module 820.
  • the processing module 820 is specifically configured to: extract source image information of the ith frame image, and extract the extracted source image information and the light extracted from each frame image of the previous i-1 frame image.
  • the source image information is fused.
  • the processing module 820 is specifically configured to: combine source image information extracted from each frame image of the pre-i-1 frame image with the ith frame image, so that the ith frame image The light source image information in the light source is merged with the light source image information extracted from each of the previous i-1 frame images.
  • processing module 820 is further configured to:
  • the acquiring module 810 is further configured to acquire a P frame image, where the P frame image is an image obtained by the shooting device by capturing the preset background, where P is an integer greater than or equal to 1. ;
  • processing module 820 is further configured to:
  • the processing module 820 is further configured to: extract source image information in each frame image of the N frame image, and fuse the source image information to obtain an M corresponding to the N frame image. a motion trajectory, wherein the motion trajectory of the M light sources includes the first motion trajectory, and M is an integer greater than or equal to 1.
  • the processing module 820 is further configured to save each of the M motion trajectories in the form of a layer.
  • the processing module 820 is further configured to: when the M ⁇ 2, perform a synthesis process on the multiple motion trajectories of the M motion trajectories to obtain a composite image.
  • the processing module 820 is specifically configured to: perform superimposition processing on the layer corresponding to each of the saved plurality of motion trajectories to obtain a composite image.
  • the obtaining module 810 is further configured to acquire a first background image.
  • the processing module 820 is further configured to use the first background image and the M motion tracks acquired by the acquiring module 810. One or more motion trajectories in the synthesis are combined to obtain a composite image.
  • the first background image is obtained by one or more methods of photographing, Internet downloading, receiving an external device, and reading from a memory.
  • the obtaining module 810 is specifically configured to receive a first instruction, where the first instruction may be used to indicate a preset image;
  • processing module 820 is specifically configured to:
  • the apparatus 800 further includes: a first receiving module, configured to receive a second instruction, where the second instruction is used to indicate a preset position of one or more motion trajectories of the M motion trajectories in the composite image;
  • the processing module 820 is further configured to move the one or more motion trajectories in the composite image to a preset position indicated by the second instruction.
  • processing module 820 is further configured to: delete L motion trajectories of the M motion trajectories;
  • the processing module 820 is specifically configured to delete L motion trajectories of the M motion trajectories that do not meet preset requirements, where 1 ⁇ L ⁇ M.
  • the preset requirement includes at least one of the following: a color requirement, a transparency requirement, a definition requirement, a size requirement, and a brightness requirement.
  • the apparatus 800 further includes: a second receiving module, configured to receive a third instruction, where the third instruction is used to indicate the preset requirement;
  • the processing module 820 is specifically configured to: determine, according to the preset requirement indicated by the third instruction, that the M motion trajectories do not satisfy the L motion trajectories of the preset requirement, and the L motions The track is deleted.
  • the display module 830 is configured to display the M motion trajectories.
  • the device 800 further includes: a third receiving module, configured to receive a fourth instruction, where the fourth instruction is used to indicate L motion trajectories to be deleted among the M motion trajectories;
  • processing module 820 is specifically configured to delete the L motion tracks to be deleted indicated by the fourth instruction.
  • the processing module 820 is specifically configured to perform the remaining (M-L) motion trajectories. Image synthesis processing to obtain a composite image.
  • the apparatus 800 further includes: a fourth receiving module, configured to receive a fifth instruction, where the fifth instruction is used to set a target value of an image parameter of one or more of the M motion trajectories ;
  • the processing module 820 is further configured to modify image parameters of the one or more motion trajectories according to the target value set by the fifth instruction.
  • the image parameters include one or more of color, transparency, brightness, fill, and sharpness.
  • the display module 830 is further configured to display an image comparison interface, where the image comparison interface includes a preset trajectory indicating the movement of the light source.
  • the photographing device is specifically an imaging device configured with a pan/tilt.
  • the device 800 may be specifically an electronic device.
  • a smartphone, a tablet, a personal digital assistant (PDA), a laptop computer, a desktop computer, a wearable device (for example, a watch, glasses), and the like are not limited in this embodiment of the present invention.
  • the apparatus 800 herein is embodied in the form of a functional module.
  • module may refer to an application specific integrated circuit (ASIC), an electronic circuit, a processor for executing one or more software or firmware programs (eg, a shared processor, a proprietary processor, or a group). Processors, etc.) and memory, merge logic, and/or other suitable components that support the described functionality.
  • ASIC application specific integrated circuit
  • processors, etc. e.g, a shared processor, a proprietary processor, or a group.
  • memory merge logic, and/or other suitable components that support the described functionality.
  • the apparatus 800 may be used to perform various processes and/or steps of the foregoing method embodiments. To avoid repetition, details are not described herein.
  • FIG. 9 is a schematic block diagram of an apparatus 900 for image processing according to an embodiment of the present invention.
  • the device 900 includes a processor 910, a memory 920, and an interaction interface 930.
  • the memory 920 is configured to store instructions
  • the processor 910 is configured to invoke the instructions to perform the following operations:
  • N-frame image which is an image obtained by the photographing device 900 for taking a motion of the light source under a preset background, wherein the N is an integer greater than or equal to 2;
  • the processor 910 is specifically configured to: extract the image of the ith frame
  • the light source image information is fused with the extracted light source image information and the light source image information extracted from each frame image of the previous i-1 frame image.
  • the processor 910 is specifically configured to: synthesize source image information extracted from each frame image of the pre-i-1 frame image and the ith frame image, so that the first The light source image information in the i frame image is fused with the light source image information extracted from each of the previous i-1 frame images.
  • processor 910 is further configured to:
  • processor 910 is further configured to:
  • the P frame image is an image obtained by the photographing device by photographing the preset background, and P is an integer greater than or equal to 1;
  • the processor 910 is further configured to: extract source image information in each frame image of the N frames of images, and fuse the source image information to obtain an image with the N frames.
  • the processor 910 is further configured to save each of the M motion trajectories in the form of a layer in the memory 920.
  • the processor 910 is further configured to: when the M ⁇ 2, perform a synthesis process on the multiple motion trajectories of the M motion trajectories to obtain a composite image.
  • the processor 910 is specifically configured to: perform superimposition processing on the layer corresponding to each of the saved motion trajectories to obtain a composite image.
  • processor 910 is further configured to:
  • the first background image is obtained by one or more methods of photographing, downloading the Internet, receiving the external device 900, and reading from the memory 920.
  • the interaction interface 930 is further configured to receive the first instruction
  • the processor 910 is specifically configured to perform the following operations:
  • the interaction interface is further configured to receive a second instruction, where the second instruction is used to indicate a preset position of one or more motion trajectories of the M motion trajectories in the composite image;
  • the processor 910 is further configured to move the one or more motion trajectories in the composite image to a preset position indicated by the second instruction.
  • the processor 910 is further configured to: delete L motion trajectories of the M motion trajectories;
  • the processor 910 is specifically configured to delete L motion trajectories of the M motion trajectories that do not meet preset requirements, where 1 ⁇ L ⁇ M.
  • the preset requirement includes at least one of the following: a color requirement, a transparency requirement, a definition requirement, a size requirement, and a brightness requirement.
  • the interaction interface 930 is further configured to receive a third instruction, where the third instruction is used to indicate the preset requirement;
  • the processor 910 is specifically configured to: determine, according to the preset requirement indicated by the third instruction, that the M motion trajectories do not satisfy the L motion trajectories of the preset requirement, L motion tracks are deleted.
  • the processor 910 is further configured to use the M motion trajectories on the interaction interface 930.
  • the interaction interface is further configured to receive a fourth instruction, where the fourth instruction is used to indicate L motion trajectories to be deleted among the M motion trajectories;
  • the processor 910 is specifically configured to delete the L motion tracks to be deleted indicated by the fourth instruction.
  • the processor 910 is specifically configured to perform image synthesis processing on the remaining (M-L) motion trajectories to obtain a composite image.
  • the interaction interface is further configured to receive a fifth instruction, where the fifth instruction is used to set the location Determining a target value of an image parameter of one or more motion trajectories of the M motion trajectories;
  • the processor 910 is further configured to modify image parameters of the one or more motion trajectories according to the target value set by the fifth instruction.
  • the image parameters include one or more of color, transparency, brightness, fill, and sharpness.
  • the processor 910 is further configured to display an image comparison interface on the interaction interface 930, where the image comparison interface includes a preset trajectory indicating movement of the light source.
  • the photographing device is specifically an imaging device configured with a pan/tilt.
  • the interaction interface of the embodiment is an interface that the image processing device interacts with the user, and the interaction interface may include a display, which may or may not be a touch screen, may be a Light-Emitting Diode (LED) screen, or an organic light-emitting device.
  • a display which may or may not be a touch screen
  • the interactive interface may further include an input device, such as a keyboard, a joystick, a dial, etc., for receiving control commands of the user, and implementing control of the image processing device.
  • the device 900 may be specifically an electronic device.
  • the device 900 may be specifically a handheld electronic device.
  • a smartphone, a tablet, a personal digital assistant (PDA), a laptop computer, a desktop computer, a wearable device (for example, a watch, glasses), and the like are not limited in this embodiment of the present invention.
  • the device 900 may be used to perform various processes and/or steps of the foregoing image processing method embodiments. To avoid repetition, details are not described herein.
  • system and “network” are used interchangeably herein.
  • the term “and/or” in this context is merely an association describing the associated object, indicating that there may be three relationships, for example, A and / or B, which may indicate that A exists separately, and both A and B exist, respectively. B these three situations.
  • the character "/" in this article generally indicates that the contextual object is an "or" relationship.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules is only a logical function division.
  • there may be another division manner for example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or module, or an electrical, mechanical or other form of connection.
  • the modules described as separate components may or may not be physically separated.
  • the components displayed as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.
  • each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated modules if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium.
  • the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (RoM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program code. .

Abstract

一种图像处理的方法、装置和设备。所述方法包括:依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并显示所述光源的第一运动轨迹,其中1<i≤N,所述图像处理方法可以将用户绘制的图像实时地显示出来,使用户预览自己绘制的光绘图像,实现了边看边绘制的效果,提高了光绘摄影的灵活性。

Description

图像处理的方法、装置和设备
版权申明
本专利文件披露的内容包含受版权保护的材料。该版权为版权所有人所有。版权所有人不反对任何人复制专利与商标局的官方记录和档案中所存在的该专利文件或者该专利披露。
技术领域
本发明实施例涉及通信领域,并且更具体地,涉及图像处理的方法、装置和设备。
背景技术
光绘摄影,是通过拍摄设备的长曝光模式拍摄光源的移动轨迹而得到的摄影作品,任何光源都可作为成像效果的一部分。光绘摄影通常在夜间室外或暗房条件下拍摄,环境光越暗拍摄效果越好,目前,光绘摄影需要一定的摄影技术,对用户的专业要求高,用户可能需要进行多次重复绘制才能获得想要的图像;在光绘过程中,用户不能实时地观测到自己在拍摄画面中所处的位置,因此,在拍摄过程中经常发生用户移动到拍摄画面外的情况;另外,目前,用户只有光绘摄影结束后才能看到自己绘制的图像,不能在绘制过程中实时地看到自己绘制的图像,因此,用户在光绘摄影的过程中处于盲目绘制的状态。
发明内容
本发明实施例提供一种图像处理的方法、装置和设备,能够使用户预览绘制的光绘图像,提高光绘摄影的灵活性。
第一方面,提供了一种图像处理的方法,包括:依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并显示所述光源的第一运动轨迹,其中1<i≤N。
第二方面,提供了一种图像处理的装置,包括:获取模块,用于依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;处理模块,用于在所述获取模块获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,其中1<i≤N;显示模块,用于显示所述处理模块得到的所述光源的第一运动轨迹。
第三方面,提供了一种图像处理的设备,包括处理器、存储器和交互界面,所述存储器用于存储指令,所述处理器用于调用所述指令,执行以下操作:依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并在所述交互界面上显示所述光源的第一运动轨迹,其中1<i≤N。
在本发明实施例中,拍摄设备对光源在预设背景下的运动进行拍摄,拍摄设备将拍摄得到的图像发送给图像处理装置,图像处理装置按照时间顺序依次接收拍摄设备发送的N帧图像,并且在接收到第i帧图像时,将从前i-1帧图像中提取的i-1个光源图像信息与第i帧图像中的光源图像信息进行融合,得到光源的第一运动轨迹,并将前i帧图像指示的光源的第一运动轨迹显示在第i帧图像上。这样,图像处理装置可以将用户绘制的图像显示出来,用户可以在光绘的过程中实时地预览自己绘制的图像,实现了边看边绘制的效果,有助于用户对绘制过程的把控,同时方便用户对后期的绘制策略进行调整,降低了对用户的专业要求,提高了光绘摄影的灵活性。
附图说明
为了更清楚的说明本发明实施例的技术方案,下面将对本发明实施例描述中所需要使用的附图作简单的介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本发明实施例应用的光绘摄影系统的示意图。
图2是本发明实施例提供的图像处理的方法的示意性流程图。
图3是本发明实施例提供的图像处理的方法中在接收到第N帧图像时显示M个运动轨迹的示意图。
图4是本发明实施例提供的图像处理的方法中提取的M个光源的运动轨迹的示意图。
图5是本发明又一实施例提供的图像处理的方法的示意性流程图。
图6是本发明又一实施例提供的图像处理的方法的示意性流程图。
图7是本发明实施例提供的图像处理的方法中第一背景图像与光源的运动轨迹合成的示意图。
图8是本发明实施例提供的图像处理的装置的示意性框图。
图9是本发明实施例提供的图像处理的设备的示意性框图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行描述。
图1是本发明实施例提供的光绘摄影系统100的示意图。由于在光绘摄影中,是对光源的运动轨迹进行拍摄,所以需要在夜间或光线较暗的条件下进行拍摄。在进行拍摄之前,用户可以首先挑选光绘摄影的预设背景104,即用户需要以何种景物作为光绘摄影的拍摄场景,用户可以按照自己的意愿选择预设背景,此处选用树和草作为预设背景只是示意性说明,本领域技术人员可以选用其他的景物作为预设背景,在这里不做具体的限定。值得注意的是,用户在选取预设背景时,预设背景中不宜存在亮度较高的或者处于移动状态的光源设备。
光绘摄影需要稳定的拍摄画面,画面的抖动会严重影响光绘摄影的效果,因此,在拍摄之前,可以将拍摄设备101安装在三脚架上。可选地,拍摄设备101可以为配置有云台的成像设备,在没有三脚架的情况下,可以使用手持的方式来进行拍摄,因为成像设备配置有云台,可以使配置在云台上的镜头保持稳定,保证画面不会抖动,同样满足光绘摄影的要求。
在预设背景104前,用户手持光源设备102按照自己的意愿或者绘制需求进行绘制,在绘制的过程中,会产生光源的运动轨迹105,则运动轨迹105即是运动绘制出的光绘图像。其中光源设备102最好是容易操作的,即用户可以很方便地将其打开或者关闭,这样可以避免成像中有多余的拖影,另外 光源设备发出光的颜色和亮度,用户可以按照自己的意愿或者绘制需求来选择。值得注意的是,为例保证光绘的效果,用户需要是穿着深色的衣服,优选地是黑色或者深蓝色,这样可以减小光源设备发出的光在用户衣服上形成的反射而使光绘图像中存在残影。
在用户手持光源设备102绘制的过程中,拍摄设备101进行拍摄,并且拍摄设备101会将拍摄得到的一系列图像发送给图像处理装置103,图像处理装置103可以对拍摄设备101发送的图像进行实时的处理,图像处理装置103可以将用户绘制的图像,即光源的运动轨迹105显示在图像处理装置103的交互界面上,这样用户可以实时地预览自己绘制的图像。其中,拍摄设备101和图像处理装置103之间可以通过有线通信方式连接,其中有线通信通信方式可以使用各种有线通信协议,例如通用串行总线(Universal Serial Bus,USB)、CAN、以太网、RS232、RS458等,也可以通过无线通信方式连接,其中无线通信方式可以为WIFI、蓝牙、近场通讯(Near Field Communication,NFC)、射频识别(Radio Frequency Identification,RFID)等,拍摄设备101拍摄获取的图像可以通过有线或者无线的通信方式发送给图像处理装置,在这里不做具体的限定。
接下来,将详细描述图像处理装置103对拍摄设备101发送的图像进行处理的处理方法。
可选地,该图像处理装置可以为终端设备,该终端设备可以安装有用于进行图像处理的应用程序,所述应用程序可以对拍摄设备101发送的图像进行处理;或者,该图像处理装置可以为拍摄设备101,拍摄设备101具有图像处理功能,可以直接对拍摄获取的图像进行处理,并将用户绘制的图像,即光源的运动轨迹显示在其交互界面上,用户可以通过查看拍摄设备101的交互界面实现预览绘制的图像,但本发明实施例不限于此。
应理解,在本发明实施例中,终端设备可以是任何类型的具有图像接收和处理功能的外部装置。用户终端的实例可以包括但不限于:智能电话/手机、平板电脑、个人数字助理(PDA)、膝上计算机、台式计算机、媒体内容播放器、视频游戏站/系统、虚拟现实系统、增强现实系统、可穿戴式装置(例如,手表、眼镜、手套、头饰(例如,帽子、头盔、虚拟现实头戴耳机、增强现实头戴耳机、头装式装置(HMD)、头带)、挂件、臂章、腿环、鞋子、马甲)、手势识别装置、麦克风、能够提供或渲染图像数据的任意电子装置、 或者任何其他类型的装置。该用户终端可以是手持物体。该用户终端可以是便携式的。该用户终端可以由人类用户携带。在一些情况下,该用户终端可以远离人类用户,并且用户可以使用无线和/或有线通信来控制该用户终端。用户终端可以包括交互界面。该交互界面可以是屏幕。该交互界面可以是或者可以不是触摸屏,该显示器可以是发光二极管(LED)屏幕、OLED屏幕、液晶显示器(LCD)屏幕、等离子体屏幕、或任何其他类型的屏幕,用于对信息的显示。另外交互界面还可以包括输入设备,例如键盘、摇杆、拨轮等,用于接收相应的控制指令。
图2是本发明实施例提供的图像处理的方法的流程图,所述方法包括:
S110:依次获取N帧图像,其中,该N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,N为大于或等于2的整数。
具体地,在预设背景下,用户手持光源设备并移动所述光源设备进行绘制,拍摄设备可以对光源运动进行连续拍摄,可选地,拍摄设备可以为配置有云台的成像设备,其中成像设备的拍摄镜头配置在云台上,通过对云台的控制可以调节成像设备的拍摄方向,在本实施例中,云台可以使得拍摄镜头保持稳定,防止成像设备的拍摄画面抖动,从而可以克服拍摄画面抖动而引起的拍摄图像质量的缺陷,无需三脚架也可以拍摄出稳定的图像。
拍摄设备可以实时地将拍摄得到的每一帧图像发送给图像处理装置,图像处理装置可以按照拍摄时间的先后顺序依次接收拍摄设备发送的每一帧图像。可选地,该图像处理设备也可以该拍摄设备每得到一定数量帧的图像时,获取该数量帧的图像。在S110中,该终端设备可以接收拍摄设备依次发送的N帧图像。
S120:在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并显示所述光源的第一运动轨迹,其中1<i≤N。
具体地,图像处理设备接收到前i-1帧图像时,可以从每一帧图像中提取中指示光源的光源图像信息,这样可以i-1帧图像中提取i-1个光源图像信息,图像处理装置可以将提取得到的前i-1个光源图像信息进行保存,当图像处理装置接收到第i帧图像,图像处理装置可以将从前i-1帧图像提取的前i-1个光源图像信息和该第i帧图像中的光源图像信息进行融合处理,得 到该光源的第一运动轨迹,所述第一运动轨迹可以指示光源在预设背景下进行运动而形成的运动轨迹,即用户光绘形成的光绘图像,将所述第一运动轨迹显示在第i帧图像上,此时,图像处理装置在显示第i帧图像时,可以将前i帧图像指示的光源的运动轨迹同时显示在第i帧图像上,这样可以将用户绘制形成的光源的运动轨迹全部保留并且实时地显示,用户可以将图像处理装置拿在手上,并可以通过图像处理装置的交互界面实时地看到自己绘制的图像。其中第i帧只是作为示意性说明,i可以为大于1,且小于或等于N的任意整数。其中具体的融合方式会在本文后面部分详细描述。在本发明实施例中,第i帧图像的光源图像信息可以指第i帧图像中包括的光源图像的信息,用于指示图像中光源的所有信息,其中所述信息可以包括光源的位置信息、透明度信息、亮度信息、光源发光面积大小中的一种或多种,本发明实施例对此不做具体限定。
在本发明实施例中,拍摄设备对光源在预设背景下的运动进行拍摄,拍摄设备将拍摄得到的每帧图像发送给图像处理装置,图像处理装置按照时间顺序依次接收拍摄设备发送的N帧图像,图像处理装置接收到第i帧图像时,将从前i-1帧图像中提取的i-1个光源图像信息与第i帧图像中的光源图像信息进行融合,得到光源的第一运动轨迹,将前i帧图像指示的光源的第一运动轨迹显示在第i帧图像上,用户可以在光绘的过程中实时地预览自己绘制的图像,实现了边看边绘制的效果,克服了在光绘的过程中用户不能实时预览绘制出的图像而导致用户在拍摄画面中盲目绘制、用户绘制时跑出拍摄画面的缺陷。
作为一个可选的实施例,提取所述第i帧图像的光源图像信息,并将提取到的光源图像信息与从前i-1帧图像中每一帧图像提取的光源图像信息进行融合,得到第一运动轨迹。
具体地,图像处理装置在接收到第i帧图像时,从第i帧图像中提取光源的图像信息,将第i帧图像中的光源图像信息与从前i-1帧图像中提取出的i-1个光源图像进行融合,得到由于光源运动产生的第一运动轨迹。其中从第i帧图像中提取出光源的图像信息可以使用多种方式,如利用前景提取技术来提取,在这里不作具体的限定。在本实施例中,图像处理装置每接收到一帧图像,便将图像中的光源图像信息提取出来,然后将提取出来的光源图像信息与之前提取并保存的i-1个光源图像信息进行融合处理,获取由i 个光源图像信息组成的光源的第一运动轨迹。
作为一个可选的实施例,将所述前i-1帧图像中每一帧图像提取的光源图像信息与所述第i帧图像进行合成,以使得所述第i帧图像中的光源图像信息与所述前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
具体地,图像处理装置在接收第i帧图像时,并不对第i帧图像中的光源图像信息进行提取,而是将第i帧图像与从前i-1帧中提取出的i-1个光源图像信息进行合成处理,可选地,直接将从前i-1帧图像中提取出的i-1个光源图像信息叠加到第i帧图像上,以使第i帧图像的光源图像信息与提取出的i-1个光源图像信息融合,这样可以直接在第i帧图像上得到由光源运动产生的第一运动轨迹,在显示第i帧图像时,第一运动轨迹就会显示在第i帧图像上。
在本发明实施例中,可以采用多种方式提取图像处理装置接收到的图像中的光源图像信息。例如,该图像处理装置可以先确定所述预设背景对应的背景图像信息,并根据该背景图像信息从接收到的图像中提取出光源图像信息,下面将对如何提取图像中的光源图像信息来进行具体的阐述。
作为另一个可选实施例,获取P帧图像,其中,所述P帧图像是所述拍摄设备通过对所述预设背景进行拍摄得到的图像,P为大于或等于1的整数;根据所述P帧图像,确定预设背景的背景图像信息;根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
具体地,在用户进行光绘之前,拍摄设备可以对预设的背景进行拍摄,来获取P帧预设背景的图像,此时在预设背景中是中没有用户在进行光绘,即拍摄设备拍摄得到的是预设背景的图像,拍摄设备将所述P帧图像发送给图像处理装置,图像处理装置可以从P帧图像中提取出预设背景对应的背景图像信息,处理图像装置可以将所述背景图像信息进行保存,以便来对光源图像信息进行提取。在用户进行光绘时,图像处理装置在接收到前i-1帧图像中的任一帧时,便利用所述背景图像信息从任一帧图像中提取光源图像信息。例如,可以利用背景图像信息在任一帧图像中确定前景区域,光源图像信息属于前景信息,可以在前景区域中提取出光源图像信息。其中,该预设背景的背景图像信息可以为该P帧图像中的一帧图像,也可以通过对该P帧图像中多帧进行处理得到的,本发明实施例对此不做限定。
作为一个可选的实施例,对所述前i-1帧图像中的一帧或多帧图像进行背景建模,得到预设背景对应的背景图像信息;根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到所述每一帧图像提取的光源图像信息。
具体地,图像处理装置在可以对前i-1帧图像中的一帧或多帧图像进行背景建模,得到预设背景对应的背景图像信息,其中背景建模的方式可以选用多种方式,例如混合高斯建模,在本实施例中不作具体的限定。在得到预设背景的背景图像信息后,便利用所述背景图像信息从前i-1帧图像中每一帧图像中提取对应的光源图像信息,具体解释请参见上述部分,此处不再赘述。在本实施例中,不需要预先获取单纯预设的背景的图像,直接利用接收到的一帧或多帧光绘图像来进行背景建模获取所述背景图像信息。
这样,当光源在预设背景下运动时,拍摄设备对该光源在该预设背景下的运动进行连续拍摄,图像处理装置接收该拍摄设备拍摄得到的多帧图像,得到该光源在预设背景下的运动轨迹,并显示得到的该运动轨迹,能够使得用户可以实时看到绘制的图像,有利于用户进行后续操作。
作为一个可选的实施例,所述方法还包括:提取所述N帧图像中的每一帧图像中的光源图像信息,将所述光源图像信息进行融合,得到与所述N帧图像对应的M个运动轨迹,其中,所述M个光源的运动轨迹包括所述第一运动轨迹,M为大于或等于1的整数。
具体地,在本发明实施例中,用户在预设背景下手持光源设备绘制,当图像处理装置在接收到第N帧图像时,图像处理装置将从前N-1帧图像中提取出的光源图像信息与第N帧图像中的光源图像信息进行融合,将前N帧图像对应的光源的运动轨迹,将所述运动轨迹显示出来在交互界面,如图3所示,当接收到第N帧图像时,交互界面将光源的运动轨迹显示出来,即将用户在前N帧绘制的
Figure PCTCN2016112302-appb-000001
显示出来。并且在绘制过程结束后,图像处理装置提取出与所述N帧图像对应的M个运动轨迹,即如图4所示的3个运动轨迹“I”、
Figure PCTCN2016112302-appb-000002
和“U”,此时M=3。
另外,该3个运动轨迹可以包括所述第一运动轨迹:第一运动轨迹可以是M个运动轨迹中的一部分的运动轨迹,或者第一运动轨迹可以为该M个运动轨迹中全部的运动轨迹。
例如,用户手持光源设备在预设背景下以“S”形的方式运动,则该图像 处理装置可以得到与该N帧图像对应的一个运动轨迹,即M=1。此时,对于i<N,该图像处理装置得到的与i帧图像对应的第一运动轨迹可以为与该N帧图像对应的运动轨迹的一部分。再例如,如图4所示,用户手持光源设备在预设背景下以
Figure PCTCN2016112302-appb-000003
的方式运动,则该图像处理装置可以得到以下三个运动轨迹:“I”、
Figure PCTCN2016112302-appb-000004
和“U”,即M=3,此时,对于i<N,该与i帧图像对应的第一运动轨迹可以为“I”、
Figure PCTCN2016112302-appb-000005
和“U”中的一部分运动轨迹。
作为一个可选实施例,以图层的形式保存所述M个运动轨迹中的每个运动轨迹。
具体地,在每得到该M个运动轨迹中的一个运动轨迹时,该图像处理装置可以保存该运动轨迹,并且可选地,该图像处理装置可以以图层的形式保存该运动轨迹,如图5所示,可以将用户绘制的三个运动轨迹“I”、
Figure PCTCN2016112302-appb-000006
和“U”中的每一个都以图层的形式进行保存,具体地,图层1保存运动轨迹“I”,图层2保存运动轨迹
Figure PCTCN2016112302-appb-000007
图层3保存运动轨迹“U”。使用图层对M个运动轨迹中的每一个进行保存,方便后期的图像编辑处理,用户可以按照自己意愿操作一个或多个图层,实现对图层中保存的运动轨迹进行编辑处理,这样可以在不影响其他运动轨迹的前提下,对图层中保存的运动轨迹进行定制化编辑,其中编辑包括删除、改变图像参数、移动等,具体编辑操作将在下文详细描述。
作为一个可选实施例,当所述M≥2时,对所述M个运动轨迹中的多个运动轨迹进行合成处理,得到合成图像。
具体地,图像处理装置从N帧图像中提取出M个运动轨迹,可以将M个运动轨迹分别进行保存,通过图像处理设备的交互界面,可以将保存的M个运动轨迹中的每一个都显示出来,用户可以根据自己的意愿对M个轨迹中的多个进行组合和合成,得到自己想要的光源的运动轨迹组合。例如,假设该M个运动轨迹具体为“I”、
Figure PCTCN2016112302-appb-000008
和“U”,则该图像处理装置可以对这三个运动轨迹进行合成处理,得到包括
Figure PCTCN2016112302-appb-000009
的合成图像,用户也可以挑选“I”、
Figure PCTCN2016112302-appb-000010
和“U”中的
Figure PCTCN2016112302-appb-000011
和“U”进行合成处理,但本发明实施例不限于此。
作为一个可选实施例,所述对所述M个运动轨迹中的多个运动轨迹进行合成处理,包括:将保存所述多个运动轨迹中每个运动轨迹对应的图层进行叠加处理,得到合成图像。
具体地,M个运动轨迹中的每一个或者多个都分别保存在不同的图层 中,当需要对M个运动轨迹中的多个运动轨迹进行合成处理时,用户可以按照自己的意愿选中保存有所述运动轨迹的多个图层,经用户操作确认后,图像处理装置可以将被选中的图层进行叠加,通过图层的叠加可以获取合成后的图像。
在本发明实施例中,该图像处理装置可以以多种方式对该M个运动轨迹中的一个或多个运动轨迹进行合成处理。作为一个可选实施例,可以对该M个运动轨迹与预设背景的背景图像信息进行合成处理,得到合成图像。
具体地,图像处理装置可以将提取得到的预设背景的背景图像信息进行保存,在获取并保存M个运动轨迹后,用户可以将手动选择将M个运动轨迹与所述背景图像信息进行合成;另外,也可以在提取到M个运动轨迹以后,图像处理装置自动将M个运动轨迹与所述背景图像信息进行合成,得到合成后的图像;另外用户也可以手动选择M个运动轨迹中的一个或多个来与所述背景图像信息进行合成,得到合成图像。在本发明实施例中,将M个运动轨迹中的一个或多个与所述背景图像信息进行合成即可以得到光源在预设背景下运动而形成的光绘图像,光绘图像中既包括预设背景也包括光源的运动轨迹。
作为另一个可选实施例,如图6所示,所述方法还包括:获取第一背景图像;将所述第一背景图像和所述M个运动轨中的一个或多个运动轨迹进行合成处理,得到合成图像。
具体地,在获取并保存M个运动轨迹后,用户可以选用不同于预设背景的第一背景图像来与M个运动轨迹进行合成处理,得到合成后的图像。例如,如图7所示,在合成处理前,用户可以从互联网下载一张想要的图片作为背景图像,即第一背景,在这里用户下载了一张埃菲尔铁塔的夜景图作为第一背景图像,并将第一背景图像保存在一个新的图层中,即图层4中,另外,用户可以从保存有“I”、
Figure PCTCN2016112302-appb-000012
和“U”的3个图层中选取分别保存有“I”和“U”的两个图层,即图层1和图层3,最后用户可以对图像处理装置输入合成指令,将保存有埃菲尔铁塔夜景的图层4和保存有“I”和“U”的两个图层进行合成,这样即可以得到合成图像其中图像中以埃菲尔铁塔为背景,“I”和“U”分别位于埃菲尔铁塔的两侧。在本发明实施例中,可以使用其他背景图像来作为M个运动轨迹的背景,所述第一背景可以由用户按照自己的意愿选择,这样用户可以使用任意图片作为合成图像的背景,提高了图像编辑和 操作的灵活性,改善了用户体验。
作为一个可选实施例,所述获取第一图像包括:接收第一指令,根据第一指令将预设的图像确定为第一背景图像。所述将所述第一背景图像和所述一个或多个运动轨迹进行合成处理,得到合成图像,包括:将第一指令确定的第一背景图像与所述一个或多个运动轨迹进行合成,得到合成图像。
具体地,图像处理装置可以显示多张图像,用户可以对图像处理装置输入第一指令用于选中一张图像作为第一背景图像,在确定了第一背景图像以后,图像处理装置将用户选中的图像作为第一背景图像,并将所述第一背景图像与所述M个运动轨迹中的一个或多个进行合成,得到后合成后的图像。
在本发明实施例中,可以通过多种方式获取该第一背景图像。例如,该图像处理装置具有拍照功能,并且该第一背景图像是该图像处理装置通过拍照获得的;或者,该第一背景图像可以是该图像处理装置从互联网下载的;或者,该第一背景图像是该图像处理装置从外部设备接收的,该外部设备可以为其他终端设备、如智能手机、平板电脑、个人数字助理(PDA)、膝上计算机、台式计算机、可穿戴式装置(例如,手表、眼镜)等;或者,该图像处理装置可以包括存储器,该第一背景图像是存储器中预先存储的;或者,该图像处理装置还可以通过其他方式获取该第一背景图像,本发明实施例对此不做限定。
在本发明实施例中,在图像处理装置提取并保存了M个运动轨迹后,用户可以通过图像处理装置的交互界面显示这M个运动轨迹,另外用户还可以部分地或者整体地对这M个运动轨迹进行一步的编辑处理,同时可以对编辑处理后的运动轨迹进行进一步的合成处理,下面将结合实施例进行具体的阐述。
作为一个可选实施例,用户可以设置该M个运动轨迹中的一个或多个运动轨迹所处的位置。相应地,该方法100还包括:接收第二指令;第二指令用于指示M个运动轨迹中的一个或多个运动轨迹在合成图像中的预设位置;将所述一个或多个运动轨迹在合成图像中移动到所述第二指令指示的预设位置。
具体地,用户可以改变M个运动轨迹中一个或者多个运动轨迹在合成图像中的位置,例如用户向图像处理装置输入第二指令,第二指令用于指示M个运动轨迹中的一个或多个轨迹在合成图像中的预设位置,图像处理装置 将所述一个或多个运动轨迹移动至合成图像的预设位置。可选地,第二指令可以在选中所述一个或多个轨迹的同时,将所述一个或多个轨迹移动到合成图像中的预设位置,例如用户使用手指在图像处理装置的交互界面中以画框的方式框选所述一个或多个运动轨迹,同时移动手指,使选中的一个或多个运动轨迹随手指移动,直至所述一个或多个运动轨迹达到合成图像中的预设位置。但本发明实施例不限于此。
作为另一个可选实施例,所述方法还包括:删除所述M个运动轨迹中的L个运动轨迹。具体地,用户可以通过图像处理装置的交互界面将M个运动轨迹显示出来,并且按照自己的意愿或者按照某种要求来删除M个运动轨迹中L个运动轨迹。
作为另一个可选实施例,删除所述M个运动轨迹中不满足预设要求的L个运动轨迹,1≤L<M。
具体地,图像处理装置可以按照预设的要求来对M个运动轨迹的特性进行检测和判断,当M个运动轨迹中的L个运动轨迹不符合预设的要求时,图像处理装置可以自动对这L个运动轨迹进行删除,或者图像处理装置可以将L个不符合预设要求的运动轨迹显示给用户,由用户来进行操作和确认,将这L个运动轨迹进行删除。其中,预设要求可包括下列中的至少一种:颜色要求、透明度要求、清晰度要求、大小要求、亮度要求。
作为另一个可选实施例,接收第三指令,所述第三指令用于指示所述预设要求;所述删除所述M个运动轨迹中不满足预设要求的L个运动轨迹包括:根据所述预设要求,确定所述M个运动轨迹不满足所述预设要求的L个运动轨迹,将所述L个运动轨迹删除。
具体地,用户可以通过图像处理装置的交互界面来输入第三指令,通过第三指令来指定预设的要求,比如用户通过图像处理装置的交互界面输入某个亮度参数,图像处理装置在收到三指令指示的亮度参数后,会根据所述亮度参数对M个运动轨迹中的每一个运动轨迹的亮度进行判断,确定亮度小于所述亮度参数的L个运动轨迹,并将L个运动轨迹进行删除。其中亮度参数只是示意性说明,本领域技术人员也可以选用其他参数作为预设要求。
作为另一种可选的实施例,显示所述M个运动轨迹;接收第四指令,所述第四指令确定M个运动轨迹中的待删除的L个运动轨迹;所述删除所述M个运动轨迹中的L个运动轨迹,包括:将所述待删除的L个运动轨迹 删除。
具体地,图像处理装置显示M个运动轨迹,用户通过图像处理装置的交互界面输入第四指令,所述第四指令用于选中M个运动轨迹中的待删除的L个运动轨迹,例如用户使用手指在图像处理装置的交互界面上以框选的方式选中L个运动轨迹,在选中了待删除的运动轨迹后,图像处理装置的交互界面可以出现弹窗,提示用户是否需要将选中的L个运动轨迹删除,用户继续输入指令,将选中的L个运动轨迹删除;另外在选中了L个轨迹以后,图像处理装置也可以直接将L个运动轨迹删除。
进一步地,对剩余的(M-L)个运动轨迹进行图像合成处理,得到合成图像。具体地,在用户将M个运动轨迹中的L个运动轨迹删除后,用户依然可以将剩下的M-L个运动轨迹进行合成,通过本实施例的方法,用户可以按照自己的意愿或者按照预设要求将M个运动轨迹中的L个运动轨迹删除,保留M-L个运动轨迹,然后对剩下的M-L个运动轨迹进行合成,例如在M个运动轨迹中,存在一个或多个轨迹不清晰或者轨迹亮度满足要求,用户可以将所述一个或多个轨迹删除,保存其他满足要求的运动轨迹来进行下一步的操作,这样可以有效地提高了图像编辑的灵活性,为用户提供了更多的编辑方式。
作为一种可选的实施例,所述方法还包括:接收第五指令,所述第五指令用于设置所述M个运动轨迹中一个或多个运动轨迹的图像参数的目标值;根据第五指令设置的所述目标值修改所述一个或多个运动轨迹的图像参数。
具体地,用户可以通过图像处理的交互界面设置该M个运动轨迹中的一个或多个运动轨迹的图像参数的目标值。所述图像参数包括颜色、透明度、亮度、填充、清晰度中的一种或多种。例如,图像参数可以为颜色,用户可以向图像处理装置输入第五指令,将颜色的目标值设置为蓝色,在用户设置完成以后,图像处理装置可以将M个运动轨迹中的一个或多个运动轨迹的颜色修改成蓝色,其中图像参数为颜色只是示意性的说明,本领域技术人员可以选定其他的图像参数,例如来改变M个运动轨迹中的一个或多个运动轨迹的亮度,通过本实施例的方法,用户可以通过与图像处理装置的交互来改变M个运动轨迹中的任一个的颜色、亮度、透明度、填充等。克服了以往不能对光绘图像进行进一步编辑的缺陷。进一步地,用户可以将修改图像参数后的运动轨迹进行合成处理,组合出自己想要的光绘图像。
作为另一个可选实施例,所述方法还可以包括:显示图像对比界面,所述图像对比界面包括指示所述光源运动的预设轨迹。
具体地,用户想在拍摄画面中绘制一个埃菲尔铁塔,但是用户可能由于绘制经验不足,并不知道怎么绘制,此时,图像处理装置可以在显示图像比对界面,其中图像比对界面上会有指示用户移动光源的轨迹,例如图像显示装置的交互界面中会显示一个埃菲尔铁塔的轨迹,由于利用该图像处理装置,用户可以实时看到光源的轨迹和光源在拍摄画面中的位置,则用户可以按照图像比对界面中的预设轨迹,即埃菲尔铁塔的轨迹来移动光源,这样采用这种临摹的方式,即使用户没有任何光绘摄影的经验,也可以绘制出自己想要的图像,降低了对用户操作水平的要求。可选地,该图像处理装置也可以在执行S110和S120之前显示该图像比对界面,用户按照预设轨迹来绘制,以使得用户可以按照该预设运动轨迹移动光源,从而使得该光源在该预设背景下的运动更符合用户期望,但本发明实施例不限于此。
应理解,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。
本发明实施例还提供了一种计算机存储介质,该计算机存储介质中存储有程序指令,所述程序执行时可包括如图2对应实施例中的图像处理方法的部分或全部步骤。
图8是本发明实施例提供的图像处理的装置800的示意性框图。该装置800包括:
获取模块810,用于依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;
处理模块820,用于在所述获取模块810获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,其中1<i≤N;
显示模块830,用于显示所述处理模块820得到的所述光源的第一运动轨迹。
可选地,所述处理模块820具体用于:提取所述第i帧图像的光源图像信息,并将提取到的光源图像信息与从前i-1帧图像中每一帧图像提取的光 源图像信息进行融合。
可选地,所述处理模块820具体用于:将所述前i-1帧图像中每一帧图像提取的光源图像信息与所述第i帧图像进行合成,以使得所述第i帧图像中的光源图像信息与所述前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
可选地,所述处理模块820还用于:
对所述前i-1帧图像中的一帧或多帧图像进行背景建模,得到所述预设背景的背景图像信息;
根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
可选地,所述获取模块810还用于获取P帧图像,其中,所述P帧图像是所述拍摄设备通过对所述预设背景进行拍摄得到的图像,P为大于或等于1的整数;
相应地,所述处理模块820还用于:
根据所述获取模块810获取的所述P帧图像,确定预设背景的背景图像信息;
根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
可选地,所述处理模块820还用于:提取所述N帧图像中的每一帧图像中的光源图像信息,将所述光源图像信息进行融合,得到与所述N帧图像对应的M个运动轨迹,其中,所述M个光源的运动轨迹包括所述第一运动轨迹,M为大于或等于1的整数。
可选地,所述处理模块820还用于将所述M个运动轨迹中的每个运动轨迹以图层的形式保存。
可选地,所述处理模块820还用于:当所述M≥2时,对所述M个运动轨迹中的多个运动轨迹进行合成处理,得到合成图像。
可选地,所述处理模块820具体用于:将保存的所述多个运动轨迹中每个运动轨迹对应的图层进行叠加处理,得到合成图像。
可选地,所述获取模块810还用于获取第一背景图像;相应地,所述处理模块820还用于将所述获取模块810获取的所述第一背景图像和所述M个运动轨中的一个或多个运动轨迹进行合成处理,得到合成图像。
可选地,所述第一背景图像是通过拍照、互联网下载、接收外部设备发送、从存储器读取中的一种或多种方式获取的。
可选地,所述获取模块810具体用于接收第一指令,所述第一指令可以用于指示预设的图像;
相应地,所述处理模块820具体用于:
根据所述获取模块810获取的第一指令,将预设的图像确定为第一背景图像;
将根据所述第一指令确定的第一背景图像与所述一个或多个运动轨迹进行合成,得到合成图像。
可选地,所述装置800还包括:第一接收模块,用于接收第二指令,第二指令用于指示M个运动轨迹中的一个或多个运动轨迹在合成图像中的预设位置;
相应地,所述处理模块820还用于将所述一个或多个运动轨迹在合成图像中移动到所述第二指令指示的预设位置。
可选地,所述处理模块820还用于:删除所述M个运动轨迹中的L个运动轨迹;
可选地,所述处理模块820具体用于删除所述M个运动轨迹中不满足预设要求的L个运动轨迹,1≤L<M。
可选地,所述预设要求包括下列中的至少一种:颜色要求、透明度要求、清晰度要求、大小要求、亮度要求。
可选地,所述装置800还包括:第二接收模块,用于接收第三指令,所述第三指令用于指示所述预设要求;
相应地,所述处理模块820具体用于:根据所述第三指令指示的预设要求,确定所述M个运动轨迹不满足所述预设要求的L个运动轨迹,将所述L个运动轨迹删除。
可选地,所述显示模块830用于显示所述M个运动轨迹。
所述装置800还包括:第三接收模块,用于接收第四指令,所述第四指令用于指示M个运动轨迹中的待删除的L个运动轨迹;
相应地,所述处理模块820具体用于将所述第四指令指示的所述待删除的L个运动轨迹删除。
可选地,所述处理模块820具体用于对剩余的(M-L)个运动轨迹进行 图像合成处理,得到合成图像。
可选地,所述装置800还包括:第四接收模块,用于接收第五指令,所述第五指令用于设置所述M个运动轨迹中一个或多个运动轨迹的图像参数的目标值;
相应地,所述处理模块820还用于根据所述第五指令设置的所述目标值,修改所述一个或多个运动轨迹的图像参数。
可选地,所述图像参数包括颜色、透明度、亮度、填充、清晰度中的一种或多种。
可选地,所述显示模块830还用于显示图像对比界面,所述图像对比界面包括指示所述光源运动的预设轨迹。
可选地,所述拍摄设备具体为配置有云台的成像设备。
可选地,所述装置800可以具体为电子设备。例如,智能手机、平板电脑、个人数字助理(PDA)、膝上计算机、台式计算机、可穿戴式装置(例如,手表、眼镜)等等,本发明实施例对此不做限定。
应理解,这里的装置800以功能模块的形式体现。这里的术语“模块”可以指应用特有集成电路(Application Specific Integrated Circuit,ASIC)、电子电路、用于执行一个或多个软件或固件程序的处理器(例如共享处理器、专有处理器或组处理器等)和存储器、合并逻辑电路和/或其它支持所描述的功能的合适组件。在一个可选例子中,本领域技术人员可以理解,装置800可以用于执行上述方法实施例的各个流程和/或步骤,为避免重复,在此不再赘述。
图9是本发明实施例提供的图像处理的设备900的示意性框图。
所述设备900包括处理器910、存储器920和交互界面930,所述存储器920用于存储指令,所述处理器910用于调用所述指令,执行以下操作:
依次获取N帧图像,所述N帧图像是拍摄设备900对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;
在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并在所述交互界面930上显示所述光源的第一运动轨迹,其中1<i≤N。
可选地,所述处理器910具体用于执行以下操作:提取所述第i帧图像 的光源图像信息,并将提取到的光源图像信息与从前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
可选地,所述处理器910具体用于执行以下操作:将所述前i-1帧图像中每一帧图像提取的光源图像信息与所述第i帧图像进行合成,以使得所述第i帧图像中的光源图像信息与所述前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
可选地,所述处理器910还用于执行以下操作:
对所述前i-1帧图像中的一帧或多帧图像进行背景建模,得到所述预设背景的背景图像信息;
根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
可选地,所述处理器910还用于执行以下操作:
获取P帧图像,其中,所述P帧图像是所述拍摄设备通过对所述预设背景进行拍摄得到的图像,P为大于或等于1的整数;
根据所述P帧图像,确定预设背景的背景图像信息;
根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
可选地,所述处理器910还用于执行以下操作:提取所述N帧图像中的每一帧图像中的光源图像信息,将所述光源图像信息进行融合,得到与所述N帧图像对应的M个运动轨迹,其中,所述M个光源的运动轨迹包括所述第一运动轨迹,M为大于或等于1的整数。
可选地,所述处理器910还用于将所述M个运动轨迹中的每个运动轨迹以图层的形式保存在所述存储器920。
可选地,所述处理器910还用于执行以下操作:当所述M≥2时,对所述M个运动轨迹中的多个运动轨迹进行合成处理,得到合成图像。
可选地,所述处理器910具体用于执行以下操作:将保存的所述多个运动轨迹中每个运动轨迹对应的图层进行叠加处理,得到合成图像。
可选地,所述处理器910还用于执行以下操作:
获取第一背景图像;
将所述第一背景图像和所述M个运动轨中的一个或多个运动轨迹进行合成处理,得到合成图像。
可选地,所述第一背景图像是通过拍照、互联网下载、接收外部设备900发送、从存储器920读取中的一种或多种方式获取的。
可选地,所述交互界面930还用于接收第一指令;
所述处理器910具体用于执行以下操作:
根据所述第一指令,将预设的图像确定为第一背景图像;
将根据所述第一指令确定的第一背景图像与所述一个或多个运动轨迹进行合成,得到合成图像。
可选地,所述交互界面还用于接收第二指令,第二指令用于指示M个运动轨迹中的一个或多个运动轨迹在合成图像中的预设位置;
所述处理器910还用于将所述一个或多个运动轨迹在合成图像中移动到所述第二指令指示的预设位置。
可选地,所述处理器910还用于执行以下操作:删除所述M个运动轨迹中的L个运动轨迹;
可选地,所述处理器910具体用于删除所述M个运动轨迹中不满足预设要求的L个运动轨迹,1≤L<M。
可选地,所述预设要求包括下列中的至少一种:颜色要求、透明度要求、清晰度要求、大小要求、亮度要求。
可选地,所述交互界面930还用于接收第三指令,所述第三指令用于指示所述预设要求;
相应地,所述处理器910具体用于执行以下操作:根据所述第三指令指示的预设要求,确定所述M个运动轨迹不满足所述预设要求的L个运动轨迹,将所述L个运动轨迹删除。
可选地,所述处理器910还用于在所述交互界面930上所述M个运动轨迹。
所述交互界面还用于接收第四指令,所述第四指令用于指示M个运动轨迹中的待删除的L个运动轨迹;
所述处理器910具体用于将所述第四指令指示的所述待删除的L个运动轨迹删除。
可选地,所述处理器910具体用于对剩余的(M-L)个运动轨迹进行图像合成处理,得到合成图像。
可选地,所述交互界面还用于接收第五指令,所述第五指令用于设置所 述M个运动轨迹中一个或多个运动轨迹的图像参数的目标值;
相应地,所述处理器910还用于根据所述第五指令设置的所述目标值,修改所述一个或多个运动轨迹的图像参数。
可选地,所述图像参数包括颜色、透明度、亮度、填充、清晰度中的一种或多种。
可选地,所述处理器910还用于在所述交互界面930上显示图像对比界面,所述图像对比界面包括指示所述光源运动的预设轨迹。
可选地,所述拍摄设备具体为配置有云台的成像设备。
其中,本实施例的交互界面是图像处理设备与用户进行交互的界面,交互界面可以包括显示器,该显示器可以是或者可以不是触摸屏,可以是发光二极管(Light-Emitting Diode,LED)屏幕、有机发光二极管(Organic Light Emitting Diode,OLED)屏幕、液晶显示器(Liquid Crystal Display,LCD)屏幕、等离子体屏幕、或任何其他类型的屏幕,用于对信息的显示,另外显示器作为触摸屏时,可以接收用户的控制指令。另外交互界面还可以包括输入设备,例如键盘、摇杆、拨轮等,用于接收用户的控制指令,实现对图像处理设备的控制。
可选地,所述设备900可以具体为电子设备。可选地,所述设备900可以具体为手持电子设备。例如,智能手机、平板电脑、个人数字助理(PDA)、膝上计算机、台式计算机、可穿戴式装置(例如,手表、眼镜)等等,本发明实施例对此不做限定。
在一个可选例子中,本领域技术人员可以理解,设备900可以用于执行上述图像处理方法实施例的各个流程和/或步骤,为避免重复,在此不再赘述。
还应理解,本文中术语“系统”和“网络”在本文中常被可互换使用。本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。
本领域普通技术人员可以意识到,结合本文中所公开的实施例中描述的各方法步骤和模块,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各实施例的步骤及组成。这些功能究竟以硬件还是软件方式来执 行,取决于技术方案的特定应用和设计约束条件。本领域普通技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的系统、装置和模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口、装置或模块的间接耦合或通信连接,也可以是电的,机械的或其它的形式连接。
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本发明实施例方案的目的。
另外,在本发明各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以是两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。
所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分,或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-only Memory,RoM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限 于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以权利要求的保护范围为准。

Claims (67)

  1. 一种图像处理的方法,其特征在于,包括:
    依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;
    在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并显示所述光源的第一运动轨迹,其中1<i≤N。
  2. 根据权利要求1所述的方法,其特征在于,
    所述将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,包括:
    提取所述第i帧图像的光源图像信息,并将提取到的光源图像信息与从前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
  3. 根据权利要求1所述的方法,其特征在于,
    所述将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,包括:
    将所述前i-1帧图像中每一帧图像提取的光源图像信息与所述第i帧图像进行合成,以使得所述第i帧图像中的光源图像信息与所述前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
  4. 根据权利要求1-3任一项所述的方法,其特征在于,所述方法还包括:
    对所述前i-1帧图像中的一帧或多帧图像进行背景建模,得到所述预设背景的背景图像信息;
    根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
  5. 根据权利要求1-3任一项所述的方法,其特征在于,所述方法还包括:
    获取P帧图像,其中,所述P帧图像是所述拍摄设备通过对所述预设背景进行拍摄得到的图像,P为大于或等于1的整数;
    根据所述P帧图像,确定预设背景的背景图像信息;
    根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
  6. 根据权利要求1-5任一项所述的方法,其特征在于,所述方法还包 括:
    提取所述N帧图像中的每一帧图像中的光源图像信息,将所述光源图像信息进行融合,得到与所述N帧图像对应的M个运动轨迹,其中,所述M个光源的运动轨迹包括所述第一运动轨迹,M为大于或等于1的整数。
  7. 根据权利要求6所述的方法,其特征在于,所述方法还包括:
    将所述M个运动轨迹中的每个运动轨迹以图层的形式保存。
  8. 根据权利要求6或7所述的方法,其特征在于,所述方法还包括:
    当所述M≥2时,对所述M个运动轨迹中的多个运动轨迹进行合成处理,得到合成图像。
  9. 根据权利要求8所述的方法,其特征在于,
    所述对所述M个运动轨迹中的多个运动轨迹进行合成处理,包括:
    将保存所述多个运动轨迹中每个运动轨迹对应的图层进行叠加处理,得到合成图像。
  10. 根据权利要求6或7所述的方法,其特征在于,所述方法还包括:
    获取第一背景图像;
    将所述第一背景图像和所述M个运动轨中的一个或多个运动轨迹进行合成处理,得到合成图像。
  11. 根据权利要求10所述的方法,其特征在于,所述第一背景图像是通过拍照、互联网下载、接收外部设备发送、从存储器读取中的一种或多种方式获取的。
  12. 根据权利要求10或11所述的方法,其特征在于,所述获取第一图像包括:
    接收第一指令,根据第一指令将预设的图像确定为第一背景图像;
    所述将所述第一背景图像和所述一个或多个运动轨迹进行合成处理,得到合成图像,包括:
    将第一指令确定的第一背景图像与所述一个或多个运动轨迹进行合成,得到合成图像。
  13. 根据权利要求8至12中任一项所述的方法,其特征在于,所述方法还包括:
    接收第二指令,第二指令用于指示M个运动轨迹中的一个或多个运动轨迹在合成图像中的预设位置;
    将所述一个或多个运动轨迹在合成图像中移动到所述第二指令指示的预设位置。
  14. 根据权利要求6至13中任一项所述的方法,其特征在于,所述方法还包括:
    删除所述M个运动轨迹中的L个运动轨迹;
  15. 根据权利要求14所述的方法,其特征在于,所述删除所述M个运动轨迹中的L个运动轨迹,包括:
    删除所述M个运动轨迹中不满足预设要求的L个运动轨迹,1≤L<M。
  16. 根据权利要求15所述的方法,其特征在于,
    所述预设要求包括下列中的至少一种:颜色要求、透明度要求、清晰度要求、大小要求、亮度要求。
  17. 根据权利要求15或16所述的方法,其特征在于,所述方法还包括:
    接收第三指令,所述第三指令用于指示所述预设要求;
    所述删除所述M个运动轨迹中不满足预设要求的L个运动轨迹包括:
    根据所述预设要求,确定所述M个运动轨迹不满足所述预设要求的L个运动轨迹,将所述L个运动轨迹删除。
  18. 根据权利要求14所述的方法,其特征在于,所述方法还包括:
    显示所述M个运动轨迹;
    接收第四指令,所述第四指令用于指示M个运动轨迹中的待删除的L个运动轨迹;
    所述删除所述M个运动轨迹中的L个运动轨迹,包括:
    将所述待删除的L个运动轨迹删除。
  19. 根据权利要求6至18中任一项所述的方法,其特征在于,所述方法还包括:
    接收第五指令,所述第五指令用于设置所述M个运动轨迹中一个或多个运动轨迹的图像参数的目标值;
    根据第五指令设置的所述目标值修改所述一个或多个运动轨迹的图像参数。
  20. 根据权利要求19所述的方法,其特征在于,所述图像参数包括颜色、透明度、亮度、填充、清晰度中的一种或多种。
  21. 根据权利要求1至20中任一项所述的方法,其特征在于,所述方 法还包括:
    显示图像对比界面,所述图像对比界面包括指示所述光源运动的预设轨迹。
  22. 根据权利要求1至21中任一项所述的方法,其特征在于,所述拍摄设备具体为配置有云台的成像设备。
  23. 一种图像处理的装置,其特征在于,包括:
    获取模块,用于依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;
    处理模块,用于在所述获取模块获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,其中1<i≤N;
    显示模块,用于显示所述处理模块得到的所述光源的第一运动轨迹。
  24. 根据权利要求23所述的装置,其特征在于,所述处理模块具体用于:
    提取所述第i帧图像的光源图像信息,并将提取到的光源图像信息与从前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
  25. 根据权利要求23所述的装置,其特征在于,所述处理模块具体用于:
    将所述前i-1帧图像中每一帧图像提取的光源图像信息与所述第i帧图像进行合成,以使得所述第i帧图像中的光源图像信息与所述前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
  26. 根据权利要求23-25任一项所述的装置,其特征在于,所述处理模块还用于:
    对所述前i-1帧图像中的一帧或多帧图像进行背景建模,得到所述预设背景的背景图像信息;
    根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
  27. 根据权利要求23-25任一项所述的装置,其特征在于,所述获取模块还用于获取P帧图像,其中,所述P帧图像是所述拍摄设备通过对所述预设背景进行拍摄得到的图像,P为大于或等于1的整数;
    所述处理模块还用于:
    根据所述获取模块获取的所述P帧图像,确定预设背景的背景图像信息;
    根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
  28. 根据权利要求23-27任一项所述的装置,其特征在于,所述处理模块还用于:
    提取所述N帧图像中的每一帧图像中的光源图像信息,将所述光源图像信息进行融合,得到与所述N帧图像对应的M个运动轨迹,其中,所述M个光源的运动轨迹包括所述第一运动轨迹,M为大于或等于1的整数。
  29. 根据权利要求28所述的装置,其特征在于,所述处理模块还用于将所述M个运动轨迹中的每个运动轨迹以图层的形式保存。
  30. 根据权利要求28或29所述的装置,其特征在于,所述处理模块还用于:
    当所述M≥2时,对所述M个运动轨迹中的多个运动轨迹进行合成处理,得到合成图像。
  31. 根据权利要求30所述的装置,其特征在于,所述处理模块具体用于:
    将保存的所述多个运动轨迹中每个运动轨迹对应的图层进行叠加处理,得到合成图像。
  32. 根据权利要求28或29所述的装置,其特征在于,所述获取模块还用于获取第一背景图像;
    所述处理模块还用于将所述获取模块获取的所述第一背景图像和所述M个运动轨中的一个或多个运动轨迹进行合成处理,得到合成图像。
  33. 根据权利要求32所述的装置,其特征在于,所述第一背景图像是通过拍照、互联网下载、接收外部设备发送、从存储器读取中的一种或多种方式获取的。
  34. 根据权利要求32或33所述的装置,其特征在于,所述获取模块具体用于接收第一指令;
    所述处理模块具体用于:
    根据所述获取模块获取的第一指令,将预设的图像确定为第一背景图像;
    将根据所述第一指令确定的第一背景图像与所述一个或多个运动轨迹 进行合成,得到合成图像。
  35. 根据权利要求30至34中任一项所述的装置,其特征在于,
    所述获取模块,还用于接收第二指令;其中,所述第二指令用于指示M个运动轨迹中的一个或多个运动轨迹在合成图像中的预设位置;
    所述处理模块还用于将所述一个或多个运动轨迹在合成图像中移动到所述第二指令指示的预设位置。
  36. 根据权利要求28至35中任一项所述的装置,其特征在于,所述处理模块还用于:
    删除所述M个运动轨迹中的L个运动轨迹;
  37. 根据权利要求36所述的装置,其特征在于,所述处理模块具体用于删除所述M个运动轨迹中不满足预设要求的L个运动轨迹,1≤L<M。
  38. 根据权利要求37所述的装置,其特征在于,所述预设要求包括下列中的至少一种:颜色要求、透明度要求、清晰度要求、大小要求、亮度要求。
  39. 根据权利要求37或38所述的装置,其特征在于,
    所述获取模块,还用于接收第三指令,所述第三指令用于指示所述预设要求;
    所述处理模块具体用于:根据所述第三指令指示的预设要求,确定所述M个运动轨迹不满足所述预设要求的L个运动轨迹,将所述L个运动轨迹删除。
  40. 根据权利要求36所述的装置,其特征在于,
    所述显示模块,用于显示所述M个运动轨迹;
    所述获取模块,还用于接收第四指令,所述第四指令用于指示M个运动轨迹中的待删除的L个运动轨迹;
    所述处理模块具体用于将所述第四指令指示的所述待删除的L个运动轨迹删除。
  41. 根据权利要求28至40中任一项所述的装置,其特征在于,所述获取模块,还用于接收第五指令,所述第五指令用于设置所述M个运动轨迹中一个或多个运动轨迹的图像参数的目标值;
    所述处理模块还用于根据所述第五指令设置的所述目标值,修改所述一个或多个运动轨迹的图像参数。
  42. 根据权利要求41所述的装置,其特征在于,所述图像参数包括颜色、透明度、亮度、填充、清晰度中的一种或多种。
  43. 根据权利要求23至42中任一项所述的装置,其特征在于,所述显示模块还用于显示图像对比界面,所述图像对比界面包括指示所述光源运动的预设轨迹。
  44. 根据权利要求23至43中任一项所述的装置,其特征在于,所述拍摄设备具体为配置有云台的成像设备。
  45. 一种图像处理的设备,其特征在于,包括处理器、存储器和交互界面,所述存储器用于存储指令,所述处理器用于调用所述指令,执行以下操作:
    依次获取N帧图像,所述N帧图像是拍摄设备对光源在预设背景下的运动进行拍摄得到的图像,所述N为大于或等于2的整数;
    在获取所述N帧图像中的第i帧图像时,将所述第i帧图像中的光源图像信息与从前i-1帧图像中每一帧图像中提取的光源图像信息进行融合,得到所述光源的第一运动轨迹,并在所述交互界面上显示所述光源的第一运动轨迹,其中1<i≤N。
  46. 根据权利要求45所述的设备,其特征在于,所述处理器具体用于执行以下操作:
    提取所述第i帧图像的光源图像信息,并将提取到的光源图像信息与从前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
  47. 根据权利要求45所述的设备,其特征在于,所述处理器具体用于执行以下操作:
    将所述前i-1帧图像中每一帧图像提取的光源图像信息与所述第i帧图像进行合成,以使得所述第i帧图像中的光源图像信息与所述前i-1帧图像中每一帧图像提取的光源图像信息进行融合。
  48. 根据权利要求45-47任一项所述的设备,其特征在于,所述处理器还用于执行以下操作:
    对所述前i-1帧图像中的一帧或多帧图像进行背景建模,得到所述预设背景的背景图像信息;
    根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
  49. 根据权利要求45-47任一项所述的设备,其特征在于,所述处理器还用于执行以下操作:
    获取P帧图像,其中,所述P帧图像是所述拍摄设备通过对所述预设背景进行拍摄得到的图像,P为大于或等于1的整数;
    根据所述P帧图像,确定预设背景的背景图像信息;
    根据所述背景图像信息,对所述前i-1帧图像中每一帧图像进行提取,得到从所述每一帧图像提取的光源图像信息。
  50. 根据权利要求45-49任一项所述的设备,其特征在于,所述处理器还用于执行以下操作:
    提取所述N帧图像中的每一帧图像中的光源图像信息,将所述光源图像信息进行融合,得到与所述N帧图像对应的M个运动轨迹,其中,所述M个光源的运动轨迹包括所述第一运动轨迹,M为大于或等于1的整数。
  51. 根据权利要求50所述的设备,其特征在于,所述处理器还用于将所述M个运动轨迹中的每个运动轨迹以图层的形式保存在所述存储器。
  52. 根据权利要求50或51所述的设备,其特征在于,所述处理器还用于执行以下操作:
    当所述M≥2时,对所述M个运动轨迹中的多个运动轨迹进行合成处理,得到合成图像。
  53. 根据权利要求52所述的设备,其特征在于,所述处理器具体用于执行以下操作:
    将保存的所述多个运动轨迹中每个运动轨迹对应的图层进行叠加处理,得到合成图像。
  54. 根据权利要求50或51所述的设备,其特征在于,所述处理器还用于执行以下操作:
    获取第一背景图像;
    将所述第一背景图像和所述M个运动轨中的一个或多个运动轨迹进行合成处理,得到合成图像。
  55. 根据权利要求54所述的设备,其特征在于,所述第一背景图像是通过拍照、互联网下载、接收外部设备发送、从存储器读取中的一种或多种方式获取的。
  56. 根据权利要求54或55所述的设备,其特征在于,所述交互界面, 还用于接收第一指令;
    所述处理器具体用于执行以下操作:
    根据所述第一指令,将预设的图像确定为第一背景图像;
    将根据所述第一指令确定的第一背景图像与所述一个或多个运动轨迹进行合成,得到合成图像。
  57. 根据权利要求52至56中任一项所述的设备,其特征在于,所述交互界面,还用于接收第二指令,第二指令用于指示M个运动轨迹中的一个或多个运动轨迹在合成图像中的预设位置;
    所述处理器还用于将所述一个或多个运动轨迹在合成图像中移动到所述第二指令指示的预设位置。
  58. 根据权利要求50至57中任一项所述的设备,其特征在于,所述处理器还用于执行以下操作:
    删除所述M个运动轨迹中的L个运动轨迹;
  59. 根据权利要求58所述的设备,其特征在于,所述处理器具体用于删除所述M个运动轨迹中不满足预设要求的L个运动轨迹,1≤L<M。
  60. 根据权利要求59所述的设备,其特征在于,所述预设要求包括下列中的至少一种:颜色要求、透明度要求、清晰度要求、大小要求、亮度要求。
  61. 根据权利要求59或60所述的设备,其特征在于,所述设备交互界面,还用于接收第三指令,所述第三指令用于指示所述预设要求;
    所述处理器具体用于执行以下操作:
    根据所述第三指令指示的预设要求,确定所述M个运动轨迹不满足所述预设要求的L个运动轨迹,将所述L个运动轨迹删除。
  62. 根据权利要求58所述的设备,其特征在于,所述处理器还用于在所述交互界面上显示所述M个运动轨迹;
    所述交互界面,还用于接收第四指令,所述第四指令用于指示M个运动轨迹中的待删除的L个运动轨迹;
    所述处理器具体用于将所述第四指令指示的所述待删除的L个运动轨迹删除。
  63. 根据权利要求50至62中任一项所述的设备,其特征在于,所述交互界面,还用于接收第五指令,所述第五指令用于设置所述M个运动轨迹 中一个或多个运动轨迹的图像参数的目标值;
    所述处理器还用于根据所述第五指令设置的所述目标值,修改所述一个或多个运动轨迹的图像参数。
  64. 根据权利要求63所述的设备,其特征在于,所述图像参数包括颜色、透明度、亮度、填充、清晰度中的一种或多种。
  65. 根据权利要求45至64中任一项所述的设备,其特征在于,所述处理器还用于在所述交互界面上显示图像对比界面,所述图像对比界面包括指示所述光源运动的预设轨迹。
  66. 根据权利要求45至65中任一项所述的设备,其特征在于,所述拍摄设备具体为配置有云台的成像设备。
  67. 根据权利要求45至66中任一项所述的设备,其特征在于,所述设备具体为电子设备。
PCT/CN2016/112302 2016-12-27 2016-12-27 图像处理的方法、装置和设备 WO2018119632A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2016/112302 WO2018119632A1 (zh) 2016-12-27 2016-12-27 图像处理的方法、装置和设备
CN201680002775.XA CN107077720A (zh) 2016-12-27 2016-12-27 图像处理的方法、装置和设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/112302 WO2018119632A1 (zh) 2016-12-27 2016-12-27 图像处理的方法、装置和设备

Publications (1)

Publication Number Publication Date
WO2018119632A1 true WO2018119632A1 (zh) 2018-07-05

Family

ID=59624490

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/112302 WO2018119632A1 (zh) 2016-12-27 2016-12-27 图像处理的方法、装置和设备

Country Status (2)

Country Link
CN (1) CN107077720A (zh)
WO (1) WO2018119632A1 (zh)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109978968A (zh) * 2019-04-10 2019-07-05 广州虎牙信息科技有限公司 运动对象的视频绘制方法、装置、设备及存储介质
CN112565844A (zh) * 2020-12-04 2021-03-26 维沃移动通信有限公司 视频通信方法、装置和电子设备
CN112672199A (zh) * 2020-12-22 2021-04-16 海信视像科技股份有限公司 一种显示设备及多图层叠加方法
CN112672059A (zh) * 2020-12-28 2021-04-16 维沃移动通信有限公司 一种拍摄方法及拍摄装置
CN113467680A (zh) * 2021-06-28 2021-10-01 网易(杭州)网络有限公司 绘图处理方法、装置、电子设备及存储介质
CN113660397A (zh) * 2021-08-12 2021-11-16 广州竭力信息科技有限公司 一种基于现实场景实时展示的光绘互动方法
EP4207742A4 (en) * 2020-11-30 2024-03-20 Vivo Mobile Communication Co Ltd PHOTOGRAPHY METHOD, PHOTOGRAPHY APPARATUS AND ELECTRONIC DEVICE

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110365927B (zh) * 2018-04-09 2022-03-01 腾讯科技(深圳)有限公司 视频录制方法、装置、存储介质和计算机设备
CN108495041B (zh) * 2018-04-18 2020-09-29 国之云(山东)信息科技有限公司 一种用于电子终端的图像处理和显示方法、装置
CN108898652B (zh) * 2018-06-13 2022-11-25 珠海豹趣科技有限公司 一种皮肤图像设置方法、装置及电子设备
CN110412828A (zh) * 2018-09-07 2019-11-05 广东优世联合控股集团股份有限公司 一种三维光迹影像的打印方法及系统
CN110913118B (zh) * 2018-09-17 2021-12-17 腾讯数码(天津)有限公司 视频处理方法、装置及存储介质
CN109741242B (zh) * 2018-12-25 2023-11-14 努比亚技术有限公司 光绘处理方法、终端和计算机可读存储介质
CN110611768B (zh) 2019-09-27 2021-06-29 北京小米移动软件有限公司 多重曝光摄影方法及装置
CN113709389A (zh) * 2020-05-21 2021-11-26 北京达佳互联信息技术有限公司 一种视频渲染方法、装置、电子设备及存储介质
CN113810587B (zh) * 2020-05-29 2023-04-18 华为技术有限公司 一种图像处理方法及装置
CN114531547A (zh) * 2022-02-23 2022-05-24 维沃移动通信有限公司 图像处理方法、装置和电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014035642A1 (en) * 2012-08-28 2014-03-06 Mri Lightpainting Llc Light painting live view
CN103888683A (zh) * 2014-03-24 2014-06-25 深圳市中兴移动通信有限公司 移动终端及其拍摄方法
CN104104798A (zh) * 2014-07-23 2014-10-15 深圳市中兴移动通信有限公司 拍摄光绘视频的方法和移动终端
CN104159040A (zh) * 2014-08-28 2014-11-19 深圳市中兴移动通信有限公司 拍摄方法和拍摄装置
CN104202521A (zh) * 2014-08-28 2014-12-10 深圳市中兴移动通信有限公司 拍摄方法及拍摄装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012066775A1 (ja) * 2010-11-18 2012-05-24 パナソニック株式会社 撮像装置、撮像方法
CN103903213B (zh) * 2012-12-24 2018-04-27 联想(北京)有限公司 一种拍摄方法和电子设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014035642A1 (en) * 2012-08-28 2014-03-06 Mri Lightpainting Llc Light painting live view
CN103888683A (zh) * 2014-03-24 2014-06-25 深圳市中兴移动通信有限公司 移动终端及其拍摄方法
CN104104798A (zh) * 2014-07-23 2014-10-15 深圳市中兴移动通信有限公司 拍摄光绘视频的方法和移动终端
CN104159040A (zh) * 2014-08-28 2014-11-19 深圳市中兴移动通信有限公司 拍摄方法和拍摄装置
CN104202521A (zh) * 2014-08-28 2014-12-10 深圳市中兴移动通信有限公司 拍摄方法及拍摄装置

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109978968A (zh) * 2019-04-10 2019-07-05 广州虎牙信息科技有限公司 运动对象的视频绘制方法、装置、设备及存储介质
EP4207742A4 (en) * 2020-11-30 2024-03-20 Vivo Mobile Communication Co Ltd PHOTOGRAPHY METHOD, PHOTOGRAPHY APPARATUS AND ELECTRONIC DEVICE
CN112565844A (zh) * 2020-12-04 2021-03-26 维沃移动通信有限公司 视频通信方法、装置和电子设备
CN112672199A (zh) * 2020-12-22 2021-04-16 海信视像科技股份有限公司 一种显示设备及多图层叠加方法
CN112672059A (zh) * 2020-12-28 2021-04-16 维沃移动通信有限公司 一种拍摄方法及拍摄装置
CN112672059B (zh) * 2020-12-28 2022-06-28 维沃移动通信有限公司 一种拍摄方法及拍摄装置
CN113467680A (zh) * 2021-06-28 2021-10-01 网易(杭州)网络有限公司 绘图处理方法、装置、电子设备及存储介质
CN113660397A (zh) * 2021-08-12 2021-11-16 广州竭力信息科技有限公司 一种基于现实场景实时展示的光绘互动方法

Also Published As

Publication number Publication date
CN107077720A (zh) 2017-08-18

Similar Documents

Publication Publication Date Title
WO2018119632A1 (zh) 图像处理的方法、装置和设备
CN108986199B (zh) 虚拟模型处理方法、装置、电子设备及存储介质
JP6834056B2 (ja) 撮影モバイル端末
CN106570110B (zh) 图像去重方法及装置
US20160180593A1 (en) Wearable device-based augmented reality method and system
CN108762501B (zh) Ar显示方法、智能终端、ar设备及系统
US20210343070A1 (en) Method, apparatus and electronic device for processing image
CN107977083B (zh) 基于vr系统的操作执行方法及装置
WO2022042776A1 (zh) 一种拍摄方法及终端
US20210065342A1 (en) Method, electronic device and storage medium for processing image
CN110572706B (zh) 视频截屏方法、终端及计算机可读存储介质
CN111970456B (zh) 拍摄控制方法、装置、设备及存储介质
CN106951090B (zh) 图片处理方法及装置
CN108122195B (zh) 图片处理方法及装置
WO2022142388A1 (zh) 特效显示方法及电子设备
US10063791B2 (en) Method for presentation of images
EP3799415A2 (en) Method and device for processing videos, and medium
US11252341B2 (en) Method and device for shooting image, and storage medium
CN104349065B (zh) 一种图片拍摄方法、装置和智能终端
WO2016101426A1 (zh) 拍照方法及装置
CN114078280A (zh) 动作捕捉方法、装置、电子设备及存储介质
CN114070998A (zh) 一种拍摄月亮的方法、装置、电子设备及介质
CN114915722B (zh) 处理视频的方法和装置
WO2022170918A1 (zh) 合拍方法和电子设备
WO2022062554A1 (zh) 多镜头视频录制方法及相关设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16925541

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16925541

Country of ref document: EP

Kind code of ref document: A1