WO2017101293A1 - 多媒体照片生成方法、装置、设备及手机 - Google Patents

多媒体照片生成方法、装置、设备及手机 Download PDF

Info

Publication number
WO2017101293A1
WO2017101293A1 PCT/CN2016/087666 CN2016087666W WO2017101293A1 WO 2017101293 A1 WO2017101293 A1 WO 2017101293A1 CN 2016087666 W CN2016087666 W CN 2016087666W WO 2017101293 A1 WO2017101293 A1 WO 2017101293A1
Authority
WO
WIPO (PCT)
Prior art keywords
music
picture
photo
location information
multimedia
Prior art date
Application number
PCT/CN2016/087666
Other languages
English (en)
French (fr)
Inventor
王振宇
Original Assignee
乐视控股（北京）有限公司
乐视移动智能信息技术（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 乐视控股（北京）有限公司, 乐视移动智能信息技术（北京）有限公司 filed Critical 乐视控股（北京）有限公司
Priority to US15/245,168 priority Critical patent/US20170171471A1/en
Publication of WO2017101293A1 publication Critical patent/WO2017101293A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/487—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location

Definitions

  • the present invention relates to the field of multimedia technologies, and in particular, to a multimedia photo generation method, device, device, and mobile phone.
  • Devices with camera functions such as smartphones and tablets, have become a good social tool because of their portability and rapid dissemination of information. As the penetration rate increases, more and more auxiliary functions are added.
  • the photos can be sent to social platforms for sharing through social media such as smart phones, tablets, etc. (such as WeChat, Weibo, QQ chat tools, etc.), and some smartphones and tablets also have GPS installed.
  • the module of the positioning function acquires the current geographic information and adds the geographic information to the currently photographed photo, so that others can also obtain the geographical information of the photographing place while sharing the photo with others.
  • the technical problem to be solved by the present invention is to overcome the defects in the prior art that the user performs an optimization process on the photo with poor background effect, and the operation is extremely complicated and the experience is poor, thereby providing a multimedia photo generation method, device, device and mobile phone. .
  • the present invention provides a multimedia photo generation method for a photographing apparatus, comprising the following steps:
  • the foreground picture, the background picture, and the background music are mixed into a multimedia photo.
  • the step of searching for a picture and music matching the location information from the multimedia database as the background image and the background music of the photo according to the location information includes:
  • the picture and music corresponding to the keyword index that is the same or similar to the location information keyword are used as the picture and music matching the location information.
  • the multimedia photo generating method of the present invention after the step of searching for a picture and music corresponding to the keyword index of the same or similar keyword of the location information from the multimedia database by using the location information as a key include:
  • the keyword information corresponding to the location information keyword other than the previously searched picture or music is searched from the multimedia database by using the location information as a key. Pictures or music until no longer receive instructions to re-find pictures or music;
  • the picture and music corresponding to the keyword index that is finally found to be the same or similar to the location information keyword are used as the picture and music that match the location information.
  • the multimedia photo generation method of the present invention determines whether an instruction to cull the background of the photo is received and whether an instruction to re-find the picture or music is received by performing speech recognition on the received sound.
  • the present invention also provides a multimedia photo generating apparatus for a photographing apparatus, comprising:
  • a location information acquiring unit configured to acquire location information of a location where the photographing device is located
  • An original photo acquisition unit configured to acquire a photo of a subject of the photographing device
  • a foreground picture extracting unit configured to extract a person image from the photo as a foreground picture after receiving an instruction to cull the background of the photo;
  • a matching unit configured to search, according to the location information, a picture and music that matches the location information from the multimedia database as a background image of the photo and background music;
  • a generating unit configured to mix the foreground picture, the background picture, and the background music into a multimedia photo.
  • the matching unit searches for a picture and music corresponding to the keyword index of the same or similar keyword of the location information from the multimedia database by using the location information as a key.
  • the keyword database indexing corresponding to the picture and the music is stored in the multimedia database; and when the instruction for re-finding the picture or the music is not received, the keyword corresponding to the keyword information with the same or similar position keyword is indexed Music acts as a picture and music that matches the location information.
  • the matching unit is further configured to: when receiving an instruction to re-find a picture or music, use the location information as a key to search for a picture other than the previously found picture from the multimedia database or A keyword or music other than music that is the same as or similar to the location information keyword, until the instruction to re-find the picture or music is no longer received; and the final search is the same as the location information keyword or Similar keyword indexing
  • the pictures and music should be the pictures and music that match the location information.
  • the multimedia photo generating apparatus of the present invention further includes an instruction recognizing unit configured to perform speech recognition on the received sound to determine whether an instruction to cull the background of the photo is received and whether an instruction to re-find the picture or music is received.
  • the present invention also provides a multimedia photo generating device, comprising: a positioning device, a photographing device, a multimedia photo generating device, a display device, and a playing device;
  • the positioning device is configured to determine location information of a location where the photographing device is located;
  • the photographing device is configured to photograph a photograph of a photographing object of the photographing device
  • the multimedia photo generating device is connected to the positioning device and the photographing device, and configured to receive position information sent by the positioning component, receive a photo sent by the photographing component, and after receiving an instruction to remove the background of the photo Extracting a character image from the photo as a foreground image, and then searching for a picture and music matching the location information from the multimedia database as a background image of the photo and background music according to the location information, and the foreground
  • the picture, the background picture, and the background music are mixed into a multimedia photo;
  • the display device is connected to the photographing device and the multimedia photo generating device for displaying the photo and the multimedia photo;
  • the playing device is connected to the multimedia photo generating device for playing the background music.
  • the invention also provides a mobile phone, comprising: the above multimedia photo generating device or the above Media photo generation device.
  • the present invention further provides a multimedia photo generating apparatus for a photographing apparatus, comprising:
  • One or more processors a memory; one or more programs, the one or more programs being stored in the memory, and when executed by the one or more processors, performing the following operations:
  • Acquiring location information of a location where the photographing device is located acquiring a photograph of a photographing object of the photographing device; extracting a character image from the photograph as a foreground image after receiving an instruction to remove the background of the photograph;
  • the location information finds a picture and music matching the location information from the multimedia database as a background picture of the photo and background music; and mixes the foreground picture, the background picture, and the background music into a multimedia photo.
  • the multimedia photo generating apparatus wherein the step of searching for a picture and music matching the location information from the multimedia database according to the location information as a background image of the photo and background music comprises:
  • the location information is a keyword, and the picture and music corresponding to the keyword index of the same or similar to the location information keyword are searched from the multimedia database, and the keyword index corresponding to the picture and the music is stored in the multimedia database; If no instruction to re-find the picture or music is received, the picture and music corresponding to the keyword index that is the same or similar to the location information keyword are used as the picture and music matching the location information.
  • the multimedia photo generating apparatus wherein the step of searching for a picture and music corresponding to a keyword index identical or similar to the location information keyword from the multimedia database using the location information as a key is further Including: If you receive an instruction to re-find pictures or music, Searching, by using the location information as a key, a picture or music corresponding to a keyword index that is the same as or similar to the location information keyword except the previously searched picture or music, and no longer receives the re-review An instruction to find a picture or music; the picture and music corresponding to the keyword index that is finally found to be the same or similar to the location information keyword as the picture and music matching the location information.
  • the multimedia photo generating apparatus wherein the voice recognition of the received sound is used to determine whether an instruction to cull the background of the photo is received and whether an instruction to re-find the picture or music is received.
  • the invention provides a multimedia photo generation method and device, which first acquires position information of a position where the photographing device is located, and acquires a photograph of a photographed object of the photographing device; and extracts a character image from the photograph after receiving an instruction to remove the background of the photograph
  • the picture and music matching the location information are searched from the multimedia database as the background picture of the photo and the background music according to the location information; finally, the foreground picture, the background picture and the background music are mixed into one multimedia photo.
  • the person image can be automatically extracted from the photo as the foreground image and the original poor background can be eliminated, and the location of the photographed place will be found from the multimedia database.
  • the image matching the image is used as a new background image. It is not necessary for the user to optimize the background of the photo through the professional retouching software. Just send out the instruction to remove the background of the photo and replace the background with the image that matches the position information of the photo. Easy to handle and high user experience. And can also automatically find the music that matches the location information as the background music, which is used to mix the foreground photo and the background image into a multimedia photo. The film achieves the perfect combination of audiovisual.
  • the method and device for generating multimedia photos if the user is dissatisfied with the searched picture or music, after receiving the instruction to re-match the picture or music, the location information is used as a key to search from the multimedia database. Finding a picture or music other than the picture or music that is the same or similar to the location information keyword, until the instruction to re-find the picture or music is no longer received; after that, the final search and the location will be found.
  • the keywords and music corresponding to the same or similar keyword are indexed as pictures and music matching the location information. It lays the foundation for generating multimedia photos with high user satisfaction, including foreground images, background images and background music, and the user experience is better.
  • the multimedia photo generation method and device of the present invention determines whether an instruction to cull the background of the photo is received and whether an instruction to re-find the picture or music is received by performing voice recognition on the received sound, and the user can manually pass the instruction without inputting the instruction manually.
  • the voice of the user is voice-recognized to receive the corresponding instruction and perform corresponding operations according to the instruction, which liberates the user's hands, can quickly respond to the user's needs, and improves the user's experience.
  • FIG. 1 is a flowchart of a specific example of a method for generating a multimedia photo in Embodiment 1 of the present invention
  • FIG. 2 is a flowchart of a specific example of finding a picture and music matching the location information from a multimedia database in a multimedia photo generation method according to Embodiment 1 of the present invention
  • FIG. 3 is a structural block diagram of a specific example of a multimedia photo generating apparatus according to Embodiment 2 of the present invention.
  • FIG. 4 is a structural block diagram of a specific example of a multimedia photo generating device in Embodiment 3 of the present invention.
  • FIG. 5 is a structural diagram of a multimedia photo generating apparatus having a processor according to the present invention.
  • FIG. 6 is a structural diagram of a multimedia photo generating apparatus having two processors according to the present invention.
  • 1-position information acquisition unit 2-original photo acquisition unit; 3-foreground picture extraction unit; 4-match unit; 5-generation unit; 6-instruction identification unit; 11-positioning device; 12-photographing device; Photo generation device; 14-display device; 15-play device.
  • connection or integral connection; may be mechanical connection or electrical connection; may be directly connected, may also be indirectly connected through an intermediate medium, or may be internal communication of two components, may be wireless connection, or may be wired connection.
  • connection or integral connection; may be mechanical connection or electrical connection; may be directly connected, may also be indirectly connected through an intermediate medium, or may be internal communication of two components, may be wireless connection, or may be wired connection.
  • This embodiment provides a multimedia photo generation method for a photographing device, as shown in FIG. 1 , including the following steps:
  • the location information generally includes latitude and longitude information and information about the country, province, city, county, district, or scenic spot, that is, the location information of the location where the photographing device is located, and the geographical environment in which the photographing location is located can be known, for example, It is shot at the seaside, in the mountains, or in some places of interest such as Mount Tai, the Forbidden City, etc.
  • the period provides a guide to the background image and background music that match the photo.
  • the character image is extracted from the photo as a foreground image.
  • the character image in the photo may be determined by the contour analysis method and extracted as a foreground image.
  • any method in the prior art capable of realizing image extraction of a person in the photo may be used to implement the above operation.
  • Pushing it to the user can make the background image fit as much as possible with the original background that was previously removed.
  • the multimedia photo generation method in this embodiment the background effect of the user on the photograph taken If you are not satisfied, you can automatically extract the character image from the photo as the foreground image and reject the background with the original poor effect.
  • the image matching the location information of the shooting location found in the multimedia database will be used as the new background.
  • the picture does not require the user to optimize the background of the photo through the professional retouching software, and only needs to issue an instruction to remove the background of the photo to replace the background with the image matching the position information of the photographing position, and the optimization process is simple and the user experience is high. And can also automatically find the music that matches the location information as the background music, which is used to mix with the foreground image and the background image into a multimedia photo, realizing the perfect combination of audiovisual.
  • step S4 includes:
  • the location information as a key, search for a picture and music corresponding to the keyword index that is the same as or similar to the location information keyword, and store the keyword index corresponding to the picture and the music in the multimedia database. .
  • music and pictures are stored in the multimedia database with keyword indexing for later retrieval.
  • the common keyword indexing method is TIF format information, which can be understood by reading the TIF information of the picture and music.
  • the content displayed by pictures and music is very convenient. The closer the location information keyword is to the corresponding picture and picture, the closer the content is to the geographic environment, features, etc. of the location, and the higher the matching degree.
  • the key to finding the location information is Keywords and music with the same or similar words are indexed to ensure that the pictures and music with the highest matching position information are pushed to the user.
  • step S43 If an instruction to re-find the picture or music is received, the keyword information corresponding to the location information keyword other than the previously searched picture or music is searched from the multimedia database by using the location information as a key. Pictures or music until you no longer receive instructions to re-find pictures or music. Then, the process returns to step S42, and the picture and music corresponding to the keyword index which is the same or similar to the location information keyword are finally found as the picture and music matching the location information.
  • the user searches for the multimedia database by using the location information as a key.
  • the picture and music corresponding to the keyword index with the same or similar location information keywords are the pictures and music that match the location information, that is, the final selected picture and music as the background are satisfied by the user, and the user is satisfied.
  • the high-quality multimedia photos with foreground images, background images and background music laid the foundation for a better user experience.
  • the multimedia photo generation method in the embodiment determines whether an instruction to cull the background of the photo and an instruction to re-find the picture or music are received by performing voice recognition on the received sound.
  • any software with voice recognition function in the prior art can be selected to implement the voice recognition function, and the user can receive the corresponding instruction by performing voice recognition on the voice sent by the user without manually inputting the instruction.
  • the instructions perform corresponding operations, freeing the user's hands, and responding quickly to the user's needs, improving the user's experience. degree.
  • the embodiment provides a multimedia photo generating device, which is used for a photographing device, as shown in FIG. 3, and includes:
  • the location information obtaining unit 1 is configured to acquire location information of a location where the photographing device is located.
  • the original photo acquisition unit 2 is configured to acquire a photo of a subject of a photographing device.
  • the foreground picture extracting unit 3 is configured to extract a person image as a foreground picture from the photo after receiving the instruction to cull the background of the photo.
  • the matching unit 4 is configured to find, according to the location information, the picture and music that match the location information from the multimedia database as the background image of the photo and the background music.
  • the generating unit 5 is configured to mix the foreground picture, the background picture and the background music into a multimedia photo.
  • the person image when the user is dissatisfied with the background effect of the photograph taken, the person image can be automatically extracted from the photo as a foreground image and the original poor background can be eliminated.
  • the image found in the database matching the location information of the shooting location is used as a new background image, and the user needs to optimize the background of the photo through professional retouching software, and only needs to issue an instruction to remove the background of the photo to replace the background with
  • the picture with the location information of the photo is easy to optimize and the user experience is high. It also automatically finds music that matches the location information as background music for use with foreground and background images. Blending into multimedia photos, the perfect combination of audiovisual.
  • the matching unit 4 is configured to obtain a keyword index corresponding to the content displayed by the picture in the multimedia database, obtain a keyword index corresponding to the content displayed by the music in the multimedia database, and use the location information as a keyword to Searching for the picture and music corresponding to the keyword index of the same or similar keyword of the location information in the multimedia database; if the instruction to re-find the picture or music is not received, the key that is the same or similar to the location information keyword
  • the words and music corresponding to the word index are used as pictures and music that match the location information.
  • the matching unit 4 searches the multimedia database for the same or similar to the location information keyword except the previously searched picture or music by using the location information as a key.
  • the keyword indexes the corresponding picture or music until the instruction to re-find the picture or music is no longer received, and the picture and music corresponding to the keyword index that is the same or similar to the location information keyword are finally found as Location information matches the pictures and music.
  • the multimedia photo generating apparatus in this embodiment can ensure that the final selected picture and music as the background are satisfied by the user, and lay a foundation for generating multimedia photos including the foreground picture, the background picture and the background music with high user satisfaction. User experience is better.
  • the multimedia photo generating apparatus in this embodiment further includes an instruction recognizing unit 6 configured to perform speech recognition on the received sound to determine whether an instruction to cull the photo background is received and whether an instruction to re-find the picture or music is received. .
  • the multimedia photo generating device in this embodiment can be used without the user manually inputting an instruction. After the voice of the user is voice-recognized to receive the corresponding instruction and perform corresponding operations according to the instruction, the user's hands are freed, the user's needs can be quickly responded, and the user's experience is improved.
  • the present embodiment provides a multimedia photo generating device, as shown in FIG. 4, comprising: a positioning device 11, a photographing device 12, a multimedia photo generating device 13 in Embodiment 2, a display device 14, and a playback device 15.
  • the positioning device 11 is configured to determine position information of a location where the photographing device is located. Specifically, the positioning device 11 selects a component having a positioning function such as a GPS module to determine position information of a location where the photographing device is located.
  • a positioning function such as a GPS module
  • the photographing device 12 is configured to take a photograph of a subject of the photographing device.
  • the photographing device 12 may include components such as a camera, a flash, and the like.
  • the multimedia photo generating device 13 and the positioning device 11 and the photographing device 12 are configured to receive the position information transmitted by the positioning unit 11, receive the photo sent by the photographing device 12, and extract the image of the person from the photo after receiving the instruction to remove the background of the photo.
  • the multimedia photo generating device 13 may be a controller that incorporates a program capable of executing the steps in the first embodiment. Automatic optimization of photos is achieved.
  • the multimedia photo generating device 13 can access the multimedia database of the shooting device memory, or Accessing a multimedia database stored by devices other than the shooting device provides technical support for finding images and music that meet user needs.
  • the display device 14 is connected to the photographing device 12 and the multimedia photo generating device 13 for displaying photos and multimedia photos.
  • the display device 14 can be a display screen.
  • the playback device 15 is connected to the multimedia photo generating device 13 for playing background music.
  • the playing device 15 can be a micro electronic horn. By playing the found music to the user, the user can promptly determine whether the music needs to be re-matched, and enables the user to enjoy the background music in the multimedia photo at the first time.
  • the multimedia photo generating device 13 when the user is dissatisfied with the background effect of the photograph taken, the multimedia photo generating device 13 can automatically extract the character image as a foreground image from the photo and the background of the original poor effect. It is rejected, and the image matching the location information of the shooting location found in the multimedia database is used as a new background image, and the user does not need to optimize the background of the photo through professional retouching software, and only needs to issue an instruction to remove the background of the photo.
  • the background can be replaced with a picture that matches the position information of the photographing place, and the optimization process is simple and the user experience is high.
  • the emitted sound is voice-recognized to receive the corresponding instruction and perform corresponding operations according to the instruction, which liberates the user's hands and can Quickly respond to user needs and improve user experience.
  • the embodiment provides a mobile phone, including: the multimedia photo generating device in Embodiment 2 or the multimedia photo generating device in Embodiment 3.
  • the person image when the user is dissatisfied with the background effect of the photograph taken, the person image can be automatically extracted from the photo as a foreground image and the original poor background is removed, and the multimedia database is searched.
  • the image matching the location information of the shooting location is used as a new background image, and the user needs to optimize the background of the photo through professional retouching software, and only needs to issue a command to remove the background of the photo to change the background to the position of the photo.
  • the images matched by the information are easy to optimize and have a high user experience.
  • the emitted voice performs voice recognition to receive the corresponding instruction and perform corresponding operations according to the instruction, which liberates the user's hands, can quickly respond to the user's needs, and improves the user's experience.
  • the embodiment provides a multimedia photo generating apparatus for a photographing apparatus, comprising: a multimedia photo generating apparatus, for a photographing apparatus, comprising: one or more processors 17; a memory 16; one or more programs, The one or more programs are stored in the memory 16, and when executed by the one or more processors 17, perform the following operations: acquiring location information of a location where the photographing device is located; acquiring one of the Photograph of the subject of the shooting device a slice; extracting a character image from the photo as a foreground image after receiving an instruction to cull the background of the photo; and searching for a picture and music matching the location information from the multimedia database as the photo according to the location information a background picture and background music; mixing the foreground picture, the background picture, and the background music into a multimedia photo.
  • a processor may be included, and as shown in FIG. 6, two processors may be included.
  • the multimedia photo generating apparatus wherein the step of searching for a picture and music matching the location information from the multimedia database according to the location information as a background image of the photo and background music comprises: Searching, by using the location information as a key, a picture and a music corresponding to a keyword index that is the same as or similar to the location information keyword, and the keyword corresponding to the picture and the music is stored in the multimedia database. If there is no instruction to re-find the picture or music, the picture and music corresponding to the keyword index that is the same or similar to the location information keyword are used as the picture and music matching the location information.
  • the location and the location information are used as keywords, and the picture and music corresponding to the keyword index corresponding to the location information keyword are searched from the multimedia database.
  • the step further includes: if receiving an instruction to re-find the picture or music, using the location information as a key to search the multimedia database for the same or similar to the location information keyword except the previously searched picture or music.
  • the keyword indexes the corresponding picture or music until the instruction to re-find the picture or music is no longer received; the picture and music corresponding to the keyword index that is finally found to be the same or similar to the location information keyword are Location information matches the pictures and music.
  • the multimedia photo generating apparatus in this embodiment preferably determines whether an instruction to cull the background of the photo is received and whether an instruction to re-find the picture or music is received by performing speech recognition on the received sound.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer usable storage media including computer usable program code, including but not limited to disk storage, CD-ROM, optical storage, and so forth.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Library & Information Science (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种多媒体照片生成方法、装置、设备及手机，其中多媒体照片生成方法为：先获取拍摄设备所在的位置的位置信息（S1）以及获取一幅拍摄设备的拍摄对象的照片（S2）；接收到剔除照片背景的指令（S3）后从照片中提取出人物图像作为前景图片，并根据位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为照片的背景图片以及背景音乐（S4）；最后将前景图片、背景图片以及背景音乐混合成一幅多媒体照片（S5）。在用户对拍摄的照片的背景效果不满意时，能自动从照片中提取出人物图像作为前景图片并将原有的效果差的背景予以剔除，将从多媒体数据库中查找出的与拍摄地的位置信息相匹配的图片作为新的背景图片，优化处理简便，用户体验度高。

Description

多媒体照片生成方法、装置、设备及手机
本申请要求在2015年12月14日提交中国专利局、申请号为201510927562.5、发明名称为“多媒体照片生成方法、装置、设备及手机”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及多媒体技术领域，具体涉及一种多媒体照片生成方法、装置、设备及手机。
背景技术
智能手机、平板电脑等具有拍照功能的设备因具有便于携带、能快速传播信息等功能，已成为很好的社交化工具，随着普及率的不断提升，其添加的附属功能也越来越多，比如可以将拍摄的照片通过智能手机、平板电脑等内置的社交软件(比如微信、微博、QQ聊天工具等)发送到社交平台进行分享，有的智能手机、平板电脑还会安装GPS等具有定位功能的模块以获取当前的地理信息，并将地理信息添加到当前拍摄的照片中，可以在与人分享照片的同时使他人也能获取到照片拍摄地的地理信息。
但有的时候由于天气原因(比如雾霾天气)或者拍照者自身拍照水平的原因，往往导致拍摄出的照片的背景效果比较差，如果用户想要对照片的背景进行修改，需要通过修图软件对照片进行分析、修复、美化、合成等处理，但由于修图软件专业性强，非常难于操作，对于非专业用户，需要学习和熟悉相应的软件操作方法才能达到用户想要的效果，用户体验度 差。
发明内容
因此，本发明要解决的技术问题在于克服现有技术中用户对背景效果差的照片进行优化处理时操作异常复杂，体验度差的缺陷，从而提供一种多媒体照片生成方法、装置、设备及手机。
为此，本发明的技术方案如下所述：
本发明提供了一种多媒体照片生成方法，用于拍摄设备，包括如下步骤：
获取所述拍摄设备所在的位置的位置信息；
获取一幅所述拍摄设备的拍摄对象的照片；
接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片；
根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；
将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。
本发明所述的多媒体照片生成方法，所述根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐的步骤包括：
以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存储有与图片、音乐对应的关键字标引；
若没有接收到重新查找图片或音乐的指令，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本发明所述的多媒体照片生成方法，所述以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐的步骤之后还包括：
若接收到重新查找图片或音乐的指令，以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；
将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本发明所述的多媒体照片生成方法，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
本发明还提供了一种多媒体照片生成装置，用于拍摄设备，包括：
位置信息获取单元，用于获取所述拍摄设备所在的位置的位置信息；
原始照片获取单元，用于获取一幅所述拍摄设备的拍摄对象的照片；
前景图片提取单元，用于在接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片；
匹配单元，用于根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；
生成单元，用于将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。
本发明所述的多媒体照片生成装置，所述匹配单元以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存储有与图片、音乐对应的关键字标引；并在没有接收到重新查找图片或音乐的指令时，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本发明所述的多媒体照片生成装置，所述匹配单元还用于在接收到重新查找图片或音乐的指令时，以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；并将最终查找出的与该位置信息关键字相同或相近的关键字标引对 应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本发明所述的多媒体照片生成装置，还包括指令识别单元，用于对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
本发明还提供了一种多媒体照片生成设备，包括：定位装置、拍照装置、多媒体照片生成装置、显示装置以及播放装置；
所述定位装置，用于确定所述拍摄设备所在位置的位置信息；
所述拍照装置，用于拍摄所述拍摄设备的拍摄对象的照片；
所述多媒体照片生成装置，与所述定位装置、所述拍照装置连接，用于接收所述定位部件发送的位置信息，接收所述拍照部件发送的照片，并在接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片，然后根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐，将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片；
所述显示装置，与所述拍照装置和所述多媒体照片生成装置连接，用于显示所述照片以及所述多媒体照片；
所述播放装置，与所述多媒体照片生成装置连接，用于播放所述背景音乐。
本发明还提供了一种手机，包括：上述多媒体照片生成装置或上述多 媒体照片生成设备。
本发明又提供了一种多媒体照片生成装置，用于拍摄设备，包括：
一个或者多个处理器；存储器；一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时，进行如下操作：
获取所述拍摄设备所在的位置的位置信息；获取一幅所述拍摄设备的拍摄对象的照片；在接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片；根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。
所述的多媒体照片生成装置，其中，所述根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐的步骤包括：以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存储有与图片、音乐对应的关键字标引；若没有接收到重新查找图片或音乐的指令，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
所述的多媒体照片生成装置，其中，所述以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐的步骤之后还包括：若接收到重新查找图片或音乐的指令， 以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
所述的多媒体照片生成装置，其中，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
本发明技术方案，具有如下优点：
本发明提供了一种多媒体照片生成方法及装置，先获取拍摄设备所在的位置的位置信息以及获取一幅拍摄设备的拍摄对象的照片；接收到剔除照片背景的指令后从照片中提取出人物图像作为前景图片，并根据位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为照片的背景图片以及背景音乐；最后将前景图片、背景图片以及背景音乐混合成一幅多媒体照片。在用户对拍摄的照片的背景效果不满意时，能自动从照片中提取出人物图像作为前景图片并将原有的效果差的背景予以剔除，将从多媒体数据库中查找出的与拍摄地的位置信息相匹配的图片作为新的背景图片，无需用户通过专业的修图软件对照片背景进行优化，只需发出剔除照片背景的指令即可将背景更换为与拍照地位置信息相匹配的图片，优化处理简便，用户体验度高。并且还能自动查找出与位置信息相匹配的音乐作为背景音乐，用来同前景图片、背景图片一起混合成多媒体照 片，实现了视听的完美组合。
本发明所述多媒体照片生成方法及装置，若用户对查找出的图片或者音乐不满意，会在收到重新匹配图片或音乐的指令后，以位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；之后将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。为生成用户满意度高的包含前景图片、背景图片以及背景音乐的多媒体照片奠定了基础，用户体验度更好。
本发明所述多媒体照片生成方法及装置，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令，无需用户手动输入指令，即可通过对用户发出的声音进行语音识别来接收到相应的指令并依据指令进行相应的操作，解放了用户的双手，能够快速响应用户的需求，提升了用户的体验度。
附图说明
为了更清楚地说明本发明具体实施方式或现有技术中的技术方案，下面将对具体实施方式或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施方式，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明实施例1中多媒体照片生成方法的一个具体实例的流程图；
图2为本发明实施例1中多媒体照片生成方法中从多媒体数据库中查找出与该位置信息相匹配的图片和音乐的一个具体实例的流程图；
图3为本发明实施例2中多媒体照片生成装置的一个具体实例的结构框图；
图4为本发明实施例3中多媒体照片生成设备的一个具体实例的结构框图。
图5为本发明具有一个处理器的多媒体照片生成装置的结构图；
图6为本发明具有二个处理器的多媒体照片生成装置的结构图；
附图标记：
1-位置信息获取单元；2-原始照片获取单元；3-前景图片提取单元；4-匹配单元；5-生成单元；6-指令识别单元；11-定位装置；12-拍照装置；13-多媒体照片生成装置；14-显示装置；15-播放装置。
具体实施方式
下面将结合附图对本发明的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
在本发明的描述中，需要说明的是，术语“中心”、“上”、“下”、“左”、“右”、“竖直”、“水平”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本发明的限制。此外，术语“第一”、“第二”、“第三”仅用于描述目的，而不能理解为指示或暗示相对重要性。
在本发明的描述中，需要说明的是，除非另有明确的规定和限定，术语“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，还可以是两个元件内部的连通，可以是无线连接，也可以是有线连接。对于本领域的普通技术人员而言，可以具体情况理解上述术语在本发明中的具体含义。
此外，下面所描述的本发明不同实施方式中所涉及的技术特征只要彼此之间未构成冲突就可以相互结合。
实施例1
本实施例提供了一种多媒体照片生成方法，用于拍摄设备，如图1所示，包括如下步骤：
S1.获取拍摄设备所在的位置的位置信息。具体地，位置信息一般包括经纬度信息以及所在的国、省、市、县、区或者景区等信息，也即获取了拍摄设备所在位置的位置信息，就能知道拍摄地所处的地理环境，比如是在海边、山林或者一些名胜古迹像泰山、故宫等等位置进行的拍摄，为后 期匹配出与照片契合度高的背景图片、背景音乐提供了指引。
S2.获取一幅拍摄设备的拍摄对象的照片。
S3.接收到剔除照片背景的指令后从照片中提取出人物图像作为前景图片。具体应用中，可以通过轮廓分析法确定照片中的人物图像并提取出来作为前景图片，当然也可以选用现有技术中任何一种能够实现照片中人物图像提取的方法来实现上述操作。
S4.根据位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为照片的背景图片以及背景音乐。具体应用中，在用户由于外部环境比较恶劣，比如雾霾天气的情况导致拍摄的照片背景效果不理想时，通过查找出与该位置信息相匹配的图片和音乐作为照片的背景图片以及背景音乐，能够使背景图片和背景音乐与拍摄地的位置信息尽可能贴合。比如用户在长城拍照，由于雾霾天气导致照片的背景效果非常差，通过查找出与长城这个位置信息相匹配的图片和音乐，能够将包括长城内容的图片以及跟长城有关的音乐，比如歌曲“万里长城永不倒”推送给用户，能够使背景图片与之前剔除的原有背景尽可能贴合。当然，对于一些自然风光，比如海边、森林中，也可以将一些展示自然界声音的音乐，比如海浪声、小溪流水声、鸟鸣声等推送给用户，使背景音乐也尽可能符合照片所展示的内容。
S5.将前景图片、背景图片以及背景音乐混合成一幅多媒体照片。
本实施例中的多媒体照片生成方法，在用户对拍摄的照片的背景效果 不满意时，能自动从照片中提取出人物图像作为前景图片并将原有的效果差的背景予以剔除，将从多媒体数据库中查找出的与拍摄地的位置信息相匹配的图片作为新的背景图片，无需用户通过专业的修图软件对照片背景进行优化，只需发出剔除照片背景的指令即可将背景更换为与拍照地位置信息相匹配的图片，优化处理简便，用户体验度高。并且还能自动查找出与位置信息相匹配的音乐作为背景音乐，用来同前景图片、背景图片一起混合成多媒体照片，实现了视听的完美组合。
优选地，如图2所示，步骤S4包括：
S41.以位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，多媒体数据库中存储有与图片、音乐对应的关键字标引。具体地，音乐和图片存入多媒体数据库时都会带有关键字标引，以便于后期的检索，常见的关键字标引方式为TIF格式的信息，通过读取图片、音乐的TIF信息就可以了解图片、音乐所展示的内容了，非常便捷。与位置信息关键字越贴近的关键字标引对应的图片和图片，则说明其所展示的内容与拍摄地的地理环境、特征等越接近，匹配度也越高，通过查找与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，能够确保将与拍摄地位置信息匹配度最高的图片和音乐推送给用户。
S42.若没有接收到重新查找图片或音乐的指令，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
S43.若接收到重新查找图片或音乐的指令，以位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令。之后返回步骤S42，将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本实施例中的多媒体照片生成方法，若用户对查找出的图片或者音乐不满意，会在收到重新匹配图片或音乐的指令后，以位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；之后才会将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐，也即最终选取的作为背景的图片和音乐都是用户满意的，为生成用户满意度高的包含前景图片、背景图片以及背景音乐的多媒体照片奠定了基础，用户体验度更好。
优选地，本实施例中的多媒体照片生成方法，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。具体地，可以选用现有技术中任何一款具有语音识别功能的软件来实现语音识别的功能，无需用户手动输入指令，即可通过对用户发出的声音进行语音识别来接收到相应的指令并依据指令进行相应的操作，解放了用户的双手，能够快速响应用户的需求，提升了用户的体验 度。
实施例2
本实施例提供了一种多媒体照片生成装置，用于拍摄设备，如图3所示，包括：
位置信息获取单元1，用于获取拍摄设备所在的位置的位置信息。
原始照片获取单元2，用于获取一幅拍摄设备的拍摄对象的照片。
前景图片提取单元3，用于在接收到剔除照片背景的指令后从照片中提取出人物图像作为前景图片。
匹配单元4，用于根据位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为照片的背景图片以及背景音乐。
生成单元5，用于将前景图片、背景图片以及背景音乐混合成一幅多媒体照片。
本实施例中的多媒体照片生成装置，在用户对拍摄的照片的背景效果不满意时，能自动从照片中提取出人物图像作为前景图片并将原有的效果差的背景予以剔除，将从多媒体数据库中查找出的与拍摄地的位置信息相匹配的图片作为新的背景图片，无需用户通过专业的修图软件对照片背景进行优化，只需发出剔除照片背景的指令即可将背景更换为与拍照地位置信息相匹配的图片，优化处理简便，用户体验度高。并且还能自动查找出与位置信息相匹配的音乐作为背景音乐，用来同前景图片、背景图片一起 混合成多媒体照片，实现了视听的完美组合。
优选地，匹配单元4，用于通过获取多媒体数据库中图片所展示的内容对应的关键字标引；获取多媒体数据库中音乐所展示的内容对应的关键字标引；以位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐；在没有接收到重新查找图片或音乐的指令时，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
优选地，匹配单元4在接收到重新查找图片或音乐的指令时，以位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令，将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本实施例中的多媒体照片生成装置，能够确保最终选取的作为背景的图片和音乐都是用户满意的，为生成用户满意度高的包含前景图片、背景图片以及背景音乐的多媒体照片奠定了基础，用户体验度更好。
优选地，本实施例中的多媒体照片生成装置，还包括指令识别单元6，用于对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
本实施例中的多媒体照片生成装置，无需用户手动输入指令，即可通 过对用户发出的声音进行语音识别来接收到相应的指令并依据指令进行相应的操作，解放了用户的双手，能够快速响应用户的需求，提升了用户的体验度。
实施例3
本实施例提供了一种多媒体照片生成设备，如图4所示，包括：定位装置11、拍照装置12、实施例2中的多媒体照片生成装置13、显示装置14以及播放装置15。
定位装置11，用于确定拍摄设备所在位置的位置信息。具体地，定位装置11选用GPS模块等具有定位功能的部件来确定拍摄设备所在位置的位置信息。
拍照装置12，用于拍摄拍摄设备的拍摄对象的照片。具体应用中，拍照装置12可以包括摄像头、闪光灯等部件。
多媒体照片生成装置13，与定位装置11、拍照装置12用于接收定位部件11发送的位置信息，接收拍照装置12发送的照片，并在接收到剔除照片背景的指令后从照片中提取出人物图像作为前景图片，然后根据位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为照片的背景图片以及背景音乐，将前景图片、背景图片以及背景音乐混合成一幅多媒体照片。具体应用中，多媒体照片生成装置13可以为控制器，内置能够执行实施例1中的步骤的程序。实现了照片的自动优化处理。具体地，多媒体照片生成装置13既可以访问拍摄设备内存的多媒体数据库，也可以 访问拍摄设备以外的其它设备存储的多媒体数据库，为查找到符合用户需求的图片和音乐提供了技术上的支持。
显示装置14，与拍照装置12和多媒体照片生成装置13连接，用于显示照片以及多媒体照片。具体地，显示装置14可以为显示屏，通过将拍摄的照片呈现给用户，能够使用户及时判断是否需要剔除背景，通过将查找出的图片呈现给用户，能够使用户及时判断是否需要重新匹配图片，并能使用户第一时间欣赏到优化生成的多媒体照片。
播放装置15，与多媒体照片生成装置13连接，用于播放背景音乐。具体地，播放装置15可以为微型电子喇叭，通过将查找出的音乐播放给用户，能够使用户及时判断是否需要重新匹配音乐，并能使用户第一时间欣赏到多媒体照片中的背景音乐。
本实施例中的多媒体照片生成设备，在用户对拍摄的照片的背景效果不满意时，通过多媒体照片生成装置13能自动从照片中提取出人物图像作为前景图片并将原有的效果差的背景予以剔除，将从多媒体数据库中查找出的与拍摄地的位置信息相匹配的图片作为新的背景图片，无需用户通过专业的修图软件对照片背景进行优化，只需发出剔除照片背景的指令即可将背景更换为与拍照地位置信息相匹配的图片，优化处理简便，用户体验度高。并且还能自动查找出与位置信息相匹配的音乐作为背景音乐，用来同前景图片、背景图片一起混合成多媒体照片，实现了视听的完美组合；并且无需用户手动输入指令，即可通过对用户发出的声音进行语音识别来接收到相应的指令并依据指令进行相应的操作，解放了用户的双手，能够 快速响应用户的需求，提升了用户的体验度。
实施例4
本实施例提供了一种手机，包括：实施例2中的多媒体照片生成装置或实施例3中的多媒体照片生成设备。
本实施例中的手机，在用户对拍摄的照片的背景效果不满意时，能自动从照片中提取出人物图像作为前景图片并将原有的效果差的背景予以剔除，将从多媒体数据库中查找出的与拍摄地的位置信息相匹配的图片作为新的背景图片，无需用户通过专业的修图软件对照片背景进行优化，只需发出剔除照片背景的指令即可将背景更换为与拍照地位置信息相匹配的图片，优化处理简便，用户体验度高。并且还能自动查找出与位置信息相匹配的音乐作为背景音乐，用来同前景图片、背景图片一起混合成多媒体照片，实现了视听的完美组合；并且无需用户手动输入指令，即可通过对用户发出的声音进行语音识别来接收到相应的指令并依据指令进行相应的操作，解放了用户的双手，能够快速响应用户的需求，提升了用户的体验度。
实施例5
本实施例提供了一种多媒体照片生成装置，用于拍摄设备，包括：一种多媒体照片生成装置，用于拍摄设备，包括：一个或者多个处理器17；存储器16；一个或者多个程序，所述一个或者多个程序存储在所述存储器16中，当被所述一个或者多个处理器17执行时，进行如下操作：获取所述拍摄设备所在的位置的位置信息；获取一幅所述拍摄设备的拍摄对象的照 片；在接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片；根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。具体为如图5所示可以包括一个处理器，如图6所示可以包括二个处理器。
优选地，所述的多媒体照片生成装置，其中，所述根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐的步骤包括：以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存储有与图片、音乐对应的关键字标引；若没有接收到重新查找图片或音乐的指令，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本实施例中的多媒体照片生成装置，优选地，所述以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐的步骤之后还包括：若接收到重新查找图片或音乐的指令，以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
本实施例中的多媒体照片生成装置，优选地，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。

Claims (14)

  1. 一种多媒体照片生成方法，用于拍摄设备，其特征在于，包括如下步骤：
    获取所述拍摄设备所在的位置的位置信息；
    获取一幅所述拍摄设备的拍摄对象的照片；
    接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片；
    根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；
    将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。
  2. 根据权利要求1所述的多媒体照片生成方法，其特征在于，所述根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐的步骤包括：
    以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存储有与图片、音乐对应的关键字标引；
    若没有接收到重新查找图片或音乐的指令，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片 和音乐。
  3. 根据权利要求2所述的多媒体照片生成方法，其特征在于，所述以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐的步骤之后还包括：
    若接收到重新查找图片或音乐的指令，以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；
    将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
  4. 根据权利要求1-3任一项所述的多媒体照片生成方法，其特征在于，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
  5. 一种多媒体照片生成装置，用于拍摄设备，其特征在于，包括：
    位置信息获取单元(1)，用于获取所述拍摄设备所在的位置的位置信息；
    原始照片获取单元(2)，用于获取一幅所述拍摄设备的拍摄对象的照片；
    前景图片提取单元(3)，用于在接收到剔除照片背景的指令后从所述 照片中提取出人物图像作为前景图片；
    匹配单元(4)，用于根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；
    生成单元(5)，用于将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。
  6. 根据权利要求5所述的多媒体照片生成装置，其特征在于，所述匹配单元(4)以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存储有与图片、音乐对应的关键字标引；并在没有接收到重新查找图片或音乐的指令时，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
  7. 根据权利要求6所述的多媒体照片生成装置，其特征在于，所述匹配单元(4)还用于在接收到重新查找图片或音乐的指令时，以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；并将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
  8. 根据权利要求5-7任一项所述的多媒体照片生成装置，其特征在于，还包括指令识别单元(6)，用于对接收的声音进行语音识别来判断是否接 收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
  9. 一种多媒体照片生成设备，其特征在于，包括：定位装置(11)、拍照装置(12)、多媒体照片生成装置(13)、显示装置(14)以及播放装置(15)；
    所述定位装置(11)，用于确定所述拍摄设备所在位置的位置信息；
    所述拍照装置(12)，用于拍摄所述拍摄设备的拍摄对象的照片；
    所述多媒体照片生成装置(13)，与所述定位装置(11)、所述拍照装置(12)连接，用于接收所述定位部件(11)发送的位置信息，接收所述拍照部件(12)发送的照片，并在接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片，然后根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐，将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片；
    所述显示装置(14)，与所述拍照装置(12)和所述多媒体照片生成装置(13)连接，用于显示所述照片以及所述多媒体照片；
    所述播放装置(15)，与所述多媒体照片生成装置(13)连接，用于播放所述背景音乐。
  10. 一种手机，其特征在于，包括：权利要求5-8任意一项所述的多媒体照片生成装置或权利要求9所述的多媒体照片生成设备。
  11. 一种多媒体照片生成装置，用于拍摄设备，其特征在于，包括：
    一个或者多个处理器；
    存储器；
    一个或者多个程序，所述一个或者多个程序存储在所述存储器中，当被所述一个或者多个处理器执行时，进行如下操作：
    获取所述拍摄设备所在的位置的位置信息；
    获取一幅所述拍摄设备的拍摄对象的照片；
    在接收到剔除照片背景的指令后从所述照片中提取出人物图像作为前景图片；
    根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐；
    将所述前景图片、所述背景图片以及所述背景音乐混合成一幅多媒体照片。
  12. 根据权利要求11所述的多媒体照片生成装置，其特征在于，所述根据所述位置信息从多媒体数据库中查找出与该位置信息相匹配的图片和音乐作为所述照片的背景图片以及背景音乐的步骤包括：
    以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐，所述多媒体数据库中存 储有与图片、音乐对应的关键字标引；
    若没有接收到重新查找图片或音乐的指令，将与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
  13. 根据权利要求12所述的多媒体照片生成装置，其特征在于，所述以所述位置信息为关键字，从多媒体数据库中查找出与该位置信息关键字相同或相近的关键字标引对应的图片和音乐的步骤之后还包括：
    若接收到重新查找图片或音乐的指令，以所述位置信息为关键字从多媒体数据库中查找除之前已查找出的图片或音乐以外的与该位置信息关键字相同或相近的关键字标引对应的图片或音乐，直至不再接收到重新查找图片或音乐的指令；
    将最终查找出的与该位置信息关键字相同或相近的关键字标引对应的图片和音乐作为与该位置信息相匹配的图片和音乐。
  14. 根据权利要求11-13任一项所述的多媒体照片生成装置，其特征在于，通过对接收的声音进行语音识别来判断是否接收到剔除照片背景的指令以及是否接收到重新查找图片或音乐的指令。
PCT/CN2016/087666 2015-12-14 2016-06-29 多媒体照片生成方法、装置、设备及手机 WO2017101293A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/245,168 US20170171471A1 (en) 2015-12-14 2016-08-23 Method and device for generating multimedia picture and an electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510927562.5 2015-12-14
CN201510927562.5A CN105869198A (zh) 2015-12-14 2015-12-14 多媒体照片生成方法、装置、设备及手机

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/245,168 Continuation US20170171471A1 (en) 2015-12-14 2016-08-23 Method and device for generating multimedia picture and an electronic device

Publications (1)

Publication Number Publication Date
WO2017101293A1 true WO2017101293A1 (zh) 2017-06-22

Family

ID=56623927

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/087666 WO2017101293A1 (zh) 2015-12-14 2016-06-29 多媒体照片生成方法、装置、设备及手机

Country Status (2)

Country Link
CN (1) CN105869198A (zh)
WO (1) WO2017101293A1 (zh)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105338242A (zh) * 2015-10-29 2016-02-17 努比亚技术有限公司 一种图像合成方法和装置
CN106453861B (zh) * 2016-09-26 2019-08-13 珠海格力电器股份有限公司 一种基于终端的照片背景音乐的设置方法和装置
CN106488017A (zh) * 2016-10-09 2017-03-08 上海斐讯数据通信技术有限公司 一种移动终端及其对拍摄的图像进行配乐的方法
CN106447741A (zh) * 2016-11-30 2017-02-22 努比亚技术有限公司 照片自动合成方法及系统
CN107451186A (zh) * 2017-06-22 2017-12-08 珠海市魅族科技有限公司 照片处理方法及装置、计算机装置和可读存储介质
WO2019000325A1 (zh) * 2017-06-29 2019-01-03 深圳市大疆创新科技有限公司 用于无人机航拍的增强现实方法、处理器及无人机
CN107331067A (zh) * 2017-06-30 2017-11-07 深圳前海弘稼科技有限公司 景区拍照方法和系统
WO2019047983A1 (zh) * 2017-09-11 2019-03-14 Oppo广东移动通信有限公司 图像处理方法及装置、电子装置和计算机可读存储介质
CN107704808A (zh) * 2017-09-11 2018-02-16 广东欧珀移动通信有限公司 图像处理方法及装置、电子装置和计算机可读存储介质
CN107832773B (zh) * 2017-09-22 2021-05-04 华南师范大学 一种场景匹配方法及装置
EP3667488B1 (en) * 2017-09-29 2023-06-28 Shanghai Cambricon Information Technology Co., Ltd Image processing apparatus and method
CN107707823A (zh) * 2017-10-18 2018-02-16 维沃移动通信有限公司 一种拍摄方法及移动终端
CN108174091B (zh) * 2017-12-28 2021-04-13 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备
CN108198162A (zh) * 2017-12-29 2018-06-22 努比亚技术有限公司 照片处理方法、移动终端、服务器、系统、存储介质
WO2019205170A1 (zh) * 2018-04-28 2019-10-31 华为技术有限公司 一种拍照方法和终端设备
CN109309862A (zh) * 2018-07-26 2019-02-05 浠诲嘲 多媒体数据编辑系统
CN110855875A (zh) * 2018-08-20 2020-02-28 珠海格力电器股份有限公司 获取图像的背景信息的方法及装置
CN109558504A (zh) * 2018-11-21 2019-04-02 扬州市职业大学 一种图像处理方法
KR102604937B1 (ko) * 2018-12-05 2023-11-23 삼성전자주식회사 캐릭터를 포함하는 동영상을 생성하기 위한 전자 장치 및 그에 관한 방법
CN109767397B (zh) 2019-01-09 2022-07-12 三星电子（中国）研发中心 一种基于人工智能的图像优化方法和系统
CN109905598A (zh) * 2019-02-25 2019-06-18 四川长虹电器股份有限公司 一种智能拍照方法和智能拍照系统
CN112312178B (zh) * 2020-07-29 2022-08-30 上海和煦文旅集团有限公司 一种多媒体展厅的多媒体影像处理系统
CN113873080B (zh) * 2021-09-27 2022-12-13 维沃移动通信有限公司 多媒体文件的获取方法和获取装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101783889A (zh) * 2010-02-05 2010-07-21 北京水晶石数字科技有限公司 一种实时抠像及视频监视和采集方法
CN101827258A (zh) * 2010-02-05 2010-09-08 北京水晶石数字科技有限公司 一种实时抠像及视频监视和采集系统
CN201623771U (zh) * 2010-02-05 2010-11-03 北京水晶石数字科技有限公司 一种实时抠像及视频监视和采集系统
CN201886257U (zh) * 2010-12-21 2011-06-29 崔娜 动感摄影系统
CN102131146A (zh) * 2011-03-23 2011-07-20 惠州Tcl移动通信有限公司 根据位置信息更换背景图片的移动终端及方法
CN103795897A (zh) * 2014-01-21 2014-05-14 深圳市中兴移动通信有限公司 自动生成背景音乐的方法和装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8659667B2 (en) * 2011-08-29 2014-02-25 Panasonic Corporation Recipe based real-time assistance for digital image capture and other consumer electronics devices
KR20140114238A (ko) * 2013-03-18 2014-09-26 삼성전자주식회사 오디오와 결합된 이미지 표시 방법
WO2014184417A1 (en) * 2013-05-13 2014-11-20 Nokia Corporation Method, apparatus and computer program product to represent motion in composite images
WO2015122929A1 (en) * 2014-02-14 2015-08-20 Sapient Corporation Location-based digital media platform
CN105100491B (zh) * 2015-08-11 2018-06-01 努比亚技术有限公司 一种处理照片的装置和方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101783889A (zh) * 2010-02-05 2010-07-21 北京水晶石数字科技有限公司 一种实时抠像及视频监视和采集方法
CN101827258A (zh) * 2010-02-05 2010-09-08 北京水晶石数字科技有限公司 一种实时抠像及视频监视和采集系统
CN201623771U (zh) * 2010-02-05 2010-11-03 北京水晶石数字科技有限公司 一种实时抠像及视频监视和采集系统
CN201886257U (zh) * 2010-12-21 2011-06-29 崔娜 动感摄影系统
CN102131146A (zh) * 2011-03-23 2011-07-20 惠州Tcl移动通信有限公司 根据位置信息更换背景图片的移动终端及方法
CN103795897A (zh) * 2014-01-21 2014-05-14 深圳市中兴移动通信有限公司 自动生成背景音乐的方法和装置

Also Published As

Publication number Publication date
CN105869198A (zh) 2016-08-17

Similar Documents

Publication Publication Date Title
WO2017101293A1 (zh) 多媒体照片生成方法、装置、设备及手机
WO2017092280A1 (zh) 一种多媒体照片生成方法、装置、设备及手机
US9898847B2 (en) Multimedia picture generating method, device and electronic device
US9471600B2 (en) Electronic device and method for handling tags
RU2659746C2 (ru) Способ и устройство обработки изображений
US9317531B2 (en) Autocaptioning of images
WO2016058456A1 (zh) 拍照方法及智能终端、云端服务器
US20110292221A1 (en) Automatic camera
US20170171471A1 (en) Method and device for generating multimedia picture and an electronic device
WO2017054358A1 (zh) 导航方法及装置
WO2015124082A1 (en) Electronic travel album generating method and system
CN107197153B (zh) 一种照片的拍摄方法及拍摄装置
WO2015172359A1 (zh) 一种对象搜索方法及装置
US10594930B2 (en) Image enhancement and repair using sample data from other images
JP5223034B2 (ja) 情報提供装置、情報提供方法、情報提供処理プログラム、及び情報提供処理プログラムを記録した記録媒体
EP3493078A1 (en) Environment information storage and playback method, and storage and playback system and terminal
CN105847413A (zh) 相机参数处理方法、装置、系统及服务器
CN202171801U (zh) 一种包含有位置信息图片的生成装置和处理装置
WO2015154383A1 (zh) 拍照方法及拍照终端
CN111680238A (zh) 信息分享方法、装置和存储介质
WO2015007142A1 (zh) 在电子地图上搜索兴趣点的方法、系统、装置和服务器
CN102196147A (zh) 在数码相机拍摄的照片中记录位置信息的方法
CN101110889A (zh) 在输出文件内自动记载文件形成地信息的方法及装置
JP2007179368A (ja) 画像編集支援システムとその装置、方法、及びプログラム
JP2010276364A (ja) ナビ情報作成装置、ナビゲーションシステム、ナビゲーション情報作成方法、およびナビゲーション方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874357

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16874357

Country of ref document: EP

Kind code of ref document: A1