WO2019206316A1 - 一种拍照方法和终端设备 - Google Patents

一种拍照方法和终端设备 Download PDF

Info

Publication number
WO2019206316A1
WO2019206316A1 PCT/CN2019/084704 CN2019084704W WO2019206316A1 WO 2019206316 A1 WO2019206316 A1 WO 2019206316A1 CN 2019084704 W CN2019084704 W CN 2019084704W WO 2019206316 A1 WO2019206316 A1 WO 2019206316A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
preview image
preview
text information
information
Prior art date
Application number
PCT/CN2019/084704
Other languages
English (en)
French (fr)
Inventor
佘智
刘彬
鞠华玮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP19791992.1A priority Critical patent/EP3758358A4/en
Priority to JP2020560409A priority patent/JP7074891B2/ja
Priority to AU2019259066A priority patent/AU2019259066B2/en
Priority to CN201980027660.XA priority patent/CN112204942B/zh
Priority to CN202210198006.9A priority patent/CN114793267A/zh
Priority to US17/047,653 priority patent/US11470240B2/en
Publication of WO2019206316A1 publication Critical patent/WO2019206316A1/zh
Priority to US17/898,186 priority patent/US11863856B2/en
Priority to US18/365,735 priority patent/US20240031665A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/65Control of camera operation in relation to power supply

Definitions

  • the present application relates to the field of image capturing technologies, and in particular, to a photographing method and a terminal device.
  • the camera function in the terminal device has become one of the functions that the user uses frequently.
  • the embodiment of the present invention provides a photographing method and a terminal device, which are used to guide a user to obtain a high quality image and improve a user experience.
  • an embodiment of the present invention provides a photographing method, which is applicable to a terminal device having an image capturing function.
  • the method includes: receiving, by the terminal device, a first operation; in response to the first operation, the terminal device starts a camera; the terminal device displays a first preview interface including a first preview image, where the first preview image includes at least one shot An object, wherein at least one of the first preview images matches the preset first text information; the terminal device outputs the first preview image according to the first preview image and the first text information.
  • the first prompt information is used to prompt a missing or redundant subject in the first preview image.
  • the preview image includes at least one photographic subject
  • the terminal device outputs the prompt information according to the preview image and the text information matching the preview image to prompt the user to preview the missing or redundant photographic subject in the image.
  • the prompt of the prompt information the user can move the position or angle of the terminal device, so that the missing subject is captured as much as possible, and the unnecessary subject is not photographed, thereby achieving a better shooting effect.
  • This method can guide the user to shoot higher quality images, which helps to improve the user experience.
  • the terminal device after the terminal device outputs the first prompt information, the terminal device receives the second operation; in response to the second operation, the terminal device displays a second preview interface including the second preview image.
  • the second preview image is different from the first preview image, and the second preview image includes at least one photographic subject, wherein at least one of the second preview images is associated with preset second text information.
  • Matching; the terminal device outputs second prompt information according to the second preview image and the second text information, where the second prompt information is different from the first prompt information, and the second prompt information is used for prompting A missing or redundant subject in the second preview image.
  • the preview image when the terminal device moves the position or changes the focal length, the preview image is dynamically changed.
  • the prompt information output by the terminal device also changes, that is, the terminal device can prompt the user for the missing or redundant subject in the current preview image in real time.
  • the terminal device can prompt the user to move the position or angle of the terminal device such that the missing subject is photographed, and the unnecessary subject is not photographed, thereby achieving a better photographing effect.
  • This method can guide the user to shoot higher quality images, which helps to improve the user experience.
  • the preview image includes M photographic objects, and the preview image is the first preview image or the second preview image; if the N photographic objects of the M photographic objects are If the preset text information matches, the redundant subject is the remaining MN subjects of the M subjects except the N subjects; if the words match the M subjects
  • the information includes keywords corresponding to the other subject other than the M subjects, and the other subject is the missing subject; N ⁇ 1, and N ⁇ M. That is to say, the unnecessary photographic subject in the first preview image is a photographic subject included in the first preview image but not included in the first text information.
  • the photographic subject missing in the first preview image is a photographic subject included in the first text information but not included in the first preview image.
  • the unnecessary photographic subject in the second preview image is a photographic subject included in the second preview image but not included in the second text information.
  • the photographic subject missing in the second preview image is a photographic subject included in the second text information but not included in the second preview image.
  • the terminal device matches the appropriate text information according to the M photographic objects in the preview image. If N of the M subjects match the text information, the remaining MN subjects are redundant subjects; if the text information is matched according to the M subjects, the matched text information is excluded from this
  • the M subjects also include other objects, and the other objects are the missing subjects.
  • the terminal device can prompt the user to move the position or angle of the terminal device such that the missing subject is photographed, and the unnecessary subject is not photographed, thereby achieving a better photographing effect.
  • This method can guide the user to shoot higher quality images, which helps to improve the user experience.
  • the first prompt information is displayed in the first preview interface; and the second prompt information is displayed in the second preview interface.
  • the prompt information may be displayed in the preview interface to facilitate prompting the user.
  • the prompt information may also be voice information, that is, the user is prompted by voice.
  • the terminal device further outputs matching first text information according to the first preview image, and the first text information is displayed in the first preview interface.
  • the terminal device may display the text information for the user to view.
  • the terminal device further outputs matching second text information according to the second preview image, and the second text information is displayed in the second preview interface.
  • the preview image changes, and therefore, the matched text information also changes. Therefore, when the preview image changes dynamically, the text information displayed by the terminal device also dynamically changes.
  • the first text information includes at least one text information; or the second text information includes at least one text information.
  • the terminal device may display more than one type of text information according to the photographic subject in the preview image. If the text information is multiple text information, the terminal device may display multiple text information in the preview interface.
  • the terminal device further outputs first matching degree information according to the first preview image, where the first matching degree information is used to indicate the first text information and the first preview image.
  • the degree of matching between the first matching degrees is displayed in the first preview interface.
  • the matching degree information may also be displayed, and the user knows the degree of matching between the text information and the preview image by using the matching degree information.
  • the terminal device further outputs second matching degree information according to the second preview image, where the second matching degree information is used to indicate the second text information and the second preview image.
  • the degree of matching between the second matching degree information is displayed in the second preview interface.
  • the preview image changes, and the matched text information also changes, so the matching degree information between the text information and the preview image also changes. Therefore, when the preview image dynamically changes, the matching degree information output by the terminal device also dynamically changes. Therefore, the user can find a better shooting range or angle through the matching degree information. For example, when the user finds a certain shooting angle, the matching degree displayed in the preview interface is high, and the user can determine that the shooting angle is better. In this way, the user can be instructed to take higher quality images, which helps to improve the user experience.
  • the terminal device further outputs first direction indication information according to the first preview image, where the first direction indication information is used to prompt the user to move the terminal device according to the indicated first direction,
  • the first direction indication information is displayed in the first preview interface.
  • the terminal device may further display direction indication information, and prompt the user to move the terminal device according to a certain direction by using the direction indication information. For example, if the terminal device determines that the bird is missing from the current preview image, the terminal device may display an upward arrow prompting the user to move the terminal device upward. In this way, the user can be instructed to take higher quality images, which helps to improve the user experience.
  • the terminal device further outputs second direction indication information according to the second preview image, where the second direction indication information is used to prompt the user to move the terminal device according to the indicated second direction.
  • the second direction indication information is displayed in the second preview interface.
  • the preview image when the terminal device moves the position or changes the focal length, the preview image changes, and the matched text information also changes, so the direction indication information also changes. Therefore, when the preview image dynamically changes, the direction indication information displayed by the terminal device also dynamically changes to prompt the user to move the terminal device in a specific direction. In this way, the user can be instructed to take higher quality images, which helps to improve the user experience.
  • a second control is displayed in the first preview image, the second control is used to trigger a type of displaying text information, and the terminal device is responsive to a user triggering an operation of the second control, Displaying a first list, the first list includes at least one type of text information; the terminal device displays first text information in response to the user selecting a first type of operation, the type of the first text information being the One type.
  • the user can select the type of the text information.
  • the terminal device can display the text information belonging to the type. In this way, the user can select the type of text information according to his or her preference, which helps to improve the user experience.
  • the first preview interface includes a first shooting control
  • the terminal device obtains two first captured images in response to an operation for triggering the first shooting control, One of the first captured images of the first captured image includes the first text information, and the other first captured image does not include the first text information.
  • the terminal device can obtain two images, one of which does not contain the image of the text information, and the other of which contains the text information.
  • the second preview interface includes a second shooting control
  • the terminal device obtains two second captured images in response to the operation for triggering the second shooting control,
  • One of the second captured images of the second captured image includes the second text information
  • the other second captured image does not include the second text information.
  • the terminal device moves the position or changes the focal length
  • the preview image changes, and the matched text information also changes. Therefore, in a certain position, if the user triggers the shooting control, two images are obtained, one of which contains text information and the other does not contain text information.
  • the preview image includes M shots, and the preview image is the first preview image or the second preview image; when M is 1, the terminal device according to the M When the N subjects in the photographic subject match the text information, the terminal device extracts feature information of the one photographic subject; the terminal device determines and extracts the feature according to the mapping relationship between the feature information and the keyword a keyword corresponding to the information; the terminal device determines text information including the keyword.
  • the text information matched by the terminal device includes a keyword corresponding to the photographic subject.
  • the preview image includes M photographic objects, and the preview image is the first preview image or the second preview image; when M is greater than or equal to 2, the terminal device according to the When N of the M photographic objects match the text information, the terminal device determines N photographic subjects whose weights are greater than the preset weights in the M photographic objects; the weights are used to indicate the display area of one photographic subject a ratio of the display area of the entire preview image; the terminal device extracts feature information from each of the N photographic objects, and obtains a total of N feature information; the terminal device is based on the feature information and the keyword The mapping relationship determines N keywords corresponding to the extracted N feature information; the terminal device determines text information including the N keywords.
  • the terminal device selects N photographic objects from the plurality of photographic objects according to the weight of each photographic subject, determines N keywords, and then queries the N-containing object. Text information for a keyword.
  • the terminal device when the terminal device matches the text information according to the N shooting targets of the M shooting objects, the terminal device determines at least two according to the N shooting targets of the M shooting objects. Character information; the terminal device detects current time information/geographic location information; the terminal device selects one piece of text information from the at least two pieces of text information according to the time information/geographic location information; or the terminal The device selects one piece of text information from the at least two pieces of text information according to a priority policy, wherein the priority policy includes a priority order between the at least two pieces of text information.
  • the terminal device may select one type of text according to the time information/geographic information or the plurality of text information in the priority policy. information.
  • the terminal device determines whether the number of times the user selects the other text information exceeds a preset number of times; When the number of times the other text information is selected exceeds a preset number of times, the terminal device sets a first priority level of the other text information to a second priority level, and the second priority level is greater than the first priority level.
  • the terminal device updates the priority policy with a second priority level of the other text information.
  • the text information displayed by the terminal device may not be the text information that the user likes, so the user may select other text information, and the terminal device may record the number of times the user selects other text information, when the user selects other text information. For a long time, the priority level of the other text information is raised, and the text information can be preferentially recommended in the next shooting. In this way, the terminal device can record the user's usage habits and match the text information in accordance with the user's usage habits.
  • the terminal device before the terminal device outputs the first prompt information according to the first preview image, the terminal device further responds to the third operation of the user, where the terminal device is in the a setting interface for setting a poetry mode is displayed in the first preview interface, the setting interface includes an icon of the poetry mode and the first control; and in response to the user triggering the operation of the first control, starting the poetry mode, the poetry mode is The terminal device matches the mode of the appropriate poetry according to the photographic subject in the first preview image.
  • the user after the terminal device starts the camera, the user can open the device interface for setting the poetry mode, and start the poetry mode by triggering the control corresponding to the poetry mode. In this way, the user can choose to turn poetry mode on or off, which helps to improve the user experience.
  • the first preview interface includes a third control for triggering updating the first text information, and a fourth control for triggering display use.
  • Text information if the user is not satisfied with the text information matched by the terminal device, a certain control may be triggered to replace other text information, and the user may also view the text information that has been used by triggering another control.
  • the textual information includes poetry, songs, slang, celebrity quotes, or online buzzwords.
  • the above-mentioned several are only listed, and the text information may also include other types of information, which is not limited in the embodiment of the present application.
  • an embodiment of the present invention provides a photographing method, which is applicable to a terminal device having an image capturing function.
  • the method includes: receiving, by the terminal device, a first operation; in response to the first operation, the terminal device starts a camera; the terminal device displays a first preview interface including a first preview image, where the first preview image includes At least one photographic subject; the terminal device displays a first identifier of the first music in the first preview interface, the first music being matched by the terminal device according to at least one photographic object in the first preview image Out of the music, the first identifier is a text or an icon.
  • the terminal device matches the appropriate music according to the photographic subject in the preview image, and then displays the identifier of the matched music. In this way, the terminal device can match the appropriate music during the process of capturing the image, thereby improving the user experience.
  • the terminal device after the terminal device displays the first identifier of the first music in the first preview interface, the terminal device receives a second operation; in response to the second operation, the terminal device Displaying a second preview interface including a second preview image, the second preview image being different from the first preview image, the second preview image including at least one photographic subject; the terminal device being in the second preview Displaying, in the interface, a second identifier of the second music, the second music being different from the first music, the second music being matched by the terminal device according to at least one of the second preview images Music, the second logo is a text or an icon.
  • the preview image when the terminal device moves the position or changes the focal length, the preview image changes, and the matched music also changes. Therefore, when the preview image dynamically changes, the terminal device matches the appropriate music in real time.
  • the first preview interface includes a first shooting control
  • the terminal device obtains a first captured image in response to an operation for triggering the first shooting control, the first shooting
  • the image is an image in which the terminal device combines the first music and the first preview image.
  • the terminal device may match the preview music according to the preview image, and may generate the sound image synthesized by the preview image and the matched music. In this way, it helps to improve the quality of the captured image, and to some extent, the fun of the image capture process.
  • the second preview interface includes a second shooting control
  • the terminal device obtains a second captured image in response to an operation for triggering the second shooting control, the second shooting
  • the image is an image in which the terminal device combines the second music and the second preview image.
  • the terminal device moves the position or changes the focal length
  • the preview image changes
  • the matched music also changes. Therefore, when the preview image dynamically changes, the terminal device matches the appropriate music in real time.
  • the terminal device is moved to a certain position, if the user triggers the shooting control, the terminal device can match the appropriate music according to the preview image, and can generate a sound image synthesized by the preview image and the matched music. In this way, it helps to improve the quality of the captured image, and to some extent, the fun of the image capture process.
  • the terminal device displays a setting interface for setting a music mode in the first preview interface, the setting The interface includes an icon of the music mode and the first control; in response to the user triggering the operation of the first control, the music mode is activated, the music mode being a mode in which the terminal device matches the appropriate music according to the photographic subject in the preview image.
  • the user can select to turn the music mode on or off according to his or her preference, which helps to improve the user experience.
  • the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; when M is 1, the terminal device is according to the preview image.
  • the terminal device extracts feature information of the one photographic subject when the at least one photographic object matches the music; the terminal device determines a key corresponding to the extracted feature information according to the mapping relationship between the feature information and the keyword a word; the terminal device determines music in the lyric or song name that includes the keyword.
  • the lyrics or the song title of the music matched by the terminal device includes keywords corresponding to the photographic subject.
  • the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; when M is greater than or equal to 2, the terminal device according to the preview image
  • the terminal device determines N photographic subjects whose weights are greater than the preset weights; the weight is used to indicate that the display area of one photographic subject occupies the entire preview image Displaying a ratio of the area; the terminal device extracts feature information from each of the N photographic objects, and obtains a total of N pieces of feature information; the terminal device determines the mapping relationship between the feature information and the keyword N keywords corresponding to the extracted N pieces of feature information; the terminal device determines music including the keyword in the lyrics or the song title.
  • the terminal device selects N photographic objects from the plurality of photographic objects according to the weight of each photographic subject, determines N keywords, and then queries the lyrics or songs. The music containing the N keywords in the name.
  • the terminal device when the terminal device matches music according to N shooting objects of the M shooting objects, the terminal device determines at least two according to N shooting objects in the M shooting objects. Music; the terminal device detects current time information/geographical location information; the terminal device selects one of the at least two types of music according to the time information/geographical location information; or the terminal device is based on priority
  • the policy selects one of the at least two types of music, wherein the priority policy includes a priority order between the at least two types of music.
  • the terminal device when the terminal device matches the music according to the shooting object in the preview image, the terminal device may select one of the plurality of music according to the time information/geographic information or the priority policy.
  • the terminal device determines whether the number of times the user selects the other music exceeds a preset number of times; When the number of times of the other music exceeds the preset number of times, the terminal device sets the first priority level of the other music to the second priority level, the second priority level is greater than the first priority level; the terminal device The priority policy is updated with a second priority level of the other music.
  • the music matched by the terminal device may not be the music that the user likes, so the user may select other music, and the terminal device may record the number of times the user selects other music, and when the user selects other music, the number is increased.
  • the priority level of other music can be recommended first in the next shot. In this way, the terminal device can record the user's usage habits and match the music that suits the user's usage habits.
  • an embodiment of the present application provides a terminal device, including a camera, a display screen, a processor, and a memory.
  • the camera is for capturing a preview image
  • the display screen is for displaying a preview image
  • the memory is for storing one or more computer programs; and when the one or more computer programs stored in the memory are executed by the processor, enabling the terminal device to A method of implementing the first aspect or any one of the possible aspects of the first aspect; or, when the one or more computer programs stored in the memory are executed by the processor, enabling the terminal device to implement the second aspect or the second aspect A possible method of design.
  • the embodiment of the present application further provides a terminal device, where the terminal device includes a module/unit that performs the method of any one of the first aspect or the first aspect; or the terminal device includes A module/unit that performs the method of any one of the possible aspects of the second aspect or the second aspect; these modules/units may be implemented by hardware or by corresponding software implementation by hardware.
  • the embodiment of the present application further provides a computer readable storage medium, where the computer readable storage medium includes a computer program, when the computer program runs on the terminal device, causing the terminal device to perform the first aspect or The method of any one of the foregoing possible aspects of the first aspect; or, when the computer program is run on the terminal device, causing the terminal device to perform the method of any one of the second aspect or the second aspect described above.
  • the embodiment of the present application further provides a computer program product, when the computer program product is run on a terminal device, causing the terminal device to perform any one of the first aspect or the first aspect.
  • FIG. 1 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of a photographing method according to an embodiment of the present invention.
  • 3A is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 3B is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • 3C is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 3D is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 3E is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 9A is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 9B is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 10 is a flowchart of a photographing method according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
  • the terminal device involved in the embodiment of the present application may also be referred to as a user equipment (UE).
  • UE user equipment
  • the terminal device can be a smart phone, a tablet computer, various wearable devices, an in-vehicle device, and the like.
  • Various applications such as WeChat, maps, etc. can be installed in the terminal device.
  • a plurality of the embodiments of the present application refer to two or more.
  • the embodiment of the present application provides a photographing method and a terminal device, and the method is applicable to a terminal device.
  • Figure 1 shows a block diagram of a possible terminal device.
  • the terminal device 100 includes: a radio frequency (RF) circuit 110 , a power source 120 , a processor 130 , a memory 140 , an input unit 150 , a display unit 160 , a camera 170 , a communication interface 180 , and a wireless device Components such as the Wireless Fidelity (WiFi) module 190.
  • RF radio frequency
  • the terminal device provided by the embodiment of the present application may include more or less components than the illustrated ones, or combine some Some parts, or different parts are arranged.
  • the components of the terminal device 100 are specifically described below with reference to FIG. 1 :
  • the RF circuit 110 can be used for receiving and transmitting data during communication or during a call. Specifically, after receiving the downlink data of the base station, the RF circuit 110 sends the data to the processor 130 for processing; in addition, the uplink data to be sent is sent to the base station.
  • the RF circuit 110 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
  • LNA Low Noise Amplifier
  • RF circuitry 110 can also communicate with the network and other devices via wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code). Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), etc.
  • GSM Global System of Mobile communication
  • GPRS General Packet Radio Service
  • Code Division Multiple Access CDMA
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • E-mail Short Messaging Service
  • the WiFi technology belongs to the short-range wireless transmission technology, and the terminal device 100 can connect to an access point (AP) through the WiFi module 190, thereby implementing access of the data network.
  • the WiFi module 190 can be used for receiving and transmitting data during communication.
  • the terminal device 100 can implement physical connection with other devices through the communication interface 180.
  • the communication interface of the communication interface 180 and the other device is connected by a cable to implement data transmission between the terminal device 100 and other devices.
  • the terminal device 100 can implement the communication service and send information to other contacts. Therefore, the terminal device 100 needs to have a data transmission function, that is, the terminal device 100 needs to include a communication module.
  • FIG. 1 shows a communication module such as the RF circuit 110, the WiFi module 190, and the communication interface 180, it can be understood that at least one of the above components or other uses are present in the terminal device 100.
  • a communication module (such as a Bluetooth module) that implements communication for data transmission.
  • the terminal device 100 when the terminal device 100 is a mobile phone, the terminal device 100 may include the RF circuit 110, and may further include the WiFi module 190.
  • the terminal device 100 When the terminal device 100 is a computer, the terminal device 100 may The communication interface 180 is further included, and the WiFi module 190 may be included.
  • the terminal device 100 When the terminal device 100 is a tablet computer, the terminal device 100 may include the WiFi module.
  • the memory 140 can be used to store software programs as well as modules.
  • the processor 130 executes various functional applications and data processing of the terminal device 100 by running software programs and modules stored in the memory 140.
  • the memory 140 may mainly include a storage program area and a storage data area.
  • the storage program area may store an operating system, various applications (such as a communication application), a face recognition module, and the like;
  • the storage data area may store data created according to the use of the terminal device (such as various pictures and video files). Such as multimedia files, as well as face information templates).
  • the memory 140 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the input unit 150 can be configured to receive numeric or character information input by a user, and generate a key signal input related to user settings and function control of the terminal device 100.
  • the input unit 150 may include a touch panel 151 and other input devices 152.
  • the touch panel 151 can collect touch operations on or near the user (such as a user using a finger, a stylus, or the like on the touch panel 151 or on any suitable object or accessory.
  • the operation in the vicinity of the touch panel 151) drives the corresponding connecting device according to a preset program.
  • the touch panel 151 may include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 130 is provided and can receive commands from the processor 130 and execute them.
  • the touch panel 151 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the other input device 152 may include, but is not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, and the like.
  • function keys such as a volume control button, a switch button, etc.
  • a trackball such as a mouse, a joystick, and the like.
  • the display unit 160 can be used to display information input by a user or information provided to a user and various menus of the terminal device 100.
  • the display unit 160 is a display system of the terminal device 100 for presenting an interface to implement human-computer interaction.
  • the display unit 160 may include a display panel 161.
  • the display panel 161 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • the touch panel 151 may cover the display panel 161, and when the touch panel 151 detects a touch operation on or near it, the touch panel 151 transmits to the processor 130 to determine the type of the touch event. The processor 130 then provides a corresponding visual output on the display panel 161 based on the type of touch event.
  • the touch panel 151 and the display panel 161 are two independent components to implement the input and input functions of the terminal device 100, in some embodiments, the touch panel may be implemented.
  • the touch panel 151 is integrated with the display panel 161 to implement input and output functions of the terminal device 100.
  • the processor 130 is a control center of the terminal device 100, and connects various components by using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 140, and calling the storage in the
  • the data in the memory 140 performs various functions and processing data of the terminal device 100, thereby implementing various services based on the terminal device.
  • the processor 130 may include one or more processing units.
  • the processor 130 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, and the like, and the modem processor mainly processes wireless communications. It can be understood that the above modem processor may not be integrated into the processor 130.
  • the camera 170 is configured to implement a photographing function of the terminal device 100, and take a picture or a video.
  • the camera 170 can also be used to implement the scanning function of the terminal device 100 to scan the scanned object (two-dimensional code/barcode).
  • the terminal device 100 also includes a power source 120 (such as a battery) for powering various components.
  • a power source 120 (such as a battery) for powering various components.
  • the power source 120 can be logically connected to the processor 130 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption through the power management system.
  • the terminal device 100 may further include at least one type of sensor, audio circuit, and the like, and details are not described herein.
  • the embodiment of the present application provides a photographing method and a terminal device.
  • the terminal device can identify the photographic subject in the preview image, recommend text information such as poems and songs that match the photographic object, and prompt information to prompt the user to preview the image that is missing or more a subject.
  • the user can adjust the shooting range/angle and so on under the guidance of the prompt information to obtain a higher quality image. In this way, a user with high quality can also take a higher quality image.
  • the photographing method provided in the embodiment of the present application is applicable to the terminal device 100 shown in FIG. 1 . Therefore, in the following description, the terminal device 100 will be taken as an example.
  • FIG. 2 is a flowchart of a photographing method provided by an embodiment of the present application. As shown in Figure 2, the process of the method includes:
  • the terminal device 100 displays a preview image, and the preview image includes at least one photographic subject.
  • the terminal device 100 can open the camera 170 by launching an application having a photographing function.
  • the application having the photographing function may be a camera application provided in the terminal device 100, or other applications installed in the terminal device 100, such as a beauty camera, a filter master, a beauty camera, a WeChat, an Alipay, and a Tencent chat software ( QQ, nail, photo sharing (instagram), Kakao Talk, even line (Line) and other applications with shooting capabilities.
  • the camera icon displayed on the terminal device 100 can be triggered to activate the camera.
  • the processor 130 of the terminal device 100 runs the camera, activates the camera 170, and displays a preview image on the display panel 161 of the display unit 160.
  • the user aligns the camera 170 with the subject the subject is displayed in the preview image.
  • the terminal device 100 identifies at least one photographic object included in the preview image, and matches the recognized photographic object according to the recognized photographic object, and the text information may include a poem, a song, a slang, a celebrity quote, or a network buzzword. Wait.
  • the terminal device 100 when the terminal device 100 recognizes at least one photographic subject included in the preview image, one or more frames of the preview image may be acquired, and then the captured preview image is image-recognized.
  • the terminal device 100 may collect the preview image from the time when the camera 170 is activated, until the terminal device 100 detects that the user triggers the shooting button to stop the acquisition.
  • the terminal device 100 acquires a preview image from the time when the camera 170 is activated, until the terminal device 100 determines that it is in a stationary state or the photographing object in the preview image is stably displayed.
  • the photographic subject can be identified from the preview image.
  • the subject may include various contents such as: people, animals, food, flowers, green plants, mountains, rivers, stages, beaches, waterfalls, night scenes, blue sky, snow scenes, and the like.
  • the terminal device 100 recognizes the photographic subject included in the preview image, it can match the appropriate text information from the database based on the recognized photographic subject.
  • the text information is mainly poetry as an example.
  • the terminal device 100 matches appropriate text information according to the recognized photographic subject, it can be implemented by keyword matching.
  • the feature information is extracted from the photographic subject, and the keyword corresponding to the extracted feature information is determined according to the mapping relationship between the feature information and the keyword, and then the determined keyword is determined according to the determined keyword.
  • Match text information containing these keywords from the database.
  • the terminal device 100 when the terminal device 100 extracts that the feature information included in the photographic subject is a person, the keyword corresponding to the person is acquired according to the mapping relationship, for example, the keyword corresponding to the character is acquired, including “person”, “her”, “ He "three keywords.
  • the terminal device 100 can match the text information of a certain keyword contained therein from the database.
  • the mapping relationship between the feature information and the keyword may be stored locally or at the server. Further, the user can also change the mapping relationship.
  • the keywords in the text information stored in the terminal device or in the server may be matched with the feature information in advance, for example, the stored text information includes “Panasonic asks the boy, the teacher takes the medicine to go”, The keywords such as "boy” and “teacher” are matched with the feature information "person” in advance; in the process of subsequent shooting, when the feature information included in the object extracted by the terminal device 100 has a character, the sentence can be " Panasonic asked the boy, the teacher took the medicine to "match it.”
  • the stored text information includes "lifting the head and looking at the moon, looking down on the hometown", “the sea is shining and the moon is at the end of the world”, and the keyword “Mingyue” can be matched with the feature information "moon” in advance;
  • the two poems can be matched.
  • the terminal device 100 may adopt a different manner depending on the number of photographic subjects.
  • the terminal device 100 may recognize more than one type of subject.
  • the terminal device 100 queries the database for text information matching the photographic subject, and then recommends the text information to the user.
  • the terminal device 100 can combine the recognized subjects.
  • the terminal device 100 recognizes that the subject includes three, and assumes that three subjects correspond to three keywords. If there is text information including these three keywords at the same time, the text information is recommended to the user. If there is no text information containing the three keywords at the same time, the three keywords are combined in pairs to obtain three combinations, and each combination includes two keywords. Then, each search for text information that exists in two keywords containing some combination. If it exists, the text information is recommended to the user. If none exists, the terminal device 100 matches the appropriate text information according to each of the three keywords, and if there is text information including one of the keywords, the user recommends the text information.
  • the terminal device 100 when the terminal device 100 combines the recognized photographic objects, they may be randomly combined or combined according to the weights of the recognized photographic subjects. If the terminal device 100 is combined according to the weights of the recognized photographic subject, the terminal device 100 needs to evaluate the weight of each photographic subject. For example, the weight may be set according to the ratio of the display area of the photographing object to the display area of the entire preview image, and the higher the ratio of the display area of the photographing object to the display area of the entire preview image, the larger the weight of the photographing object may be set. Taking the terminal device 100 as an example in which the photographic subject includes three, it is assumed that the display area of the first photographic subject among the three photographic subjects in the preview image is the largest, and the display area of the third photographic subject is the smallest.
  • the terminal device 100 sorts the weights between the three photographic subjects: the weight of the first photographic subject > the weight of the second photographic subject > the weight of the third photographic subject.
  • the terminal device 100 can give priority to the combination between the subjects with higher weights.
  • the terminal device 100 may evaluate the weight of each photographic subject in various ways. For example, the terminal device 100 evaluates the weight of each photographic subject according to the brightness or color saturation of each photographic subject.
  • the terminal device 100 may match a plurality of types of appropriate text information according to the recognized photographic subject. Taking the identified object as an example, the object recognized by the terminal device 100 includes the moon, and the terminal device 100 may find a variety of text information matching the database, such as “lifting the head and seeing the moon, "Looking at the hometown", "the sea is bright and the moon, the end of the world at this time” and so on. In order to recommend more appropriate text information to the user, the terminal device 100 may also acquire other information, and select more appropriate text information from the matched plurality of text information according to other information.
  • the terminal device 100 can detect the current time or date, and select more appropriate text information from the plurality of text information according to the detected time (or date).
  • the time described here may be a specific time or a time period.
  • the terminal device 100 recognizes that the photographic object includes the sun from the preview image, and the text information determined by the terminal device 100 includes “the sunset is in the west, the broken intestine is in the horizon”, “the sunrise is in the red and the fire is in the fire, and the spring is green and blue”. "Two poems. When the terminal device 100 detects that the current time is 18:00, it is determined that "the sun sets, the heartbroken person is at the end of the world” is a more appropriate poem.
  • the terminal device 100 can also detect the geographical location where it is currently located, and select more appropriate text information from multiple text information according to the geographic location.
  • the photographic object recognized by the terminal device 100 from the preview image includes flowers and bridges, and the corresponding keywords are “grass” and “bridge”, respectively, and the terminal device 100 queries the database for the two keywords.
  • Poetry For example, the terminal device 100 queries two poems, "Suzaku Bridge side wildflowers, Wuyixiangkou sunset oblique” and "the bottom of the water is like a snow, and the bridgeside grass is like smoke.”
  • the terminal device 100 detects that it is currently in the "Wuyi Lane” in Nanjing, it is determined that the "Suzaku Bridge side wild flowers and grasses, the Wuyi alley sunset” is a more appropriate poem.
  • a further possible implementation manner is that when the terminal device 100 has multiple types of text information matched according to the photographic subject, one type of text information may be determined from the plurality of text information by using the priority policy. For example, the terminal device 100 can determine the priority level between the plurality of text information, and recommend the text information with higher priority to the user.
  • the priority level between different text information can be obtained according to the user's usage habits. For example, the user often selects “Looking at the moon, looking down on the hometown”, then “Looking at the moon, looking down on the hometown” The priority level is higher than “the sea is bright and the moon is at the end of the world”. Therefore, the terminal device 100 recommends to the user that "the head is looking at the moon, and the head is down.”
  • the priority level is updateable. For example, after the terminal device 100 recommends the text information to the user, the user chooses to use other text information. When the terminal device 100 detects that the number of times the user uses other text information exceeds the preset number of times, the terminal device 100 may increase the priority level of other text information and update the priority policy.
  • the terminal device 100 can jointly find suitable text information by combining time, geographical location, keywords of the shooting object, and other information.
  • poems, songs, slang, celebrity quotes, network buzzwords, and the like may be stored locally in the terminal device 100.
  • the terminal 100 can also be obtained from a network or a server.
  • the terminal device 100 outputs the text information and/or the prompt information, where the prompt information is used to prompt the user for a missing or redundant photographic subject in the preview image.
  • the prompt information is used to prompt the user for a missing or redundant photographic subject in the preview image.
  • the text information is matched according to the photographic objects, only N of the M photographic objects match the appropriate text information, and the unnecessary photographic subject is the N photographic subjectes except the N The remaining MN subjects of the subject.
  • the unnecessary photographic subject can be presented to the user; according to the prompt, the user can move the position or angle of the terminal device, so that the redundant photographic subject is not included in the preview image, that is, the redundant photographic subject is not Captured so that you can achieve better photo results.
  • the terminal device may prompt the user for the missing photographic subject; according to the prompt, the user may move the position or angle of the terminal device, so that the missing photographic subject is added to the preview image, that is, the previously missing photographic subject is Captured so that you can achieve better photo results.
  • the terminal device 100 when the terminal device 100 recognizes that there are a plurality of photographic objects included in the preview image, a plurality of photographic subjects may be combined, and the text information is determined based on the combined photographic subject. Therefore, it may happen that some of the plurality of subjects in the preview image are redundant. For example, if the subject included in the preview image has a character, a sea, and a moon, the terminal device 100 determines a poem according to the sea and the moon: "The sea is bright and the moon is at the end of the world", wherein the character is redundant. In this case, the terminal device 100 can display prompt information for prompting the user that there is an extra subject, that is, a character, in the current preview image.
  • the character information matched by the terminal device 100 may include a certain keyword, but the preview image does not include the subject corresponding to the keyword. Therefore, the terminal device 100 can display prompt information for prompting the user that the current preview image lacks a subject corresponding to a certain keyword in the text information.
  • the terminal device 100 may also not display the prompt information.
  • the prompt information may be a voice prompt, that is, the terminal may prompt the user by playing a voice.
  • the prompt information may be text, an icon, an image, and the like that can be displayed on the display screen, and the prompt information may be specifically displayed in the preview interface to facilitate prompting the user.
  • the terminal device 100 may pop up a prompt box in the preview image, and the prompt box includes “adding a river”, “moving the camera to increase the river”, “the character is redundant” or “moving the camera to delete the character”. Wait for the text.
  • the matching degree information may also be displayed on the display screen, and the matching degree information is used to indicate the degree of matching between the text information and the matched text information.
  • the matching degree information can be displayed in the form of a number, for example, the percentage of matching is displayed.
  • the matching degree information can also be displayed in other forms, such as displaying in an expression manner. When the expression is smiling, the matching degree is high, and the expression is sad. , indicating a low degree of matching.
  • the terminal device 100 may collect a preview image in real time, and match appropriate text information from the database according to the captured object included in the captured preview image, and match the matched text information, matching degree information, and prompts.
  • the message is displayed to prompt the user to preview the image that is missing or extra.
  • the user can adjust the shooting range/angle, etc. under the guidance of the prompt information.
  • the terminal device moves the position or changes the focal length to adjust the shooting range/angle, the preview image changes; the terminal re-matches the text according to the subject in the changed preview image.
  • the information if the re-matched text information changes compared with the previous text information, correspondingly, the matching degree information and the prompt information also change; the terminal can display the changed matching degree information and the prompt information. That is, when the preview image changes dynamically, the text information, the matching degree information, and the prompt information also dynamically change.
  • Figures 3A-3E show schematic diagrams of display states of a handset display.
  • a preview interface 301 is displayed on the display screen of the mobile phone 300.
  • the preview interface 301 includes a preview image and some control keys (flash, camera switching, etc.), and the preview image includes a poem 302 matched by the mobile phone 300:
  • the grass is on the shore and there is a deep yellow tree on the grass.
  • the preview image also includes a matching degree of 303:50%.
  • the mobile phone 300 can also display in the preview interface 301 which of the keywords in the poem 302 are matched by the photographic subject included in the current preview image. See Figure 3B.
  • the word “grass” in the poem 302 "Single Pity on the Shore, and the Yellow Grass on the Tree" is in the solid coil to prompt the user to preview the image contained in the image and in the poem 302. "Grass” matches.
  • the word "grass” is displayed in a solid line frame.
  • other display modes such as highlighting, bubble, bolding, etc., may also be used. As long as the purpose of prompting the user is reached.
  • the mobile phone 300 may pop up a prompt box 304 in the preview image, and the text of "adding jaundice” is displayed in the prompt box 304, please refer to FIG. 3C.
  • the mobile phone 300 may also display indication information (in the form of an arrow or a text) of the moving direction, and the indication information of the moving direction is used to prompt the user to adjust the shooting range according to the indicated moving direction.
  • indication information in the form of an arrow or a text
  • the mobile phone may display an indication of adjusting the focal length (the distance between the object and the subject) in the preview image to prompt the user to increase (or shorten) the focal length to obtain more (or fewer) subjects.
  • the indication information for adjusting the focal length may be a text or an icon.
  • a preview interface 301 is displayed on the display screen of the mobile phone 300.
  • the preview interface 301 includes a preview image, and the preview image includes more shooting objects and a poem 302 matched by the mobile phone: There is a yellow scorpion in the tree, and the preview image also includes: 305:80% matching.
  • the "grass” and “yellow” in the poem 302 are displayed in the solid line frame to prompt the user that the current included preview image matches the "grass” and "yellow”.
  • a poem is displayed in a preview image.
  • the phone can also display multiple poems in the preview image.
  • the mobile phone matches two poems according to the object in the preview image, and the mobile phone can display the two poems in the preview image, and the user can select the poetry of interest from among them.
  • a preview interface 401 is displayed on the display screen of the mobile phone 400.
  • the preview image is displayed in the preview interface 401.
  • the preview image includes two poems, namely, a poem 402 and a poem 403.
  • the user can select a poem by the user's finger. Swipe left/right to cancel the poem.
  • there may be other cancellation modes which are not limited in the embodiment of the present application.
  • the poems displayed by the mobile phone are not necessarily preferred by the user.
  • the user can select poems according to his own needs.
  • One possible implementation is that the user can select the type of poetry, and the mobile phone matches the appropriate poetry according to the type of poetry selected by the user.
  • the type of poetry selected by the user is a landscape poem, so the mobile phone recommends the poetry of the gardening style of the landscape.
  • the mobile phone 500 displays an identifier 501 of a poetry type in the preview image.
  • the mobile phone displays a plurality of poetry types, and the user selects one of the poem types.
  • Another possible implementation is that if the user wants to try other poems, he or she can choose to change the poetry.
  • the refresh (or change control) control 601 is displayed in the preview interface 601 of the mobile phone 600.
  • the phone 600 displays other poems.
  • the mobile phone needs to find suitable text information from the database in the process of matching the text information according to the object.
  • Text messages can be stored locally on the phone or stored on the server. Therefore, in the case that the mobile phone is not connected to the network, after the user triggers the "refresh" control 601, the mobile phone can find suitable text information in the local database.
  • the mobile phone can find the appropriate text information in the server in addition to the local database.
  • the mobile phone can send the reserved image to the server, and the server performs the process of recognizing the object in the reserved image and matching the text information.
  • the mobile phone may recognize the subject in the preview image and then transmit the keyword corresponding to the recognized subject to the server.
  • the server matches the appropriate poetry according to the received keywords, and then the server sends the matched poems to the mobile phone.
  • the "refresh" control 601 is displayed in the same box as the poem. This is just an example.
  • the "refresh” control 601 can also be displayed at other locations, or can be displayed in other ways, such as an icon.
  • the manner of the present application is not limited in the embodiment of the present application.
  • the display of the handset 700 displays a "History” control 701.
  • the handset 700 displays a list showing the poems that have been displayed.
  • the "History” control 701 is displayed in the same box as the poem. This is just an example.
  • the "History” control 701 can also be displayed at other locations, or otherwise displayed. The application embodiment does not limit this.
  • the poetry and the matching degree information may be fixed position information in the preview image (the position may be set by the user), or may be displayed in a blank place in the preview image, see the figure.
  • the mobile phone 800 displays poetry and matching degree information in a blank space in the preview image. In this way, the poetry and matching degree information can not obscure the subject in the preview image as much as possible, and is convenient for the user to view, and is more helpful for guiding the user to shoot.
  • the matching degree information is mainly information for guiding the user to photograph
  • the matching degree information and the poetry can be displayed in the preview image.
  • only the poems can be displayed in the final captured image.
  • the user can select the font in which the poetry is displayed in the final captured image, such as the fonts of the Song, the corpus, and the like.
  • Poetry can be displayed statically or dynamically. For example, each word in a poem can be displayed one by one, showing the effect of dynamic display.
  • poems can be displayed in blank places in the final captured image, and try to avoid occluding the display content in the image.
  • the solution provided by the embodiment of the present application is mainly used to guide the user to take a better quality image. Therefore, when the user triggers the shooting button, the poems may not be displayed in the final captured image. Or, when the user triggers the shooting button, the last shot is to get two images, one of which does not contain poetry and the other contains poetry.
  • the mobile phone may not display the poetry, and only display the prompt information to prompt the user to preview the image lacking a certain shooting object or a certain shooting object, and the user may shoot the effect according to the prompt information. image.
  • the mobile phone detects that the user triggers the shooting button, the image that can be captured may not contain poetry.
  • the prompt information mainly prompts the user that the preview image lacks a certain shooting object or a certain shooting object, and the prompt information may also prompt the user to replace one of the unnecessary shooting objects in the preview image with another shooting object.
  • the mobile phone may first determine the redundant first subject, then determine the missing second subject, and then output a prompt message to prompt the user to replace the first subject with the second subject.
  • the terminal device can identify the photographing object in the preview image, recommend text information such as poetry, song and so on, and prompt information matching the photographing object to prompt the user to preview the image. Missing or extra shots.
  • the user can adjust the shooting range/angle and so on under the guidance of the prompt information to obtain a higher quality image. In this way, a user with high quality can also take a higher quality image.
  • the user may choose to turn on the poetry shooting mode or turn off the poetry shooting mode.
  • a poetry matching mode may be set in the preview interface of the mobile phone. After the user starts the poetry matching mode, the mobile phone may execute S201-S203.
  • FIG. 9A shows a schematic diagram of a display screen of a mobile phone display.
  • a preview interface 901 is displayed on the display screen of the mobile phone 900.
  • the preview interface 901 includes a shooting mode selection box 902, and the shooting mode selection box includes a control 903 corresponding to the poetry mode.
  • the user triggers the control 903 to start the poetry mode, and the mobile phone executes S201-S203 of the embodiment shown in FIG. 2, and the text information and the matching degree information are displayed on the display screen. If the user triggers the control 903 again and the mobile phone 900 turns off the poetry mode, the text information and the matching degree information on the display of the mobile phone 900 disappear.
  • the mobile phone can detect that the object included in the current preview image belongs to a landscape such as a mountain, a water, a plant, a desert, a pavilion, etc., and can display a logo (text or icon) of the poetry mode on the preview image. , remind the user to start the poetry mode. See Figure 9B.
  • a preview interface 901 is displayed on the display screen of the mobile phone 900.
  • the preview interface 901 includes a preview image, and the preview image includes an icon 904 of a poetry mode.
  • the handset 900 initiates the poetry mode.
  • the phone 900 turns off the poetry mode.
  • the terminal device may identify the photographic subject in the preview image, recommend text information such as poems, songs, and the like that match the photographic subject to the user, and prompt information to prompt the user to preview the image. Missing or extra shots.
  • the user can adjust the shooting range/angle and so on under the guidance of the prompt information to obtain a higher quality image.
  • the terminal device after the terminal device recognizes a plurality of photographic objects included in the preview image, the terminal can recommend music that matches the recognized photographic subject, and the user can select the recommended music and the shooting.
  • the resulting image is synthesized into an acoustic image.
  • This method can be applied to the terminal device 100 shown in Fig. 1, so the terminal device 100 is taken as an example in the following description. Referring to Figure 10, the process of the method includes:
  • the terminal device 100 displays a preview image, and the preview image includes at least one photographic subject.
  • the terminal device 100 recognizes at least one photographic subject included in the preview image, and matches the recognized photographic object according to the recognized photographic subject.
  • the terminal device 100 matches appropriate music according to the recognized photographic subject, it can be realized by keyword matching.
  • the feature information is extracted from the photographic subject, and the keyword corresponding to the extracted feature information is determined according to the mapping relationship between the feature information and the keyword, and then the determined keyword is determined according to the determined keyword.
  • the terminal device 100 matches appropriate music according to the recognized photographic subject, it can be matched by the scene information in which the photographic subject is located.
  • the terminal device 100 when the terminal device 100 recognizes that the subject is in a scene such as a bar, a karaoke bar, or a stage, the terminal device 100 can search for music suitable for playing in a bar, a karaoke bar, or a stage.
  • the terminal device 100 matches the appropriate music according to the recognized photographic subject, it can be matched by the environment information currently provided by the terminal device 100.
  • the terminal device 100 may also collect the sound of the surrounding environment.
  • the terminal device 100 may search for the light music.
  • the terminal device 100 may match by the current time when matching the appropriate music according to the recognized photographic subject.
  • the terminal device 100 can detect the current time and determine the appropriate music based on the detected time. For example, of course, the time is night, you can look for light music.
  • the terminal device 100 may match by the current geographic location when matching the appropriate music according to the recognized photographic subject.
  • the terminal device 100 can detect the current geographic location and find suitable music according to the geographic location. For example, when the terminal device 100 detects that it is currently in Hong Kong, it searches for Cantonese music. When the terminal device 100 detects that it is currently in the United States, it searches for European and American music.
  • the terminal device 100 can also match other sounds other than music. For example, when the terminal device 100 recognizes that an object is included in the subject, the call of the animal can be queried from the server or locally. For example, if the subject contains a bird, the terminal device 100 can query the bird's voice.
  • the terminal device can combine the several methods listed above.
  • the music may be stored locally in the terminal device 100 or stored in the server. Therefore, in the case where the terminal device 100 is not connected to the network, the appropriate music can be queried in the local database. In the case of mobile phone networking, the terminal device 100 can query the appropriate music in the server in addition to querying the appropriate music locally. Exemplarily, the terminal device 100 may transmit the preview image to the server, identify the photographic subject in the preview image by the server, and match the appropriate music, and then the server transmits the related information of the matched music to the terminal device 100.
  • the terminal device 100 may identify the photographic subject in the preview image, and then send the identified keyword corresponding to the photographic subject to the server, and the server matches the appropriate music according to the received keyword, and then the server matches the matched music.
  • the related information is transmitted to the terminal device 100.
  • the music may be a music piece, such as a music piece whose playing time is 10s-12s. Therefore, after the terminal device 100 or the server stores the music piece that has been intercepted, or the terminal device 100 or the server determines the appropriate music, the appropriate music piece is intercepted from the music, and then the music piece is pushed to the user.
  • the terminal device 100 displays an identifier of the music, and the identifier is a text or an icon.
  • Fig. 11 is a view showing the display state of the screen of the mobile phone.
  • the display screen of the mobile phone 1100 displays a preview interface 1101.
  • the preview interface 1101 includes a preview image, and the preview image includes an identifier 1102 of the music matched by the mobile phone 1100.
  • music can be played. If the user is satisfied with the music, the shooting control can be triggered, and the terminal device 100 synthesizes the music and the captured image to obtain a sound image.
  • the user can choose to turn on the music mode or turn off the music mode.
  • a music mode may be set in the preview interface of the terminal device 100, and when the user activates the music mode, the terminal device 100 may execute S1001-S1003.
  • FIG. 12 shows a schematic diagram of a display screen of a mobile phone display.
  • a preview interface 1201 is displayed on the display screen of the mobile phone 1200.
  • the preview interface 1201 includes a shooting mode selection box 1202, and the shooting mode selection box 1202 includes a control 1203 corresponding to the music mode.
  • the user triggers the control 1203 to activate the music mode, and the mobile phone 1200 executes S1001-S1003 of the embodiment shown in FIG. 10, and displays the recommended music identification on the display screen. If the user triggers the control 1203 again, the mobile phone 1200 turns off the music mode, and the identification of the music on the display of the mobile phone 1200 disappears.
  • Embodiments of the present application can be arbitrarily combined to achieve different technical effects. Therefore, various embodiments in the embodiment shown in FIG. 2 can also be applied to the embodiment shown in FIG. That is, when a photo or video is taken, the method of the embodiment shown in FIG. 2 can be used to prompt the user for the currently missing or redundant subject, and the identification of the music can be displayed by the method of the embodiment shown in FIG. After shooting, you can get photos or videos that include text messages and music. That is, the user can obtain a multimedia photo or video, that is, when the user views the photo, the terminal can have corresponding text information on the photo, and can also play the corresponding music.
  • the method provided by the embodiment of the present application is introduced from the perspective of the terminal device as an execution subject.
  • the terminal device may include a hardware structure and/or a software module, and implement the foregoing functions in the form of a hardware structure, a software module, or a hardware structure plus a software module.
  • One of the above functions is performed in a hardware structure, a software module, or a hardware structure plus a software module, depending on the specific application and design constraints of the technical solution.
  • FIG. 13 is a terminal device 1300 according to an embodiment of the present application.
  • the terminal device 1300 may be a terminal device with image capturing capability, and the terminal device may perform the implementation shown in FIG. 2 to FIG. 9 above.
  • the terminal device 1300 includes: a processing unit 1301, and a display unit 1302. among them,
  • the processing unit 1301 is configured to receive a first operation, and start the camera in response to the first operation;
  • the display unit 1302 is configured to display a first preview interface including a first preview image, where the first preview image includes at least one photographic subject;
  • the processing unit 1301 is further configured to output first prompt information according to the first preview image, where the first prompt information is used to prompt a missing or redundant photographing object in the first preview image.
  • the first prompt information may be a language prompt information or a text prompt information.
  • the processing unit 1301 may output voice prompt information through a speaker, or the processing unit 1301 may output text prompt information through the display unit 1302.
  • the processing unit 1301 is further configured to receive a second operation, and respond to the second operation to be displayed by the display unit 1302. a second preview interface of the second preview image, the second preview image being different from the first preview image, wherein the second preview image includes at least one photographic subject;
  • the processing unit 1301 is further configured to output second prompt information according to the second preview image, where the second prompt information is different from the first prompt information, and the second prompt information is used to prompt the second preview information Missing or unwanted subjects in the image.
  • the second prompt information may also be a language prompt information or a text prompt information.
  • the processing unit 1301 may output voice prompt information through a speaker, or the processing unit 1301 may output text prompt information through the display unit 1302.
  • the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; if the N photographic objects and the preset text in the M photographic objects If the information is matched, the redundant photographic subject is the MN photographic subjects remaining in the M photographic subjects except the N photographic subjects; if the text information matching the M photographic objects includes The keyword corresponding to the other subject other than the M subjects, the other subject is the missing subject; N ⁇ 1, and N ⁇ M.
  • the first prompt information is displayed in the first preview interface; and the second prompt information is displayed in the second preview interface.
  • the processing unit 1301 is further configured to output the matched first text information according to the first preview image, and display the first text information in the first preview interface by using the display unit 1302.
  • the processing unit 1301 is further configured to output the matched second text information according to the second preview image, and display the second text information in the second preview interface by using the display unit 1302. .
  • the first text information includes at least one text information; or the second text information includes at least one text information.
  • the processing unit 1301 is further configured to further output first matching degree information according to the first preview image, and display the first matching degree information in the first preview interface by using the display unit 1302;
  • the first matching degree information is used to indicate a degree of matching between the first text information and the first preview image.
  • the processing unit 1301 is further configured to output second matching degree information according to the first preview image, and display the second matching degree information in the second preview interface by using the display unit 1302,
  • the second matching degree information is used to indicate a degree of matching between the second text information and the second preview image.
  • the processing unit 1301 is further configured to output the first direction indication information according to the first preview image, and display the first direction indication information in the first preview interface by using the display unit 1302,
  • the first direction indication information is used to prompt the user to move the terminal device according to the indicated first direction.
  • the processing unit 1301 is further configured to output second direction indication information according to the first preview image, and display the second direction indication information on the second preview interface by using the display unit 1302.
  • the second direction indication information is used to prompt the user to move the terminal device according to the indicated second direction.
  • a second control is displayed in the first preview image, where the second control is used to trigger a type of displaying text information, and the processing unit 1301 is configured to respond to a user triggering an operation of the second control by using the
  • the display unit 1302 displays a first list, the first list includes at least one type of text information; the processing unit 1301 displays the first text information through the display unit 1302 in response to the user selecting the first type of operation,
  • the type of the first text information is the first type.
  • the first preview interface includes a first shooting control
  • the processing unit 1301 is further configured to obtain two first captured images, in response to the operation for triggering the first shooting control.
  • One of the first captured images of the first captured image includes the first text information, and the other first captured image does not include the first text information.
  • the second preview interface includes a second shooting control
  • the processing unit 1301 is further configured to obtain two second captured images, in response to the operation for triggering the second shooting control.
  • One of the second captured images of the second captured image includes the second text information, and the other second captured image does not include the second text information.
  • the preview image includes M photographic objects, and the preview image is the first preview image or the second preview image; when M is 1, the processing unit 1301 is configured to use the M
  • the method is specifically configured to: extract feature information of the one photographic subject; and determine a key corresponding to the extracted feature information according to a mapping relationship between the feature information and the keyword. a word; determining textual information containing the keyword.
  • the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; when M is greater than or equal to 2, the processing unit 1301 is configured to use the M according to the M
  • the method is specifically configured to: determine N photographic subjects whose weights are greater than the preset weights; and the weights are used to indicate the display area of one photographic subject. a ratio of a display area of the entire preview image; extracting feature information from each of the N shot objects, and obtaining a total of N feature information; determining and extracting according to a mapping relationship between the feature information and the keyword N keywords corresponding to the N feature information; and character information including the N keywords is determined.
  • the processing unit 1301 is further configured to: determine, according to the N pieces of the M photographic objects, at least two types of characters according to the N pieces of the M photographic objects. Information; detecting current time information/geographic location information; selecting one piece of text information from the at least two types of text information according to the time information/geographic location information; or from the at least two pieces of text information according to a priority policy A piece of text information is selected, wherein the priority policy includes a priority order between the at least two pieces of text information.
  • the processing unit 1301 is further configured to: determine whether the number of times the user selects the other text information exceeds a preset number of times; When the number of times the user selects the other text information exceeds a preset number of times, the first priority level of the other text information is set to a second priority level, and the second priority level is greater than the first priority level; The second priority level of the other text information updates the priority policy.
  • the processing unit 1301 may be equivalent to a processor in the terminal device; the display unit 1302 may be equivalent to a display screen in the terminal device.
  • FIG. 14 shows a terminal device 1400 according to an embodiment of the present application.
  • the terminal device 1400 may be a terminal device with image capturing capability, and the terminal device may perform the implementation shown in FIG. 10 to FIG. 12 above.
  • the terminal device 1400 includes a processing unit 1401 and a display unit 1402.
  • the processing unit 1401 is configured to receive a first operation, and start the camera in response to the first operation;
  • the display unit 1402 is configured to display a first preview interface including a first preview image, where the first preview image includes at least one photographic subject; the display unit 1402 is further configured to display the first preview interface a first identifier of the music, wherein the first music is music that is matched by the terminal device according to at least one of the first preview images, and the first identifier is a text or an icon.
  • the processing unit 1401 is further configured to receive a second operation
  • the display unit 1402 is further configured to display, according to the second operation, a second preview interface including a second preview image, where the second preview image is different from the first preview image, and the second preview image includes At least one photographic subject; the display unit 1402 is further configured to display a second identifier of the second music in the second preview interface, the second music is different from the first music, and the second music is
  • the terminal device is configured to match music according to at least one of the second preview images, and the second identifier is a text or an icon.
  • the first preview interface includes a first shooting control
  • the processing unit 1401 is further configured to obtain a first captured image, the first shooting, in response to an operation for triggering the first shooting control.
  • the image is an image in which the terminal device combines the first music and the first preview image.
  • the second preview interface includes a second shooting control
  • the processing unit 1401 is further configured to obtain a second captured image, the second shooting, in response to an operation for triggering the second shooting control.
  • the image is an image in which the terminal device combines the second music and the second preview image.
  • the terminal device further includes a sound playing unit, and the sound playing unit is configured to play the first music in response to an operation of triggering the first identifier.
  • a second control is displayed in the preview image, the second control is used to trigger a type of displaying music, and the display unit 1402 is further configured to display the first one in response to the user triggering the operation of the second control.
  • a list the first list includes at least one type of music; the display unit 1402 is further configured to display a first identifier of the first music, the type of the first music, in response to the user selecting a first type of operation For the first type.
  • the processing unit 1401 may be equivalent to a processor in the terminal device; the display unit 1402 may be equivalent to a display screen in the terminal device.
  • the foregoing various embodiments describe the processing of the preview image by the terminal device at the time of shooting. It should be noted that the foregoing shooting may be taking a photo or shooting a video. Moreover, referring to the foregoing processing method for the preview image, similar processing is performed on the captured video image. For example, the processing of video images can be as follows.
  • the captured video image may include several frames. Among them, some consecutive frames may be similar or continuous scenes, that is, the subjects in these frames are the same or mostly the same.
  • the terminal device can analyze the content of each frame in the captured video image to identify text information or music information that matches the subject in each frame; thus, text or music that matches the entire video image There may be more than one, because the content that matches each frame may be the same or different.
  • the terminal device may analyze the content in the consecutive frames after identifying consecutive frames indicating similar or continuous scenes, and identify text information or music information that matches the shooting objects in the consecutive frames, where A set of consecutive frames corresponds to one piece of text information or music information; thus, there may be more than one text or music that matches the entire video image, because the entire video image may include multiple sets of consecutive frames (all of which are in a group of consecutive frames) The scenes represented are similar or continuous), and the content matching each group of consecutive frames may be the same or different.
  • the terminal device may further identify a text information or music information that matches the shooting objects according to the image objects in the image image or a part of the image frames in the video image; thereby, the text matching the entire video image Or music is one. That is to say, a text message or music information can match the entire video image, or can match a certain frame or frames in the video image.
  • the method of recognizing text information or music information matching each frame or some consecutive frames or all image frames is the same as the method of recognizing text information or music information matching the preview image in the foregoing embodiment.
  • the text information may be displayed on the display interface in real time; or after the video is played, when the video is played again, the matched text information is displayed in the play interface.
  • the matched music can be played in real time; or the matching music can be played simultaneously when the video is played again after the end of the shooting video.
  • the entire video image corresponds to only one text message or music information
  • the same text or the same music can be always displayed during the entire video playback.
  • each frame or some frames correspond to different text information or music information, in the process of playing the entire video, text matching the current frame is displayed, or music matching the current frame is played.
  • the embodiment of the present application may further include a method for processing a photograph or a video after the shooting, and the method may include:
  • the terminal device acquires the first content.
  • the first content may be a photo or a video.
  • the terminal device can obtain the first content by taking a photo or a video.
  • the terminal device may also acquire the first content from the cloud or other external device; for example, the terminal device downloads photos or videos from the cloud, or the terminal device receives photos or videos sent by other terminal devices.
  • the terminal device receives the fourth operation.
  • the fourth operation is: selecting the first content, and the first content to be shared. That is, the fourth operation indicates that the user wants to share the first content.
  • the fourth operation may be one operation or multiple operations.
  • the sharing may be sent to an external terminal, or may be uploaded to an external network; that is, as long as the first content is sent out through the network, so that other users can obtain or see the first content.
  • This embodiment does not limit the specific form of sharing.
  • the terminal device may send the first content to another one or more terminal devices through instant messaging software (for example, WeChat, QQ); or the terminal device may send the first content to the social software (for example: WeChat, Facebook) platform for other users of the social software to view the first content.
  • instant messaging software for example, WeChat, QQ
  • the terminal device may send the first content to the social software (for example: WeChat, Facebook) platform for other users of the social software to view the first content.
  • the terminal device In response to the fourth operation, the terminal device identifies an object in the first content; wherein at least one of the first content matches a preset text information or audio.
  • the terminal device may query text information or audio information corresponding to one or more objects in the first content locally or in the network.
  • S1504 The terminal device generates the second content according to the first content and text or audio that matches the first content.
  • the second content may be generated according to the matched text or audio.
  • the terminal device may superimpose the matched text on the first content (photo or video) to form the second content.
  • the terminal device may superimpose or associate the matched audio information with the first content.
  • the audio information may include audio data, and may also include audio data and text corresponding to the audio data.
  • the second content may include matching audio information, or the second content may include a download address or a download link of the matched audio information.
  • S1505 The terminal device shares the second content.
  • the terminal device may first render the second content. For example, the terminal device presents the first content superimposed with the matching text. Alternatively, the terminal device presents the first content superimposed with the identifier of the matching audio, that is, the name of the matching audio or other graphic identifier may be displayed on the display interface of the first content, so that the user can know what audio is matched. After the user sees the second content presented by the terminal device, the user may choose to share the second content. After the terminal device receives the operation indication for instructing to share the second content, the terminal device shares the second content with the other device. The terminal device can share the second content to other devices through various existing networks.
  • S1506 After the other device receives the second content, the second content is presented.
  • other devices can display photos or videos that contain matching text.
  • other devices can play matching audio when displaying photos or playing videos; and can also display text corresponding to audio when playing audio.
  • the audio is a song
  • the text corresponding to the audio may be the lyrics of the song.
  • the embodiment of the present application can process the photographed photo or video, and automatically add matching text or audio.
  • Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another.
  • a storage medium may be any available media that can be accessed by a computer.
  • the computer readable medium may include a RAM, a ROM, an electrically erasable programmable read only memory (EEPROM), a compact disc read-only memory (CD-).
  • ROM read-only memory
  • Any connection may suitably be a computer readable medium.
  • the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, Then coaxial cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, wireless and microwave are included in the fixing of the associated medium.
  • a disk and a disc include a compact disc (CD), a laser disc, a compact disc, a digital video disc (DVD), a floppy disk, and a Blu-ray disc, wherein Disks typically replicate data magnetically, while disks use lasers to optically replicate data. Combinations of the above should also be included within the scope of the computer readable media.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Telephone Function (AREA)
  • Image Analysis (AREA)

Abstract

一种拍照方法和终端设备。该方法包括:终端设备接收第一操作;响应所述第一操作,所述终端设备启动相机;所述终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象,所述第一预览图像中的至少一个拍摄对象与预设的第一文字信息相匹配;所述终端设备根据所述第一预览图像和所述第一文字信息输出第一提示信息,所述第一提示信息用于提示所述第一预览图像中缺少或多余的拍摄对象。在提示信息的提示下,用户可以移动终端设备的位置或角度,尽可能的使得缺少的拍摄对象被拍到,多余的拍摄对象不被拍到,从而达到更好的拍摄效果。这种方式可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。

Description

一种拍照方法和终端设备
本申请要求于2018年4月28日提交中国专利局、国际申请号为PCT/CN2018/085184、发明名称为“一种拍照方法和终端设备”的国际专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及图像拍摄技术领域,尤其涉及一种拍照方法和终端设备。
背景技术
随着通信技术的进步,终端设备中各种功能不断完善。其中,终端设备中的拍照功能已经成为用户使用频率较高的功能之一。
比如,用户旅行时,遇到美丽的风景时,用户希望拍摄出质量较高的图像作为留念。但是,对于大部分用户并非专业摄影者或者摄影爱好者,不懂拍摄技术,不知道如何才能拍摄出效果良好的照片,造成拍摄出来的照片生硬、呆板,也会影响用户心情,降低用户体验。
发明内容
本申请实施例提供一种拍照方法和终端设备,用以指导用户拍摄得到质量较高的图像,提高用户体验。
第一方面,本发明实施例提供一种拍照方法,该方法适用于具有图像拍摄功能的终端设备。该方法包括:终端设备接收第一操作;响应所述第一操作,所述终端设备启动相机;终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象,其中,所述第一预览图像中的至少一个拍摄对象与预设的第一文字信息相匹配;终端设备根据所述第一预览图像和所述第一文字信息在所述第一预览界面中输出第一提示信息,所述第一提示信息用于提示所述第一预览图像中缺少或多余的拍摄对象。
在本申请实施例中,预览图像中包含至少一个拍摄对象,终端设备根据预览图像和与预览图像匹配的文字信息输出提示信息,以提示用户预览图像中缺少或者多余的拍摄对象。在提示信息的提示下,用户可以移动终端设备的位置或角度,尽可能的使得缺少的拍摄对象被拍到,多余的拍摄对象不被拍到,从而达到更好的拍摄效果。这种方式可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。
在一种可能的设计中,所述终端设备输出第一提示信息之后,终端设备接收第二操作;响应所述第二操作,所述终端设备显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象,其中,所述第二预览图像中的至少一个拍摄对象与预设的第二文字信息相匹配;所述终端设备根据所述第二预览图像和所述第二文字信息输出第二提示信息,所述第二提示信息与所述第一提示信息不同,所述第二提示信息用于提示所述第二预览图像中缺少或多余的拍摄对象。
在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像是动态变化的。在预览图像变化时,终端设备输出的提示信息也发生变化,即终端设备可以实时地提示用 户当前的预览图像中缺少或者多余的拍摄对象。通过这种方式,终端设备可以提示用户移动终端设备的位置或角度,使得缺少的拍摄对象被拍到,多余的拍摄对象不被拍到,从而达到更好的拍摄效果。这种方式可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。
在一种可能的设计中,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;若所述M个拍摄对象中的N个拍摄对象与预设的文字信息相匹配,则所述多余的拍摄对象为所述M个拍摄对象中除去所述N个拍摄对象剩下的M-N个拍摄对象;若与所述M个拍摄对象相匹配的文字信息中包括除所述M个拍摄对象之外的其它拍摄对象对应的关键词,则所述其它拍摄对象为所述缺少的拍摄对象;N≥1,且N<M。也就是说,所述第一预览图像中多余的拍摄对象为:包含在所述第一预览图像中、但未包含在所述第一文字信息中的拍摄对象。所述第一预览图像中缺少的拍摄对象为:包含在所述第一文字信息中,但未包含在所述第一预览图像中的拍摄对象。所述第二预览图像中多余的拍摄对象为:包含在所述第二预览图像中、但未包含在所述第二文字信息中的拍摄对象。所述第二预览图像中缺少的拍摄对象为:包含在所述第二文字信息中,但未包含在所述第二预览图像中的拍摄对象。
在本申请实施例中,终端设备根据预览图像中的M个拍摄对象匹配合适的文字信息。如果M个拍摄对象中的N个拍摄对象匹配到文字信息,剩下的M-N个拍摄对象就是多余拍摄对象;如果在根据所述M个拍摄对象匹配文字信息时,匹配到的文字信息中除了这M个拍摄对象还包括有其它对象,则所述的其它对象就是缺少的拍摄对象。通过这种方式,终端设备可以提示用户移动终端设备的位置或角度,使得缺少的拍摄对象被拍到,多余的拍摄对象不被拍到,从而达到更好的拍摄效果。这种方式可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。
在一种可能的设计中,所述第一提示信息显示在所述第一预览界面中;所述第二提示信息显示在所述第二预览界面中。在本申请实施例中,提示信息可以显示在预览界面中,以方便提示用户。当然,提示信息还可以是语音信息,即通过语音提示用户。
在一种可能的设计中,所述终端设备根据所述第一预览图像还输出匹配的第一文字信息,所述第一文字信息显示在所述第一预览界面中。在本申请实施例中,终端设备根据预览图像中的拍摄对象匹配出文字信息后,可以显示文字信息,以便用户查看。
在一种可能的设计中,所述终端设备根据所述第二预览图像还输出匹配的第二文字信息,所述第二文字信息显示在所述第二预览界面中。在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像发生变化,所以,匹配的文字信息也发生变化。因此,在预览图像动态变化时,终端设备显示的文字信息也是动态变化的。
在一种可能的设计中,所述第一文字信息包括至少一个文字信息;或者所述第二文字信息包括至少一个文字信息。在本申请实施例中,终端设备根据预览图像中的拍摄对象匹配出的文字信息可能不止一种,如果是多种文字信息,终端设备也可以在预览界面中显示多种文字信息。
在一种可能的设计中,所述终端设备根据所述第一预览图像还输出第一匹配度信息,所述第一匹配度信息用于指示所述第一文字信息和所述第一预览图像之间的匹配程度,所述第一匹配度信息显示于所述第一预览界面中。在本申请实施例中,终端设备匹配出文字 信息后,还可以显示匹配度信息,用户通过匹配度信息知晓文字信息与预览图像之间的匹配程度。
在一种可能的设计中,所述终端设备根据所述第二预览图像还输出第二匹配度信息,所述第二匹配度信息用于指示所述第二文字信息和所述第二预览图像之间的匹配程度,所述第二匹配度信息显示于所述第二预览界面中。在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像发生变化,匹配的文字信息也发生变化,所以文字信息与预览图像之间的匹配度信息也发生变化。因此,在预览图像动态变化时,终端设备输出的匹配度信息也是动态变化的。因此,用户可以通过匹配度信息寻找较佳的拍摄范围或角度,比如用户寻找到在某个拍摄角度时,预览界面中显示的匹配度较高,用户可以确定这个拍摄角度较好。通过这种方式,可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。
在一种可能的设计中,所述终端设备根据所述第一预览图像还输出第一方向指示信息,所述第一方向指示信息用于提示用户按照指示的第一方向移动所述终端设备,所述第一方向指示信息显示在所述第一预览界面中。在本申请实施例中,终端设备还可以显示方向指示信息,通过方向指示信息提示用户按照某个方向移动终端设备。比如终端设备确定当前的预览图像中缺少鸟,终端设备可以显示向上的箭头,提示用户向上移动终端设备。通过这种方式,可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。
在一种可能的设计中,所述终端设备根据所述第二预览图像还输出第二方向指示信息,所述第二方向指示信息用于提示用户按照指示的第二方向移动所述终端设备,所述第二方向指示信息显示在所述第二预览界面中。在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像发生变化,匹配的文字信息也发生变化,所以方向指示信息也发生变化。因此,在预览图像动态变化时,终端设备显示的方向指示信息也动态变化,以提示用户按照特定的方向移动终端设备。通过这种方式,可以指导用户拍摄得到质量较高的图像,有助于提高用户体验。
在一种可能的设计中,所述第一预览图像中显示第二控件,所述第二控件用于触发显示文字信息的类型,所述终端设备响应于用户触发所述第二控件的操作,显示第一列表,所述第一列表中包含至少一种文字信息的类型;所述终端设备响应于用户选择第一类型的操作,显示第一文字信息,所述第一文字信息的类型为所述第一类型。在本申请实施例中,用户可以选择文字信息的类型,当用户选择某种类型时,终端设备可以显示属于这种类型的文字信息。这种方式中,用户可以根据自己的喜好选择文字信息的类型,有助于提高用户体验。
在一种可能的设计中,所述第一预览界面中包含第一拍摄控件,所述终端设备响应于用于触发所述第一拍摄控件的操作,得到两张第一拍摄图像,所述两张第一拍摄图像中的一张第一拍摄图像包含所述第一文字信息,另一张第一拍摄图像不包含所述第一文字信息。在本申请实施例中,若用户触发拍摄控件,终端设备可以得到两张图像,其中一张不包含文字信息的图像,另一张包含文字信息。
在一种可能的设计中,所述第二预览界面中包含第二拍摄控件,所述终端设备响应于用于触发所述第二拍摄控件的操作,得到两张第二拍摄图像,所述两张第二拍摄图像中的一张第二拍摄图像包含所述第二文字信息,另一张第二拍摄图像不包含所述第二文字信息。在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像发生变化,匹配的文 字信息也发生变化。因此,在某一个位置时,若用户触发拍摄控件,则得到两张图像,其中一张包含文字信息,另一张不包含文字信息。
在一种可能的设计中,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;当M为1时,所述终端设备根据所述M个拍摄对象中的N个拍摄对象匹配文字信息时,所述终端设备提取所述一个拍摄对象的特征信息;所述终端设备根据特征信息与关键词之间的映射关系,确定与提取出的特征信息对应的一个关键词;所述终端设备确定包含所述关键词的文字信息。在本申请实施例中,预览图像中包含一个拍摄对象时,终端设备匹配出的文字信息中包含与所述拍摄对象对应的关键词。
在一种可能的设计中,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;当M大于等于2时,所述终端设备根据所述M个拍摄对象中的N个拍摄对象匹配文字信息时,所述终端设备确定所述M个拍摄对象中权重大于预设权重的N个拍摄对象;所述权重用于指示一个拍摄对象的显示面积占整个预览图像的显示面积的比例;所述终端设备从所述N个拍摄对象中每个拍摄对象中提取特征信息,一共得到N个特征信息;所述终端设备根据特征信息与关键词之间的映射关系,确定与提取出的N个特征信息对应的N个关键词;所述终端设备确定包含所述N个关键词的文字信息。在本申请实施例中,当预览图像中包含多个拍摄对象时,终端设备根据每个拍摄对象的权重从多个拍摄对象中选择N个拍摄对象,确定N个关键词,然后查询包含这N个关键词的文字信息。
在一种可能的设计中,所述终端设备根据所述M个拍摄对象中的N个拍摄对象匹配文字信息时,所述终端设备根据所述M个拍摄对象中的N个拍摄对象确定至少两种文字信息;所述终端设备检测当前的时间信息/地理位置信息;所述终端设备根据所述时间信息/地理位置信息从所述至少两种文字信息中选择一种文字信息;或者所述终端设备根据优先级策略从所述至少两种文字信息中选择一种文字信息,其中,所述优先级策略包含所述至少两种文字信息之间的优先级顺序。在本申请实施例中,终端设备根据预览图像中的拍摄对象匹配出的文字信息有多种时,终端设备可以根据时间信息/地理位置信息或者优先级策略中多种文字信息中选择一种文字信息。
在一种可能的设计中,若用户选择的是除匹配出的所述文字信息之外的其它文字信息,所述终端设备确定用户选择所述其它文字信息的次数是否超出预设次数;在用户选择所述其它文字信息的次数是否超出预设次数时,所述终端设备将所述其它文字信息的第一优先等级设置为第二优先等级,所述第二优先等级大于所述第一优先等级;所述终端设备以所述其它文字信息的第二优先等级更新所述优先级策略。在本申请实施例中,终端设备显示的文字信息可能不是用户喜欢的文字信息,所以用户可能选择其它文字信息,终端设备可以记录用户选择其它文字信息的次数,当用户选择其它文字信息的次数较多时,提升该其它文字信息的优先等级,在下次拍摄时,可以优先推荐这种文字信息。通过这种方式,终端设备可以记录用户的使用习惯,匹配符合用户使用习惯的文字信息。
在一种可能的设计中,若所述文字信息包含诗词,在所述终端设备根据第一预览图像输出第一提示信息之前,终端设备还响应于用户的第三操作,所述终端设备在所述第一预览界面中显示设置诗词模式的设置界面,所述设置界面包括诗词模式的图标以及第一控件;响应于用户触发所述第一控件的操作,启动诗词模式,所述诗词模式为所述终端设备根据 第一预览图像中的拍摄对象匹配合适的诗词的模式。在本申请实施例中,终端设备启动相机后,用户可以打开设置诗词模式的设备界面,通过触发诗词模式对应的控件,启动诗词模式。通过这种方式,用户可以选择开启或者关闭诗词模式,有助于提高用户体验。
在一种可能的设计中,所述第一预览界面中包含第三控件和第四控件,所述第三控件用于触发更新所述第一文字信息,所述第四控件用于触发显示使用过的文字信息。在本申请实施例中,若用户对终端设备匹配出的文字信息不满意,可以通过触发某个控件以更换其它的文字信息,而且用户也可以通过触发另一个控件查看曾经使用过的文字信息。
在一种可能的设计中,所述文字信息包括诗词、歌赋、谚语、名人名言或网络流行语。在本申请实施例中,以上的几种只是列举,文字信息还可以包含其它类型的信息,本申请实施例不作限定。
第二方面,本发明实施例提供一种拍照方法,该方法适用于具有图像拍摄功能的终端设备。所述方法包括:终端设备接收第一操作;响应所述第一操作,所述终端设备启动相机;所述终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象;所述终端设备在所述第一预览界面中显示第一音乐的第一标识,所述第一音乐为所述终端设备根据所述第一预览图像中的至少一个拍摄对象匹配出的音乐,所述第一标识为文字或图标。在本申请实施例中,终端设备根据预览图像中的拍摄对象匹配合适的音乐,然后显示匹配出的音乐的标识。通过这种方式,终端设备在拍摄图像的过程中,可以匹配出合适的音乐,提高用户体验。
在一种可能的设计中,所述终端设备在所述第一预览界面中显示第一音乐的第一标识之后,所述终端设备接收第二操作;响应所述第二操作,所述终端设备显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象;所述终端设备在所述第二预览界面中显示第二音乐的第二标识,所述第二音乐与所述第一音乐不同,所述第二音乐为所述终端设备根据所述第二预览图像中的至少一个拍摄对象匹配出的音乐,所述第二标识为文字或图标。在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像发生变化,匹配的音乐也发生变化。因此,在预览图像动态变化时,终端设备实时地匹配合适的音乐。
在一种可能的设计中,所述第一预览界面中包含第一拍摄控件,所述终端设备响应于用于触发所述第一拍摄控件的操作,获得第一拍摄图像,所述第一拍摄图像为所述终端设备将所述第一音乐和所述第一预览图像合成的图像。在本申请实施例中,终端设备可以根据预览图像匹配合适的音乐,而且可以生成预览图像与匹配出的音乐合成得到的有声图像。通过这种方式,有助于提高拍摄的图像的质量,而且一定程度上提高图像拍摄过程的趣味性。
在一种可能的设计中,所述第二预览界面中包含第二拍摄控件,所述终端设备响应于用于触发所述第二拍摄控件的操作,获得第二拍摄图像,所述第二拍摄图像为所述终端设备将所述第二音乐和所述第二预览图像合成的图像。在本申请实施例中,当终端设备移动位置或者改变焦距时,预览图像发生变化,匹配的音乐也发生变化。因此,在预览图像动态变化时,终端设备实时地匹配合适的音乐。当终端设备被移动到某个位置时,若用户触发拍摄控件,终端设备可以根据预览图像匹配合适的音乐,而且可以生成预览图像与匹配出的音乐合成得到的有声图像。通过这种方式,有助于提高拍摄的图像的质量,而且一定 程度上提高图像拍摄过程的趣味性。
在一种可能的设计中,在所述终端设备显示第一音乐的第一标识之前,响应于用户的操作,所述终端设备在第一预览界面中显示设置音乐模式的设置界面,所述设置界面包括音乐模式的图标以及第一控件;响应于用户触发所述第一控件的操作,启动音乐模式,所述音乐模式为所述终端设备根据预览图像中的拍摄对象匹配合适的音乐的模式。在本申请实施例中,用户可以根据自己的喜好选择开启或关闭音乐模式,有助于提高用户体验。
在一种可能的设计中,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;当M为1时,所述终端设备根据预览图像中的至少一个拍摄对象匹配音乐时,所述终端设备提取所述一个拍摄对象的特征信息;所述终端设备根据特征信息与关键词之间的映射关系,确定与提取出的特征信息对应的一个关键词;所述终端设备确定歌词或者歌名中包含所述关键词的音乐。在本申请实施例中,预览图像中包含一个拍摄对象时,终端设备匹配出的音乐的歌词或歌名中包含与所述拍摄对象对应的关键词。
在一种可能的设计中,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;当M大于等于2时,所述终端设备根据预览图像中的至少一个拍摄对象匹配音乐时,所述终端设备确定所述M个拍摄对象中权重大于预设权重的N个拍摄对象;所述权重用于指示一个拍摄对象的显示面积占整个预览图像的显示面积的比例;所述终端设备从所述N个拍摄对象中每个拍摄对象中提取特征信息,一共得到N个特征信息;所述终端设备根据特征信息与关键词之间的映射关系,确定与提取出的N个特征信息对应的N个关键词;所述终端设备确定歌词或者歌名中包含所述关键词的音乐。在本申请实施例中,当预览图像中包含多个拍摄对象时,终端设备根据每个拍摄对象的权重从多个拍摄对象中选择N个拍摄对象,确定N个关键词,然后查询歌词或歌名中包含这N个关键词的音乐。
在一种可能的设计中,所述终端设备根据所述M个拍摄对象中的N个拍摄对象匹配音乐时,所述终端设备根据所述M个拍摄对象中的N个拍摄对象确定至少两种音乐;所述终端设备检测当前的时间信息/地理位置信息;所述终端设备根据所述时间信息/地理位置信息从所述至少两种音乐中选择一种音乐;或者所述终端设备根据优先级策略从所述至少两种音乐中选择一种音乐,其中,所述优先级策略包含所述至少两种音乐之间的优先级顺序。在本申请实施例中,终端设备根据预览图像中的拍摄对象匹配出的音乐有多种时,终端设备可以根据时间信息/地理位置信息或者优先级策略中多种音乐中选择一种音乐。
在一种可能的设计中,若用户选择的是除匹配出的所述音乐之外的其它音乐,所述终端设备确定用户选择所述其它音乐的次数是否超出预设次数;在用户选择所述其它音乐的次数是否超出预设次数时,所述终端设备将所述其它音乐的第一优先等级设置为第二优先等级,所述第二优先等级大于所述第一优先等级;所述终端设备以所述其它音乐的第二优先等级更新所述优先级策略。在本申请实施例中,终端设备匹配出的音乐可能不是用户喜欢的音乐,所以用户可能选择其它音乐,终端设备可以记录用户选择其它音乐的次数,当用户选择其它音乐的次数较多时,提升该其它音乐的优先等级,在下次拍摄时,可以优先推荐这种音乐。通过这种方式,终端设备可以记录用户的使用习惯,匹配符合用户使用习惯的音乐。
第三方面,本申请实施例提供一种终端设备,包括摄像头、显示屏、处理器和存储器。 其中,摄像头用于捕捉预览图像;所述显示屏用于显示预览图像;存储器用于存储一个或多个计算机程序;当存储器存储的一个或多个计算机程序被处理器执行时,使得终端设备能够实现第一方面或者第一方面的任意一种可能的设计的方法;或者,当存储器存储的一个或多个计算机程序被处理器执行时,使得终端设备能够实现第二方面或者第二方面的任意一种可能的设计的方法。
第四方面,本申请实施例还提供了一种终端设备,所述终端设备包括执行第一方面或者第一方面的任意一种可能的设计的方法的模块/单元;或者,所述终端设备包括执行第二方面或者第二方面的任意一种可能的设计的方法的模块/单元;这些模块/单元可以通过硬件实现,也可以通过硬件执行相应的软件实现。
第五方面,本申请实施例中还提供一种计算机可读存储介质,所述计算机可读存储介质包括计算机程序,当计算机程序在终端设备上运行时,使得所述终端设备执行第一方面或上述第一方面的任意一种可能的设计的方法;或者,当计算机程序在终端设备上运行时,使得所述终端设备执行第二方面或上述第二方面的任意一种可能的设计的方法。
第六方面,本申请实施例还提供一种包含计算机程序产品,当所述计算机程序产品在终端设备上运行时,使得所述终端设备执行第一方面或上述第一方面的任意一种可能的设计的方法;或者,当所述计算机程序产品在终端设备上运行时,使得终端设备执行第二方面或上述第二方面的任意一种可能的设计的方法。
附图说明
图1为本发明一实施例提供的一种终端设备的结构示意图;
图2为本发明一实施例提供的一种拍照方法的流程图;
图3A为本发明一实施例提供的手机显示屏的显示状态的示意图;
图3B为本发明一实施例提供的手机显示屏的显示状态的示意图;
图3C为本发明一实施例提供的手机显示屏的显示状态的示意图;
图3D为本发明一实施例提供的手机显示屏的显示状态的示意图;
图3E为本发明一实施例提供的手机显示屏的显示状态的示意图;
图4为本发明一实施例提供的手机显示屏的显示状态的示意图;
图5为本发明一实施例提供的手机显示屏的显示状态的示意图;
图6为本发明一实施例提供的手机显示屏的显示状态的示意图;
图7为本发明一实施例提供的手机显示屏的显示状态的示意图;
图8为本发明一实施例提供的手机显示屏的显示状态的示意图;
图9A为本发明一实施例提供的手机显示屏的显示状态的示意图;
图9B为本发明一实施例提供的手机显示屏的显示状态的示意图;
图10为本发明一实施例提供的一种拍照方法的流程图;
图11为本发明一实施例提供的手机显示屏的显示状态的示意图;
图12为本发明一实施例提供的手机显示屏的显示状态的示意图;
图13为本发明一实施例提供的终端设备的结构示意图;
图14为本发明一实施例提供的终端设备的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。
本申请实施例涉及的终端设备,又可以称为用户设备(user equipment,UE)。终端设备可以是智能手机、平板电脑、各类可穿戴设备、车载设备等。终端设备中可以安装各种应用程序,比如微信、地图等。
本申请实施例涉及的多个,是指大于或等于两个。
另外,需要理解的是,在本申请的描述中,“第一”、“第二”等词汇,仅用于区分描述的目的,而不能理解为指示或暗示相对重要性,也不能理解为指示或暗示顺序。
本申请实施例提供了一种拍照方法及终端设备,该方法适用于终端设备中。图1示出了一种可能的终端设备的结构图。参阅图1所示,所述终端设备100包括:射频(Radio Frequency,RF)电路110、电源120、处理器130、存储器140、输入单元150、显示单元160、摄像头170、通信接口180、以及无线保真(Wireless Fidelity,WiFi)模块190等部件。本领域技术人员可以理解,图1中示出的终端设备的结构并不构成对终端设备的限定,本申请实施例提供的终端设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面结合图1对所述终端设备100的各个构成部件进行具体的介绍:
所述RF电路110可用于通信或通话过程中,数据的接收和发送。特别地,所述RF电路110在接收到基站的下行数据后,发送给所述处理器130处理;另外,将待发送的上行数据发送给基站。通常,所述RF电路110包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier,LNA)、双工器等。
此外,RF电路110还可以通过无线通信与网络和其他设备通信。所述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE)、电子邮件、短消息服务(Short Messaging Service,SMS)等。
WiFi技术属于短距离无线传输技术,所述终端设备100通过WiFi模块190可以连接接入点(Access Point,AP),从而实现数据网络的访问。所述WiFi模块190可用于通信过程中,数据的接收和发送。
所述终端设备100可以通过所述通信接口180与其他设备实现物理连接。可选的,所述通信接口180与所述其他设备的通信接口通过电缆连接,实现所述终端设备100和其他设备之间的数据传输。
由于在本申请实施例中,所述终端设备100能够实现通信业务,向其他联系人发送信息,因此所述终端设备100需要具有数据传输功能,即所述终端设备100内部需要包含通信模块。虽然图1示出了所述RF电路110、所述WiFi模块190、和所述通信接口180等通信模块,但是可以理解的是,所述终端设备100中存在上述部件中的至少一个或者其他用于实现通信的通信模块(如蓝牙模块),以进行数据传输。
例如,当所述终端设备100为手机时,所述终端设备100可以包含所述RF电路110,还可以包含所述WiFi模块190;当所述终端设备100为计算机时,所述终端设备100可以 包含所述通信接口180,还可以包含所述WiFi模块190;当所述终端设备100为平板电脑时,所述终端设备100可以包含所述WiFi模块。
所述存储器140可用于存储软件程序以及模块。所述处理器130通过运行存储在所述存储器140的软件程序以及模块,从而执行所述终端设备100的各种功能应用以及数据处理。
可选的,所述存储器140可以主要包括存储程序区和存储数据区。其中,存储程序区可存储操作系统、各种应用程序(比如通信应用)以及人脸识别模块等;存储数据区可存储根据所述终端设备的使用所创建的数据(比如各种图片、视频文件等多媒体文件,以及人脸信息模板)等。
此外,所述存储器140可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
所述输入单元150可用于接收用户输入的数字或字符信息,以及产生与所述终端设备100的用户设置以及功能控制有关的键信号输入。
可选的,输入单元150可包括触控面板151以及其他输入设备152。
其中,所述触控面板151,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在所述触控面板151上或在所述触控面板151附近的操作),并根据预先设定的程式驱动相应的连接装置。可选的,所述触控面板151可以包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给所述处理器130,并能接收所述处理器130发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现所述触控面板151。
可选的,所述其他输入设备152可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
所述显示单元160可用于显示由用户输入的信息或提供给用户的信息以及所述终端设备100的各种菜单。所述显示单元160即为所述终端设备100的显示系统,用于呈现界面,实现人机交互。
所述显示单元160可以包括显示面板161。可选的,所述显示面板161可以采用液晶显示屏(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置。
进一步的,所述触控面板151可覆盖所述显示面板161,当所述触控面板151检测到在其上或附近的触摸操作后,传送给所述处理器130以确定触摸事件的类型,随后所述处理器130根据触摸事件的类型在所述显示面板161上提供相应的视觉输出。
虽然在图1中,所述触控面板151与所述显示面板161是作为两个独立的部件来实现所述终端设备100的输入和输入功能,但是在某些实施例中,可以将所述触控面板151与所述显示面板161集成而实现所述终端设备100的输入和输出功能。
所述处理器130是所述终端设备100的控制中心,利用各种接口和线路连接各个部件,通过运行或执行存储在所述存储器140内的软件程序和/或模块,以及调用存储在所述存储器140内的数据,执行所述终端设备100的各种功能和处理数据,从而实现基于所述终端 设备的多种业务。
可选的,所述处理器130可包括一个或多个处理单元。可选的,所述处理器130可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到所述处理器130中。
所述摄像头170,用于实现所述终端设备100的拍摄功能,拍摄图片或视频。所述摄像头170还可以用于实现终端设备100的扫描功能,对扫描对象(二维码/条形码)进行扫描。
所述终端设备100还包括用于给各个部件供电的电源120(比如电池)。可选的,所述电源120可以通过电源管理系统与所述处理器130逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗等功能。
尽管未示出,所述终端设备100还可以包括至少一种传感器、音频电路等,在此不再赘述。
本申请实施例提供一种拍照方法和终端设备。在该方法中,终端设备可以对预览图像中的拍摄对象进行识别,向用户推荐与拍摄对象相匹配的诗词、歌赋等文字信息,以及提示信息,以提示用户预览图像中缺少或者多出某个拍摄对象。用户可以在提示信息的指导下调整拍摄范围/角度等,得到质量较高的图像,通过这种方式,对于不懂拍摄技术的用户,也能够拍摄出质量较高的图像。本申请实施例提供的拍照方法适用于图1所示的终端设备100中,所以在下文的介绍中,将以终端设备100为例进行介绍。具体请参见图2,为本申请实施例提供的拍照方法的流程图。如图2所示,该方法的流程包括:
S201:终端设备100显示预览图像,预览图像中包含至少一个拍摄对象。
在本申请实施例中,终端设备100可以通过启动具有拍摄功能的应用程序来打开摄像头170。具有拍摄功能的应用程序可以是终端设备100中自带的相机应用,或者,终端设备100中安装的其它应用程序,比如美颜相机、滤镜大师、美人相机、微信、支付宝、腾讯聊天软件(QQ)、钉钉、照片分享(instagram)、Kakao Talk、连我(Line)等具有拍摄功能的应用程序。
以终端设备100自带的相机为例。当用户需要拍照时,可以触发终端设备100上显示的相机图标,启动相机。终端设备100的处理器130运行相机,启动摄像头170,并在显示单元160的显示面板161上显示预览图像。当用户将摄像头170对准拍摄对象时,预览图像中显示拍摄对象。
S202:终端设备100对预览图像中包含的至少一个拍摄对象进行识别,并根据识别出的拍摄对象匹配合适的文字信息,所述文字信息可以包含诗词、歌赋、谚语、名人名言或网络流行语等。
示例性的,终端设备100对预览图像中包含的至少一个拍摄对象进行识别时,可以采集一帧或者多帧预览图像,然后对采集的预览图像进行图像识别。终端设备100在采集预览图图像时,可以从启动摄像头170的时刻开始采集预览图像,直到终端设备100检测到用户触发拍摄按钮的时刻停止采集。或者,终端设备100从启动摄像头170的时刻开始采集预览图像,直到终端设备100确定自身已处于静止状态或预览图像中的拍摄对象稳定显示的时刻停止采集。
终端设备100采集到预览图像后,可以从预览图像中识别拍摄对象。拍摄对象可以包括各种内容,例如:人、动物、美食、花卉、绿植、山、河、舞台、沙滩、瀑布、夜景、蓝天、雪景等。终端设备100识别出预览图像中包含的拍摄对象后,可以根据识别出的拍摄对象从数据库中匹配合适的文字信息。在下文的介绍中主要以文字信息是诗词为例。作为一种示例,终端设备100在根据识别出的拍摄对象匹配合适的文字信息时,可以通过关键词匹配来实现。
举例来说,终端设备100识别出拍摄对象后,从拍摄对象中提取特征信息,根据特征信息与关键词之间的映射关系确定与提取的特征信息对应的关键词,然后根据确定出的关键词从数据库中匹配包含这些关键词的文字信息。
举例来说,终端设备100提取出拍摄对象包含的特征信息是人物时,根据映射关系获取与人物对应的关键词,例如:获取到与人物对应的关键词包含“人”、“她”、“他”三个关键词。终端设备100可以从数据库中匹配包含其中的某个关键词的文字信息。在本申请实施例中,特征信息与关键词之间的映射关系可以存储在本地或者服务器。进一步的,用户也可以对该映射关系进行更改。比如“松下问童子,言师采药去”中并没有“人”、“她”、“他”三个关键词,用户可以将“童子”这一关键词添加到映射关系中,即映射关系中与人物对应的关键词增加了“童子”。在另一个例子中,可以预先将终端设备中或服务器中存储的所有文字信息中的关键词与特征信息进行匹配,例如:存储的文字信息包括“松下问童子,言师采药去”,可以预先将“童子”、“师”等关键词与特征信息“人物”进行匹配;在后续拍摄的过程中,当终端设备100提取的拍摄对象包含的特征信息有人物时,就可以将该句“松下问童子,言师采药去”匹配出来。或者,存储的文字信息包括“举头望明月,低头思故乡”、“海上生明月,天涯共此时”,可以预先将关键词“明月”与特征信息“月亮”进行匹配;在后续拍摄的过程中,当终端设备100提取的拍摄对象包含的特征信息有月亮时,就可以将该这两句诗词匹配出来。
作为另一种示例,终端设备100在根据识别出的拍摄对象匹配合适的文字信息时,可以根据拍摄对象的数量不同采取不同的方式。
在实际应用过程中,终端设备100识别出的拍摄对象可能不止一种。
当识别出的拍摄对象只有一种时,终端设备100从数据库中查询与该拍摄对象相匹配的文字信息,然后向用户推荐该文字信息即可。
当识别出的拍摄对象不止一种时,终端设备100可以对识别出的拍摄对象进行组合。以终端设备100识别出拍摄对象包含三个为例,假设三个拍摄对象对应三个关键词。若存在同时包含这三个关键词的文字信息,则向用户推荐该文字信息。若不存在同时包含这三个关键词的文字信息,则将这三个关键词进行两两组合,得到三种组合,每种组合中包含两个关键词。然后,分别寻找是否存在于包含某种组合的两个关键词的文字信息。若存在,则向用户推荐该文字信息。若都不存在,则终端设备100分别根据三个关键词中的每个关键词匹配合适的文字信息,若存在包含其中的某个关键词的文字信息,则用户推荐该文字信息。
可选的,终端设备100对识别出的拍摄对象进行组合时,可以随机组合,也可以根据识别出的拍摄对象的权重大小来组合。如果终端设备100根据识别出的拍摄对象的权重大小来组合,那么终端设备100需要对每个拍摄对象的权重进行评估。例如可以根据拍摄对 象的显示面积占整个预览图像的显示面积的比例来设置权重,拍摄对象的显示面积占整个预览图像的显示面积的比例越高,则可以设置该拍摄对象的权重越大。以终端设备100识别出拍摄对象包含三个为例,假设预览图像中三个拍摄对象中第一个拍摄对象的显示面积最大,第三个拍摄对象的显示面积最小。则终端设备100为三个拍摄对象之间的权重进行排序:第一个拍摄对象的权重>第二个拍摄对象的权重>第三个拍摄对象的权重。终端设备100可以优先考虑权重较高的拍摄对象之间的组合。当然,若第三个拍摄对象的显示面积占整个预览图像的面积的比例小于预设值,则终端设备100也可以忽略第三个拍摄对象。当然,终端设备100对每个拍摄对象的权重进行评估的方式还可以有多种,比如终端设备100根据每个拍摄对象的亮度或色彩饱和度等对每个拍摄对象的权重进行评估。
作为又一种示例,在实际应用中,终端设备100根据识别出的拍摄对象匹配合适的文字信息可以有多种。以识别出的拍摄对象是一个为例,终端设备100识别出的拍摄对象包含月亮,则终端设备100可能从数据库中寻找到与之相匹配的文字信息有多种,比如“举头望明月,低头思故乡”、“海上生明月,天涯共此时”等。为了向用户推荐出较为合适的文字信息,终端设备100还可以获取其它信息,并根据其它信息从匹配出的多种文字信息中选择较为合适的文字信息。
一种可能的实现方式为,终端设备100可以检测当前的时间或日期,根据检测到的时间(或日期)从多种文字信息中选择较为合适的文字信息。这里所述的时间可以是具体的时刻,也可以是时间段。
举例来说,终端设备100从预览图像中识别出拍摄对象包含太阳,终端设备100确定的文字信息包含“夕阳西下,断肠人在天涯”、“日出江花红胜火,春来江水绿如蓝”两条诗词。终端设备100检测到当前的时间是18:00,则确定“夕阳西下,断肠人在天涯”是较为合适的诗词。
另一种可能的实现方式为,终端设备100还可以检测自身当前所处的地理位置,根据地理位置从多种文字信息中选择较为合适的文字信息。
举例来说,终端设备100从预览图像中识别出的拍摄对象包含花草、桥,对应的关键词分别是“草”和“桥”,则终端设备100从数据库中查询包含这两个关键词的诗词。比如,终端设备100查询到两条诗词,“朱雀桥边野花草,乌衣巷口夕阳斜”和“水底远山云似雪,桥边平岸草如烟”。终端设备100检测到当前处于南京“乌衣巷”,则确定“朱雀桥边野花草,乌衣巷口夕阳斜”是较为合适的诗词。
又一种可能的实现方式为,当终端设备100根据拍摄对象匹配出的文字信息有多种时,可以通过优先级策略从多种文字信息中确定一种文字信息。比如,终端设备100可以确定多种文字信息之间的优先等级,向用户推荐优先等级较高的文字信息。可选的,不同的文字信息之间的优先等级可以根据用户的使用习惯得到,比如用户经常选择的是“举头望明月,低头思故乡”,那么“举头望明月,低头思故乡”的优先等级高于“海上生明月,天涯共此时”。因此,终端设备100向用户推荐“举头望明月,低头思故乡”。
在本申请实施例中,优先等级是可以更新的,比如,终端设备100向用户推荐文字信息后,但用户却选择使用其它文字信息。当终端设备100检测到用户使用其他文字信息的次数超出预设次数时,终端设备100可以提高其它文字信息的优先等级,并更新优先级策略。
当然,在实际应用过程中,终端设备100可以结合时间、地理位置、拍摄对象的关键词以及其它信息共同寻找合适的文字信息。
在本申请实施例中,诗词、歌赋、谚语、名人名言、网络流行语等可以存储在终端设备100本地。当然,终端100也可以从网络或服务器中获取。
S203:终端设备100输出所述文字信息和/或提示信息,所述提示信息用于提示用户所述预览图像中缺少或者多余的拍摄对象。其中,例如:所述终端设备的预览图像中有M个拍摄对象。在根据这些拍摄对象匹配文字信息时,在所述M个拍摄对象中只有N个拍摄对象匹配到了合适的文字信息,则所述多余的拍摄对象为所述M个拍摄对象中除去所述N个拍摄对象剩下的M-N个拍摄对象。此时,可以将多余的拍摄对象提示给用户;用户根据该提示,可以移动该终端设备的位置或角度,使得预览图像中不包括这些多余的拍摄对象,即,使得这些多余的拍摄对象不被拍摄到,从而可以达到更好的拍照效果。另一种情况,在根据所述M个拍摄对象匹配文字信息时,匹配到的文字信息中除了这M个拍摄对象还包括有其它对象,则所述的其它对象即为缺少的拍摄对象。同样的,终端设备可以提示用户缺少的拍摄对象;用户根据该提示,可以移动该终端设备的位置或角度,使得预览图像中增加这些被缺少的拍摄对象,即,使得这些之前缺少的拍摄对象被拍摄到,从而可以达到更好的拍照效果。
举例来说,如前述内容可知,当终端设备100识别出预览图像中包含的拍摄对象有多个时,可以将多个拍摄对象进行组合,根据组合的拍摄对象确定文字信息。因此,可能会出现预览图像中的多个拍摄对象中有部分拍摄对象是多余的。比如,预览图像中包含的拍摄对象有人物、海、月亮,那么终端设备100根据海和月亮确定诗词:“海上生明月,天涯共此时”,其中,人物是多余的。这种情况下,终端设备100可以显示提示信息,该提示信息用于提示用户当前的预览图像中存在多余的拍摄对象,即人物。
再例如,通常,文字信息中包含的关键词也有多个。因此,终端设备100匹配出的文字信息中可能包含某个关键词,但是预览图像中不包含与这个关键词对应的拍摄对象。因此,终端设备100可以显示提示信息,该提示信息用于提示用户当前的预览图像中缺少与文字信息中的某个关键词对应的拍摄对象。
在本申请实施例中,若预览图像中没有多余的或者缺少的拍摄对象,即预览图像中的M个拍摄对象对应的M个关键词刚好和文字信息中包含的M个关键词一一匹配,终端设备100也可以不显示提示信息。
在本申请实施例中,提示信息可以是语音提示,即终端可以通过播放语音来提示用户。或者,提示信息可以为文字、图标、图像等能够在显示屏上显示的内容,该提示信息具体可以在预览界面中显示,以方便提示用户。
以提示信息是文字为例,终端设备100可以在预览图像中弹出提示框,提示框中包含“增加河流”、“移动相机以增加河流”、“人物多余”或“移动该相机以删除人物”等文字。
终端设备100匹配出文字信息后,还可以在显示屏上显示匹配度信息,所述匹配度信息用于指示文字信息和匹配出的文字信息之间的匹配程度。匹配度信息可以以数字的形式显示,比如显示匹配度百分比,当然匹配度信息也可以以其它形式显示,比如以表情的方式显示,当表情是微笑时,说明匹配度较高,表情是难过时,说明匹配度较低。
在本申请实施例中,终端设备100可以实时地采集预览图像,并根据采集的预览图像 中包含的拍摄对象从数据库中匹配合适的文字信息,并将匹配出的文字信息、匹配度信息以及提示信息显示出来,以提示用户预览图像中缺少或者多出某个拍摄对象。用户可以在提示信息的指导下调整拍摄范围/角度等,当终端设备移动位置或者改变焦距以调整拍摄范围/角度时,预览图像发生变化;终端根据变化后的预览图像中的拍摄对象重新匹配文字信息,如果重新匹配的文字信息与之前的文字信息相比发生了变化,则相应的,匹配度信息和提示信息也发生变化;终端可以显示变化后的匹配度信息和提示信息。即预览图像在动态变化时,文字信息、匹配度信息、提示信息也是动态变化的。
示例性的,图3A-3E示出了手机显示屏的显示状态的示意图。
在图3A中,手机300的显示屏上显示预览界面301,预览界面301中包含预览图像以及一些控制键(闪光灯、摄像头切换等),预览图像中包含手机300匹配出的诗词302:“独怜幽草岸边生,上有黄鹂深树鸣”,预览图像中还包括匹配度303:50%。
手机300还可以在预览界面301中显示当前的预览图像中包含的拍摄对象与诗词302中的哪些关键词匹配。请参见图3B。
在图3B中,诗词302“独怜幽草岸边生,上有黄鹂深树鸣”中的“草”关键词被实线圈中,以提示用户预览图像中包含的拍摄对象与诗词302中的“草”匹配。当然,图3B中,仅作为一种示例,将“草”二字显示在实线框中,在实际应用中,还可以有其它显示方式,比如高亮、气泡、加粗等等的方式,只要达到提示用户的目的即可。
同时,在图3B中,诗词302“独怜幽草岸边生,上有黄鹂深树鸣”中的“黄鹂”关键词被虚线圈中,以提示用户当前的预览图像中缺乏与“黄鹂”这一关键词对应的拍摄对象。在图3B中,仅作为一种示例,将“黄鹂”二字显示在虚线框中,还可以有其它的方式提示用户预览图像中缺少与“黄鹂”这一关键词对应的拍摄对象。
比如,手机300可以在预览图像中弹出提示框304,提示框304中显示“增加黄鹂”的文字,请参见图3C。
作为一种示例,手机300还可以显示移动方向的指示信息(箭头或者文字等形式),该移动方向的指示信息用于提示用户按照指示的移动方向调整拍摄范围。请参见图3D,在图3D中,预览图像中显示向上箭头305,提示用户将拍摄范围向上移动。或者,手机还可以在预览图像显示调整焦距(物体与拍摄对象之间的距离)的指示信息,以提示用户增加(或缩短)焦距,以获取更多(或更少)的拍摄对象。其中,调整焦距的指示信息可以是文字或者图标等。
当用户移动手机300或者用户调整焦距时,预览图像将可能出现更多的拍摄对象或者不同的拍摄对象。请参见图3E。
在图3E中,手机300的显示屏上显示预览界面301,预览界面301中包含预览图像,预览图像中包含更多的拍摄对象、手机匹配出的诗词302:“独怜幽草岸边生,上有黄鹂深树鸣”,预览图像中还包括:匹配度305:80%。同时,诗词302中的“草”和“黄鹂”均显示于实线框中,以提示用户当前的预览图像中包含的拍摄对象与“草”和“黄鹂”匹配。
在图3A-3E中,是以预览图像中显示一条诗词为例。当然,手机还可以在预览图像中显示多条诗词。比如,手机根据预览图像中的拍摄对象匹配出的诗词有两条,手机可以在预览图像中显示这两条诗词,用户可以从中选择感兴趣的诗词。请参见图4所示,手机400的显示屏上显示预览界面401,预览界面401中显示预览图像,预览图像中包含两条诗词, 即诗词402和诗词403,用户可以用户手指选中某条诗词向左/右滑动,取消该诗词。当然,还可以有其它的取消方式,本申请实施例不作限定。
当然,手机显示出的诗词并不一定是用户喜欢的,在本申请实施例中,用户可以根据自己的需求选择诗词。
一种可能的实现方式为,用户可以选择诗词的类型,手机根据用户选择的诗词类型匹配合适的诗词。比如,用户选择的诗词类型是山水田园诗,那么手机向用户推荐山水田园诗类型的诗词。
示例性的,请参见图5所示,手机500在预览图像中显示诗词类型的标识501,当用户触发该标识501时,手机显示多种诗词类型,用户选择其中某种诗词类型。
另一种可能的实现方式为,如果用户想要尝试其它诗词,可以选择更换诗词。
示例性的,请参见图6所示,手机600的预览界面601中显示刷新(或者换一换控件)控件601。当用户触发刷新控件601后,手机600显示其它诗词。
如前述内容可知,手机在根据拍摄对象匹配文字信息的过程中,需要从数据库中寻找合适的文字信息。文字信息可以存储在手机本地,或者存储在服务器中。因此,在手机不联网的情况下,用户触发“刷新”控件601后,手机可以在本地数据库中查找合适文字信息。在手机联网的情况下,用户触发“刷新”控件601后,手机除了可以在本地数据库中查找,还可以在服务器中查找合适的文字信息。示例性的,手机可以将预留图像发送给服务器,由服务器进行预留图像中拍摄对象的识别,以及匹配文字信息的过程。或者,手机可以对预览图像中的拍摄对象进行识别,然后将与识别出的拍摄对象对应的关键词发送给服务器。服务器根据接收的关键词匹配合适的诗词,然后服务器将匹配出的诗词发送给手机。
在图6中,“刷新”控件601与诗词显示在同一个框内,这仅是一种举例,“刷新”控件601还可以显示在其它位置处,或者还可以以其它方式显示,比如以图标的方式显示,本申请实施例不作限定。
当然,用户还可以从“历史记录”中查看曾经使用过的诗词。
示例性的,请参见图7所示,手机700的显示屏显示“历史记录”控件701。当用户触发“历史记录”控件701后,手机700显示清单,该清单中显示曾经显示过的诗词。同样的,在图7中“历史记录”控件701与诗词显示在同一个框内,这仅是一种举例,“历史记录”控件701还可以显示在其它位置处,或者以其它方式显示,本申请实施例对此不作限定。
作为一种示例,在本申请实施例中,诗词、匹配度信息可以在预览图像中固定的位置信息(该位置可以是用户设置的),也可以在预览图像中空白的地方显示,请参见图8所示,手机800在预览图像中的空白处显示诗词、匹配度信息。通过这种方式,诗词和匹配度信息可以尽可能的不遮挡预览图像中的拍摄对象,而且方便用户查看,更有助于指导用户拍摄。
作为另一种示例,由于匹配度信息主要是用于指导用户拍摄的信息,所以,预览图像中可以显示匹配度信息和诗词。当用户触发拍摄按钮后,最终拍摄得到的图像中可以只显示诗词。用户可以选择诗词在最终拍摄得到的图像中以何种字体形式显示,比如宋体、楷体等字体。诗词可以静态显示也可以动态显示。比如,诗词中的每个字可以逐一显示出来,呈现动态显示的效果。而且诗词可以在最终拍摄得到的图像中空白的地方显示,尽量避免遮挡图像中的显示内容。当然,本申请实施例提供的方案,主要用于指导用户拍摄质量更 好的图像。因此,当用户触发拍摄按钮后,最终拍摄得到的图像中也可以不显示诗词。或者,当用户触发拍摄按钮后,最后拍摄得到两张图像,其中一张是不包含诗词,另一张包含诗词。
在前面的描述中,手机从预览图像中识别出拍摄对象后,确定与拍摄对象匹配的诗词,然后将诗词、提示信息显示在预览图像中。在另一种实施方式中,手机也可以不显示诗词,只显示提示信息,以提示用户预览图像中缺少某种拍摄对象或者多出某种拍摄对象,用户可以根据提示信息拍摄到效果更好的图像。这种情况下,手机检测到用户触发拍摄按钮后,可以拍摄得到的图像可以不包含诗词。
在前面的实施例中,提示信息主要提示用户预览图像中缺少某种拍摄对象或者多出某种拍摄对象,提示信息还可以提示用户将预览图像中多余的某个拍摄对象替换为其它拍摄对象。这种方式中,手机可以先确定多余的第一拍摄对象,然后确定缺少的第二拍摄对象,然后输出提示信息,以提示用户将第一拍摄对象替换为第二拍摄对象。
通过本申请实施例提供的拍照方式,终端设备可以对预览图像中的拍摄对象进行识别,向用户推荐与拍摄对象相匹配的诗词、歌赋等文字信息,以及提示信息,以提示用户预览图像中缺少或者多出某个拍摄对象。用户可以在提示信息的指导下调整拍摄范围/角度等,得到质量较高的图像,通过这种方式,对于不懂拍摄技术的用户,也能够拍摄出质量较高的图像。
在实际应用中,用户可以选择开启诗词拍摄模式或者关闭诗词拍摄模式。
作为一种示例,手机的预览界面中可以设置有诗词匹配模式,当用户启动该诗词匹配模式后,手机可以执行S201-S203。
示例性的,图9A示出了手机显示屏显示预览界面的示意图。
图9A中,手机900的显示屏上显示预览界面901,预览界面901中包含拍摄模式选择框902,该拍摄模式选择框中包含诗词模式对应的控件903。用户触发控件903,启动诗词模式,手机执行图2所示实施例的S201-S203,显示屏上显示文字信息和匹配度信息。若用户再次触发控件903,手机900关闭诗词模式,则手机900显示屏上的文字信息和匹配度信息消失。
通常,用户在拍摄风景的时候,更希望在拍摄的风景照片上附上附有意境的文字信息,来提升照片的艺术效果。因此,作为一种示例,手机可以检测到当前预览图像中包含的拍摄对象属于风景类比如山、水、植物、沙漠、楼阁等时,可以在预览图像上显示诗词模式的标识(文字或者图标),提醒用户启动诗词模式。请参见图9B。
在图9B中,手机900的显示屏上显示预览界面901,预览界面901中包含预览图像,预览图像中包含诗词模式的图标904。当用户触发图标904时,手机900启动诗词模式。当用户再次触发图标904时,手机900关闭诗词模式。
在图2所示的实施例中,终端设备可以对预览图像中的拍摄对象进行识别,向用户推荐与拍摄对象相匹配的诗词、歌赋等文字信息,以及提示信息,以提示用户预览图像中缺少或者多出某个拍摄对象。用户可以在提示信息的指导下调整拍摄范围/角度等,得到质量较高的图像。下面介绍另一实施例,在下面的实施例中,终端设备识别出预览图像中包含的多个拍摄对象后,可以推荐与识别出的拍摄对象相匹配的音乐,用户可以将推荐的音乐与拍摄得到的图像合成有声图像。该方法可以适用于图1所示的终端设备100,所以在下 文的介绍中以终端设备100为例。请参见图10,该方法的流程包括:
S1001:终端设备100显示预览图像,预览图像中包含至少一个拍摄对象。
S1002:终端设备100对预览图像中包含的至少一个拍摄对象进行识别,并根据识别出的拍摄对象匹配合适的音乐。
作为一种示例,终端设备100在根据识别出的拍摄对象匹配合适的音乐时,可以通过关键词匹配来实现。
举例来说,终端设备100识别出拍摄对象后,从拍摄对象中提取特征信息,根据特征信息与关键词之间的映射关系确定与提取的特征信息对应的关键词,然后根据确定出的关键词从数据库中匹配歌词或者歌名中包含这些关键词的音乐。
作为另一种示例,终端设备100在根据识别出的拍摄对象匹配合适的音乐时,可以通过拍摄对象所处的场景信息来匹配。
举例来说,当终端设备100识别出拍摄对象所处的是酒吧、歌厅或舞台等场景时,终端设备100可以寻找适合酒吧、歌厅或舞台播放的音乐。
作为另一种示例,终端设备100在根据识别出的拍摄对象匹配合适的音乐时,可以通过终端设备100当前所处的环境信息来匹配。
举例来说,终端设备100在采集预览图像的过程中,也可以采集周围环境的声音,当采集到的周围环境的声音较小时,终端设备100可以寻找轻音乐。当采集到周围环境的声音比较大,可以选择重音乐。
作为另一种示例,终端设备100在根据识别出的拍摄对象匹配合适的音乐时,可以通过当前的时间来匹配。
举例来说,终端设备100可以检测当前所处的时间,根据检测到的时间确定合适的音乐。比如,当然时间是晚上,可以寻找轻音乐。
作为另一种示例,终端设备100在根据识别出的拍摄对象匹配合适的音乐时,可以通过当前的地理位置来匹配。
举例来说,终端设备100可以检测当前所处的地理位置,根据地理位置寻找合适的音乐。比如,终端设备100检测到当前处于香港,则寻找粤语音乐。终端设备100检测到当前处于美国,则寻找欧美音乐。
在本申请实施例中,终端设备100也可以匹配出音乐之外的其它声音。比如,当终端设备100识别出拍摄对象中包含某种动物时,可以从服务器或者本地查询该动物的叫声。比如,拍摄对象中包含鸟,终端设备100可以查询鸟叫声。
在实际操作过程中,终端设备可以将以上列举的几种方式结合使用。
在本申请实施例中,音乐可以存储在终端设备100本地,或者存储在服务器中。因此,在终端设备100在不联网的情况下,可以在本地数据库中查询合适音乐。在手机联网的情况下,终端设备100除了可以在本地查询合适的音乐外,还可以在服务器中查询合适的音乐。示例性的,终端设备100可以将预览图像发送给服务器,由服务器对预览图像中的拍摄对象进行识别,并匹配合适的音乐,然后服务器将匹配出的音乐的相关信息发送给终端设备100。或者,终端设备100可以对预览图像中的拍摄对象进行识别,然后将识别出的拍摄对象对应的关键词发送给服务器,由服务器根据接收的关键词匹配合适的音乐,然后服务器将匹配出的音乐的相关信息发送给终端设备100。
在本申请实施例中,所述的音乐可以是音乐片段,比如播放总时长是10s-12s的音乐片段。因此,终端设备100或服务器中存储的可以是已经截取好的音乐片段,或者终端设备100或者服务器确定合适的音乐后,从该音乐中截取合适的音乐片段,然后向用户推送该音乐片段。
S1003:终端设备100显示音乐的标识,所述标识为文字或者图标。
图11示出了手机显示屏的显示状态的示意图。
在图11中,手机1100的显示屏显示预览界面1101,预览界面1101中包含预览图像,预览图像中包含手机1100匹配出的音乐的标识1102。当用户触发标识1102时,可以播放音乐。若用户对音乐满意,可以触发拍摄控件,终端设备100将音乐与拍摄得到的图像合成,得到有声图像。
在实际应用中,用户可以选择开启音乐模式或者关闭音乐模式。
作为一种示例,终端设备100的预览界面中可以设置有音乐模式,当用户启动该音乐模式后,终端设备100可以执行S1001-S1003。
示例性的,图12示出了手机显示屏显示预览界面的示意图。
图12中,手机1200的显示屏上显示预览界面1201,预览界面1201中包含拍摄模式选择框1202,该拍摄模式选择框1202中包含音乐模式对应的控件1203。用户触发控件1203,启动音乐模式,手机1200执行图10所示实施例的S1001-S1003,显示屏上显示推荐的音乐的标识。若用户再次触发控件1203,手机1200关闭音乐模式,则手机1200显示屏上的音乐的标识消失。
本申请的各实施方式可以任意进行组合,以实现不同的技术效果。因此,图2所示的实施例中的各种实施方式也可以应用在图10所示的实施例中。即,在拍摄照片或视频时,可以采用如图2所示实施例的方法提示用户当前缺少或多余的拍摄对象,并且可以采用图10所示实施例的方法显示音乐的标识。拍摄后,可以得到包括文字信息和音乐的照片或视频。即,用户可以获得一个多媒体的照片或视频,即用户查看该照片时,终端在该照片上能够相应的文字信息,并且还能播放相应的音乐。
上述本申请提供的实施例中,从终端设备作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能,终端设备可以包括硬件结构和/或软件模块,以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行,取决于技术方案的特定应用和设计约束条件。
基于相同的构思,图13所示为本申请实施例提供的一种终端设备1300,该终端设备1300可以是具备图像拍摄能力的终端设备,该终端设备可以执行上述图2-图9所示实施例中的方法。如图13所示,终端设备1300包括:处理单元1301,显示单元1302。其中,
所述处理单元1301用于接收第一操作,并响应所述第一操作,启动相机;
所述显示单元1302用于显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象;
所述处理单元1301还用于根据所述第一预览图像输出第一提示信息,所述第一提示信息用于提示所述第一预览图像中缺少或多余的拍摄对象。第一提示信息可以是语言提示信息或者文字提示信息。例如:所述处理单元1301可以通过扬声器输出语音提示信息, 或者所述处理单元1301可以通过显示单元1302输出文字提示信息。
可选的,所述处理单元1301在根据所述第一预览图像输出第一提示信息之后,还用于接收第二操作,并对所述第二操作响应,以通过所述显示单元1302显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象;
所述处理单元1301还用于根据所述第二预览图像输出第二提示信息,所述第二提示信息与所述第一提示信息不同,所述第二提示信息用于提示所述第二预览图像中缺少或多余的拍摄对象。同样的,第二提示信息也可以是语言提示信息或者文字提示信息。例如:所述处理单元1301可以通过扬声器输出语音提示信息,或者所述处理单元1301可以通过显示单元1302输出文字提示信息。
可选的,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;若所述M个拍摄对象中的N个拍摄对象与预设的文字信息相匹配,则所述多余的拍摄对象为所述M个拍摄对象中除去所述N个拍摄对象剩下的M-N个拍摄对象;若与所述M个拍摄对象相匹配的文字信息中包括除所述M个拍摄对象之外的其它拍摄对象对应的关键词,则所述其它拍摄对象为所述缺少的拍摄对象;N≥1,且N<M。
可选的,所述第一提示信息显示在所述第一预览界面中;所述第二提示信息显示在所述第二预览界面中。
可选的,所述处理单元1301还用于根据所述第一预览图像输出匹配的第一文字信息,并通过所述显示单元1302将所述第一文字信息显示在所述第一预览界面中。
可选的,所述处理单元1301还用于根据所述第二预览图像输出匹配的第二文字信息,并通过所述显示单元1302将所述第二文字信息显示在所述第二预览界面中。
可选的,所述第一文字信息包括至少一个文字信息;或者所述第二文字信息包括至少一个文字信息。
可选的,所述处理单元1301还用于根据所述第一预览图像还输出第一匹配度信息,并通过所述显示单元1302将所述第一匹配度信息显示在第一预览界面中;所述第一匹配度信息用于指示所述第一文字信息和所述第一预览图像之间的匹配程度。
可选的,所述处理单元1301还用于根据所述第一预览图像还输出第二匹配度信息,并通过所述显示单元1302将所述第二匹配度信息显示在第二预览界面中,所述第二匹配度信息用于指示所述第二文字信息和所述第二预览图像之间的匹配程度。
可选的,所述处理单元1301还用于根据所述第一预览图像还输出第一方向指示信息,并通过所述显示单元1302将所述第一方向指示信息显示在第一预览界面中,所述第一方向指示信息用于提示用户按照指示的第一方向移动所述终端设备。
可选的,所述处理单元1301还用于根据所述第一预览图像还输出第二方向指示信息,并通过所述显示单元1302将所述第二方向指示信息显示在所述第二预览界面中,所述第二方向指示信息用于提示用户按照指示的第二方向移动所述终端设备。
可选的,所述第一预览图像中显示第二控件,所述第二控件用于触发显示文字信息的类型,所述处理单元1301响应于用户触发所述第二控件的操作,通过所述显示单元1302显示第一列表,所述第一列表中包含至少一种文字信息的类型;所述处理单元1301响应于用户选择第一类型的操作,通过所述显示单元1302显示第一文字信息,所述第一文字 信息的类型为所述第一类型。
可选的,所述第一预览界面中包含第一拍摄控件,所述处理单元1301还用于响应于用于触发所述第一拍摄控件的操作,得到两张第一拍摄图像,所述两张第一拍摄图像中的一张第一拍摄图像包含所述第一文字信息,另一张第一拍摄图像不包含所述第一文字信息。
可选的,所述第二预览界面中包含第二拍摄控件,所述处理单元1301还用于响应于用于触发所述第二拍摄控件的操作,得到两张第二拍摄图像,所述两张第二拍摄图像中的一张第二拍摄图像包含所述第二文字信息,另一张第二拍摄图像不包含所述第二文字信息。
可选的,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;当M为1时,所述处理单元1301用于根据所述M个拍摄对象中的N个拍摄对象匹配文字信息时,具体用于:提取所述一个拍摄对象的特征信息;根据特征信息与关键词之间的映射关系,确定与提取出的特征信息对应的一个关键词;确定包含所述关键词的文字信息。
可选的,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;当M大于等于2时,所述处理单元1301用于根据所述M个拍摄对象中的N个拍摄对象匹配文字信息时,具体用于:确定所述M个拍摄对象中权重大于预设权重的N个拍摄对象;所述权重用于指示一个拍摄对象的显示面积占整个预览图像的显示面积的比例;从所述N个拍摄对象中每个拍摄对象中提取特征信息,一共得到N个特征信息;根据特征信息与关键词之间的映射关系,确定与提取出的N个特征信息对应的N个关键词;确定包含所述N个关键词的文字信息。
可选的,所述处理单元1301在根据所述M个拍摄对象中的N个拍摄对象匹配文字信息时,还用于:根据所述M个拍摄对象中的N个拍摄对象确定至少两种文字信息;检测当前的时间信息/地理位置信息;根据所述时间信息/地理位置信息从所述至少两种文字信息中选择一种文字信息;或者根据优先级策略从所述至少两种文字信息中选择一种文字信息,其中,所述优先级策略包含所述至少两种文字信息之间的优先级顺序。
可选的,若用户选择的是除匹配出的所述文字信息之外的其它文字信息,所述处理单元1301还用于:确定用户选择所述其它文字信息的次数是否超出预设次数;在用户选择所述其它文字信息的次数是否超出预设次数时,将所述其它文字信息的第一优先等级设置为第二优先等级,所述第二优先等级大于所述第一优先等级;以所述其它文字信息的第二优先等级更新所述优先级策略。
在具体实现中,所述的处理单元1301可以相当于终端设备中的处理器;所述的显示单元1302可以相当于终端设备中的显示屏。
基于相同的构思,图14所示为本申请实施例提供的一种终端设备1400,该终端设备1400可以是具备图像拍摄能力的终端设备,该终端设备可以执行上述图10-图12所示实施例中的方法。如图14所示,终端设备1400包括:处理单元1401,显示单元1402。其中,处理单元1401用于接收第一操作,并响应所述第一操作,启动相机;
所述显示单元1402用于显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象;所述显示单元1402还用于在所述第一预览界面中显示第一音乐的第一标识,所述第一音乐为所述终端设备根据所述第一预览图像中的至少一个拍摄对象匹配出的音乐,所述第一标识为文字或图标。
可选的,所述显示单元1402用于在所述第一预览界面中显示第一音乐的第一标识之后,所述处理单元1401还用于接收第二操作;
所述显示单元1402还用于响应所述第二操作,显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象;所述显示单元1402还用于在所述第二预览界面中显示第二音乐的第二标识,所述第二音乐与所述第一音乐不同,所述第二音乐为所述终端设备根据所述第二预览图像中的至少一个拍摄对象匹配出的音乐,所述第二标识为文字或图标。
可选的,所述第一预览界面中包含第一拍摄控件,所述处理单元1401还用于响应于用于触发所述第一拍摄控件的操作,得到第一拍摄图像,所述第一拍摄图像为所述终端设备将所述第一音乐和所述第一预览图像合成的图像。
可选的,所述第二预览界面中包含第二拍摄控件,所述处理单元1401还用于响应于用于触发所述第二拍摄控件的操作,获得第二拍摄图像,所述第二拍摄图像为所述终端设备将所述第二音乐和所述第二预览图像合成的图像。
可选的,所述终端设备还包括声音播放单元,所述声音播放单元用于响应于触发所述第一标识的操作,播放所述第一音乐。
可选的,所述预览图像中显示第二控件,所述第二控件用于触发显示音乐的类型,所述显示单元1402还用于响应于用户触发所述第二控件的操作,显示第一列表,所述第一列表中包含至少一种音乐的类型;所述显示单元1402还用于响应于用户选择第一类型的操作,显示第一音乐的第一标识,所述第一音乐的类型为所述第一类型。
在具体实现中,所述的处理单元1401可以相当于终端设备中的处理器;所述的显示单元1402可以相当于终端设备中的显示屏。
前述各实施例描述的是终端设备在拍摄时对预览图像的处理。需要说明的是,前述的拍摄可以为拍摄照片,也可以为拍摄视频。并且,可以参见前述对预览图像的处理方法,对拍摄的视频图像进行类似的处理。例如:对视频图像的处理可以如下。
在拍摄视频的过程中,拍摄到的视频图像可以包括若干帧。其中,一些连续帧可能为相似或连续的场景,即这些帧中的拍摄对象相同或者大部分相同。终端设备可以对拍摄的视频图像中的每一帧的内容进行分析,识别出与每一帧中的拍摄对象相匹配的文字信息或者音乐信息;由此,与整个视频图像相匹配的文字或音乐可能有多个,因为与每一帧相匹配的内容可能相同也可以能不相同。或者,终端设备也可以在识别出表示相似或连续场景的连续帧之后,对这些连续帧中的内容进行分析,识别出与这些连续帧中的拍摄对象相匹配的文字信息或音乐信息,其中,一组连续帧对应一个文字信息或音乐信息;由此,与整个视频图像相匹配的文字或音乐可能有多个,因为整个视频图像可能包括多组连续帧(其中一组连续帧中所有的帧表示的场景相似或连续),与每组连续帧相匹配的内容可能相同也可以能不相同。又或者,终端设备还可以根据视频图像中全部图像帧或者一部分图像帧中的拍摄对象,识别出与这些拍摄对象相匹配的一个文字信息或者音乐信息;由此,与整个视频图像相匹配的文字或音乐为一个。也就是说,一个文字信息或音乐信息,可以与整个视频图像相匹配,也可以与视频图像中的某一帧或某几帧相匹配。
其中,识别与每一帧或一些连续帧或全部图像帧相匹配的文字信息或音乐信息的方法 与前述实施例中识别与预览图像相匹配的文字信息或音乐信息的方法相同。
在识别出匹配的文字信息后,可以实时的在显示界面显示所述文字信息;也可以在拍摄视频结束后,再次播放该视频时,在播放界面中显示相匹配的文字信息。
在识别出匹配的音乐信息后,可以实时的播放相匹配的音乐;也可以在拍摄视频结束后,再次播放该视频时,同时播放相匹配的音乐。
当整个视频图像只对应一个文字信息或音乐信息时,在播放整个视频的过程中,可以始终显示同样的文字或者播放同样的音乐。当每一帧或者一些帧对应不同的文字信息或音乐信息时,在播放整个视频的过程中,要显示与当前帧相匹配的文字,或者播放与当前帧相匹配的音乐。
前述各实施例描述的是终端设备在拍摄照片或者拍摄视频时的处理。需要说明的是,除了前述对拍摄过程的处理,本申请实施例还可以包括对拍摄后的照片或视频的处理方法,该方法可以包括:
S1501:终端设备获取第一内容。所述第一内容可以为照片或视频。
其中,终端设备可以通过拍摄照片或视频来获取第一内容。终端设备也可以从云端或者其它外部设备获取第一内容;例如终端设备从云端下载照片或视频,或者终端设备接收其它终端设备发送的照片或视频。
S1502:终端设备接收第四操作。所述第四操作为:选中所述第一内容,且待分享所述第一内容。即,第四操作表示:用户想要分享所述第一内容。第四操作可以为一个操作,也可以包括多个操作。
其中,所述的分享可以为发送给外部终端,也可以为上传到外部网络;即只要是把所述第一内容通过网络发送出去,使得其它用户能够获取到或者看到所述第一内容即可。本实施例并不限定分享的具体形式。例如:可以是终端设备把第一内容通过即时通信软件(例如:WeChat(微信)、QQ)发送给另一个或多个终端设备;也可以是终端设备把第一内容发送到社交软件(例如:WeChat、Facebook)的平台,能够供该社交软件的其他用户查看该第一内容。
S1503:响应所述第四操作,终端设备识别所述第一内容中的对象;其中,所述第一内容中的至少一个对象与预设的文字信息或者音频相匹配。
终端设备可以在本地或者网络中查询到所述第一内容中的一个或多个对象对应的文字信息或者音频信息。
S1504:终端设备根据所述第一内容和与所述第一内容相匹配的文字或音频,生成第二内容。
终端设备在查询到与所述第一内容相匹配的文字或者音频后,可以根据这些匹配的文字或者音频生成第二内容。例如:终端设备可以将匹配的文字叠加到所述第一内容(照片或者视频)上,形成第二内容。或者,终端设备可以将匹配的音频信息与所述第一内容相叠加或者相关联。其中,所述的音频信息可以包括音频数据,也可以包括音频数据和该音频数据对应的文本。所述的第二内容可以包括匹配的音频信息,或者,第二内容中可以包括匹配的音频信息的下载地址或者下载链接。
S1505:终端设备分享所述第二内容。
在生成第二内容之后,终端设备可以先呈现第二内容。例如:终端设备呈现叠加了匹配文字的第一内容。或者,终端设备呈现叠加了匹配音频的标识的第一内容,即可以在第一内容的显示界面上显示匹配音频的名称或者其它图形标识,使得用户可以得知匹配的是什么音频。当用户看到终端设备呈现的第二内容之后,用户可以选择分享该第二内容。当终端设备接收到用于指示分享该第二内容的操作指示之后,终端设备向其它设备分享该第二内容。其中,终端设备可以通过各种现有的网络向其它设备分享该第二内容。
S1506:其它设备接收到第二内容后,呈现所述第二内容。具体的,其它设备可以显示包含了匹配文字的照片或者视频。或者其它设备可以在显示照片或播放视频时,播放匹配的音频;并且还可以在播放音频的时候显示音频对应的文本。例如当音频是歌曲时,音频对应的文本可以是该歌曲的歌词。
本申请实施例可以对拍摄后的照片或视频进行处理,自动添加匹配的文本或者音频。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到本申请实施例可以用硬件实现,或固件实现,或它们的组合方式来实现。当使用软件实现时,可以将上述功能存储在计算机可读介质中或作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质,其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是计算机能够存取的任何可用介质。以此为例但不限于:计算机可读介质可以包括RAM、ROM、电可擦可编程只读存储器(electrically erasable programmable read only memory,EEPROM)、只读光盘(compact disc read-Only memory,CD-ROM)或其他光盘存储、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质。此外。任何连接可以适当的成为计算机可读介质。例如,如果软件是使用同轴电缆、光纤光缆、双绞线、数字用户线(digital subscriber line,DSL)或者诸如红外线、无线电和微波之类的无线技术从网站、服务器或者其他远程源传输的,那么同轴电缆、光纤光缆、双绞线、DSL或者诸如红外线、无线和微波之类的无线技术包括在所属介质的定影中。如本申请实施例所使用的,盘(disk)和碟(disc)包括压缩光碟(compact disc,CD)、激光碟、光碟、数字通用光碟(digital video disc,DVD)、软盘和蓝光光碟,其中盘通常磁性的复制数据,而碟则用激光来光学的复制数据。上面的组合也应当包括在计算机可读介质的保护范围之内。
总之,以上所述仅为本申请的实施例而已,并非用于限定本申请的保护范围。凡根据本申请的揭露,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。

Claims (27)

  1. 一种拍照方法,其特征在于,该方法包括:
    终端设备接收第一操作;
    响应所述第一操作,所述终端设备启动相机;
    所述终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象,所述第一预览图像中的至少一个拍摄对象与预设的第一文字信息相匹配;
    所述终端设备根据所述第一预览图像和所述第一文字信息输出第一提示信息,所述第一提示信息用于提示所述第一预览图像中缺少或多余的拍摄对象。
  2. 如权利要求1所述的方法,其特征在于,所述终端设备根据所述第一预览图像和所述第一文字信息输出第一提示信息之后,所述方法还包括:
    所述终端设备接收第二操作;
    响应所述第二操作,所述终端设备显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象,所述第二预览图像中的至少一个拍摄对象与预设的第二文字信息相匹配;
    所述终端设备根据所述第二预览图像和所述第二文字信息输出第二提示信息,所述第二提示信息与所述第一提示信息不同,所述第二提示信息用于提示所述第二预览图像中缺少或多余的拍摄对象。
  3. 如权利要求1或2所述的方法,其特征在于,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;
    若所述M个拍摄对象中的N个拍摄对象与预设的文字信息相匹配,则所述多余的拍摄对象为所述M个拍摄对象中除去所述N个拍摄对象剩下的M-N个拍摄对象;
    若与所述M个拍摄对象相匹配的文字信息中包括除所述M个拍摄对象之外的其它拍摄对象对应的关键词,则所述其它拍摄对象为所述缺少的拍摄对象;N≥1,且N<M。
  4. 如权利要求1或2所述的方法,其特征在于:
    所述第一预览图像中多余的拍摄对象为:包含在所述第一预览图像中、但未包含在所述第一文字信息中的拍摄对象;所述第一预览图像中缺少的拍摄对象为:包含在所述第一文字信息中,但未包含在所述第一预览图像中的拍摄对象;或者
    所述第二预览图像中多余的拍摄对象为:包含在所述第二预览图像中、但未包含在所述第二文字信息中的拍摄对象;所述第二预览图像中缺少的拍摄对象为:包含在所述第二文字信息中,但未包含在所述第二预览图像中的拍摄对象。
  5. 如权利要求1-4任一所述的方法,其特征在于,所述第一提示信息显示在所述第一预览界面中;所述第二提示信息显示在所述第二预览界面中。
  6. 如权利要求1-5所述的方法,其特征在于,还包括:
    所述终端设备在所述第一预览界面显示所述第一文字信息。
  7. 如权利要求2-5所述的方法,其特征在于,还包括:
    所述终端设备在所述第二预览界面显示所述第二文字信息。
  8. 如权利要求6或7所述的方法,其特征在于,
    所述第一文字信息包括至少一个文字信息;或者
    所述第二文字信息包括至少一个文字信息。
  9. 如权利要求1-8任一所述的方法,其特征在于,还包括:
    所述终端设备在所述第一预览界面显示第一匹配度信息,所述第一匹配度信息用于指示所述第一文字信息和所述第一预览图像之间的匹配程度。
  10. 如权利要求2-9任一所述的方法,其特征在于,还包括:
    所述终端设备在所述第二预览界面显示第二匹配度信息,所述第二匹配度信息用于指示所述第二文字信息和所述第二预览图像之间的匹配程度。
  11. 如权利要求1-10任一所述的方法,其特征在于,所述方法还包括:
    所述终端设备在所述第一预览图像显示第一方向指示信息,所述第一方向指示信息用于提示用户按照指示的第一方向移动所述终端设备。
  12. 如权利要求2-11任一所述的方法,其特征在于,所述方法还包括:
    所述终端设备在所述第二预览图像显示第二方向指示信息,所述第二方向指示信息用于提示用户按照指示的第二方向移动所述终端设备。
  13. 如权利要求6-12任一所述的方法,其特征在于,所述第一预览图像中显示第二控件,所述第二控件用于触发显示文字信息的类型,所述方法还包括:
    所述终端设备响应于用户触发所述第二控件的操作,显示第一列表,所述第一列表中包含至少一种文字信息的类型;
    所述终端设备响应于用户选择第一类型的操作,显示第一文字信息,所述第一文字信息的类型为所述第一类型。
  14. 如权利要求1-13任一所述的方法,其特征在于,所述第一预览界面中包含第一拍摄控件,所述方法还包括:
    所述终端设备响应于用于触发所述第一拍摄控件的操作,得到两张第一拍摄图像,所述两张第一拍摄图像中的一张第一拍摄图像包含所述第一文字信息,另一张第一拍摄图像不包含所述第一文字信息。
  15. 如权利要求2-14任一所述的方法,其特征在于,所述第二预览界面中包含第二拍摄控件,所述方法还包括:
    所述终端设备响应于用于触发所述第二拍摄控件的操作,得到两张第二拍摄图像,所述两张第二拍摄图像中的一张第二拍摄图像包含所述第二文字信息,另一张第二拍摄图像不包含所述第二文字信息。
  16. 一种拍照方法,其特征在于,所述方法包括:
    终端设备接收第一操作;
    响应所述第一操作,所述终端设备启动相机;
    所述终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象;
    所述终端设备在所述第一预览界面中显示第一音乐的第一标识,所述第一音乐为所述终端设备根据所述第一预览图像中的至少一个拍摄对象匹配出的音乐,所述第一标识为文字或图标。
  17. 如权利要求16所述的方法,其特征在于,所述终端设备在所述第一预览界面中显示第一音乐的第一标识之后,还包括:
    所述终端设备接收第二操作;
    响应所述第二操作,所述终端设备显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象;
    所述终端设备在所述第二预览界面中显示第二音乐的第二标识,所述第二音乐与所述第一音乐不同,所述第二音乐为所述终端设备根据所述第二预览图像中的至少一个拍摄对象匹配出的音乐,所述第二标识为文字或图标。
  18. 如权利要求16所述的方法,其特征在于,所述第一预览界面中包含第一拍摄控件,所述方法还包括:
    所述终端设备响应于用于触发所述第一拍摄控件的操作,获得第一拍摄图像,所述第一拍摄图像为所述终端设备将所述第一音乐和所述第一预览图像合成的图像。
  19. 如权利要求17所述的方法,其特征在于,所述第二预览界面中包含第二拍摄控件,所述方法还包括:
    所述终端设备响应于用于触发所述第二拍摄控件的操作,获得第二拍摄图像,所述第二拍摄图像为所述终端设备将所述第二音乐和所述第二预览图像合成的图像。
  20. 如权利要求16-19任一所述的方法,其特征在于,所述方法还包括:
    所述终端设备响应于触发所述第一标识的操作,播放所述第一音乐。
  21. 如权利要求16-20任一所述的方法,其特征在于,所述第一预览图像中显示第二控件,所述第二控件用于触发显示音乐的类型,所述方法还包括:
    所述终端设备响应于用户触发所述第二控件的操作,显示第一列表,所述第一列表中包含至少一种音乐的类型;
    所述终端设备响应于用户选择第一类型的操作,显示所述第一音乐的所述第一标识,所述第一音乐的类型为所述第一类型。
  22. 一种终端设备,其特征在于,所述终端设备包括摄像头、显示屏、存储器和处理器,其中所述摄像头用于捕捉预览图像;所述显示屏上显示所述预览图像;所述存储器用于存储一个或多个计算机程序;
    当所述存储器存储的一个或多个计算机程序被所述处理器执行时,使得所述终端设备执行如权利要求1至15任一所述的方法。
  23. 一种终端设备,其特征在于,所述终端设备包括摄像头、显示屏、存储器和处理器,其中所述摄像头用于捕捉预览图像;所述显示屏上显示所述预览图像;所述存储器用于存储一个或多个计算机程序;
    当所述存储器存储的一个或多个计算机程序被所述处理器执行时,使得所述终端设备执行如权利要求16至22任一所述的方法。
  24. 一种计算机存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当计算机程序在终端设备上运行时,使得所述终端设备执行如权利要求1至15任一所述的方法。
  25. 一种计算机存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当计算机程序在终端设备上运行时,使得所述终端设备执行如权利要求16至22任一所述的方法。
  26. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时, 使得所述计算机执行如权利要求1至15任一所述的方法。
  27. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求16至22任一所述的方法。
PCT/CN2019/084704 2018-04-28 2019-04-28 一种拍照方法和终端设备 WO2019206316A1 (zh)

Priority Applications (8)

Application Number Priority Date Filing Date Title
EP19791992.1A EP3758358A4 (en) 2018-04-28 2019-04-28 PHOTOGRAPHIC PROCEDURE AND TERMINAL DEVICE
JP2020560409A JP7074891B2 (ja) 2018-04-28 2019-04-28 撮影方法及び端末装置
AU2019259066A AU2019259066B2 (en) 2018-04-28 2019-04-28 Photographic method and terminal device
CN201980027660.XA CN112204942B (zh) 2018-04-28 2019-04-28 一种拍照方法和终端设备
CN202210198006.9A CN114793267A (zh) 2018-04-28 2019-04-28 一种拍照方法和终端设备
US17/047,653 US11470240B2 (en) 2018-04-28 2019-04-28 Method and terminal device for matching photgraphed objects and preset text imformation
US17/898,186 US11863856B2 (en) 2018-04-28 2022-08-29 Method and terminal device for matching photographed objects and preset text information
US18/365,735 US20240031665A1 (en) 2018-04-28 2023-08-04 Method and terminal device for matching photographed objects and preset text information

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CNPCT/CN2018/085184 2018-04-28
PCT/CN2018/085184 WO2019205170A1 (zh) 2018-04-28 2018-04-28 一种拍照方法和终端设备

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/047,653 A-371-Of-International US11470240B2 (en) 2018-04-28 2019-04-28 Method and terminal device for matching photgraphed objects and preset text imformation
US17/898,186 Continuation US11863856B2 (en) 2018-04-28 2022-08-29 Method and terminal device for matching photographed objects and preset text information

Publications (1)

Publication Number Publication Date
WO2019206316A1 true WO2019206316A1 (zh) 2019-10-31

Family

ID=68293468

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/CN2018/085184 WO2019205170A1 (zh) 2018-04-28 2018-04-28 一种拍照方法和终端设备
PCT/CN2019/084704 WO2019206316A1 (zh) 2018-04-28 2019-04-28 一种拍照方法和终端设备

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/085184 WO2019205170A1 (zh) 2018-04-28 2018-04-28 一种拍照方法和终端设备

Country Status (6)

Country Link
US (3) US11470240B2 (zh)
EP (1) EP3758358A4 (zh)
JP (1) JP7074891B2 (zh)
CN (2) CN112204942B (zh)
AU (1) AU2019259066B2 (zh)
WO (2) WO2019205170A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111177420A (zh) * 2019-12-31 2020-05-19 维沃移动通信有限公司 一种多媒体文件显示方法、电子设备及介质

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113473017A (zh) * 2021-07-01 2021-10-01 北京字跳网络技术有限公司 一种图像处理方法、装置、设备及存储介质
CN113873165A (zh) * 2021-10-25 2021-12-31 维沃移动通信有限公司 拍照方法、装置和电子设备
CN114500833B (zh) * 2022-01-13 2024-02-02 西安维沃软件技术有限公司 拍摄方法、装置及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013229680A (ja) * 2012-04-24 2013-11-07 Canon Inc 撮像装置とその制御方法、プログラム
CN104199876A (zh) * 2014-08-20 2014-12-10 广州三星通信技术研究有限公司 关联乐曲与图片的方法和装置
CN107135351A (zh) * 2017-04-01 2017-09-05 宇龙计算机通信科技(深圳)有限公司 拍照方法及拍照装置
CN107820013A (zh) * 2017-11-24 2018-03-20 上海创功通讯技术有限公司 一种拍照方法及终端
CN107943842A (zh) * 2017-10-31 2018-04-20 维沃移动通信有限公司 一种照片标签生成方法、移动终端

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030039410A1 (en) * 2001-08-23 2003-02-27 Beeman Edward S. System and method for facilitating image retrieval
JP4086050B2 (ja) * 2005-04-12 2008-05-14 コニカミノルタビジネステクノロジーズ株式会社 情報管理プログラムおよび情報管理装置
JP5057918B2 (ja) * 2007-09-28 2012-10-24 株式会社東芝 電子機器およびシーン種類表示方法
JP2009117973A (ja) * 2007-11-02 2009-05-28 Fujifilm Corp 再生装置および再生方法
JP2010257215A (ja) 2009-04-24 2010-11-11 Nikon Corp デジタルカメラ及び挿絵写真撮影/投稿プログラム
CN101753716B (zh) * 2009-11-20 2012-10-03 华为终端有限公司 终端及其摄像方法
JP2012094979A (ja) 2010-10-25 2012-05-17 Canon Inc 撮影支援システム、情報処理装置、プログラム、撮影支援方法
TW201337641A (zh) * 2012-03-15 2013-09-16 Fih Hong Kong Ltd 自拍提示系統及方法
CN103050025B (zh) * 2012-12-20 2015-09-09 广东欧珀移动通信有限公司 一种移动终端的学习方法及其学习系统
CN103900712A (zh) 2012-12-27 2014-07-02 杭州美盛红外光电技术有限公司 热像选择装置和热像选择方法
KR102078136B1 (ko) * 2013-01-07 2020-02-17 삼성전자주식회사 오디오 데이터를 가지는 이미지를 촬영하기 위한 장치 및 방법
KR20160024002A (ko) * 2014-08-21 2016-03-04 삼성전자주식회사 비쥬얼 사운드 이미지를 제공하는 방법 및 이를 구현하는 전자 장치
EP3217679B1 (en) 2014-11-05 2020-05-13 LG Electronics Inc. Image output device, mobile terminal, and control method therefor
CN104486552B (zh) * 2014-12-29 2018-10-12 联想(北京)有限公司 一种获取图像的方法及电子设备
US9619701B2 (en) * 2015-05-20 2017-04-11 Xerox Corporation Using motion tracking and image categorization for document indexing and validation
CN105159958B (zh) * 2015-08-20 2019-07-09 惠州Tcl移动通信有限公司 一种基于移动终端的图片信息处理的方法及系统
CN105159988B (zh) * 2015-08-28 2018-08-21 广东小天才科技有限公司 一种浏览照片的方法及装置
CN105869198A (zh) * 2015-12-14 2016-08-17 乐视移动智能信息技术(北京)有限公司 多媒体照片生成方法、装置、设备及手机
CN107026973B (zh) 2016-02-02 2020-03-13 株式会社摩如富 图像处理装置、图像处理方法与摄影辅助器材
US9942473B2 (en) * 2016-06-16 2018-04-10 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Apparatuses and methods for capture of expected data in visual media
CN106055708A (zh) * 2016-06-28 2016-10-26 广东欧珀移动通信有限公司 一种图片生成和展示方法、装置及终端设备
CN107562952A (zh) * 2017-09-28 2018-01-09 上海传英信息技术有限公司 音乐匹配播放的方法、装置和终端
KR20190081701A (ko) * 2017-12-29 2019-07-09 삼성전자주식회사 사진촬영에 음악을 링크하는 전자 장치 및 이의 제어 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013229680A (ja) * 2012-04-24 2013-11-07 Canon Inc 撮像装置とその制御方法、プログラム
CN104199876A (zh) * 2014-08-20 2014-12-10 广州三星通信技术研究有限公司 关联乐曲与图片的方法和装置
CN107135351A (zh) * 2017-04-01 2017-09-05 宇龙计算机通信科技(深圳)有限公司 拍照方法及拍照装置
CN107943842A (zh) * 2017-10-31 2018-04-20 维沃移动通信有限公司 一种照片标签生成方法、移动终端
CN107820013A (zh) * 2017-11-24 2018-03-20 上海创功通讯技术有限公司 一种拍照方法及终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3758358A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111177420A (zh) * 2019-12-31 2020-05-19 维沃移动通信有限公司 一种多媒体文件显示方法、电子设备及介质
CN111177420B (zh) * 2019-12-31 2023-10-20 维沃移动通信有限公司 一种多媒体文件显示方法、电子设备及介质

Also Published As

Publication number Publication date
US20230066116A1 (en) 2023-03-02
US11470240B2 (en) 2022-10-11
EP3758358A1 (en) 2020-12-30
AU2019259066A1 (en) 2020-10-15
CN112204942A (zh) 2021-01-08
CN112204942B (zh) 2022-03-11
AU2019259066B2 (en) 2021-12-02
US20240031665A1 (en) 2024-01-25
JP2021520163A (ja) 2021-08-12
US11863856B2 (en) 2024-01-02
EP3758358A4 (en) 2021-08-11
US20210105400A1 (en) 2021-04-08
CN114793267A (zh) 2022-07-26
JP7074891B2 (ja) 2022-05-24
WO2019205170A1 (zh) 2019-10-31

Similar Documents

Publication Publication Date Title
WO2019206316A1 (zh) 一种拍照方法和终端设备
US10685059B2 (en) Portable electronic device and method for generating a summary of video data
CN105512164B (zh) 使用语音标签管理图像的方法和装置
CN105094760B (zh) 一种图片标记方法及装置
CN110286976A (zh) 界面显示方法、装置、终端及存储介质
CN108886574B (zh) 一种拍摄引导方法、设备及系统
US11245933B2 (en) Method and server for generating image data by using multiple cameras
JP2017532582A (ja) オーディオカバー表示方法および装置
JP2016537747A (ja) リアルタイム・ビデオの提供方法、リアルタイム・ビデオの提供装置、サーバ、端末装置、プログラム及び記録媒体
CN108062390B (zh) 推荐用户的方法、装置和可读存储介质
CN105653636A (zh) 一种信息处理方法和装置、一种用于信息处理的装置
CN112752121B (zh) 一种视频封面生成方法及装置
US20170171471A1 (en) Method and device for generating multimedia picture and an electronic device
CN109257649B (zh) 一种多媒体文件生成方法及终端设备
CN112115282A (zh) 基于搜索的问答方法、装置、设备及存储介质
CN109151318A (zh) 一种图像处理方法、装置及计算机存储介质
CN112131438A (zh) 一种信息生成的方法、信息展示的方法及装置
CN114298883A (zh) 图像处理方法、智能终端及存储介质
WO2017193343A1 (zh) 媒体文件分享方法、媒体文件分享设备及终端
CN111586329A (zh) 一种信息显示方法、装置及电子设备
CN113325946A (zh) 一种基于增强现实的虚拟礼物交互方法以及相关装置
EP4141704A1 (en) Method and apparatus for music generation, electronic device, storage medium
CN112911351B (zh) 视频教程的展示方法、设备、系统及存储介质
CN113132772B (zh) 一种互动媒体的生成方法和装置
CN105608104A (zh) 图像添加方法、图像添加装置和终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19791992

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019259066

Country of ref document: AU

Date of ref document: 20190428

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2019791992

Country of ref document: EP

Effective date: 20200925

ENP Entry into the national phase

Ref document number: 2020560409

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE