WO2019206316A1 - 一种拍照方法和终端设备 - Google Patents
一种拍照方法和终端设备 Download PDFInfo
- Publication number
- WO2019206316A1 WO2019206316A1 PCT/CN2019/084704 CN2019084704W WO2019206316A1 WO 2019206316 A1 WO2019206316 A1 WO 2019206316A1 CN 2019084704 W CN2019084704 W CN 2019084704W WO 2019206316 A1 WO2019206316 A1 WO 2019206316A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- terminal device
- preview image
- preview
- text information
- information
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
Definitions
- the present application relates to the field of image capturing technologies, and in particular, to a photographing method and a terminal device.
- the camera function in the terminal device has become one of the functions that the user uses frequently.
- the embodiment of the present invention provides a photographing method and a terminal device, which are used to guide a user to obtain a high quality image and improve a user experience.
- an embodiment of the present invention provides a photographing method, which is applicable to a terminal device having an image capturing function.
- the method includes: receiving, by the terminal device, a first operation; in response to the first operation, the terminal device starts a camera; the terminal device displays a first preview interface including a first preview image, where the first preview image includes at least one shot An object, wherein at least one of the first preview images matches the preset first text information; the terminal device outputs the first preview image according to the first preview image and the first text information.
- the first prompt information is used to prompt a missing or redundant subject in the first preview image.
- the preview image includes at least one photographic subject
- the terminal device outputs the prompt information according to the preview image and the text information matching the preview image to prompt the user to preview the missing or redundant photographic subject in the image.
- the prompt of the prompt information the user can move the position or angle of the terminal device, so that the missing subject is captured as much as possible, and the unnecessary subject is not photographed, thereby achieving a better shooting effect.
- This method can guide the user to shoot higher quality images, which helps to improve the user experience.
- the terminal device after the terminal device outputs the first prompt information, the terminal device receives the second operation; in response to the second operation, the terminal device displays a second preview interface including the second preview image.
- the second preview image is different from the first preview image, and the second preview image includes at least one photographic subject, wherein at least one of the second preview images is associated with preset second text information.
- Matching; the terminal device outputs second prompt information according to the second preview image and the second text information, where the second prompt information is different from the first prompt information, and the second prompt information is used for prompting A missing or redundant subject in the second preview image.
- the preview image when the terminal device moves the position or changes the focal length, the preview image is dynamically changed.
- the prompt information output by the terminal device also changes, that is, the terminal device can prompt the user for the missing or redundant subject in the current preview image in real time.
- the terminal device can prompt the user to move the position or angle of the terminal device such that the missing subject is photographed, and the unnecessary subject is not photographed, thereby achieving a better photographing effect.
- This method can guide the user to shoot higher quality images, which helps to improve the user experience.
- the preview image includes M photographic objects, and the preview image is the first preview image or the second preview image; if the N photographic objects of the M photographic objects are If the preset text information matches, the redundant subject is the remaining MN subjects of the M subjects except the N subjects; if the words match the M subjects
- the information includes keywords corresponding to the other subject other than the M subjects, and the other subject is the missing subject; N ⁇ 1, and N ⁇ M. That is to say, the unnecessary photographic subject in the first preview image is a photographic subject included in the first preview image but not included in the first text information.
- the photographic subject missing in the first preview image is a photographic subject included in the first text information but not included in the first preview image.
- the unnecessary photographic subject in the second preview image is a photographic subject included in the second preview image but not included in the second text information.
- the photographic subject missing in the second preview image is a photographic subject included in the second text information but not included in the second preview image.
- the terminal device matches the appropriate text information according to the M photographic objects in the preview image. If N of the M subjects match the text information, the remaining MN subjects are redundant subjects; if the text information is matched according to the M subjects, the matched text information is excluded from this
- the M subjects also include other objects, and the other objects are the missing subjects.
- the terminal device can prompt the user to move the position or angle of the terminal device such that the missing subject is photographed, and the unnecessary subject is not photographed, thereby achieving a better photographing effect.
- This method can guide the user to shoot higher quality images, which helps to improve the user experience.
- the first prompt information is displayed in the first preview interface; and the second prompt information is displayed in the second preview interface.
- the prompt information may be displayed in the preview interface to facilitate prompting the user.
- the prompt information may also be voice information, that is, the user is prompted by voice.
- the terminal device further outputs matching first text information according to the first preview image, and the first text information is displayed in the first preview interface.
- the terminal device may display the text information for the user to view.
- the terminal device further outputs matching second text information according to the second preview image, and the second text information is displayed in the second preview interface.
- the preview image changes, and therefore, the matched text information also changes. Therefore, when the preview image changes dynamically, the text information displayed by the terminal device also dynamically changes.
- the first text information includes at least one text information; or the second text information includes at least one text information.
- the terminal device may display more than one type of text information according to the photographic subject in the preview image. If the text information is multiple text information, the terminal device may display multiple text information in the preview interface.
- the terminal device further outputs first matching degree information according to the first preview image, where the first matching degree information is used to indicate the first text information and the first preview image.
- the degree of matching between the first matching degrees is displayed in the first preview interface.
- the matching degree information may also be displayed, and the user knows the degree of matching between the text information and the preview image by using the matching degree information.
- the terminal device further outputs second matching degree information according to the second preview image, where the second matching degree information is used to indicate the second text information and the second preview image.
- the degree of matching between the second matching degree information is displayed in the second preview interface.
- the preview image changes, and the matched text information also changes, so the matching degree information between the text information and the preview image also changes. Therefore, when the preview image dynamically changes, the matching degree information output by the terminal device also dynamically changes. Therefore, the user can find a better shooting range or angle through the matching degree information. For example, when the user finds a certain shooting angle, the matching degree displayed in the preview interface is high, and the user can determine that the shooting angle is better. In this way, the user can be instructed to take higher quality images, which helps to improve the user experience.
- the terminal device further outputs first direction indication information according to the first preview image, where the first direction indication information is used to prompt the user to move the terminal device according to the indicated first direction,
- the first direction indication information is displayed in the first preview interface.
- the terminal device may further display direction indication information, and prompt the user to move the terminal device according to a certain direction by using the direction indication information. For example, if the terminal device determines that the bird is missing from the current preview image, the terminal device may display an upward arrow prompting the user to move the terminal device upward. In this way, the user can be instructed to take higher quality images, which helps to improve the user experience.
- the terminal device further outputs second direction indication information according to the second preview image, where the second direction indication information is used to prompt the user to move the terminal device according to the indicated second direction.
- the second direction indication information is displayed in the second preview interface.
- the preview image when the terminal device moves the position or changes the focal length, the preview image changes, and the matched text information also changes, so the direction indication information also changes. Therefore, when the preview image dynamically changes, the direction indication information displayed by the terminal device also dynamically changes to prompt the user to move the terminal device in a specific direction. In this way, the user can be instructed to take higher quality images, which helps to improve the user experience.
- a second control is displayed in the first preview image, the second control is used to trigger a type of displaying text information, and the terminal device is responsive to a user triggering an operation of the second control, Displaying a first list, the first list includes at least one type of text information; the terminal device displays first text information in response to the user selecting a first type of operation, the type of the first text information being the One type.
- the user can select the type of the text information.
- the terminal device can display the text information belonging to the type. In this way, the user can select the type of text information according to his or her preference, which helps to improve the user experience.
- the first preview interface includes a first shooting control
- the terminal device obtains two first captured images in response to an operation for triggering the first shooting control, One of the first captured images of the first captured image includes the first text information, and the other first captured image does not include the first text information.
- the terminal device can obtain two images, one of which does not contain the image of the text information, and the other of which contains the text information.
- the second preview interface includes a second shooting control
- the terminal device obtains two second captured images in response to the operation for triggering the second shooting control,
- One of the second captured images of the second captured image includes the second text information
- the other second captured image does not include the second text information.
- the terminal device moves the position or changes the focal length
- the preview image changes, and the matched text information also changes. Therefore, in a certain position, if the user triggers the shooting control, two images are obtained, one of which contains text information and the other does not contain text information.
- the preview image includes M shots, and the preview image is the first preview image or the second preview image; when M is 1, the terminal device according to the M When the N subjects in the photographic subject match the text information, the terminal device extracts feature information of the one photographic subject; the terminal device determines and extracts the feature according to the mapping relationship between the feature information and the keyword a keyword corresponding to the information; the terminal device determines text information including the keyword.
- the text information matched by the terminal device includes a keyword corresponding to the photographic subject.
- the preview image includes M photographic objects, and the preview image is the first preview image or the second preview image; when M is greater than or equal to 2, the terminal device according to the When N of the M photographic objects match the text information, the terminal device determines N photographic subjects whose weights are greater than the preset weights in the M photographic objects; the weights are used to indicate the display area of one photographic subject a ratio of the display area of the entire preview image; the terminal device extracts feature information from each of the N photographic objects, and obtains a total of N feature information; the terminal device is based on the feature information and the keyword The mapping relationship determines N keywords corresponding to the extracted N feature information; the terminal device determines text information including the N keywords.
- the terminal device selects N photographic objects from the plurality of photographic objects according to the weight of each photographic subject, determines N keywords, and then queries the N-containing object. Text information for a keyword.
- the terminal device when the terminal device matches the text information according to the N shooting targets of the M shooting objects, the terminal device determines at least two according to the N shooting targets of the M shooting objects. Character information; the terminal device detects current time information/geographic location information; the terminal device selects one piece of text information from the at least two pieces of text information according to the time information/geographic location information; or the terminal The device selects one piece of text information from the at least two pieces of text information according to a priority policy, wherein the priority policy includes a priority order between the at least two pieces of text information.
- the terminal device may select one type of text according to the time information/geographic information or the plurality of text information in the priority policy. information.
- the terminal device determines whether the number of times the user selects the other text information exceeds a preset number of times; When the number of times the other text information is selected exceeds a preset number of times, the terminal device sets a first priority level of the other text information to a second priority level, and the second priority level is greater than the first priority level.
- the terminal device updates the priority policy with a second priority level of the other text information.
- the text information displayed by the terminal device may not be the text information that the user likes, so the user may select other text information, and the terminal device may record the number of times the user selects other text information, when the user selects other text information. For a long time, the priority level of the other text information is raised, and the text information can be preferentially recommended in the next shooting. In this way, the terminal device can record the user's usage habits and match the text information in accordance with the user's usage habits.
- the terminal device before the terminal device outputs the first prompt information according to the first preview image, the terminal device further responds to the third operation of the user, where the terminal device is in the a setting interface for setting a poetry mode is displayed in the first preview interface, the setting interface includes an icon of the poetry mode and the first control; and in response to the user triggering the operation of the first control, starting the poetry mode, the poetry mode is The terminal device matches the mode of the appropriate poetry according to the photographic subject in the first preview image.
- the user after the terminal device starts the camera, the user can open the device interface for setting the poetry mode, and start the poetry mode by triggering the control corresponding to the poetry mode. In this way, the user can choose to turn poetry mode on or off, which helps to improve the user experience.
- the first preview interface includes a third control for triggering updating the first text information, and a fourth control for triggering display use.
- Text information if the user is not satisfied with the text information matched by the terminal device, a certain control may be triggered to replace other text information, and the user may also view the text information that has been used by triggering another control.
- the textual information includes poetry, songs, slang, celebrity quotes, or online buzzwords.
- the above-mentioned several are only listed, and the text information may also include other types of information, which is not limited in the embodiment of the present application.
- an embodiment of the present invention provides a photographing method, which is applicable to a terminal device having an image capturing function.
- the method includes: receiving, by the terminal device, a first operation; in response to the first operation, the terminal device starts a camera; the terminal device displays a first preview interface including a first preview image, where the first preview image includes At least one photographic subject; the terminal device displays a first identifier of the first music in the first preview interface, the first music being matched by the terminal device according to at least one photographic object in the first preview image Out of the music, the first identifier is a text or an icon.
- the terminal device matches the appropriate music according to the photographic subject in the preview image, and then displays the identifier of the matched music. In this way, the terminal device can match the appropriate music during the process of capturing the image, thereby improving the user experience.
- the terminal device after the terminal device displays the first identifier of the first music in the first preview interface, the terminal device receives a second operation; in response to the second operation, the terminal device Displaying a second preview interface including a second preview image, the second preview image being different from the first preview image, the second preview image including at least one photographic subject; the terminal device being in the second preview Displaying, in the interface, a second identifier of the second music, the second music being different from the first music, the second music being matched by the terminal device according to at least one of the second preview images Music, the second logo is a text or an icon.
- the preview image when the terminal device moves the position or changes the focal length, the preview image changes, and the matched music also changes. Therefore, when the preview image dynamically changes, the terminal device matches the appropriate music in real time.
- the first preview interface includes a first shooting control
- the terminal device obtains a first captured image in response to an operation for triggering the first shooting control, the first shooting
- the image is an image in which the terminal device combines the first music and the first preview image.
- the terminal device may match the preview music according to the preview image, and may generate the sound image synthesized by the preview image and the matched music. In this way, it helps to improve the quality of the captured image, and to some extent, the fun of the image capture process.
- the second preview interface includes a second shooting control
- the terminal device obtains a second captured image in response to an operation for triggering the second shooting control, the second shooting
- the image is an image in which the terminal device combines the second music and the second preview image.
- the terminal device moves the position or changes the focal length
- the preview image changes
- the matched music also changes. Therefore, when the preview image dynamically changes, the terminal device matches the appropriate music in real time.
- the terminal device is moved to a certain position, if the user triggers the shooting control, the terminal device can match the appropriate music according to the preview image, and can generate a sound image synthesized by the preview image and the matched music. In this way, it helps to improve the quality of the captured image, and to some extent, the fun of the image capture process.
- the terminal device displays a setting interface for setting a music mode in the first preview interface, the setting The interface includes an icon of the music mode and the first control; in response to the user triggering the operation of the first control, the music mode is activated, the music mode being a mode in which the terminal device matches the appropriate music according to the photographic subject in the preview image.
- the user can select to turn the music mode on or off according to his or her preference, which helps to improve the user experience.
- the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; when M is 1, the terminal device is according to the preview image.
- the terminal device extracts feature information of the one photographic subject when the at least one photographic object matches the music; the terminal device determines a key corresponding to the extracted feature information according to the mapping relationship between the feature information and the keyword a word; the terminal device determines music in the lyric or song name that includes the keyword.
- the lyrics or the song title of the music matched by the terminal device includes keywords corresponding to the photographic subject.
- the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; when M is greater than or equal to 2, the terminal device according to the preview image
- the terminal device determines N photographic subjects whose weights are greater than the preset weights; the weight is used to indicate that the display area of one photographic subject occupies the entire preview image Displaying a ratio of the area; the terminal device extracts feature information from each of the N photographic objects, and obtains a total of N pieces of feature information; the terminal device determines the mapping relationship between the feature information and the keyword N keywords corresponding to the extracted N pieces of feature information; the terminal device determines music including the keyword in the lyrics or the song title.
- the terminal device selects N photographic objects from the plurality of photographic objects according to the weight of each photographic subject, determines N keywords, and then queries the lyrics or songs. The music containing the N keywords in the name.
- the terminal device when the terminal device matches music according to N shooting objects of the M shooting objects, the terminal device determines at least two according to N shooting objects in the M shooting objects. Music; the terminal device detects current time information/geographical location information; the terminal device selects one of the at least two types of music according to the time information/geographical location information; or the terminal device is based on priority
- the policy selects one of the at least two types of music, wherein the priority policy includes a priority order between the at least two types of music.
- the terminal device when the terminal device matches the music according to the shooting object in the preview image, the terminal device may select one of the plurality of music according to the time information/geographic information or the priority policy.
- the terminal device determines whether the number of times the user selects the other music exceeds a preset number of times; When the number of times of the other music exceeds the preset number of times, the terminal device sets the first priority level of the other music to the second priority level, the second priority level is greater than the first priority level; the terminal device The priority policy is updated with a second priority level of the other music.
- the music matched by the terminal device may not be the music that the user likes, so the user may select other music, and the terminal device may record the number of times the user selects other music, and when the user selects other music, the number is increased.
- the priority level of other music can be recommended first in the next shot. In this way, the terminal device can record the user's usage habits and match the music that suits the user's usage habits.
- an embodiment of the present application provides a terminal device, including a camera, a display screen, a processor, and a memory.
- the camera is for capturing a preview image
- the display screen is for displaying a preview image
- the memory is for storing one or more computer programs; and when the one or more computer programs stored in the memory are executed by the processor, enabling the terminal device to A method of implementing the first aspect or any one of the possible aspects of the first aspect; or, when the one or more computer programs stored in the memory are executed by the processor, enabling the terminal device to implement the second aspect or the second aspect A possible method of design.
- the embodiment of the present application further provides a terminal device, where the terminal device includes a module/unit that performs the method of any one of the first aspect or the first aspect; or the terminal device includes A module/unit that performs the method of any one of the possible aspects of the second aspect or the second aspect; these modules/units may be implemented by hardware or by corresponding software implementation by hardware.
- the embodiment of the present application further provides a computer readable storage medium, where the computer readable storage medium includes a computer program, when the computer program runs on the terminal device, causing the terminal device to perform the first aspect or The method of any one of the foregoing possible aspects of the first aspect; or, when the computer program is run on the terminal device, causing the terminal device to perform the method of any one of the second aspect or the second aspect described above.
- the embodiment of the present application further provides a computer program product, when the computer program product is run on a terminal device, causing the terminal device to perform any one of the first aspect or the first aspect.
- FIG. 1 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
- FIG. 2 is a flowchart of a photographing method according to an embodiment of the present invention.
- 3A is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 3B is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- 3C is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 3D is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 3E is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 5 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 6 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 7 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 8 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 9A is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 9B is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 10 is a flowchart of a photographing method according to an embodiment of the present invention.
- FIG. 11 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 12 is a schematic diagram of a display state of a mobile phone display screen according to an embodiment of the present invention.
- FIG. 13 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
- FIG. 14 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
- the terminal device involved in the embodiment of the present application may also be referred to as a user equipment (UE).
- UE user equipment
- the terminal device can be a smart phone, a tablet computer, various wearable devices, an in-vehicle device, and the like.
- Various applications such as WeChat, maps, etc. can be installed in the terminal device.
- a plurality of the embodiments of the present application refer to two or more.
- the embodiment of the present application provides a photographing method and a terminal device, and the method is applicable to a terminal device.
- Figure 1 shows a block diagram of a possible terminal device.
- the terminal device 100 includes: a radio frequency (RF) circuit 110 , a power source 120 , a processor 130 , a memory 140 , an input unit 150 , a display unit 160 , a camera 170 , a communication interface 180 , and a wireless device Components such as the Wireless Fidelity (WiFi) module 190.
- RF radio frequency
- the terminal device provided by the embodiment of the present application may include more or less components than the illustrated ones, or combine some Some parts, or different parts are arranged.
- the components of the terminal device 100 are specifically described below with reference to FIG. 1 :
- the RF circuit 110 can be used for receiving and transmitting data during communication or during a call. Specifically, after receiving the downlink data of the base station, the RF circuit 110 sends the data to the processor 130 for processing; in addition, the uplink data to be sent is sent to the base station.
- the RF circuit 110 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
- LNA Low Noise Amplifier
- RF circuitry 110 can also communicate with the network and other devices via wireless communication.
- the wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code). Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), etc.
- GSM Global System of Mobile communication
- GPRS General Packet Radio Service
- Code Division Multiple Access CDMA
- WCDMA Wideband Code Division Multiple Access
- LTE Long Term Evolution
- E-mail Short Messaging Service
- the WiFi technology belongs to the short-range wireless transmission technology, and the terminal device 100 can connect to an access point (AP) through the WiFi module 190, thereby implementing access of the data network.
- the WiFi module 190 can be used for receiving and transmitting data during communication.
- the terminal device 100 can implement physical connection with other devices through the communication interface 180.
- the communication interface of the communication interface 180 and the other device is connected by a cable to implement data transmission between the terminal device 100 and other devices.
- the terminal device 100 can implement the communication service and send information to other contacts. Therefore, the terminal device 100 needs to have a data transmission function, that is, the terminal device 100 needs to include a communication module.
- FIG. 1 shows a communication module such as the RF circuit 110, the WiFi module 190, and the communication interface 180, it can be understood that at least one of the above components or other uses are present in the terminal device 100.
- a communication module (such as a Bluetooth module) that implements communication for data transmission.
- the terminal device 100 when the terminal device 100 is a mobile phone, the terminal device 100 may include the RF circuit 110, and may further include the WiFi module 190.
- the terminal device 100 When the terminal device 100 is a computer, the terminal device 100 may The communication interface 180 is further included, and the WiFi module 190 may be included.
- the terminal device 100 When the terminal device 100 is a tablet computer, the terminal device 100 may include the WiFi module.
- the memory 140 can be used to store software programs as well as modules.
- the processor 130 executes various functional applications and data processing of the terminal device 100 by running software programs and modules stored in the memory 140.
- the memory 140 may mainly include a storage program area and a storage data area.
- the storage program area may store an operating system, various applications (such as a communication application), a face recognition module, and the like;
- the storage data area may store data created according to the use of the terminal device (such as various pictures and video files). Such as multimedia files, as well as face information templates).
- the memory 140 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
- the input unit 150 can be configured to receive numeric or character information input by a user, and generate a key signal input related to user settings and function control of the terminal device 100.
- the input unit 150 may include a touch panel 151 and other input devices 152.
- the touch panel 151 can collect touch operations on or near the user (such as a user using a finger, a stylus, or the like on the touch panel 151 or on any suitable object or accessory.
- the operation in the vicinity of the touch panel 151) drives the corresponding connecting device according to a preset program.
- the touch panel 151 may include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
- the processor 130 is provided and can receive commands from the processor 130 and execute them.
- the touch panel 151 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
- the other input device 152 may include, but is not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, and the like.
- function keys such as a volume control button, a switch button, etc.
- a trackball such as a mouse, a joystick, and the like.
- the display unit 160 can be used to display information input by a user or information provided to a user and various menus of the terminal device 100.
- the display unit 160 is a display system of the terminal device 100 for presenting an interface to implement human-computer interaction.
- the display unit 160 may include a display panel 161.
- the display panel 161 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
- LCD liquid crystal display
- OLED organic light-emitting diode
- the touch panel 151 may cover the display panel 161, and when the touch panel 151 detects a touch operation on or near it, the touch panel 151 transmits to the processor 130 to determine the type of the touch event. The processor 130 then provides a corresponding visual output on the display panel 161 based on the type of touch event.
- the touch panel 151 and the display panel 161 are two independent components to implement the input and input functions of the terminal device 100, in some embodiments, the touch panel may be implemented.
- the touch panel 151 is integrated with the display panel 161 to implement input and output functions of the terminal device 100.
- the processor 130 is a control center of the terminal device 100, and connects various components by using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 140, and calling the storage in the
- the data in the memory 140 performs various functions and processing data of the terminal device 100, thereby implementing various services based on the terminal device.
- the processor 130 may include one or more processing units.
- the processor 130 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, and the like, and the modem processor mainly processes wireless communications. It can be understood that the above modem processor may not be integrated into the processor 130.
- the camera 170 is configured to implement a photographing function of the terminal device 100, and take a picture or a video.
- the camera 170 can also be used to implement the scanning function of the terminal device 100 to scan the scanned object (two-dimensional code/barcode).
- the terminal device 100 also includes a power source 120 (such as a battery) for powering various components.
- a power source 120 (such as a battery) for powering various components.
- the power source 120 can be logically connected to the processor 130 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption through the power management system.
- the terminal device 100 may further include at least one type of sensor, audio circuit, and the like, and details are not described herein.
- the embodiment of the present application provides a photographing method and a terminal device.
- the terminal device can identify the photographic subject in the preview image, recommend text information such as poems and songs that match the photographic object, and prompt information to prompt the user to preview the image that is missing or more a subject.
- the user can adjust the shooting range/angle and so on under the guidance of the prompt information to obtain a higher quality image. In this way, a user with high quality can also take a higher quality image.
- the photographing method provided in the embodiment of the present application is applicable to the terminal device 100 shown in FIG. 1 . Therefore, in the following description, the terminal device 100 will be taken as an example.
- FIG. 2 is a flowchart of a photographing method provided by an embodiment of the present application. As shown in Figure 2, the process of the method includes:
- the terminal device 100 displays a preview image, and the preview image includes at least one photographic subject.
- the terminal device 100 can open the camera 170 by launching an application having a photographing function.
- the application having the photographing function may be a camera application provided in the terminal device 100, or other applications installed in the terminal device 100, such as a beauty camera, a filter master, a beauty camera, a WeChat, an Alipay, and a Tencent chat software ( QQ, nail, photo sharing (instagram), Kakao Talk, even line (Line) and other applications with shooting capabilities.
- the camera icon displayed on the terminal device 100 can be triggered to activate the camera.
- the processor 130 of the terminal device 100 runs the camera, activates the camera 170, and displays a preview image on the display panel 161 of the display unit 160.
- the user aligns the camera 170 with the subject the subject is displayed in the preview image.
- the terminal device 100 identifies at least one photographic object included in the preview image, and matches the recognized photographic object according to the recognized photographic object, and the text information may include a poem, a song, a slang, a celebrity quote, or a network buzzword. Wait.
- the terminal device 100 when the terminal device 100 recognizes at least one photographic subject included in the preview image, one or more frames of the preview image may be acquired, and then the captured preview image is image-recognized.
- the terminal device 100 may collect the preview image from the time when the camera 170 is activated, until the terminal device 100 detects that the user triggers the shooting button to stop the acquisition.
- the terminal device 100 acquires a preview image from the time when the camera 170 is activated, until the terminal device 100 determines that it is in a stationary state or the photographing object in the preview image is stably displayed.
- the photographic subject can be identified from the preview image.
- the subject may include various contents such as: people, animals, food, flowers, green plants, mountains, rivers, stages, beaches, waterfalls, night scenes, blue sky, snow scenes, and the like.
- the terminal device 100 recognizes the photographic subject included in the preview image, it can match the appropriate text information from the database based on the recognized photographic subject.
- the text information is mainly poetry as an example.
- the terminal device 100 matches appropriate text information according to the recognized photographic subject, it can be implemented by keyword matching.
- the feature information is extracted from the photographic subject, and the keyword corresponding to the extracted feature information is determined according to the mapping relationship between the feature information and the keyword, and then the determined keyword is determined according to the determined keyword.
- Match text information containing these keywords from the database.
- the terminal device 100 when the terminal device 100 extracts that the feature information included in the photographic subject is a person, the keyword corresponding to the person is acquired according to the mapping relationship, for example, the keyword corresponding to the character is acquired, including “person”, “her”, “ He "three keywords.
- the terminal device 100 can match the text information of a certain keyword contained therein from the database.
- the mapping relationship between the feature information and the keyword may be stored locally or at the server. Further, the user can also change the mapping relationship.
- the keywords in the text information stored in the terminal device or in the server may be matched with the feature information in advance, for example, the stored text information includes “Panasonic asks the boy, the teacher takes the medicine to go”, The keywords such as "boy” and “teacher” are matched with the feature information "person” in advance; in the process of subsequent shooting, when the feature information included in the object extracted by the terminal device 100 has a character, the sentence can be " Panasonic asked the boy, the teacher took the medicine to "match it.”
- the stored text information includes "lifting the head and looking at the moon, looking down on the hometown", “the sea is shining and the moon is at the end of the world”, and the keyword “Mingyue” can be matched with the feature information "moon” in advance;
- the two poems can be matched.
- the terminal device 100 may adopt a different manner depending on the number of photographic subjects.
- the terminal device 100 may recognize more than one type of subject.
- the terminal device 100 queries the database for text information matching the photographic subject, and then recommends the text information to the user.
- the terminal device 100 can combine the recognized subjects.
- the terminal device 100 recognizes that the subject includes three, and assumes that three subjects correspond to three keywords. If there is text information including these three keywords at the same time, the text information is recommended to the user. If there is no text information containing the three keywords at the same time, the three keywords are combined in pairs to obtain three combinations, and each combination includes two keywords. Then, each search for text information that exists in two keywords containing some combination. If it exists, the text information is recommended to the user. If none exists, the terminal device 100 matches the appropriate text information according to each of the three keywords, and if there is text information including one of the keywords, the user recommends the text information.
- the terminal device 100 when the terminal device 100 combines the recognized photographic objects, they may be randomly combined or combined according to the weights of the recognized photographic subjects. If the terminal device 100 is combined according to the weights of the recognized photographic subject, the terminal device 100 needs to evaluate the weight of each photographic subject. For example, the weight may be set according to the ratio of the display area of the photographing object to the display area of the entire preview image, and the higher the ratio of the display area of the photographing object to the display area of the entire preview image, the larger the weight of the photographing object may be set. Taking the terminal device 100 as an example in which the photographic subject includes three, it is assumed that the display area of the first photographic subject among the three photographic subjects in the preview image is the largest, and the display area of the third photographic subject is the smallest.
- the terminal device 100 sorts the weights between the three photographic subjects: the weight of the first photographic subject > the weight of the second photographic subject > the weight of the third photographic subject.
- the terminal device 100 can give priority to the combination between the subjects with higher weights.
- the terminal device 100 may evaluate the weight of each photographic subject in various ways. For example, the terminal device 100 evaluates the weight of each photographic subject according to the brightness or color saturation of each photographic subject.
- the terminal device 100 may match a plurality of types of appropriate text information according to the recognized photographic subject. Taking the identified object as an example, the object recognized by the terminal device 100 includes the moon, and the terminal device 100 may find a variety of text information matching the database, such as “lifting the head and seeing the moon, "Looking at the hometown", "the sea is bright and the moon, the end of the world at this time” and so on. In order to recommend more appropriate text information to the user, the terminal device 100 may also acquire other information, and select more appropriate text information from the matched plurality of text information according to other information.
- the terminal device 100 can detect the current time or date, and select more appropriate text information from the plurality of text information according to the detected time (or date).
- the time described here may be a specific time or a time period.
- the terminal device 100 recognizes that the photographic object includes the sun from the preview image, and the text information determined by the terminal device 100 includes “the sunset is in the west, the broken intestine is in the horizon”, “the sunrise is in the red and the fire is in the fire, and the spring is green and blue”. "Two poems. When the terminal device 100 detects that the current time is 18:00, it is determined that "the sun sets, the heartbroken person is at the end of the world” is a more appropriate poem.
- the terminal device 100 can also detect the geographical location where it is currently located, and select more appropriate text information from multiple text information according to the geographic location.
- the photographic object recognized by the terminal device 100 from the preview image includes flowers and bridges, and the corresponding keywords are “grass” and “bridge”, respectively, and the terminal device 100 queries the database for the two keywords.
- Poetry For example, the terminal device 100 queries two poems, "Suzaku Bridge side wildflowers, Wuyixiangkou sunset oblique” and "the bottom of the water is like a snow, and the bridgeside grass is like smoke.”
- the terminal device 100 detects that it is currently in the "Wuyi Lane” in Nanjing, it is determined that the "Suzaku Bridge side wild flowers and grasses, the Wuyi alley sunset” is a more appropriate poem.
- a further possible implementation manner is that when the terminal device 100 has multiple types of text information matched according to the photographic subject, one type of text information may be determined from the plurality of text information by using the priority policy. For example, the terminal device 100 can determine the priority level between the plurality of text information, and recommend the text information with higher priority to the user.
- the priority level between different text information can be obtained according to the user's usage habits. For example, the user often selects “Looking at the moon, looking down on the hometown”, then “Looking at the moon, looking down on the hometown” The priority level is higher than “the sea is bright and the moon is at the end of the world”. Therefore, the terminal device 100 recommends to the user that "the head is looking at the moon, and the head is down.”
- the priority level is updateable. For example, after the terminal device 100 recommends the text information to the user, the user chooses to use other text information. When the terminal device 100 detects that the number of times the user uses other text information exceeds the preset number of times, the terminal device 100 may increase the priority level of other text information and update the priority policy.
- the terminal device 100 can jointly find suitable text information by combining time, geographical location, keywords of the shooting object, and other information.
- poems, songs, slang, celebrity quotes, network buzzwords, and the like may be stored locally in the terminal device 100.
- the terminal 100 can also be obtained from a network or a server.
- the terminal device 100 outputs the text information and/or the prompt information, where the prompt information is used to prompt the user for a missing or redundant photographic subject in the preview image.
- the prompt information is used to prompt the user for a missing or redundant photographic subject in the preview image.
- the text information is matched according to the photographic objects, only N of the M photographic objects match the appropriate text information, and the unnecessary photographic subject is the N photographic subjectes except the N The remaining MN subjects of the subject.
- the unnecessary photographic subject can be presented to the user; according to the prompt, the user can move the position or angle of the terminal device, so that the redundant photographic subject is not included in the preview image, that is, the redundant photographic subject is not Captured so that you can achieve better photo results.
- the terminal device may prompt the user for the missing photographic subject; according to the prompt, the user may move the position or angle of the terminal device, so that the missing photographic subject is added to the preview image, that is, the previously missing photographic subject is Captured so that you can achieve better photo results.
- the terminal device 100 when the terminal device 100 recognizes that there are a plurality of photographic objects included in the preview image, a plurality of photographic subjects may be combined, and the text information is determined based on the combined photographic subject. Therefore, it may happen that some of the plurality of subjects in the preview image are redundant. For example, if the subject included in the preview image has a character, a sea, and a moon, the terminal device 100 determines a poem according to the sea and the moon: "The sea is bright and the moon is at the end of the world", wherein the character is redundant. In this case, the terminal device 100 can display prompt information for prompting the user that there is an extra subject, that is, a character, in the current preview image.
- the character information matched by the terminal device 100 may include a certain keyword, but the preview image does not include the subject corresponding to the keyword. Therefore, the terminal device 100 can display prompt information for prompting the user that the current preview image lacks a subject corresponding to a certain keyword in the text information.
- the terminal device 100 may also not display the prompt information.
- the prompt information may be a voice prompt, that is, the terminal may prompt the user by playing a voice.
- the prompt information may be text, an icon, an image, and the like that can be displayed on the display screen, and the prompt information may be specifically displayed in the preview interface to facilitate prompting the user.
- the terminal device 100 may pop up a prompt box in the preview image, and the prompt box includes “adding a river”, “moving the camera to increase the river”, “the character is redundant” or “moving the camera to delete the character”. Wait for the text.
- the matching degree information may also be displayed on the display screen, and the matching degree information is used to indicate the degree of matching between the text information and the matched text information.
- the matching degree information can be displayed in the form of a number, for example, the percentage of matching is displayed.
- the matching degree information can also be displayed in other forms, such as displaying in an expression manner. When the expression is smiling, the matching degree is high, and the expression is sad. , indicating a low degree of matching.
- the terminal device 100 may collect a preview image in real time, and match appropriate text information from the database according to the captured object included in the captured preview image, and match the matched text information, matching degree information, and prompts.
- the message is displayed to prompt the user to preview the image that is missing or extra.
- the user can adjust the shooting range/angle, etc. under the guidance of the prompt information.
- the terminal device moves the position or changes the focal length to adjust the shooting range/angle, the preview image changes; the terminal re-matches the text according to the subject in the changed preview image.
- the information if the re-matched text information changes compared with the previous text information, correspondingly, the matching degree information and the prompt information also change; the terminal can display the changed matching degree information and the prompt information. That is, when the preview image changes dynamically, the text information, the matching degree information, and the prompt information also dynamically change.
- Figures 3A-3E show schematic diagrams of display states of a handset display.
- a preview interface 301 is displayed on the display screen of the mobile phone 300.
- the preview interface 301 includes a preview image and some control keys (flash, camera switching, etc.), and the preview image includes a poem 302 matched by the mobile phone 300:
- the grass is on the shore and there is a deep yellow tree on the grass.
- the preview image also includes a matching degree of 303:50%.
- the mobile phone 300 can also display in the preview interface 301 which of the keywords in the poem 302 are matched by the photographic subject included in the current preview image. See Figure 3B.
- the word “grass” in the poem 302 "Single Pity on the Shore, and the Yellow Grass on the Tree" is in the solid coil to prompt the user to preview the image contained in the image and in the poem 302. "Grass” matches.
- the word "grass” is displayed in a solid line frame.
- other display modes such as highlighting, bubble, bolding, etc., may also be used. As long as the purpose of prompting the user is reached.
- the mobile phone 300 may pop up a prompt box 304 in the preview image, and the text of "adding jaundice” is displayed in the prompt box 304, please refer to FIG. 3C.
- the mobile phone 300 may also display indication information (in the form of an arrow or a text) of the moving direction, and the indication information of the moving direction is used to prompt the user to adjust the shooting range according to the indicated moving direction.
- indication information in the form of an arrow or a text
- the mobile phone may display an indication of adjusting the focal length (the distance between the object and the subject) in the preview image to prompt the user to increase (or shorten) the focal length to obtain more (or fewer) subjects.
- the indication information for adjusting the focal length may be a text or an icon.
- a preview interface 301 is displayed on the display screen of the mobile phone 300.
- the preview interface 301 includes a preview image, and the preview image includes more shooting objects and a poem 302 matched by the mobile phone: There is a yellow scorpion in the tree, and the preview image also includes: 305:80% matching.
- the "grass” and “yellow” in the poem 302 are displayed in the solid line frame to prompt the user that the current included preview image matches the "grass” and "yellow”.
- a poem is displayed in a preview image.
- the phone can also display multiple poems in the preview image.
- the mobile phone matches two poems according to the object in the preview image, and the mobile phone can display the two poems in the preview image, and the user can select the poetry of interest from among them.
- a preview interface 401 is displayed on the display screen of the mobile phone 400.
- the preview image is displayed in the preview interface 401.
- the preview image includes two poems, namely, a poem 402 and a poem 403.
- the user can select a poem by the user's finger. Swipe left/right to cancel the poem.
- there may be other cancellation modes which are not limited in the embodiment of the present application.
- the poems displayed by the mobile phone are not necessarily preferred by the user.
- the user can select poems according to his own needs.
- One possible implementation is that the user can select the type of poetry, and the mobile phone matches the appropriate poetry according to the type of poetry selected by the user.
- the type of poetry selected by the user is a landscape poem, so the mobile phone recommends the poetry of the gardening style of the landscape.
- the mobile phone 500 displays an identifier 501 of a poetry type in the preview image.
- the mobile phone displays a plurality of poetry types, and the user selects one of the poem types.
- Another possible implementation is that if the user wants to try other poems, he or she can choose to change the poetry.
- the refresh (or change control) control 601 is displayed in the preview interface 601 of the mobile phone 600.
- the phone 600 displays other poems.
- the mobile phone needs to find suitable text information from the database in the process of matching the text information according to the object.
- Text messages can be stored locally on the phone or stored on the server. Therefore, in the case that the mobile phone is not connected to the network, after the user triggers the "refresh" control 601, the mobile phone can find suitable text information in the local database.
- the mobile phone can find the appropriate text information in the server in addition to the local database.
- the mobile phone can send the reserved image to the server, and the server performs the process of recognizing the object in the reserved image and matching the text information.
- the mobile phone may recognize the subject in the preview image and then transmit the keyword corresponding to the recognized subject to the server.
- the server matches the appropriate poetry according to the received keywords, and then the server sends the matched poems to the mobile phone.
- the "refresh" control 601 is displayed in the same box as the poem. This is just an example.
- the "refresh” control 601 can also be displayed at other locations, or can be displayed in other ways, such as an icon.
- the manner of the present application is not limited in the embodiment of the present application.
- the display of the handset 700 displays a "History” control 701.
- the handset 700 displays a list showing the poems that have been displayed.
- the "History” control 701 is displayed in the same box as the poem. This is just an example.
- the "History” control 701 can also be displayed at other locations, or otherwise displayed. The application embodiment does not limit this.
- the poetry and the matching degree information may be fixed position information in the preview image (the position may be set by the user), or may be displayed in a blank place in the preview image, see the figure.
- the mobile phone 800 displays poetry and matching degree information in a blank space in the preview image. In this way, the poetry and matching degree information can not obscure the subject in the preview image as much as possible, and is convenient for the user to view, and is more helpful for guiding the user to shoot.
- the matching degree information is mainly information for guiding the user to photograph
- the matching degree information and the poetry can be displayed in the preview image.
- only the poems can be displayed in the final captured image.
- the user can select the font in which the poetry is displayed in the final captured image, such as the fonts of the Song, the corpus, and the like.
- Poetry can be displayed statically or dynamically. For example, each word in a poem can be displayed one by one, showing the effect of dynamic display.
- poems can be displayed in blank places in the final captured image, and try to avoid occluding the display content in the image.
- the solution provided by the embodiment of the present application is mainly used to guide the user to take a better quality image. Therefore, when the user triggers the shooting button, the poems may not be displayed in the final captured image. Or, when the user triggers the shooting button, the last shot is to get two images, one of which does not contain poetry and the other contains poetry.
- the mobile phone may not display the poetry, and only display the prompt information to prompt the user to preview the image lacking a certain shooting object or a certain shooting object, and the user may shoot the effect according to the prompt information. image.
- the mobile phone detects that the user triggers the shooting button, the image that can be captured may not contain poetry.
- the prompt information mainly prompts the user that the preview image lacks a certain shooting object or a certain shooting object, and the prompt information may also prompt the user to replace one of the unnecessary shooting objects in the preview image with another shooting object.
- the mobile phone may first determine the redundant first subject, then determine the missing second subject, and then output a prompt message to prompt the user to replace the first subject with the second subject.
- the terminal device can identify the photographing object in the preview image, recommend text information such as poetry, song and so on, and prompt information matching the photographing object to prompt the user to preview the image. Missing or extra shots.
- the user can adjust the shooting range/angle and so on under the guidance of the prompt information to obtain a higher quality image. In this way, a user with high quality can also take a higher quality image.
- the user may choose to turn on the poetry shooting mode or turn off the poetry shooting mode.
- a poetry matching mode may be set in the preview interface of the mobile phone. After the user starts the poetry matching mode, the mobile phone may execute S201-S203.
- FIG. 9A shows a schematic diagram of a display screen of a mobile phone display.
- a preview interface 901 is displayed on the display screen of the mobile phone 900.
- the preview interface 901 includes a shooting mode selection box 902, and the shooting mode selection box includes a control 903 corresponding to the poetry mode.
- the user triggers the control 903 to start the poetry mode, and the mobile phone executes S201-S203 of the embodiment shown in FIG. 2, and the text information and the matching degree information are displayed on the display screen. If the user triggers the control 903 again and the mobile phone 900 turns off the poetry mode, the text information and the matching degree information on the display of the mobile phone 900 disappear.
- the mobile phone can detect that the object included in the current preview image belongs to a landscape such as a mountain, a water, a plant, a desert, a pavilion, etc., and can display a logo (text or icon) of the poetry mode on the preview image. , remind the user to start the poetry mode. See Figure 9B.
- a preview interface 901 is displayed on the display screen of the mobile phone 900.
- the preview interface 901 includes a preview image, and the preview image includes an icon 904 of a poetry mode.
- the handset 900 initiates the poetry mode.
- the phone 900 turns off the poetry mode.
- the terminal device may identify the photographic subject in the preview image, recommend text information such as poems, songs, and the like that match the photographic subject to the user, and prompt information to prompt the user to preview the image. Missing or extra shots.
- the user can adjust the shooting range/angle and so on under the guidance of the prompt information to obtain a higher quality image.
- the terminal device after the terminal device recognizes a plurality of photographic objects included in the preview image, the terminal can recommend music that matches the recognized photographic subject, and the user can select the recommended music and the shooting.
- the resulting image is synthesized into an acoustic image.
- This method can be applied to the terminal device 100 shown in Fig. 1, so the terminal device 100 is taken as an example in the following description. Referring to Figure 10, the process of the method includes:
- the terminal device 100 displays a preview image, and the preview image includes at least one photographic subject.
- the terminal device 100 recognizes at least one photographic subject included in the preview image, and matches the recognized photographic object according to the recognized photographic subject.
- the terminal device 100 matches appropriate music according to the recognized photographic subject, it can be realized by keyword matching.
- the feature information is extracted from the photographic subject, and the keyword corresponding to the extracted feature information is determined according to the mapping relationship between the feature information and the keyword, and then the determined keyword is determined according to the determined keyword.
- the terminal device 100 matches appropriate music according to the recognized photographic subject, it can be matched by the scene information in which the photographic subject is located.
- the terminal device 100 when the terminal device 100 recognizes that the subject is in a scene such as a bar, a karaoke bar, or a stage, the terminal device 100 can search for music suitable for playing in a bar, a karaoke bar, or a stage.
- the terminal device 100 matches the appropriate music according to the recognized photographic subject, it can be matched by the environment information currently provided by the terminal device 100.
- the terminal device 100 may also collect the sound of the surrounding environment.
- the terminal device 100 may search for the light music.
- the terminal device 100 may match by the current time when matching the appropriate music according to the recognized photographic subject.
- the terminal device 100 can detect the current time and determine the appropriate music based on the detected time. For example, of course, the time is night, you can look for light music.
- the terminal device 100 may match by the current geographic location when matching the appropriate music according to the recognized photographic subject.
- the terminal device 100 can detect the current geographic location and find suitable music according to the geographic location. For example, when the terminal device 100 detects that it is currently in Hong Kong, it searches for Cantonese music. When the terminal device 100 detects that it is currently in the United States, it searches for European and American music.
- the terminal device 100 can also match other sounds other than music. For example, when the terminal device 100 recognizes that an object is included in the subject, the call of the animal can be queried from the server or locally. For example, if the subject contains a bird, the terminal device 100 can query the bird's voice.
- the terminal device can combine the several methods listed above.
- the music may be stored locally in the terminal device 100 or stored in the server. Therefore, in the case where the terminal device 100 is not connected to the network, the appropriate music can be queried in the local database. In the case of mobile phone networking, the terminal device 100 can query the appropriate music in the server in addition to querying the appropriate music locally. Exemplarily, the terminal device 100 may transmit the preview image to the server, identify the photographic subject in the preview image by the server, and match the appropriate music, and then the server transmits the related information of the matched music to the terminal device 100.
- the terminal device 100 may identify the photographic subject in the preview image, and then send the identified keyword corresponding to the photographic subject to the server, and the server matches the appropriate music according to the received keyword, and then the server matches the matched music.
- the related information is transmitted to the terminal device 100.
- the music may be a music piece, such as a music piece whose playing time is 10s-12s. Therefore, after the terminal device 100 or the server stores the music piece that has been intercepted, or the terminal device 100 or the server determines the appropriate music, the appropriate music piece is intercepted from the music, and then the music piece is pushed to the user.
- the terminal device 100 displays an identifier of the music, and the identifier is a text or an icon.
- Fig. 11 is a view showing the display state of the screen of the mobile phone.
- the display screen of the mobile phone 1100 displays a preview interface 1101.
- the preview interface 1101 includes a preview image, and the preview image includes an identifier 1102 of the music matched by the mobile phone 1100.
- music can be played. If the user is satisfied with the music, the shooting control can be triggered, and the terminal device 100 synthesizes the music and the captured image to obtain a sound image.
- the user can choose to turn on the music mode or turn off the music mode.
- a music mode may be set in the preview interface of the terminal device 100, and when the user activates the music mode, the terminal device 100 may execute S1001-S1003.
- FIG. 12 shows a schematic diagram of a display screen of a mobile phone display.
- a preview interface 1201 is displayed on the display screen of the mobile phone 1200.
- the preview interface 1201 includes a shooting mode selection box 1202, and the shooting mode selection box 1202 includes a control 1203 corresponding to the music mode.
- the user triggers the control 1203 to activate the music mode, and the mobile phone 1200 executes S1001-S1003 of the embodiment shown in FIG. 10, and displays the recommended music identification on the display screen. If the user triggers the control 1203 again, the mobile phone 1200 turns off the music mode, and the identification of the music on the display of the mobile phone 1200 disappears.
- Embodiments of the present application can be arbitrarily combined to achieve different technical effects. Therefore, various embodiments in the embodiment shown in FIG. 2 can also be applied to the embodiment shown in FIG. That is, when a photo or video is taken, the method of the embodiment shown in FIG. 2 can be used to prompt the user for the currently missing or redundant subject, and the identification of the music can be displayed by the method of the embodiment shown in FIG. After shooting, you can get photos or videos that include text messages and music. That is, the user can obtain a multimedia photo or video, that is, when the user views the photo, the terminal can have corresponding text information on the photo, and can also play the corresponding music.
- the method provided by the embodiment of the present application is introduced from the perspective of the terminal device as an execution subject.
- the terminal device may include a hardware structure and/or a software module, and implement the foregoing functions in the form of a hardware structure, a software module, or a hardware structure plus a software module.
- One of the above functions is performed in a hardware structure, a software module, or a hardware structure plus a software module, depending on the specific application and design constraints of the technical solution.
- FIG. 13 is a terminal device 1300 according to an embodiment of the present application.
- the terminal device 1300 may be a terminal device with image capturing capability, and the terminal device may perform the implementation shown in FIG. 2 to FIG. 9 above.
- the terminal device 1300 includes: a processing unit 1301, and a display unit 1302. among them,
- the processing unit 1301 is configured to receive a first operation, and start the camera in response to the first operation;
- the display unit 1302 is configured to display a first preview interface including a first preview image, where the first preview image includes at least one photographic subject;
- the processing unit 1301 is further configured to output first prompt information according to the first preview image, where the first prompt information is used to prompt a missing or redundant photographing object in the first preview image.
- the first prompt information may be a language prompt information or a text prompt information.
- the processing unit 1301 may output voice prompt information through a speaker, or the processing unit 1301 may output text prompt information through the display unit 1302.
- the processing unit 1301 is further configured to receive a second operation, and respond to the second operation to be displayed by the display unit 1302. a second preview interface of the second preview image, the second preview image being different from the first preview image, wherein the second preview image includes at least one photographic subject;
- the processing unit 1301 is further configured to output second prompt information according to the second preview image, where the second prompt information is different from the first prompt information, and the second prompt information is used to prompt the second preview information Missing or unwanted subjects in the image.
- the second prompt information may also be a language prompt information or a text prompt information.
- the processing unit 1301 may output voice prompt information through a speaker, or the processing unit 1301 may output text prompt information through the display unit 1302.
- the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; if the N photographic objects and the preset text in the M photographic objects If the information is matched, the redundant photographic subject is the MN photographic subjects remaining in the M photographic subjects except the N photographic subjects; if the text information matching the M photographic objects includes The keyword corresponding to the other subject other than the M subjects, the other subject is the missing subject; N ⁇ 1, and N ⁇ M.
- the first prompt information is displayed in the first preview interface; and the second prompt information is displayed in the second preview interface.
- the processing unit 1301 is further configured to output the matched first text information according to the first preview image, and display the first text information in the first preview interface by using the display unit 1302.
- the processing unit 1301 is further configured to output the matched second text information according to the second preview image, and display the second text information in the second preview interface by using the display unit 1302. .
- the first text information includes at least one text information; or the second text information includes at least one text information.
- the processing unit 1301 is further configured to further output first matching degree information according to the first preview image, and display the first matching degree information in the first preview interface by using the display unit 1302;
- the first matching degree information is used to indicate a degree of matching between the first text information and the first preview image.
- the processing unit 1301 is further configured to output second matching degree information according to the first preview image, and display the second matching degree information in the second preview interface by using the display unit 1302,
- the second matching degree information is used to indicate a degree of matching between the second text information and the second preview image.
- the processing unit 1301 is further configured to output the first direction indication information according to the first preview image, and display the first direction indication information in the first preview interface by using the display unit 1302,
- the first direction indication information is used to prompt the user to move the terminal device according to the indicated first direction.
- the processing unit 1301 is further configured to output second direction indication information according to the first preview image, and display the second direction indication information on the second preview interface by using the display unit 1302.
- the second direction indication information is used to prompt the user to move the terminal device according to the indicated second direction.
- a second control is displayed in the first preview image, where the second control is used to trigger a type of displaying text information, and the processing unit 1301 is configured to respond to a user triggering an operation of the second control by using the
- the display unit 1302 displays a first list, the first list includes at least one type of text information; the processing unit 1301 displays the first text information through the display unit 1302 in response to the user selecting the first type of operation,
- the type of the first text information is the first type.
- the first preview interface includes a first shooting control
- the processing unit 1301 is further configured to obtain two first captured images, in response to the operation for triggering the first shooting control.
- One of the first captured images of the first captured image includes the first text information, and the other first captured image does not include the first text information.
- the second preview interface includes a second shooting control
- the processing unit 1301 is further configured to obtain two second captured images, in response to the operation for triggering the second shooting control.
- One of the second captured images of the second captured image includes the second text information, and the other second captured image does not include the second text information.
- the preview image includes M photographic objects, and the preview image is the first preview image or the second preview image; when M is 1, the processing unit 1301 is configured to use the M
- the method is specifically configured to: extract feature information of the one photographic subject; and determine a key corresponding to the extracted feature information according to a mapping relationship between the feature information and the keyword. a word; determining textual information containing the keyword.
- the preview image includes M photographic objects, the preview image is the first preview image or the second preview image; when M is greater than or equal to 2, the processing unit 1301 is configured to use the M according to the M
- the method is specifically configured to: determine N photographic subjects whose weights are greater than the preset weights; and the weights are used to indicate the display area of one photographic subject. a ratio of a display area of the entire preview image; extracting feature information from each of the N shot objects, and obtaining a total of N feature information; determining and extracting according to a mapping relationship between the feature information and the keyword N keywords corresponding to the N feature information; and character information including the N keywords is determined.
- the processing unit 1301 is further configured to: determine, according to the N pieces of the M photographic objects, at least two types of characters according to the N pieces of the M photographic objects. Information; detecting current time information/geographic location information; selecting one piece of text information from the at least two types of text information according to the time information/geographic location information; or from the at least two pieces of text information according to a priority policy A piece of text information is selected, wherein the priority policy includes a priority order between the at least two pieces of text information.
- the processing unit 1301 is further configured to: determine whether the number of times the user selects the other text information exceeds a preset number of times; When the number of times the user selects the other text information exceeds a preset number of times, the first priority level of the other text information is set to a second priority level, and the second priority level is greater than the first priority level; The second priority level of the other text information updates the priority policy.
- the processing unit 1301 may be equivalent to a processor in the terminal device; the display unit 1302 may be equivalent to a display screen in the terminal device.
- FIG. 14 shows a terminal device 1400 according to an embodiment of the present application.
- the terminal device 1400 may be a terminal device with image capturing capability, and the terminal device may perform the implementation shown in FIG. 10 to FIG. 12 above.
- the terminal device 1400 includes a processing unit 1401 and a display unit 1402.
- the processing unit 1401 is configured to receive a first operation, and start the camera in response to the first operation;
- the display unit 1402 is configured to display a first preview interface including a first preview image, where the first preview image includes at least one photographic subject; the display unit 1402 is further configured to display the first preview interface a first identifier of the music, wherein the first music is music that is matched by the terminal device according to at least one of the first preview images, and the first identifier is a text or an icon.
- the processing unit 1401 is further configured to receive a second operation
- the display unit 1402 is further configured to display, according to the second operation, a second preview interface including a second preview image, where the second preview image is different from the first preview image, and the second preview image includes At least one photographic subject; the display unit 1402 is further configured to display a second identifier of the second music in the second preview interface, the second music is different from the first music, and the second music is
- the terminal device is configured to match music according to at least one of the second preview images, and the second identifier is a text or an icon.
- the first preview interface includes a first shooting control
- the processing unit 1401 is further configured to obtain a first captured image, the first shooting, in response to an operation for triggering the first shooting control.
- the image is an image in which the terminal device combines the first music and the first preview image.
- the second preview interface includes a second shooting control
- the processing unit 1401 is further configured to obtain a second captured image, the second shooting, in response to an operation for triggering the second shooting control.
- the image is an image in which the terminal device combines the second music and the second preview image.
- the terminal device further includes a sound playing unit, and the sound playing unit is configured to play the first music in response to an operation of triggering the first identifier.
- a second control is displayed in the preview image, the second control is used to trigger a type of displaying music, and the display unit 1402 is further configured to display the first one in response to the user triggering the operation of the second control.
- a list the first list includes at least one type of music; the display unit 1402 is further configured to display a first identifier of the first music, the type of the first music, in response to the user selecting a first type of operation For the first type.
- the processing unit 1401 may be equivalent to a processor in the terminal device; the display unit 1402 may be equivalent to a display screen in the terminal device.
- the foregoing various embodiments describe the processing of the preview image by the terminal device at the time of shooting. It should be noted that the foregoing shooting may be taking a photo or shooting a video. Moreover, referring to the foregoing processing method for the preview image, similar processing is performed on the captured video image. For example, the processing of video images can be as follows.
- the captured video image may include several frames. Among them, some consecutive frames may be similar or continuous scenes, that is, the subjects in these frames are the same or mostly the same.
- the terminal device can analyze the content of each frame in the captured video image to identify text information or music information that matches the subject in each frame; thus, text or music that matches the entire video image There may be more than one, because the content that matches each frame may be the same or different.
- the terminal device may analyze the content in the consecutive frames after identifying consecutive frames indicating similar or continuous scenes, and identify text information or music information that matches the shooting objects in the consecutive frames, where A set of consecutive frames corresponds to one piece of text information or music information; thus, there may be more than one text or music that matches the entire video image, because the entire video image may include multiple sets of consecutive frames (all of which are in a group of consecutive frames) The scenes represented are similar or continuous), and the content matching each group of consecutive frames may be the same or different.
- the terminal device may further identify a text information or music information that matches the shooting objects according to the image objects in the image image or a part of the image frames in the video image; thereby, the text matching the entire video image Or music is one. That is to say, a text message or music information can match the entire video image, or can match a certain frame or frames in the video image.
- the method of recognizing text information or music information matching each frame or some consecutive frames or all image frames is the same as the method of recognizing text information or music information matching the preview image in the foregoing embodiment.
- the text information may be displayed on the display interface in real time; or after the video is played, when the video is played again, the matched text information is displayed in the play interface.
- the matched music can be played in real time; or the matching music can be played simultaneously when the video is played again after the end of the shooting video.
- the entire video image corresponds to only one text message or music information
- the same text or the same music can be always displayed during the entire video playback.
- each frame or some frames correspond to different text information or music information, in the process of playing the entire video, text matching the current frame is displayed, or music matching the current frame is played.
- the embodiment of the present application may further include a method for processing a photograph or a video after the shooting, and the method may include:
- the terminal device acquires the first content.
- the first content may be a photo or a video.
- the terminal device can obtain the first content by taking a photo or a video.
- the terminal device may also acquire the first content from the cloud or other external device; for example, the terminal device downloads photos or videos from the cloud, or the terminal device receives photos or videos sent by other terminal devices.
- the terminal device receives the fourth operation.
- the fourth operation is: selecting the first content, and the first content to be shared. That is, the fourth operation indicates that the user wants to share the first content.
- the fourth operation may be one operation or multiple operations.
- the sharing may be sent to an external terminal, or may be uploaded to an external network; that is, as long as the first content is sent out through the network, so that other users can obtain or see the first content.
- This embodiment does not limit the specific form of sharing.
- the terminal device may send the first content to another one or more terminal devices through instant messaging software (for example, WeChat, QQ); or the terminal device may send the first content to the social software (for example: WeChat, Facebook) platform for other users of the social software to view the first content.
- instant messaging software for example, WeChat, QQ
- the terminal device may send the first content to the social software (for example: WeChat, Facebook) platform for other users of the social software to view the first content.
- the terminal device In response to the fourth operation, the terminal device identifies an object in the first content; wherein at least one of the first content matches a preset text information or audio.
- the terminal device may query text information or audio information corresponding to one or more objects in the first content locally or in the network.
- S1504 The terminal device generates the second content according to the first content and text or audio that matches the first content.
- the second content may be generated according to the matched text or audio.
- the terminal device may superimpose the matched text on the first content (photo or video) to form the second content.
- the terminal device may superimpose or associate the matched audio information with the first content.
- the audio information may include audio data, and may also include audio data and text corresponding to the audio data.
- the second content may include matching audio information, or the second content may include a download address or a download link of the matched audio information.
- S1505 The terminal device shares the second content.
- the terminal device may first render the second content. For example, the terminal device presents the first content superimposed with the matching text. Alternatively, the terminal device presents the first content superimposed with the identifier of the matching audio, that is, the name of the matching audio or other graphic identifier may be displayed on the display interface of the first content, so that the user can know what audio is matched. After the user sees the second content presented by the terminal device, the user may choose to share the second content. After the terminal device receives the operation indication for instructing to share the second content, the terminal device shares the second content with the other device. The terminal device can share the second content to other devices through various existing networks.
- S1506 After the other device receives the second content, the second content is presented.
- other devices can display photos or videos that contain matching text.
- other devices can play matching audio when displaying photos or playing videos; and can also display text corresponding to audio when playing audio.
- the audio is a song
- the text corresponding to the audio may be the lyrics of the song.
- the embodiment of the present application can process the photographed photo or video, and automatically add matching text or audio.
- Computer readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one location to another.
- a storage medium may be any available media that can be accessed by a computer.
- the computer readable medium may include a RAM, a ROM, an electrically erasable programmable read only memory (EEPROM), a compact disc read-only memory (CD-).
- ROM read-only memory
- Any connection may suitably be a computer readable medium.
- the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, Then coaxial cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, wireless and microwave are included in the fixing of the associated medium.
- a disk and a disc include a compact disc (CD), a laser disc, a compact disc, a digital video disc (DVD), a floppy disk, and a Blu-ray disc, wherein Disks typically replicate data magnetically, while disks use lasers to optically replicate data. Combinations of the above should also be included within the scope of the computer readable media.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Studio Devices (AREA)
- Telephone Function (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (27)
- 一种拍照方法,其特征在于,该方法包括:终端设备接收第一操作;响应所述第一操作,所述终端设备启动相机;所述终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象,所述第一预览图像中的至少一个拍摄对象与预设的第一文字信息相匹配;所述终端设备根据所述第一预览图像和所述第一文字信息输出第一提示信息,所述第一提示信息用于提示所述第一预览图像中缺少或多余的拍摄对象。
- 如权利要求1所述的方法,其特征在于,所述终端设备根据所述第一预览图像和所述第一文字信息输出第一提示信息之后,所述方法还包括:所述终端设备接收第二操作;响应所述第二操作,所述终端设备显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象,所述第二预览图像中的至少一个拍摄对象与预设的第二文字信息相匹配;所述终端设备根据所述第二预览图像和所述第二文字信息输出第二提示信息,所述第二提示信息与所述第一提示信息不同,所述第二提示信息用于提示所述第二预览图像中缺少或多余的拍摄对象。
- 如权利要求1或2所述的方法,其特征在于,预览图像中包括M个拍摄对象,所述预览图像为所述第一预览图像或所述第二预览图像;若所述M个拍摄对象中的N个拍摄对象与预设的文字信息相匹配,则所述多余的拍摄对象为所述M个拍摄对象中除去所述N个拍摄对象剩下的M-N个拍摄对象;若与所述M个拍摄对象相匹配的文字信息中包括除所述M个拍摄对象之外的其它拍摄对象对应的关键词,则所述其它拍摄对象为所述缺少的拍摄对象;N≥1,且N<M。
- 如权利要求1或2所述的方法,其特征在于:所述第一预览图像中多余的拍摄对象为:包含在所述第一预览图像中、但未包含在所述第一文字信息中的拍摄对象;所述第一预览图像中缺少的拍摄对象为:包含在所述第一文字信息中,但未包含在所述第一预览图像中的拍摄对象;或者所述第二预览图像中多余的拍摄对象为:包含在所述第二预览图像中、但未包含在所述第二文字信息中的拍摄对象;所述第二预览图像中缺少的拍摄对象为:包含在所述第二文字信息中,但未包含在所述第二预览图像中的拍摄对象。
- 如权利要求1-4任一所述的方法,其特征在于,所述第一提示信息显示在所述第一预览界面中;所述第二提示信息显示在所述第二预览界面中。
- 如权利要求1-5所述的方法,其特征在于,还包括:所述终端设备在所述第一预览界面显示所述第一文字信息。
- 如权利要求2-5所述的方法,其特征在于,还包括:所述终端设备在所述第二预览界面显示所述第二文字信息。
- 如权利要求6或7所述的方法,其特征在于,所述第一文字信息包括至少一个文字信息;或者所述第二文字信息包括至少一个文字信息。
- 如权利要求1-8任一所述的方法,其特征在于,还包括:所述终端设备在所述第一预览界面显示第一匹配度信息,所述第一匹配度信息用于指示所述第一文字信息和所述第一预览图像之间的匹配程度。
- 如权利要求2-9任一所述的方法,其特征在于,还包括:所述终端设备在所述第二预览界面显示第二匹配度信息,所述第二匹配度信息用于指示所述第二文字信息和所述第二预览图像之间的匹配程度。
- 如权利要求1-10任一所述的方法,其特征在于,所述方法还包括:所述终端设备在所述第一预览图像显示第一方向指示信息,所述第一方向指示信息用于提示用户按照指示的第一方向移动所述终端设备。
- 如权利要求2-11任一所述的方法,其特征在于,所述方法还包括:所述终端设备在所述第二预览图像显示第二方向指示信息,所述第二方向指示信息用于提示用户按照指示的第二方向移动所述终端设备。
- 如权利要求6-12任一所述的方法,其特征在于,所述第一预览图像中显示第二控件,所述第二控件用于触发显示文字信息的类型,所述方法还包括:所述终端设备响应于用户触发所述第二控件的操作,显示第一列表,所述第一列表中包含至少一种文字信息的类型;所述终端设备响应于用户选择第一类型的操作,显示第一文字信息,所述第一文字信息的类型为所述第一类型。
- 如权利要求1-13任一所述的方法,其特征在于,所述第一预览界面中包含第一拍摄控件,所述方法还包括:所述终端设备响应于用于触发所述第一拍摄控件的操作,得到两张第一拍摄图像,所述两张第一拍摄图像中的一张第一拍摄图像包含所述第一文字信息,另一张第一拍摄图像不包含所述第一文字信息。
- 如权利要求2-14任一所述的方法,其特征在于,所述第二预览界面中包含第二拍摄控件,所述方法还包括:所述终端设备响应于用于触发所述第二拍摄控件的操作,得到两张第二拍摄图像,所述两张第二拍摄图像中的一张第二拍摄图像包含所述第二文字信息,另一张第二拍摄图像不包含所述第二文字信息。
- 一种拍照方法,其特征在于,所述方法包括:终端设备接收第一操作;响应所述第一操作,所述终端设备启动相机;所述终端设备显示包括第一预览图像的第一预览界面,所述第一预览图像中包含至少一个拍摄对象;所述终端设备在所述第一预览界面中显示第一音乐的第一标识,所述第一音乐为所述终端设备根据所述第一预览图像中的至少一个拍摄对象匹配出的音乐,所述第一标识为文字或图标。
- 如权利要求16所述的方法,其特征在于,所述终端设备在所述第一预览界面中显示第一音乐的第一标识之后,还包括:所述终端设备接收第二操作;响应所述第二操作,所述终端设备显示包括第二预览图像的第二预览界面,所述第二预览图像与所述第一预览图像不同,所述第二预览图像中包含至少一个拍摄对象;所述终端设备在所述第二预览界面中显示第二音乐的第二标识,所述第二音乐与所述第一音乐不同,所述第二音乐为所述终端设备根据所述第二预览图像中的至少一个拍摄对象匹配出的音乐,所述第二标识为文字或图标。
- 如权利要求16所述的方法,其特征在于,所述第一预览界面中包含第一拍摄控件,所述方法还包括:所述终端设备响应于用于触发所述第一拍摄控件的操作,获得第一拍摄图像,所述第一拍摄图像为所述终端设备将所述第一音乐和所述第一预览图像合成的图像。
- 如权利要求17所述的方法,其特征在于,所述第二预览界面中包含第二拍摄控件,所述方法还包括:所述终端设备响应于用于触发所述第二拍摄控件的操作,获得第二拍摄图像,所述第二拍摄图像为所述终端设备将所述第二音乐和所述第二预览图像合成的图像。
- 如权利要求16-19任一所述的方法,其特征在于,所述方法还包括:所述终端设备响应于触发所述第一标识的操作,播放所述第一音乐。
- 如权利要求16-20任一所述的方法,其特征在于,所述第一预览图像中显示第二控件,所述第二控件用于触发显示音乐的类型,所述方法还包括:所述终端设备响应于用户触发所述第二控件的操作,显示第一列表,所述第一列表中包含至少一种音乐的类型;所述终端设备响应于用户选择第一类型的操作,显示所述第一音乐的所述第一标识,所述第一音乐的类型为所述第一类型。
- 一种终端设备,其特征在于,所述终端设备包括摄像头、显示屏、存储器和处理器,其中所述摄像头用于捕捉预览图像;所述显示屏上显示所述预览图像;所述存储器用于存储一个或多个计算机程序;当所述存储器存储的一个或多个计算机程序被所述处理器执行时,使得所述终端设备执行如权利要求1至15任一所述的方法。
- 一种终端设备,其特征在于,所述终端设备包括摄像头、显示屏、存储器和处理器,其中所述摄像头用于捕捉预览图像;所述显示屏上显示所述预览图像;所述存储器用于存储一个或多个计算机程序;当所述存储器存储的一个或多个计算机程序被所述处理器执行时,使得所述终端设备执行如权利要求16至22任一所述的方法。
- 一种计算机存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当计算机程序在终端设备上运行时,使得所述终端设备执行如权利要求1至15任一所述的方法。
- 一种计算机存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当计算机程序在终端设备上运行时,使得所述终端设备执行如权利要求16至22任一所述的方法。
- 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时, 使得所述计算机执行如权利要求1至15任一所述的方法。
- 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求16至22任一所述的方法。
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP19791992.1A EP3758358A4 (en) | 2018-04-28 | 2019-04-28 | PHOTOGRAPHIC PROCEDURE AND TERMINAL DEVICE |
JP2020560409A JP7074891B2 (ja) | 2018-04-28 | 2019-04-28 | 撮影方法及び端末装置 |
AU2019259066A AU2019259066B2 (en) | 2018-04-28 | 2019-04-28 | Photographic method and terminal device |
CN201980027660.XA CN112204942B (zh) | 2018-04-28 | 2019-04-28 | 一种拍照方法和终端设备 |
CN202210198006.9A CN114793267A (zh) | 2018-04-28 | 2019-04-28 | 一种拍照方法和终端设备 |
US17/047,653 US11470240B2 (en) | 2018-04-28 | 2019-04-28 | Method and terminal device for matching photgraphed objects and preset text imformation |
US17/898,186 US11863856B2 (en) | 2018-04-28 | 2022-08-29 | Method and terminal device for matching photographed objects and preset text information |
US18/365,735 US20240031665A1 (en) | 2018-04-28 | 2023-08-04 | Method and terminal device for matching photographed objects and preset text information |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNPCT/CN2018/085184 | 2018-04-28 | ||
PCT/CN2018/085184 WO2019205170A1 (zh) | 2018-04-28 | 2018-04-28 | 一种拍照方法和终端设备 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/047,653 A-371-Of-International US11470240B2 (en) | 2018-04-28 | 2019-04-28 | Method and terminal device for matching photgraphed objects and preset text imformation |
US17/898,186 Continuation US11863856B2 (en) | 2018-04-28 | 2022-08-29 | Method and terminal device for matching photographed objects and preset text information |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019206316A1 true WO2019206316A1 (zh) | 2019-10-31 |
Family
ID=68293468
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/085184 WO2019205170A1 (zh) | 2018-04-28 | 2018-04-28 | 一种拍照方法和终端设备 |
PCT/CN2019/084704 WO2019206316A1 (zh) | 2018-04-28 | 2019-04-28 | 一种拍照方法和终端设备 |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/085184 WO2019205170A1 (zh) | 2018-04-28 | 2018-04-28 | 一种拍照方法和终端设备 |
Country Status (6)
Country | Link |
---|---|
US (3) | US11470240B2 (zh) |
EP (1) | EP3758358A4 (zh) |
JP (1) | JP7074891B2 (zh) |
CN (2) | CN112204942B (zh) |
AU (1) | AU2019259066B2 (zh) |
WO (2) | WO2019205170A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111177420A (zh) * | 2019-12-31 | 2020-05-19 | 维沃移动通信有限公司 | 一种多媒体文件显示方法、电子设备及介质 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113473017A (zh) * | 2021-07-01 | 2021-10-01 | 北京字跳网络技术有限公司 | 一种图像处理方法、装置、设备及存储介质 |
CN113873165A (zh) * | 2021-10-25 | 2021-12-31 | 维沃移动通信有限公司 | 拍照方法、装置和电子设备 |
CN114500833B (zh) * | 2022-01-13 | 2024-02-02 | 西安维沃软件技术有限公司 | 拍摄方法、装置及电子设备 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013229680A (ja) * | 2012-04-24 | 2013-11-07 | Canon Inc | 撮像装置とその制御方法、プログラム |
CN104199876A (zh) * | 2014-08-20 | 2014-12-10 | 广州三星通信技术研究有限公司 | 关联乐曲与图片的方法和装置 |
CN107135351A (zh) * | 2017-04-01 | 2017-09-05 | 宇龙计算机通信科技(深圳)有限公司 | 拍照方法及拍照装置 |
CN107820013A (zh) * | 2017-11-24 | 2018-03-20 | 上海创功通讯技术有限公司 | 一种拍照方法及终端 |
CN107943842A (zh) * | 2017-10-31 | 2018-04-20 | 维沃移动通信有限公司 | 一种照片标签生成方法、移动终端 |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030039410A1 (en) * | 2001-08-23 | 2003-02-27 | Beeman Edward S. | System and method for facilitating image retrieval |
JP4086050B2 (ja) * | 2005-04-12 | 2008-05-14 | コニカミノルタビジネステクノロジーズ株式会社 | 情報管理プログラムおよび情報管理装置 |
JP5057918B2 (ja) * | 2007-09-28 | 2012-10-24 | 株式会社東芝 | 電子機器およびシーン種類表示方法 |
JP2009117973A (ja) * | 2007-11-02 | 2009-05-28 | Fujifilm Corp | 再生装置および再生方法 |
JP2010257215A (ja) | 2009-04-24 | 2010-11-11 | Nikon Corp | デジタルカメラ及び挿絵写真撮影/投稿プログラム |
CN101753716B (zh) * | 2009-11-20 | 2012-10-03 | 华为终端有限公司 | 终端及其摄像方法 |
JP2012094979A (ja) | 2010-10-25 | 2012-05-17 | Canon Inc | 撮影支援システム、情報処理装置、プログラム、撮影支援方法 |
TW201337641A (zh) * | 2012-03-15 | 2013-09-16 | Fih Hong Kong Ltd | 自拍提示系統及方法 |
CN103050025B (zh) * | 2012-12-20 | 2015-09-09 | 广东欧珀移动通信有限公司 | 一种移动终端的学习方法及其学习系统 |
CN103900712A (zh) | 2012-12-27 | 2014-07-02 | 杭州美盛红外光电技术有限公司 | 热像选择装置和热像选择方法 |
KR102078136B1 (ko) * | 2013-01-07 | 2020-02-17 | 삼성전자주식회사 | 오디오 데이터를 가지는 이미지를 촬영하기 위한 장치 및 방법 |
KR20160024002A (ko) * | 2014-08-21 | 2016-03-04 | 삼성전자주식회사 | 비쥬얼 사운드 이미지를 제공하는 방법 및 이를 구현하는 전자 장치 |
EP3217679B1 (en) | 2014-11-05 | 2020-05-13 | LG Electronics Inc. | Image output device, mobile terminal, and control method therefor |
CN104486552B (zh) * | 2014-12-29 | 2018-10-12 | 联想(北京)有限公司 | 一种获取图像的方法及电子设备 |
US9619701B2 (en) * | 2015-05-20 | 2017-04-11 | Xerox Corporation | Using motion tracking and image categorization for document indexing and validation |
CN105159958B (zh) * | 2015-08-20 | 2019-07-09 | 惠州Tcl移动通信有限公司 | 一种基于移动终端的图片信息处理的方法及系统 |
CN105159988B (zh) * | 2015-08-28 | 2018-08-21 | 广东小天才科技有限公司 | 一种浏览照片的方法及装置 |
CN105869198A (zh) * | 2015-12-14 | 2016-08-17 | 乐视移动智能信息技术(北京)有限公司 | 多媒体照片生成方法、装置、设备及手机 |
CN107026973B (zh) | 2016-02-02 | 2020-03-13 | 株式会社摩如富 | 图像处理装置、图像处理方法与摄影辅助器材 |
US9942473B2 (en) * | 2016-06-16 | 2018-04-10 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Apparatuses and methods for capture of expected data in visual media |
CN106055708A (zh) * | 2016-06-28 | 2016-10-26 | 广东欧珀移动通信有限公司 | 一种图片生成和展示方法、装置及终端设备 |
CN107562952A (zh) * | 2017-09-28 | 2018-01-09 | 上海传英信息技术有限公司 | 音乐匹配播放的方法、装置和终端 |
KR20190081701A (ko) * | 2017-12-29 | 2019-07-09 | 삼성전자주식회사 | 사진촬영에 음악을 링크하는 전자 장치 및 이의 제어 방법 |
-
2018
- 2018-04-28 WO PCT/CN2018/085184 patent/WO2019205170A1/zh active Application Filing
-
2019
- 2019-04-28 CN CN201980027660.XA patent/CN112204942B/zh active Active
- 2019-04-28 CN CN202210198006.9A patent/CN114793267A/zh active Pending
- 2019-04-28 AU AU2019259066A patent/AU2019259066B2/en active Active
- 2019-04-28 EP EP19791992.1A patent/EP3758358A4/en active Pending
- 2019-04-28 JP JP2020560409A patent/JP7074891B2/ja active Active
- 2019-04-28 WO PCT/CN2019/084704 patent/WO2019206316A1/zh unknown
- 2019-04-28 US US17/047,653 patent/US11470240B2/en active Active
-
2022
- 2022-08-29 US US17/898,186 patent/US11863856B2/en active Active
-
2023
- 2023-08-04 US US18/365,735 patent/US20240031665A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013229680A (ja) * | 2012-04-24 | 2013-11-07 | Canon Inc | 撮像装置とその制御方法、プログラム |
CN104199876A (zh) * | 2014-08-20 | 2014-12-10 | 广州三星通信技术研究有限公司 | 关联乐曲与图片的方法和装置 |
CN107135351A (zh) * | 2017-04-01 | 2017-09-05 | 宇龙计算机通信科技(深圳)有限公司 | 拍照方法及拍照装置 |
CN107943842A (zh) * | 2017-10-31 | 2018-04-20 | 维沃移动通信有限公司 | 一种照片标签生成方法、移动终端 |
CN107820013A (zh) * | 2017-11-24 | 2018-03-20 | 上海创功通讯技术有限公司 | 一种拍照方法及终端 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3758358A4 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111177420A (zh) * | 2019-12-31 | 2020-05-19 | 维沃移动通信有限公司 | 一种多媒体文件显示方法、电子设备及介质 |
CN111177420B (zh) * | 2019-12-31 | 2023-10-20 | 维沃移动通信有限公司 | 一种多媒体文件显示方法、电子设备及介质 |
Also Published As
Publication number | Publication date |
---|---|
US20230066116A1 (en) | 2023-03-02 |
US11470240B2 (en) | 2022-10-11 |
EP3758358A1 (en) | 2020-12-30 |
AU2019259066A1 (en) | 2020-10-15 |
CN112204942A (zh) | 2021-01-08 |
CN112204942B (zh) | 2022-03-11 |
AU2019259066B2 (en) | 2021-12-02 |
US20240031665A1 (en) | 2024-01-25 |
JP2021520163A (ja) | 2021-08-12 |
US11863856B2 (en) | 2024-01-02 |
EP3758358A4 (en) | 2021-08-11 |
US20210105400A1 (en) | 2021-04-08 |
CN114793267A (zh) | 2022-07-26 |
JP7074891B2 (ja) | 2022-05-24 |
WO2019205170A1 (zh) | 2019-10-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019206316A1 (zh) | 一种拍照方法和终端设备 | |
US10685059B2 (en) | Portable electronic device and method for generating a summary of video data | |
CN105512164B (zh) | 使用语音标签管理图像的方法和装置 | |
CN105094760B (zh) | 一种图片标记方法及装置 | |
CN110286976A (zh) | 界面显示方法、装置、终端及存储介质 | |
CN108886574B (zh) | 一种拍摄引导方法、设备及系统 | |
US11245933B2 (en) | Method and server for generating image data by using multiple cameras | |
JP2017532582A (ja) | オーディオカバー表示方法および装置 | |
JP2016537747A (ja) | リアルタイム・ビデオの提供方法、リアルタイム・ビデオの提供装置、サーバ、端末装置、プログラム及び記録媒体 | |
CN108062390B (zh) | 推荐用户的方法、装置和可读存储介质 | |
CN105653636A (zh) | 一种信息处理方法和装置、一种用于信息处理的装置 | |
CN112752121B (zh) | 一种视频封面生成方法及装置 | |
US20170171471A1 (en) | Method and device for generating multimedia picture and an electronic device | |
CN109257649B (zh) | 一种多媒体文件生成方法及终端设备 | |
CN112115282A (zh) | 基于搜索的问答方法、装置、设备及存储介质 | |
CN109151318A (zh) | 一种图像处理方法、装置及计算机存储介质 | |
CN112131438A (zh) | 一种信息生成的方法、信息展示的方法及装置 | |
CN114298883A (zh) | 图像处理方法、智能终端及存储介质 | |
WO2017193343A1 (zh) | 媒体文件分享方法、媒体文件分享设备及终端 | |
CN111586329A (zh) | 一种信息显示方法、装置及电子设备 | |
CN113325946A (zh) | 一种基于增强现实的虚拟礼物交互方法以及相关装置 | |
EP4141704A1 (en) | Method and apparatus for music generation, electronic device, storage medium | |
CN112911351B (zh) | 视频教程的展示方法、设备、系统及存储介质 | |
CN113132772B (zh) | 一种互动媒体的生成方法和装置 | |
CN105608104A (zh) | 图像添加方法、图像添加装置和终端 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19791992 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2019259066 Country of ref document: AU Date of ref document: 20190428 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2019791992 Country of ref document: EP Effective date: 20200925 |
|
ENP | Entry into the national phase |
Ref document number: 2020560409 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |