WO2014206274A1 - Method, apparatus and terminal device for processing multimedia photo-capture - Google Patents

Method, apparatus and terminal device for processing multimedia photo-capture Download PDF

Info

Publication number
WO2014206274A1
WO2014206274A1 PCT/CN2014/080612 CN2014080612W WO2014206274A1 WO 2014206274 A1 WO2014206274 A1 WO 2014206274A1 CN 2014080612 W CN2014080612 W CN 2014080612W WO 2014206274 A1 WO2014206274 A1 WO 2014206274A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
moving object
image
speed information
moving speed
Prior art date
Application number
PCT/CN2014/080612
Other languages
French (fr)
Inventor
Teng ZHANG
Yunsheng Wu
Yu Gao
Ding MA
Original Assignee
Tencent Technology (Shenzhen) Company Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology (Shenzhen) Company Limited filed Critical Tencent Technology (Shenzhen) Company Limited
Publication of WO2014206274A1 publication Critical patent/WO2014206274A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof

Definitions

  • the present disclosure generally relates to the field of computer application technology and, more particularly, relates to methods, apparatus, and terminal devices for processing multimedia photo-capture.
  • a camera apparatus can now be integrated in a module and be set in a mobile terminal such as a smart phone and a tablet computer, making it convenient for people to take pictures or videos anywhere and anytime as needed.
  • One aspect of the present disclosure includes methods for processing multimedia photo-capture.
  • a target moving object for speed calculation can be selected.
  • the target moving object can include one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture.
  • a speed-calculating module of the terminal can be called to calculate and obtain moving speed information of the target moving object. When an image captured by the terminal is received, the obtained moving speed information can be superimposed on the received image.
  • the method can further include the following process.
  • an image layer containing the moving speed information calculated by the speed-calculating module can be generated.
  • the generated image layer can be superimposed and displayed on the image preview of multimedia photo-capture, in real time.
  • the calculating of the moving speed information of the target moving object can include the following process. At least two previewing images containing the moving object can be obtained within a preset time interval. The moving speed information of the target moving object can be calculated, according to a position and a size of the moving object in each previewing image of the at least two previewing images, a standard size of the moving object, and a capturing direction of the terminal.
  • the calculating of the moving speed information of the target moving object can include the following process.
  • the moving speed information of the terminal can be calculated, according to global positioning system (GPS) data from a built-in GPS module or according to acceleration data from a built-in acceleration-calculating module, coupled with a system time of the terminal.
  • GPS global positioning system
  • the calculating of the moving speed information of the target moving object can include the following process.
  • a still object in the image preview of the current multimedia photo-capture can be identified.
  • At least two previewing images containing the still object can be obtained within a preset time interval.
  • the moving speed information of the terminal can be calculated, according to a position and a size of the still object in each previewing image of the at least two previewing images, a standard size of the still object, and a capturing direction of the terminal.
  • the superimposing of the obtained moving speed information on the received image can include the following process.
  • the target moving object corresponding to the obtained moving speed information can be analyzed and identified.
  • the moving speed information can be superimposed on the received image to display a moving speed of the corresponding target moving object.
  • Another aspect of the present disclosure includes a non-transient computer-readable storage medium.
  • the computer-readable storage medium can have a program stored thereon. When being executed, the program can cause the terminal to perform the method for processing multimedia photo-capture.
  • An exemplary apparatus can include a selecting module, a processing module, and a superimposing module.
  • the selecting module is configured to select a target moving object for speed calculation after detecting that a terminal is used for a multimedia photo-capture operation.
  • the target moving object can include one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture.
  • the processing module is configured to call a speed-calculating module of the terminal to calculate and obtain moving speed information of the target moving object.
  • the superimposing module is configured to, when an image captured by the terminal is received, superimpose the obtained moving speed information on the received image.
  • the apparatus can further include a previewing module.
  • the previewing module is configured to generate an image layer containing the moving speed information calculated by the speed-calculating module according to a preset superimposition rule, and superimpose and display the generated image layer on the image preview of multimedia photo-capture, in real time.
  • the processing module can include a first obtaining unit and a first processing unit.
  • the first obtaining unit is configured to obtain at least two previewing images containing the moving object within a preset time interval.
  • the first processing unit is configured to calculate the moving speed information of the target moving object, according to a position and a size of the moving object in each previewing image of the at least two previewing images, a standard size of the moving object, and a capturing direction of the terminal.
  • the processing module can include a turn-on unit and a second processing unit.
  • the turn-on unit is configured to trigger and turn on a built-in GPS module or a built-in acceleration-calculating module.
  • the second processing unit is configured to calculate the moving speed information of the terminal, according to GPS data from the built-in GPS module or according to acceleration data from the built-in acceleration- calculating module, coupled with a system time of the terminal.
  • the processing module can include an identifying unit, a second obtaining unit, and a third processing unit.
  • the identifying unit is configured to identify a still object in the image preview of the current multimedia photo-capture.
  • the second obtaining unit is configured to obtain at least two previewing images containing the still object within a preset time interval.
  • the third processing unit is configured to calculate the moving speed information of the terminal, according to a position and a size of the still object in each previewing image of the at least two previewing images, a standard size of the still object, and a capturing direction of the terminal.
  • the superimposing module can include an analyzing unit and a superimposing unit.
  • the analyzing unit is configured to, when the image captured by the terminal is received, analyze and identify the target moving object corresponding to the obtained moving speed information.
  • the superimposing unit is configured to superimpose the moving speed information on the received image to display a moving speed of the corresponding target moving object, according to the preset superimposition rule and a position of the target moving object in the received image.
  • An exemplary terminal device can include a camera apparatus and a processor.
  • the processor is configured to select a target moving object for speed calculation after detecting that the camera apparatus of the terminal device is used for a multimedia photo-capture operation.
  • the target moving object can include one or more of the terminal device and a moving object identified in an image preview of a current multimedia photo-capture.
  • the processor is further configured to call a speed-calculating module of the terminal device to calculate and obtain moving speed information of the target moving object and, when an image captured by the camera apparatus of the terminal device is received, superimpose the obtained moving speed information on the received image.
  • FIG. 1 depicts a flow diagram of an exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments
  • FIG. 2 depicts an exemplary image with superimposed moving speed information in accordance with various disclosed embodiments
  • FIG. 3 depicts a flow diagram of another exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments
  • FIG. 4 depicts a structure diagram of an exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments
  • FIG. 5 depicts a structure diagram of another exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments
  • FIG. 6 depicts a structure diagram of an exemplary processing module in accordance with various disclosed embodiments
  • FIG. 7 depicts a structure diagram of an exemplary superimposing module in accordance with various disclosed embodiments
  • FIG. 8 depicts a structure diagram of an exemplary mobile terminal in accordance with various disclosed embodiments.
  • FIG. 9 depicts an exemplary system for processing multimedia photo-capture in accordance with various disclosed embodiments.
  • FIG. 1 depicts a flow diagram of an exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments.
  • the disclosed methods can be implemented on an intelligent/smart terminal device having a camera function.
  • a terminal device can include, e.g., a smart phone, a tablet computer, a laptop computer, an e-reader, a wearable device, and any other appropriate device.
  • a 'terminal device' can also be referred to as a 'terminal'.
  • Step SI 01 when it is detected that a terminal is used for a multimedia photo- capture operation (i.e., after detecting that a terminal is used for a multimedia photo-capture operation), a target moving object for speed calculation is selected.
  • the target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo-capture.
  • an image preview can refer to a preview interface displayed on the terminal.
  • an image preview before or during the capturing of an image i.e., picture, photo, video
  • an 'image capture preview' or a 'capture image preview' An image preview displayed when a multimedia photo-capture operation is in progress can be referred to as 'image preview during multimedia photo-capture' or 'image preview of multimedia photo- capture' .
  • a preview interface can contain a previewing image, and/or any other appropriate information.
  • a previewing image displayed before or during the capturing of an image e.g., picture, photo, or video
  • a 'capture previewing image' can also be referred to as a 'capture previewing image' .
  • a user can choose to add a moving speed of the terminal to a to-be-captured image.
  • the user can choose to superimpose, onto the to-be-captured image, moving speed(s) of one or more moving objects in the to-be-captured image.
  • the user can choose to superimpose, onto the to-be-captured image, both of the moving speed(s) of one or more moving objects in the to-be- captured image and the moving speed of the terminal, which is not limited in the present disclosure.
  • superimposing certain information e.g., moving speed
  • an image refers to preparing a transparent (or semi-transparent) image layer containing the certain formation, and then placing the image layer over the image.
  • 'Superimpose' or 'superimposition' can also be referred to as Overlay'.
  • the image that is superimposed with the certain information can be a captured image or an image preview (or previewing image), which is not limited in the present disclosure.
  • the image layer containing moving speed is superimposed onto the image, how the image and the moving speed are displayed can be determined by one or more superimposition rules regarding superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters.
  • the text style of the moving speed can have a font that is opaque, and the text of the moving speed can thus cover the portion of the image located underneath the text.
  • the text style of the moving speed can have a font that is translucent (e.g., semi-transparent), and the portion of the image located underneath the text can show through the text of the moving speed to some degree.
  • the image layer containing the moving speed can be transparent or semi-transparent, colorless or colored, without limitation.
  • the terminal can provide a prompt message prompted to inquire the user about whether to superimpose a "terminal speed" or a "target speed", or both.
  • the selecting of the target moving object can be completed.
  • a corresponding calculation apparatus can subsequently be turned on to calculate a moving speed of the terminal, as shown in Step SI 02.
  • Step S 101 can further include determining the one or more moving objects in the image preview during the multimedia photo-capture.
  • one or more target moving objects can be selected for speed calculation, without limitation. After moving speed information is obtained subsequently, the moving speed information can correspond to the one or more target moving objects. That is, one or more sets of moving speed information can be obtained. Each set of moving speed information can correspond to one target moving object.
  • object(s) and background can be first distinguished in an image, e.g., a previewing image. Two adjacent images can be compared. The difference between the two images can be drawn. Thus, it can be determined which portion of the images is in motion. Accordingly, a moving object to be processed can be analyzed and obtained.
  • a moving object in a previewing image can be identified based on any appropriate moving-object image recognition technology.
  • both of a foreground attribute and a background attribute of previewing image(s) can be distinguished based on pixel difference between extracted multiple consecutively- captured previewing images, in order to obtain a position of a moving object in the previewing image(s).
  • the terminal can further prompt the user to specify which moving object for speed calculation.
  • the terminal can first identify moving object(s) in the previewing images, indicate the moving objects in the image preview, and then prompt the user to select the desired moving object in the image preview.
  • the terminal can first prompt the user to select the desired moving object in the image preview, e.g., by specifying a specific position corresponding to the desired moving object in the image preview. Next, by using an appropriate technique for image recognition, the terminal can identify the moving object in the previewing image that the user desires.
  • the terminal before the user captures and obtains an image by clicking on a 'capture' button (i.e., a shutter button) on a camera, when one or more consecutive previewing images need to be extracted for identifying moving object or still object for speed calculation, the terminal can automatically capture the consecutive previewing images backstage (i.e., automatically, without or with user instruction), store the previewing images in any appropriate temporary storage media, and process the previewing images.
  • a 'capture' button i.e., a shutter button
  • Step S 102 a speed-calculating module of the terminal is called, to calculate and obtain moving speed information of the target moving object.
  • moving speed information can refer to any appropriate information related to moving speed of the target moving object.
  • the moving speed information can include the moving speed.
  • the moving speed can be a vector and include direction of the speed, and/or magnitude (i.e., absolute value) of the speed.
  • the moving speed information can further include data used during the calculation of the moving speed depending on the actual process used for calculating the moving speed, e.g., acceleration, system time, angle and/or the capturing direction of the camera lens, size of the moving object in the image, and/or standard size of the moving object.
  • the target moving object can be the terminal, and the calculating of the moving speed can involve a still object in previewing images.
  • the moving speed information can further include one or more parameters corresponding to the still object, e.g., size of the still object in the image, and/or standard size of the still object.
  • a process for implementing the calculation of the moving object can include the following steps.
  • the 'target moving object' can also be referred to as an 'object', or a 'moving object'
  • a distance between the target moving object and the terminal can be measured via infrared, ultrasonic wave, or any other appropriate techniques.
  • a moving distance of the object from entering the field of view to leaving the field of view can be calculated.
  • an average moving speed of the object By using the moving distance, coupled with the system time of the terminal, an average moving speed of the object can be obtained.
  • the average moving speed can be used as the moving speed of the object.
  • the moving speed can be superimposed onto an image captured at any one time during the process of measuring and calculating.
  • 'coupling' a parameter e.g., distance, position, and/or acceleration
  • with the system time can refer to calculating using both the parameter and the system time in any appropriate way.
  • the obtaining of the moving speed of a moving object in an image can be implemented using the following process.
  • Two images can be extracted from capture preview, including 'Image A' and 'Image B' .
  • An extraction time interval between the two images can be 'Time'.
  • a position of the target moving object in the two images can be Position A and Position B, respectively.
  • the size of the target moving object in the two images can be Size_A and Size_B, respectively.
  • the standard size of the target moving object can be 'Size'.
  • a capturing direction of the camera lens can be 'Direction' .
  • the capturing direction of the camera lens can be obtained automatically using any appropriate method.
  • the capturing direction of the camera lens can be obtained via a built-in gravity sensor or built-in acceleration sensor on the terminal device.
  • a distance value between the target moving object and the camera lens in Image A can be obtained.
  • an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the target moving object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the target moving object in Image A is located can be referred to as 'Space Position A'.
  • the space position that the target moving object in Image B is located at can be calculated.
  • the space position that the target moving object in Image B is located can be referred to as 'Space Position B'.
  • distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
  • the standard size 'Size' involved in the above-described process can be obtained according to a database for researching various animals, and/or according to already-known size of various moving objects including, e.g., aircraft, automobile, and/or any other appropriate objects.
  • the standard size 'Size' of various types of moving objects can be preset in a database, set up in the terminal or at server-side, in order to be looked up and used during the calculating of a corresponding moving object.
  • the target moving object is the terminal itself
  • GPS global positioning system
  • the moving speed of the one or more moving objects and the moving speed of the terminal can be obtained by any appropriate method of calculation, which is not limited in the present disclosure.
  • space positions of a moving object in two images consecutively extracted from image preview can be calculated.
  • the space positions of the moving object can be expressed as locations on a sphere having the camera lens as the center.
  • the moving speed of the camera lens i.e., the center of the sphere
  • the moving speed of the moving object can be calculated based on the moving speed of the center of the sphere and the space positions of the moving object.
  • Step S 103 when an image captured by the terminal is received, the calculated moving speed information is superimposed on the received image. That is, when the user captures and obtains an image, e.g., by clicking on a 'capture' button (i.e., a shutter button) on a camera, and before storing the captured image, the obtained moving speed information can be superimposed upon the captured image. For example, via one or more superimposition rules regarding superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters, an image layer containing the moving speed information and an image layer containing the captured image can be processed and then superimposed, to obtain an image superimposed with the moving speed information.
  • a 'capture' button i.e., a shutter button
  • image(s) can include picture(s), and/or video(s).
  • the video can be processed based on frames of the video. That is, each frame of the video can be processed separately.
  • Step S I 03 can include the following exemplary process.
  • the target moving object respectively corresponding to each set of the calculated moving speed information can be analyzed and identified.
  • the various pieces of moving speed information can be superimposed upon the received image, to display the moving speed of the corresponding target moving object. That is, the moving speed information can be displayed at a position on the image corresponding to the target moving object.
  • FIG. 2 depicts an exemplary image with superimposed moving speed information in accordance with various disclosed embodiments.
  • a captured image contains a moving object, e.g., a flying bird.
  • the flying bird is selected as the target moving object for speed calculation, and thus moving speed information of the bird is displayed.
  • the moving speed of the bird is calculated to be 10 m/s, and is displayed at the top left corner of the image.
  • the moving speed information of the terminal e.g., a mobile terminal
  • the moving speed information of the mobile terminal can be superimposed on one or more of the four corners of an image, or any other appropriate positions on the image.
  • a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview during multimedia photo-capture. Further, the moving speed information can be superimposed on an image captured by the user. Thus, recording of moving speed during capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
  • FIG. 3 depicts a flow diagram of another exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments.
  • the disclosed methods can be implemented on an intelligent terminal device having a camera function.
  • a terminal device can include, e.g., a smart phone, a tablet computer, a laptop computer, an e-reader, a wearable device, or any other appropriate device.
  • the method can include the following exemplary steps.
  • Step S201 when it is detected that a terminal is used for a multimedia photo- capture operation, a target moving object for speed calculation is selected.
  • the target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo-capture operation.
  • the target moving object can be based on an object selected by a user during image capturing. Alternatively and optionally, it can be selected by default that a moving object in the capture image preview is to be used as the target moving object.
  • Step S202 a speed-calculating module of the terminal is called, to calculate and obtain moving speed information of the target moving object.
  • the calculating of the moving speed information of the target moving object can include the following exemplary steps. At least two previewing images containing the target moving object can be obtained within a preset time interval. In other words, the at least two previewing images containing the target moving object within a preset time interval can be obtained. According to a position and a size of the target moving object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal, the moving speed information of the target moving object can then be calculated.
  • a method for calculating the moving speed of the target moving object can include the following steps. Two images can be extracted from capture preview, including 'Image A' and 'Image B'. An extraction time interval between the two images can be 'Time'. A position of the target moving object in the two images can be Position_A and Position_B, respectively. The size of the target moving object in the two images can be Size_A and Size_B, respectively. The standard size of the target moving object can be ' Size' . A capturing direction of the camera lens can be 'Direction'.
  • a distance value between the target moving object and the camera lens in Image A can be obtained.
  • an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the target moving object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the target moving object in Image A is located at can be referred to as ' Space Position A' .
  • the space position that the target moving object in Image B is located at can be calculated, and can be referred to as 'Space Position B'.
  • the distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
  • the calculating of the moving speed information of the target moving object can include the following process. That is, according to GPS data from a built-in GPS module, or according to acceleration data from a built-in acceleration-calculating module, and coupling with the system time of the terminal, the moving speed information of the terminal can be calculated.
  • an acceleration value during the moving of the terminal can be obtained.
  • the moving speed of the terminal can be calculated.
  • the calculating of the moving speed information of the target moving object can include the following exemplary steps.
  • a still object in an image preview of multimedia photo- capture can be identified.
  • At least two previewing images containing the still object can be obtained within a preset time interval.
  • the moving speed information of the terminal can then be calculated.
  • a method for calculating the moving speed of the terminal can include the following steps.
  • Two images containing a still object can be extracted from capture preview, including 'Image A' and 'Image B ⁇
  • the still object can include an immovable stationary object including, e.g., a tree, a building, and/or any other appropriate object.
  • An extraction time interval between the two images can be 'Time'.
  • a position of the still object in the two images can be Position_A and Position_B, respectively.
  • the size of the still object in the two images can be Size A and Size B, respectively.
  • the standard size of the still object can be ' Size' .
  • a capturing direction of the camera lens can be 'Direction' .
  • a distance value between the still object and the camera lens in Image A can be obtained.
  • an angle that the still object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the still object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the still object in Image A is located can be referred to as ' Space Position A' .
  • the space position that the still object in Image B is located at can be calculated and can be referred to as ' Space Position B' .
  • the moving speed of the still object can be obtained. Because the still object is immovable, the 'moving speed of the still object' can refer to the moving speed of the terminal relative to the still object.
  • the standard size 'Size' involved in the above-described process can be obtained according to a database for researching various animals, and/or according to already-known size of various moving objects including, e.g., aircraft, automobile, and/or any other appropriate objects
  • the standard size 'Size' of various types of moving objects can be preset in a database, set up in the terminal or at server-side, in order to be looked up and used during the calculating of a corresponding moving object.
  • the still object to be used for speed calculation can be identified using any appropriate processes, without limitation. For example, object(s) and background can be first distinguished in an image. Two adjacent images can be compared. The difference between the two images can be drawn. Thus, it can be determined which portion of the images is still.
  • a still object used for speed calculation can be obtained.
  • a still object in a previewing image can be identified based on any appropriate image recognition technology.
  • both of a foreground attribute and a background attribute of previewing image(s) can be distinguished based on pixel difference between extracted multiple consecutive capture previewing images, in order to obtain a position of a still object in the previewing image(s).
  • the still object can be selected from certain objects in the background of the previewing images.
  • a still object e.g., a tree, a building, a hill, can be directly recognized and selected in one previewing image using appropriate image recognition technology.
  • the terminal can automatically select a specific still object to use for speed
  • the terminal can prompt the user to specify the still object for speed calculation.
  • the terminal can first identify still object(s) in the previewing images, indicate the still objects in the image preview, and then prompt the user to select the desired still object in the image preview.
  • the terminal can first prompt the user to select the desired still object in the image preview, e.g., by specifying a specific position corresponding to the desired still object in the image preview.
  • the terminal can identify the still object in the previewing image.
  • Step S203 an image layer containing the moving speed information calculated by the speed-calculating module is generated.
  • Step S204 the generated image layer containing the moving speed information calculated by the speed- calculating module is superimposed and displayed on the image preview during multimedia photo- capture.
  • an image layer containing the moving speed can be generated.
  • the image layer can be
  • the moving speed of the terminal or the moving object in an image may change.
  • the terminal can calculate the moving speed of the terminal or the moving object in real time by the process as described above (e.g., as shown in Step S202), and generate in real time an image layer containing the moving speed information to be superimposed on the image preview.
  • the moving speed of a target moving object calculated in real time can be referred to as the real-time moving speed of the target moving object.
  • Step S205 when an image captured by the terminal is received, the calculated moving speed information is superimposed on the received image. That is, after an image is captured and obtained by the user, the image layer containing moving speed information at moment of capturing can be superimposed upon the captured image. Next, the image superimposed with the moving speed information can be stored according to a specified path.
  • a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or a moving object in an image preview of multimedia photo-capture.
  • the moving speed information can be previewed and displayed on a capture previewing image in real time, for a user to view.
  • the recording of moving speed during capturing can be accomplished in a relatively timely and accurate manner. Users' needs of intelligent and automated image recording can thus be met.
  • various embodiments also provide a computer-readable storage medium.
  • the computer-readable storage medium can store a program.
  • the program can instruct a computer system to implement the methods for processing multimedia photo-capture as described in accordance with various embodiments, e.g., as shown in FIGS. 1-3.
  • FIG. 4 depicts a structure diagram of an exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments.
  • the disclosed apparatus can be implemented on an intelligent terminal device having a camera function.
  • a terminal device can include, e.g., a smart phone, a tablet computer, a laptop computer, an e- reader, a wearable device, and any other appropriate device.
  • the apparatus can include a selecting module 1 1, a processing module 12, and/or a superimposing module 13. Certain modules may be omitted and other modules may be included.
  • the selecting module 1 1 is configured to, when it is detected that a terminal is used for a multimedia photo-capture operation, select a target moving object for speed calculation.
  • the target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo-capture.
  • the processing module 12 is configured to call a speed-calculating module of the terminal, to calculate and obtain moving speed information of the target moving object.
  • the superimposing module 13 is configured to, when an image captured by the terminal is received, superimpose the calculated moving speed information on the received image.
  • a user can choose to add a moving speed of the terminal to a to-be-captured image Alternatively and optionally, the user can choose to superimpose, onto the to-be-captured image, moving speed(s) of one or more moving objects in the to-be-captured image.
  • the selecting module 11 can provide a prompt message prompted to inquire the user about whether to superimpose a "terminal speed" or a "target speed”.
  • the selecting module 1 1 can select to determine that the terminal is the target moving object. The selecting of the target moving object can thus be completed.
  • the selecting module 11 needs to distinguish and determine the one or more moving objects from the image preview during the multimedia photo-capture.
  • the selecting module 11 can identify a moving object in a previewing image based on any appropriate moving-object image recognition technology.
  • both of a foreground attribute and a background attribute of previewing image(s) can be distinguished based on pixel difference between extracted multiple consecutive capture previewing images, in order to obtain a position of a moving object in the previewing image(s).
  • a process for calculating the moving object can include the following steps. Two images can be extracted from capture preview, including 'Image A' and 'Image B'. An extraction time interval between the two images can be 'Time'. A position of the target moving object in the two images can be Position_A and Position_B, respectively. The size of the target moving object in the two images can be Size A and Size B, respectively. The standard size of the target moving object can be ' Size' . A capturing direction of the camera lens can be 'Direction' .
  • a distance value between the target moving object and the camera lens in Image A can be obtained.
  • an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the target moving object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the target moving object in Image A is located at can be referred to as ' Space Position A' .
  • the space position that the target moving object in Image B is located at can be calculated and can be referred to as 'Space Position B'.
  • distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
  • the processing module 12 can obtain the moving speed of the terminal by triggering to obtain GPS data of the terminal or acceleration data of the terminal, and coupling with the system time of the terminal.
  • the superimposing module 13 can, when the user captures and obtains an image by clicking on a 'capture' button on a camera, and before storing the captured image, superimpose the obtained moving speed information on the captured image. For example, via one or more superimposition rules of superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters, an image layer containing the moving speed information and an image layer containing the captured image can be processed and then superimposed, to obtain an image superimposed with the moving speed information.
  • image(s) can include picture(s), and/or video(s).
  • the video can be processed based on picture frames of the video. That is, each frame of the video can be processed separately.
  • a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview during multimedia photo-capture. Further, the moving speed information can be superimposed on an image captured by the user. Thus, recording of moving speed during capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
  • FIG. 5 depicts a structure diagram of another exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments.
  • the apparatus can include a selecting module 11, a processing module 12, and/or a superimposing module 13 as described in various embodiments, e.g., as shown in FIG. 4.
  • the apparatus can further include a previewing module 14.
  • the previewing module 14 is configured to generate an image layer containing the moving speed information calculated by the speed-calculating module, according to a preset superimposition rule.
  • the previewing module 14 is further configured to superimpose and display the generated image layer containing the moving speed information calculated by the speed- calculating module on the image preview during multimedia photo-capture.
  • the previewing module 14 can generate an image layer containing the moving speed, and then superimpose and display the image layer on a previewing image, to be displayed to the user in real time.
  • the moving speed of the terminal or the moving object in an image may change.
  • the terminal can calculate the moving speed of the terminal or the moving object in real time via the processing module 12, and the previewing module 14 can generate in real time an image layer containing the moving speed information, to be superimposed on the image preview.
  • FIG. 6 depicts a structure diagram of an exemplary processing module in accordance with various disclosed embodiments.
  • the processing module 12 can include a first obtaining unit 121 and a first processing unit 122. Certain units may be omitted and other units may be included.
  • the first obtaining unit 121 is configured to obtain at least two previewing images containing the target moving object within a preset time interval.
  • the first processing unit 122 is configured to calculate the moving speed information of the target moving object, according to a position and a size of the target moving object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal.
  • the first processing unit 122 can calculate the moving speed of the target moving object using a following process.
  • Two images can be extracted from capture preview, including 'Image A' and 'Image B' .
  • An extraction time interval between the two images can be 'Time'.
  • a position of the target moving object in the two images can be Position A and Position B, respectively.
  • the size of the target moving object in the two images can be Size_A and Size_B, respectively.
  • the standard size of the target moving object can be 'Size'.
  • a capturing direction of the camera lens can be 'Direction' .
  • a distance value between the target moving object and the camera lens in Image A can be obtained.
  • an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the target moving object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the target moving object in Image A is located at can be referred to as ' Space Position A' .
  • the space position that the target moving object in Image B is located at can be calculated and can be referred to as 'Space Position B'.
  • distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
  • the standard size 'Size' involved in the above-described process can be obtained according to a database for researching various animals, and/or according to already-known size of various moving objects including, e.g., aircraft, automobile, and/or any other appropriate objects.
  • the standard size 'Size' of various types of moving objects can be preset in a database, set up in the terminal or at server-side, in order to be looked up and used during the calculating of a corresponding moving object.
  • the processing module 12 can include a turn-on unit 123, and a second processing unit 124. Certain units may be omitted and other units may be included.
  • the turn-on unit 123 is configured to trigger and turn on a built-in GPS module or a built-in acceleration-calculating module.
  • the second processing unit 124 is configured to calculate the moving speed information of the terminal, according to GPS data from the built-in GPS module or acceleration data from the built-in acceleration-calculating module, coupled with the system time of the terminal.
  • the second processing unit 124 can calculate the moving speed information using a following process. Based on the built-in GPS module, coordinate(s) of various positions during the moving of the terminal can be obtained. Next, a moving distance can be determined according to the coordinates of the positions. Then, according to time value (i.e., time information, e.g., obtained from the system time of the terminal), the moving speed of the terminal can be calculated.
  • time value i.e., time information, e.g., obtained from the system time of the terminal
  • an acceleration value during the moving of the terminal can be obtained.
  • the moving speed of the terminal can be calculated.
  • the processing module 12 can include an identifying unit 125, a second obtaining unit 126, and/or a third processing unit 127. Certain units may be omitted and other units may be included.
  • the identifying unit 125 is configured to identify a still object in an image preview of multimedia photo-capture.
  • the second obtaining unit 126 is configured to obtain at least two previewing images containing the still object within a preset time interval.
  • the third processing unit 127 is configured to calculate the moving speed information of the terminal according to a position and a size of the still object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal.
  • the processing module 12 can simultaneously include the turn-on unit 123, the second processing unit 124, the identifying unit 125, the second obtaining unit 126, and the third processing unit 127.
  • various units can be switched at any time according to the needs of the user, to calculate the moving speed information of the target moving object. That is, the user can switch between various methods for calculating the moving speed information of the target moving object according to actual needs.
  • FIG. 7 depicts a structure diagram of an exemplary superimposing module in accordance with various disclosed embodiments.
  • the superimposing module 13 can include an analyzing unit 131, and/or a superimposing unit 132.
  • the analyzing unit 131 is configured to, when an image captured by the terminal is received, the target moving object respectively corresponding to each set of the calculated moving speed information can be analyzed and identified.
  • the superimposing unit 132 is configured to superimpose the various sets of moving speed information upon the received image to display the moving speed of the corresponding target moving objects, according to a preset superimposition rule and positions of various target moving objects in the received image.
  • a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview of multimedia photo-capture. Further, the moving speed information can be previewed and displayed in real time on a capture previewing image for the user to view, such that the moving speed information can be subsequently superimposed on an image captured by the user. Thus, recording of moving speed during multimedia capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
  • FIG. 8 depicts a structure diagram of an exemplary mobile terminal in accordance with various disclosed embodiments.
  • a mobile terminal according to various disclosed embodiments is a structure diagram of an exemplary mobile terminal in accordance with various disclosed embodiments.
  • the mobile terminal 800 can include a camera apparatus 801 and a processor 802.
  • the mobile terminal 800 may further include an optional GPS module and/or an acceleration-calculating module 803, a storage medium 804, a monitor 806, a communication module 808, a database 810, peripherals 812, and one or more bus 814 to couple the devices together. Certain components may be omitted and other components may be included.
  • the disclosed methods can be implemented on any appropriate computer system, not limited to a mobile terminal. Accordingly, the mobile terminal 800 as depicted in FIG. 8 can be an appropriate computer system for implementing the disclosed methods, without limitation.
  • the camera apparatus 801 is configured to implement multimedia photo-capture operations including capturing image(s) and any other appropriate functions applicable to a camera.
  • the processor 802 can include any appropriate processor or processors. Further, the processor 802 can include multiple cores for multi-thread or parallel processing. For example, the processor 802 is configured to, when it is detected that a terminal is used for a multimedia photo-capture operation, select a target moving object for speed calculation.
  • the target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo- capture.
  • the processor 802 is further configured to, when an image captured by the terminal is received, superimpose the calculated moving speed information on the received image.
  • the processor 802 can contain a speed-calculating module.
  • the storage medium 804 may include memory modules, e.g., Read-Only Memory (ROM), Random Access Memory (RAM), and flash memory modules, and mass storages, e.g., CD- ROM, U-disk, removable hard disk, etc.
  • the storage medium 804 may store computer programs for implementing various processes (e.g., calculating moving speed, etc.), when executed by the processor 802.
  • the storage medium 804 may store images captured according to user's instruction or images captured backstage for calculating moving speed.
  • the monitor 806 may include display devices for displaying contents in the terminal 800, e.g., displaying a previewing image or captured image.
  • the peripherals 812 may include I/O devices such as function buttons (such as shutter button for camera operation), keyboard, and mouse.
  • the peripherals 812 can further include various sensors including, e.g., sensor for detecting capturing direction of the camera apparatus 801, gravity sensor, acceleration sensor, etc.
  • the communication module 808 may include network devices for establishing network connections through a communication network, and optionally exchange data/information with a server-side computer.
  • the communication network may include the Internet or other types of computer networks or telecommunication networks, either wired or wireless.
  • the database 810 may include one or more databases for storing certain data and for performing certain operations on the stored data, e.g., storing database containing standard size of objects, storing realtime data, storing mathematical calculation programs, etc.
  • the mobile terminal 800 may optionally include a GPS module and/or an
  • acceleration-calculating module 803 to obtain coordinate(s) of the position of the mobile terminal and/or acceleration information during the moving of the mobile terminal, such that the processor 1 can calculate and obtain the moving speed information of the mobile terminal itself.
  • the processor 802 can implement the methods for processing multimedia photo-capture as described in accordance with various embodiments, e.g., as shown in FIGS. 1-3.
  • a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview of multimedia photo-capture. Further, the moving speed information can be previewed and displayed in real time on a capture previewing image for the user to view, such that the moving speed information can be subsequently superimposed on an image captured by the user. Thus, recording of moving speed during multimedia capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met. [00121] In certain embodiments, during capturing an image by a user, current moving speeds of various objects can be obtained in real time via a speed-calculating module of a terminal. Further, during capturing an image by the user, the moving speed of each of the various objects can be respectively displayed at appropriate positions on the captured image.
  • a process for calculating the moving speed of a target moving object can include the following steps. Two images can be taken consecutively, including 'Image A' and 'Image B' . A time interval between taking the two images can be 'Time'. A position of the target moving object in the two images can be Position_A and Position_B, respectively. The size of the target moving object in the two images can be Size_A and Size_B, respectively. The standard size of the target moving object can be ' Size' . A capturing direction of the camera lens can be 'Direction' .
  • a distance value between the target moving object and the camera lens in Image A can be obtained.
  • an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the target moving object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the target moving object in Image A is located can be referred to as 'Space Position A'.
  • the space position that the target moving object in Image B is located at can be calculated and can be referred to as 'Space Position B'.
  • the distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
  • the selected target moving object for speed calculation is the camera apparatus.
  • a process for calculating the moving speed of the terminal can include the following steps. Two images containing a still object can be extracted from capture preview, including 'Image A' and 'Image B' .
  • a user can take two images for a still object.
  • a time interval between taking the two images can be 'Time'.
  • a position of the still object in the two images can be Position_A and Position_B, respectively.
  • the size of the still object in the two images can be Size_A and Size_B, respectively.
  • the standard size of the still object can be ' Size' .
  • a capturing direction of the camera lens can be 'Direction'.
  • a distance value between the still object and the camera lens in Image A can be obtained.
  • an angle that the still object is located at on a sphere having the camera lens as the center, in Image A can be calculated.
  • the position in space that the still object in Image A is located at can be calculated.
  • the space position can include the distance value and the angle.
  • the space position that the still object in Image A is located at can be referred to as 'Space Position A' .
  • the space position that the still object in Image B is located at can be calculated and can be referred to as ' Space Position B' .
  • the distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the camera apparatus can be obtained.
  • FIG. 9 depicts an exemplary system for processing multimedia photo-capture in accordance with various disclosed embodiments.
  • the system can include a general-photo-generating apparatus, a speed-generating module, a camera-apparatus-self-speed-generating module, a capture- target-object- speed-generating module, and/or a photo-and-information-synthesizing module.
  • the general-photo-generating apparatus is configured to generate static photo data by acquiring visual information in lens via hardware.
  • the general-photo-generating apparatus can be independent hardware, such as a camera.
  • the general-photo-generating apparatus can be software integrated with hardware, such as photo-taking application on a mobile device.
  • the speed-generating module is configured to obtain speed of various objects by using a hardware device or algorithm.
  • the speed-generating module can contain the camera- apparatus-self-speed-generating module, and/or the capture-target-object-speed-generating module.
  • the camera-apparatus-self-speed-generating module is configured to directly read the moving speed of the camera apparatus itself, according to built-in hardware in the camera apparatus, such as a GPS, and an accelerometer.
  • the camera-apparatus-self-speed-generating module can indirectly generate the moving speed of the camera apparatus itself, according to an algorithm for generating the moving speed of the camera apparatus itself.
  • the camera apparatus can be a mobile camera apparatus.
  • the capture-target-object-speed-generating module is configured to indirectly generate the moving speed of a target moving object, according to an algorithm for generating the moving speed of the target moving object.
  • the photo-and-information-synthesizing module is configured to analyze positions on the photo for superimposing the various speeds (for one or more objects), based on the original photo data and by image recognition.
  • the photo-and-information- synthesizing module can then superimpose the speed(s) on the photo via appropriate technical means (e.g., as disclosed in various embodiments), to generate photo data after the superimposing.
  • the process implemented on the system can include the following exemplary steps.
  • Photo data can be generated via the general-photo-generating apparatus.
  • Original data needed by the algorithm for generating speed can be generated.
  • speed information can be generated via the speed-generating module.
  • photo data superimposed with the speed information can be generated.
  • Part or all of the steps in the methods in accordance with various embodiments can be accomplished using a program/software to instruct related hardware.
  • instructions can be stored on a terminal to implement a method for processing multimedia photo-capture.
  • the program/software can be stored in a (non-transitory) computer-readable storage medium on a terminal.
  • the program/software can be executed by at least one processor on the terminal, to implement the steps in the methods in accordance with various embodiments.
  • the computer-readable storage medium can include, e.g., ROM/RAM, magnetic disk, optical disk, etc.
  • the disclosed methods, apparatus, and terminal devices for processing multimedia photo-capture can be used in a variety of multimedia applications that involve camera technology.
  • the multimedia applications can include, but are not limited to, digital photography, digital photo/video recording/playback/broadcasting, digital surveillance, data collection for any subjects that requires speed information (e.g., sports and transportation).
  • a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal and/or to calculate moving speed information of one or more moving objects in an image preview during multimedia photo-capture.
  • the moving speed information can be previewed and displayed on a previewing image in real time, for a user to view.
  • the moving speed information can be superimposed on an image captured by the user.
  • recording of moving speed during photo-capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.

Abstract

Methods,apparatus,and terminal devices for processing multimedia photo-capture are provided herein.In an exemplary method,after detecting that a terminal is used for a multimedia photo-capture operation,a target moving object for speed calculation can be selected. The target moving object can include one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture.A speed- calculating module of the terminal can be called to calculate and obtain moving speed information of the target moving object. When an image captured by the terminal is received, the obtained moving speed information can be superimposed on the received image.

Description

METHOD, APPARATUS AND TERMINAL DEVICE FOR PROCESSING MULTIMEDIA PHOTO-CAPTURE
CRO S S-REFERENCES TO RELATED APPLICATIONS
[0001] This application claims priority to Chinese Patent Application No. 201310253078. X, filed on June 24, 2013, the entire contents of which are incorporated herein by reference.
FIELD OF THE DISCLO SURE
[0002] The present disclosure generally relates to the field of computer application technology and, more particularly, relates to methods, apparatus, and terminal devices for processing multimedia photo-capture.
BACKGROUND
[0003] With the development of electronic technology, a camera apparatus can now be integrated in a module and be set in a mobile terminal such as a smart phone and a tablet computer, making it convenient for people to take pictures or videos anywhere and anytime as needed.
Highlights of people's work and life can thus be recorded, and people's daily needs can be met.
[0004] Conventionally, after a user captures an image or images (i.e., a picture or a video), according to actual needs, the user can usually add a capture time of the image and certain text description about the image to the captured image, by using an image processing software on a personal computer. Accordingly, the user needs to process an image via the relevant, installed image processing software after the image is captured. Such an operation is complex for some users. In addition, real-time information, such as speed of a moving object at the capturing moment, cannot be added or recorded to the captured image.
BRIEF SUMMARY OF THE DISCLO SURE
[0005] One aspect of the present disclosure includes methods for processing multimedia photo-capture. In an exemplary method, after detecting that a terminal is used for a multimedia photo-capture operation, a target moving object for speed calculation can be selected. The target moving object can include one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture. A speed-calculating module of the terminal can be called to calculate and obtain moving speed information of the target moving object. When an image captured by the terminal is received, the obtained moving speed information can be superimposed on the received image.
[0006] After calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the method can further include the following process. According to a preset superimposition rule, an image layer containing the moving speed information calculated by the speed-calculating module can be generated. The generated image layer can be superimposed and displayed on the image preview of multimedia photo-capture, in real time.
[0007] When the selected target moving object is the moving object identified in the image preview of the current multimedia photo-capture, during step of calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object can include the following process. At least two previewing images containing the moving object can be obtained within a preset time interval. The moving speed information of the target moving object can be calculated, according to a position and a size of the moving object in each previewing image of the at least two previewing images, a standard size of the moving object, and a capturing direction of the terminal.
[0008] When the selected target moving object is the terminal, during step of calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object can include the following process. The moving speed information of the terminal can be calculated, according to global positioning system (GPS) data from a built-in GPS module or according to acceleration data from a built-in acceleration-calculating module, coupled with a system time of the terminal.
[0009] When the selected target moving object is the terminal, during step of calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object can include the following process. A still object in the image preview of the current multimedia photo-capture can be identified. At least two previewing images containing the still object can be obtained within a preset time interval. The moving speed information of the terminal can be calculated, according to a position and a size of the still object in each previewing image of the at least two previewing images, a standard size of the still object, and a capturing direction of the terminal.
[0010] When the image captured by the terminal is received, the superimposing of the obtained moving speed information on the received image can include the following process. When the image captured by the terminal is received, the target moving object corresponding to the obtained moving speed information can be analyzed and identified. According to the preset superimposition rule and a position of the target moving object in the received image, the moving speed information can be superimposed on the received image to display a moving speed of the corresponding target moving object.
[0011] Another aspect of the present disclosure includes a non-transient computer-readable storage medium. The computer-readable storage medium can have a program stored thereon. When being executed, the program can cause the terminal to perform the method for processing multimedia photo-capture.
[0012] Another aspect of the present disclosure includes apparatus for processing multimedia photo-capture. An exemplary apparatus can include a selecting module, a processing module, and a superimposing module. The selecting module is configured to select a target moving object for speed calculation after detecting that a terminal is used for a multimedia photo-capture operation. The target moving object can include one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture. The processing module is configured to call a speed-calculating module of the terminal to calculate and obtain moving speed information of the target moving object. The superimposing module is configured to, when an image captured by the terminal is received, superimpose the obtained moving speed information on the received image.
[0013] The apparatus can further include a previewing module. The previewing module is configured to generate an image layer containing the moving speed information calculated by the speed-calculating module according to a preset superimposition rule, and superimpose and display the generated image layer on the image preview of multimedia photo-capture, in real time.
[0014] When the selected target moving object is the moving object identified in the image preview of the current multimedia photo-capture, the processing module can include a first obtaining unit and a first processing unit. The first obtaining unit is configured to obtain at least two previewing images containing the moving object within a preset time interval. The first processing unit is configured to calculate the moving speed information of the target moving object, according to a position and a size of the moving object in each previewing image of the at least two previewing images, a standard size of the moving object, and a capturing direction of the terminal.
[0015] When the selected target moving object is the terminal, the processing module can include a turn-on unit and a second processing unit. The turn-on unit is configured to trigger and turn on a built-in GPS module or a built-in acceleration-calculating module. The second processing unit is configured to calculate the moving speed information of the terminal, according to GPS data from the built-in GPS module or according to acceleration data from the built-in acceleration- calculating module, coupled with a system time of the terminal.
[0016] When the selected target moving object is the terminal, the processing module can include an identifying unit, a second obtaining unit, and a third processing unit. The identifying unit is configured to identify a still object in the image preview of the current multimedia photo-capture. The second obtaining unit is configured to obtain at least two previewing images containing the still object within a preset time interval. The third processing unit is configured to calculate the moving speed information of the terminal, according to a position and a size of the still object in each previewing image of the at least two previewing images, a standard size of the still object, and a capturing direction of the terminal. [0017] The superimposing module can include an analyzing unit and a superimposing unit. The analyzing unit is configured to, when the image captured by the terminal is received, analyze and identify the target moving object corresponding to the obtained moving speed information. The superimposing unit is configured to superimpose the moving speed information on the received image to display a moving speed of the corresponding target moving object, according to the preset superimposition rule and a position of the target moving object in the received image.
[0018] Another aspect of the present disclosure includes terminal devices. An exemplary terminal device can include a camera apparatus and a processor. The processor is configured to select a target moving object for speed calculation after detecting that the camera apparatus of the terminal device is used for a multimedia photo-capture operation. The target moving object can include one or more of the terminal device and a moving object identified in an image preview of a current multimedia photo-capture. The processor is further configured to call a speed-calculating module of the terminal device to calculate and obtain moving speed information of the target moving object and, when an image captured by the camera apparatus of the terminal device is received, superimpose the obtained moving speed information on the received image.
[0019] Other aspects of the present disclosure can be understood by those skilled in the art in light of the description, the claims, and the drawings of the present disclosure.
BRIEF DE SCRIPTION OF THE DRAWINGS
[0020] The following drawings are merely examples for illustrative purposes according to various disclosed embodiments and are not intended to limit the scope of the disclosure.
[0021] FIG. 1 depicts a flow diagram of an exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments;
[0022] FIG. 2 depicts an exemplary image with superimposed moving speed information in accordance with various disclosed embodiments;
[0023] FIG. 3 depicts a flow diagram of another exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments;
[0024] FIG. 4 depicts a structure diagram of an exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments;
[0025] FIG. 5 depicts a structure diagram of another exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments;
[0026] FIG. 6 depicts a structure diagram of an exemplary processing module in accordance with various disclosed embodiments,
[0027] FIG. 7 depicts a structure diagram of an exemplary superimposing module in accordance with various disclosed embodiments;
[0028] FIG. 8 depicts a structure diagram of an exemplary mobile terminal in accordance with various disclosed embodiments; and [0029] FIG. 9 depicts an exemplary system for processing multimedia photo-capture in accordance with various disclosed embodiments.
DETAILED DES CRIPTION
[0030] Reference will now be made in detail to exemplary embodiments of the disclosure, which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
[0031] Various embodiments provide methods, apparatus, and terminal devices for processing multimedia photo-capture. FIG. 1 depicts a flow diagram of an exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments. The disclosed methods can be implemented on an intelligent/smart terminal device having a camera function. Such a terminal device can include, e.g., a smart phone, a tablet computer, a laptop computer, an e-reader, a wearable device, and any other appropriate device. As used herein, a 'terminal device' can also be referred to as a 'terminal'.
[0032] In Step SI 01, when it is detected that a terminal is used for a multimedia photo- capture operation (i.e., after detecting that a terminal is used for a multimedia photo-capture operation), a target moving object for speed calculation is selected. The target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo-capture.
[0033] As used herein, an image preview can refer to a preview interface displayed on the terminal. As used herein, an image preview before or during the capturing of an image (i.e., picture, photo, video) can also be referred to as an 'image capture preview' or a 'capture image preview' . An image preview displayed when a multimedia photo-capture operation is in progress can be referred to as 'image preview during multimedia photo-capture' or 'image preview of multimedia photo- capture' .
[0034] A preview interface can contain a previewing image, and/or any other appropriate information. As used herein, a previewing image displayed before or during the capturing of an image (e.g., picture, photo, or video) can also be referred to as a 'capture previewing image' .
[0035] When a camera apparatus on the terminal is turned on for multimedia photo-capture, a user can choose to add a moving speed of the terminal to a to-be-captured image. Alternatively, the user can choose to superimpose, onto the to-be-captured image, moving speed(s) of one or more moving objects in the to-be-captured image. In addition, the user can choose to superimpose, onto the to-be-captured image, both of the moving speed(s) of one or more moving objects in the to-be- captured image and the moving speed of the terminal, which is not limited in the present disclosure.
[0036] As used herein, superimposing certain information, e.g., moving speed, onto an image refers to preparing a transparent (or semi-transparent) image layer containing the certain formation, and then placing the image layer over the image. 'Superimpose' or 'superimposition' can also be referred to as Overlay'. The image that is superimposed with the certain information can be a captured image or an image preview (or previewing image), which is not limited in the present disclosure.
[0037] When the image layer containing moving speed is superimposed onto the image, how the image and the moving speed are displayed can be determined by one or more superimposition rules regarding superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters. In one example, by adjusting the superimposition transparency, the text style of the moving speed can have a font that is opaque, and the text of the moving speed can thus cover the portion of the image located underneath the text. In another example, by adjusting the superimposition transparency, the text style of the moving speed can have a font that is translucent (e.g., semi-transparent), and the portion of the image located underneath the text can show through the text of the moving speed to some degree. Further, the image layer containing the moving speed can be transparent or semi-transparent, colorless or colored, without limitation.
[0038] For example, when the camera apparatus is turned on and enters an image capture preview, the terminal can provide a prompt message prompted to inquire the user about whether to superimpose a "terminal speed" or a "target speed", or both.
[0039] In one embodiment, when the user selects to superimpose (i.e., overlay) the "terminal speed", the selecting of the target moving object can be completed. A corresponding calculation apparatus can subsequently be turned on to calculate a moving speed of the terminal, as shown in Step SI 02.
[0040] In another embodiment, when the user selects to superimpose the "target speed", Step S 101 can further include determining the one or more moving objects in the image preview during the multimedia photo-capture. In various embodiments, when the user selects to superimpose the "target speed", one or more target moving objects can be selected for speed calculation, without limitation. After moving speed information is obtained subsequently, the moving speed information can correspond to the one or more target moving objects. That is, one or more sets of moving speed information can be obtained. Each set of moving speed information can correspond to one target moving object.
[0041] For example, object(s) and background can be first distinguished in an image, e.g., a previewing image. Two adjacent images can be compared. The difference between the two images can be drawn. Thus, it can be determined which portion of the images is in motion. Accordingly, a moving object to be processed can be analyzed and obtained. In certain examples, a moving object in a previewing image can be identified based on any appropriate moving-object image recognition technology. In one example, both of a foreground attribute and a background attribute of previewing image(s) can be distinguished based on pixel difference between extracted multiple consecutively- captured previewing images, in order to obtain a position of a moving object in the previewing image(s).
[0042] Optionally, when the user selects to superimpose the "target speed", the terminal can further prompt the user to specify which moving object for speed calculation. In one example, the terminal can first identify moving object(s) in the previewing images, indicate the moving objects in the image preview, and then prompt the user to select the desired moving object in the image preview.
[0043] In another example, the terminal can first prompt the user to select the desired moving object in the image preview, e.g., by specifying a specific position corresponding to the desired moving object in the image preview. Next, by using an appropriate technique for image recognition, the terminal can identify the moving object in the previewing image that the user desires.
[0044] In various embodiments, before the user captures and obtains an image by clicking on a 'capture' button (i.e., a shutter button) on a camera, when one or more consecutive previewing images need to be extracted for identifying moving object or still object for speed calculation, the terminal can automatically capture the consecutive previewing images backstage (i.e., automatically, without or with user instruction), store the previewing images in any appropriate temporary storage media, and process the previewing images.
[0045] In Step S 102, a speed-calculating module of the terminal is called, to calculate and obtain moving speed information of the target moving object. In various embodiments, moving speed information can refer to any appropriate information related to moving speed of the target moving object. For example, the moving speed information can include the moving speed. The moving speed can be a vector and include direction of the speed, and/or magnitude (i.e., absolute value) of the speed.
[0046] Optionally, the moving speed information can further include data used during the calculation of the moving speed depending on the actual process used for calculating the moving speed, e.g., acceleration, system time, angle and/or the capturing direction of the camera lens, size of the moving object in the image, and/or standard size of the moving object. As described in certain examples, the target moving object can be the terminal, and the calculating of the moving speed can involve a still object in previewing images. In this case, the moving speed information can further include one or more parameters corresponding to the still object, e.g., size of the still object in the image, and/or standard size of the still object.
[0047] In one embodiment, when the target moving object is a certain object in a previewing image, e.g., a flying bird, a process for implementing the calculation of the moving object can include the following steps. In this case, the 'target moving object' can also be referred to as an 'object', or a 'moving object' A distance between the target moving object and the terminal can be measured via infrared, ultrasonic wave, or any other appropriate techniques. Next, according to a position from which the object enters the field of view of the camera lens, a position from which the object leaves the field of view of the camera lens, and the viewing angle of the camera lens, a moving distance of the object from entering the field of view to leaving the field of view can be calculated. By using the moving distance, coupled with the system time of the terminal, an average moving speed of the object can be obtained. In this case, the average moving speed can be used as the moving speed of the object. Subsequently, the moving speed can be superimposed onto an image captured at any one time during the process of measuring and calculating. In various embodiments, 'coupling' a parameter (e.g., distance, position, and/or acceleration) with the system time can refer to calculating using both the parameter and the system time in any appropriate way.
[0048] In another example, the obtaining of the moving speed of a moving object in an image can be implemented using the following process. Two images can be extracted from capture preview, including 'Image A' and 'Image B' . An extraction time interval between the two images can be 'Time'. A position of the target moving object in the two images can be Position A and Position B, respectively. The size of the target moving object in the two images can be Size_A and Size_B, respectively. The standard size of the target moving object can be 'Size'. A capturing direction of the camera lens can be 'Direction' .
[0049] The capturing direction of the camera lens can be obtained automatically using any appropriate method. For example, the capturing direction of the camera lens can be obtained via a built-in gravity sensor or built-in acceleration sensor on the terminal device.
[0050] According to Size and Size_A, a distance value between the target moving object and the camera lens in Image A can be obtained. According to Direction and Position A, an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the target moving object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the target moving object in Image A is located can be referred to as 'Space Position A'. Using similar or the same procedures, the space position that the target moving object in Image B is located at can be calculated. The space position that the target moving object in Image B is located can be referred to as 'Space Position B'. Using the Space Position A and the Space Position B obtained by calculation, distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
[0051] The standard size 'Size' involved in the above-described process can be obtained according to a database for researching various animals, and/or according to already-known size of various moving objects including, e.g., aircraft, automobile, and/or any other appropriate objects. The standard size 'Size' of various types of moving objects can be preset in a database, set up in the terminal or at server-side, in order to be looked up and used during the calculating of a corresponding moving object.
[0052] When the target moving object is the terminal itself, by triggering to obtain global positioning system (GPS) data of the terminal or acceleration data of the terminal, and coupling with the system time of the terminal, the moving speed of the terminal can be obtained.
[0053] When the target moving object includes one or more moving objects in the to-be- captured image and includes the terminal, the moving speed of the one or more moving objects and the moving speed of the terminal can be obtained by any appropriate method of calculation, which is not limited in the present disclosure. For example, during the calculating of the moving speed of the terminal, space positions of a moving object in two images consecutively extracted from image preview can be calculated. The space positions of the moving object can be expressed as locations on a sphere having the camera lens as the center. At the same time, by obtaining the moving speed of the terminal, the moving speed of the camera lens (i.e., the center of the sphere) can be obtained. Accordingly, the moving speed of the moving object can be calculated based on the moving speed of the center of the sphere and the space positions of the moving object.
[0054] In Step S 103, when an image captured by the terminal is received, the calculated moving speed information is superimposed on the received image. That is, when the user captures and obtains an image, e.g., by clicking on a 'capture' button (i.e., a shutter button) on a camera, and before storing the captured image, the obtained moving speed information can be superimposed upon the captured image. For example, via one or more superimposition rules regarding superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters, an image layer containing the moving speed information and an image layer containing the captured image can be processed and then superimposed, to obtain an image superimposed with the moving speed information.
[0055] It should be noted that, image(s) can include picture(s), and/or video(s). When the image includes a video, the video can be processed based on frames of the video. That is, each frame of the video can be processed separately.
[0056] In one embodiment, Step S I 03 can include the following exemplary process. When an image captured by the terminal is received, the target moving object respectively corresponding to each set of the calculated moving speed information can be analyzed and identified. According to a preset superimposition rule, and positions of various target moving objects in the received image, the various pieces of moving speed information can be superimposed upon the received image, to display the moving speed of the corresponding target moving object. That is, the moving speed information can be displayed at a position on the image corresponding to the target moving object.
[0057] For example, FIG. 2 depicts an exemplary image with superimposed moving speed information in accordance with various disclosed embodiments. As shown in FIG. 2, a captured image contains a moving object, e.g., a flying bird. In this case, the flying bird is selected as the target moving object for speed calculation, and thus moving speed information of the bird is displayed. In this case, as shown in FIG. 2, the moving speed of the bird is calculated to be 10 m/s, and is displayed at the top left corner of the image. In another example, when the moving speed information of the terminal, e.g., a mobile terminal, is obtained, the moving speed information of the mobile terminal can be superimposed on one or more of the four corners of an image, or any other appropriate positions on the image.
[0058] In various embodiments as disclosed herein, a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview during multimedia photo-capture. Further, the moving speed information can be superimposed on an image captured by the user. Thus, recording of moving speed during capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
[0059] FIG. 3 depicts a flow diagram of another exemplary method for processing multimedia photo-capture in accordance with various disclosed embodiments. The disclosed methods can be implemented on an intelligent terminal device having a camera function. Such a terminal device can include, e.g., a smart phone, a tablet computer, a laptop computer, an e-reader, a wearable device, or any other appropriate device. The method can include the following exemplary steps.
[0060] In Step S201, when it is detected that a terminal is used for a multimedia photo- capture operation, a target moving object for speed calculation is selected. The target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo-capture operation.
[0061] For example, the target moving object can be based on an object selected by a user during image capturing. Alternatively and optionally, it can be selected by default that a moving object in the capture image preview is to be used as the target moving object.
[0062] In Step S202, a speed-calculating module of the terminal is called, to calculate and obtain moving speed information of the target moving object. During Step S202, when the selected target moving object is a moving object identified in an image preview of the current multimedia photo-capture, during the calling of the speed-calculating module of the terminal to calculate the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object can include the following exemplary steps. At least two previewing images containing the target moving object can be obtained within a preset time interval. In other words, the at least two previewing images containing the target moving object within a preset time interval can be obtained. According to a position and a size of the target moving object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal, the moving speed information of the target moving object can then be calculated.
[0063] For example, when the target moving object selected during Step S201 is a moving object identified in an image preview of a current multimedia photo-capture, a method for calculating the moving speed of the target moving object can include the following steps. Two images can be extracted from capture preview, including 'Image A' and 'Image B'. An extraction time interval between the two images can be 'Time'. A position of the target moving object in the two images can be Position_A and Position_B, respectively. The size of the target moving object in the two images can be Size_A and Size_B, respectively. The standard size of the target moving object can be ' Size' . A capturing direction of the camera lens can be 'Direction'.
[0064] According to Size and Size_A, a distance value between the target moving object and the camera lens in Image A can be obtained. According to Direction and Position A, an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the target moving object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the target moving object in Image A is located at can be referred to as ' Space Position A' . Using similar or the same procedures, the space position that the target moving object in Image B is located at can be calculated, and can be referred to as 'Space Position B'. Using the Space Position A and the Space Position B obtained by calculation, the distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
[0065] When the target moving object is the terminal itself, during the calling of the speed- calculating module of the terminal to calculate the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object can include the following process. That is, according to GPS data from a built-in GPS module, or according to acceleration data from a built-in acceleration-calculating module, and coupling with the system time of the terminal, the moving speed information of the terminal can be calculated.
[0066] For example, based on the built-in GPS module, coordinate(s) of various positions (i.e., locations) during the moving of the terminal can be obtained. Next, a moving distance can be determined according to the coordinates of a position. Then, according to time value (i.e., time information, e.g., obtained from the system time of the terminal), the moving speed of the terminal can be calculated.
[0067] Alternatively and optionally, based on the acceleration-calculating module, an acceleration value during the moving of the terminal can be obtained. Next, according to the acceleration value and the time value, the moving speed of the terminal can be calculated. [0068] Further, when the selected target moving object is the terminal, during the calling of the speed-calculating module of the terminal to calculate the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object can include the following exemplary steps. A still object in an image preview of multimedia photo- capture can be identified. At least two previewing images containing the still object can be obtained within a preset time interval. According to a position and a size of the still object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal, the moving speed information of the terminal can then be calculated.
[0069] For example, a method for calculating the moving speed of the terminal can include the following steps. Two images containing a still object can be extracted from capture preview, including 'Image A' and 'Image B\ The still object can include an immovable stationary object including, e.g., a tree, a building, and/or any other appropriate object. An extraction time interval between the two images can be 'Time'. A position of the still object in the two images can be Position_A and Position_B, respectively. The size of the still object in the two images can be Size A and Size B, respectively. The standard size of the still object can be ' Size' . A capturing direction of the camera lens can be 'Direction' .
[0070] According to Size and Size_A, a distance value between the still object and the camera lens in Image A can be obtained. According to Direction and Position A, an angle that the still object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the still object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the still object in Image A is located can be referred to as ' Space Position A' . Using similar or the same procedures, the space position that the still object in Image B is located at can be calculated and can be referred to as ' Space Position B' . Using the Space Position A and the Space Position B obtained by calculation, distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the still object can be obtained. Because the still object is immovable, the 'moving speed of the still object' can refer to the moving speed of the terminal relative to the still object.
[0071] The standard size 'Size' involved in the above-described process can be obtained according to a database for researching various animals, and/or according to already-known size of various moving objects including, e.g., aircraft, automobile, and/or any other appropriate objects The standard size 'Size' of various types of moving objects can be preset in a database, set up in the terminal or at server-side, in order to be looked up and used during the calculating of a corresponding moving object. [0072] The still object to be used for speed calculation can be identified using any appropriate processes, without limitation. For example, object(s) and background can be first distinguished in an image. Two adjacent images can be compared. The difference between the two images can be drawn. Thus, it can be determined which portion of the images is still. Accordingly, a still object used for speed calculation can be obtained. In certain examples, a still object in a previewing image can be identified based on any appropriate image recognition technology. In one example, both of a foreground attribute and a background attribute of previewing image(s) can be distinguished based on pixel difference between extracted multiple consecutive capture previewing images, in order to obtain a position of a still object in the previewing image(s). In some cases, the still object can be selected from certain objects in the background of the previewing images. In another example, a still object, e.g., a tree, a building, a hill, can be directly recognized and selected in one previewing image using appropriate image recognition technology.
[0073] The terminal can automatically select a specific still object to use for speed
calculation. Optionally, when the user selects to superimpose the "target speed", the terminal can prompt the user to specify the still object for speed calculation. In one example, the terminal can first identify still object(s) in the previewing images, indicate the still objects in the image preview, and then prompt the user to select the desired still object in the image preview.
[0074] In another example, optionally, the terminal can first prompt the user to select the desired still object in the image preview, e.g., by specifying a specific position corresponding to the desired still object in the image preview. Next, by using an appropriate technique (e.g., image recognition technology), the terminal can identify the still object in the previewing image.
[0075] In Step S203, according to a preset superimposition rule, an image layer containing the moving speed information calculated by the speed-calculating module is generated. In Step S204, the generated image layer containing the moving speed information calculated by the speed- calculating module is superimposed and displayed on the image preview during multimedia photo- capture.
[0076] For example, via one or more superimposition rules of superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters, an image layer containing the moving speed can be generated. Next, the image layer can be
superimposed and displayed on a previewing image, to be displayed to the user in real time.
[0077] During the preview process, the moving speed of the terminal or the moving object in an image may change. In this case, the terminal can calculate the moving speed of the terminal or the moving object in real time by the process as described above (e.g., as shown in Step S202), and generate in real time an image layer containing the moving speed information to be superimposed on the image preview. The moving speed of a target moving object calculated in real time can be referred to as the real-time moving speed of the target moving object. [0078] In Step S205, when an image captured by the terminal is received, the calculated moving speed information is superimposed on the received image. That is, after an image is captured and obtained by the user, the image layer containing moving speed information at moment of capturing can be superimposed upon the captured image. Next, the image superimposed with the moving speed information can be stored according to a specified path.
[0079] In various embodiments, a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or a moving object in an image preview of multimedia photo-capture. The moving speed information can be previewed and displayed on a capture previewing image in real time, for a user to view. Thus, it can be convenient to subsequently superimpose the moving speed information on an image captured by the user. The recording of moving speed during capturing can be accomplished in a relatively timely and accurate manner. Users' needs of intelligent and automated image recording can thus be met.
[0080] Corresponding, various embodiments also provide a computer-readable storage medium. The computer-readable storage medium can store a program. During the executing of the program, the program can instruct a computer system to implement the methods for processing multimedia photo-capture as described in accordance with various embodiments, e.g., as shown in FIGS. 1-3.
[0081] Various embodiments also provide apparatus and terminal devices for processing multimedia photo-capture. FIG. 4 depicts a structure diagram of an exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments. The disclosed apparatus can be implemented on an intelligent terminal device having a camera function. Such a terminal device can include, e.g., a smart phone, a tablet computer, a laptop computer, an e- reader, a wearable device, and any other appropriate device. The apparatus can include a selecting module 1 1, a processing module 12, and/or a superimposing module 13. Certain modules may be omitted and other modules may be included.
[0082] The selecting module 1 1 is configured to, when it is detected that a terminal is used for a multimedia photo-capture operation, select a target moving object for speed calculation. The target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo-capture.
[0083] The processing module 12 is configured to call a speed-calculating module of the terminal, to calculate and obtain moving speed information of the target moving object. The superimposing module 13 is configured to, when an image captured by the terminal is received, superimpose the calculated moving speed information on the received image.
[0084] When a camera apparatus on the terminal is turned on for multimedia photo-capture, a user can choose to add a moving speed of the terminal to a to-be-captured image Alternatively and optionally, the user can choose to superimpose, onto the to-be-captured image, moving speed(s) of one or more moving objects in the to-be-captured image.
[0085] For example, when the camera apparatus is turned on and enters an image capture preview, the selecting module 11 can provide a prompt message prompted to inquire the user about whether to superimpose a "terminal speed" or a "target speed". When the user selects to superimpose the "terminal speed", the selecting module 1 1 can select to determine that the terminal is the target moving object. The selecting of the target moving object can thus be completed.
[0086] When the user selects to superimpose the "target speed", the selecting module 11 needs to distinguish and determine the one or more moving objects from the image preview during the multimedia photo-capture. In certain examples, the selecting module 11 can identify a moving object in a previewing image based on any appropriate moving-object image recognition technology. In one example, both of a foreground attribute and a background attribute of previewing image(s) can be distinguished based on pixel difference between extracted multiple consecutive capture previewing images, in order to obtain a position of a moving object in the previewing image(s).
[0087] During the calculating of the moving speed information by the processing module 12, when the target moving object selected by the selecting module 1 1 is a certain object in a previewing image, e.g., a flying bird, a process for calculating the moving object can include the following steps. Two images can be extracted from capture preview, including 'Image A' and 'Image B'. An extraction time interval between the two images can be 'Time'. A position of the target moving object in the two images can be Position_A and Position_B, respectively. The size of the target moving object in the two images can be Size A and Size B, respectively. The standard size of the target moving object can be ' Size' . A capturing direction of the camera lens can be 'Direction' .
[0088] According to Size and Size_A, a distance value between the target moving object and the camera lens in Image A can be obtained. According to Direction and Position A, an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the target moving object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the target moving object in Image A is located at can be referred to as ' Space Position A' . Using similar or the same procedures, the space position that the target moving object in Image B is located at can be calculated and can be referred to as 'Space Position B'. Using the Space Position A and the Space Position B obtained by calculation, distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
[0089] When the target moving object selected by the selecting module 11 is the terminal itself, the processing module 12 can obtain the moving speed of the terminal by triggering to obtain GPS data of the terminal or acceleration data of the terminal, and coupling with the system time of the terminal.
[0090] The superimposing module 13 can, when the user captures and obtains an image by clicking on a 'capture' button on a camera, and before storing the captured image, superimpose the obtained moving speed information on the captured image. For example, via one or more superimposition rules of superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters, an image layer containing the moving speed information and an image layer containing the captured image can be processed and then superimposed, to obtain an image superimposed with the moving speed information.
[0091] It should be noted that, image(s) can include picture(s), and/or video(s). When the image includes a video, the video can be processed based on picture frames of the video. That is, each frame of the video can be processed separately.
[0092] In various embodiments as disclosed herein, a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview during multimedia photo-capture. Further, the moving speed information can be superimposed on an image captured by the user. Thus, recording of moving speed during capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
[0093] Further, FIG. 5 depicts a structure diagram of another exemplary apparatus for processing multimedia photo-capture in accordance with various disclosed embodiments. The apparatus can include a selecting module 11, a processing module 12, and/or a superimposing module 13 as described in various embodiments, e.g., as shown in FIG. 4. As shown in FIG. 5, the apparatus can further include a previewing module 14.
[0094] The previewing module 14 is configured to generate an image layer containing the moving speed information calculated by the speed-calculating module, according to a preset superimposition rule. The previewing module 14 is further configured to superimpose and display the generated image layer containing the moving speed information calculated by the speed- calculating module on the image preview during multimedia photo-capture.
[0095] For example, via one or more superimposition rules of superimposition position, superimposition transparency, superimposition size, and/or any other appropriate parameters, the previewing module 14 can generate an image layer containing the moving speed, and then superimpose and display the image layer on a previewing image, to be displayed to the user in real time.
[0096] During the preview process, the moving speed of the terminal or the moving object in an image may change. In this case, the terminal can calculate the moving speed of the terminal or the moving object in real time via the processing module 12, and the previewing module 14 can generate in real time an image layer containing the moving speed information, to be superimposed on the image preview.
[0097] Further, FIG. 6 depicts a structure diagram of an exemplary processing module in accordance with various disclosed embodiments. When the selected target moving object is a moving object identified in an image preview of a current multimedia photo-capture, the processing module 12 can include a first obtaining unit 121 and a first processing unit 122. Certain units may be omitted and other units may be included.
[0098] The first obtaining unit 121 is configured to obtain at least two previewing images containing the target moving object within a preset time interval. The first processing unit 122 is configured to calculate the moving speed information of the target moving object, according to a position and a size of the target moving object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal.
[0099] For example, the first processing unit 122 can calculate the moving speed of the target moving object using a following process. Two images can be extracted from capture preview, including 'Image A' and 'Image B' . An extraction time interval between the two images can be 'Time'. A position of the target moving object in the two images can be Position A and Position B, respectively. The size of the target moving object in the two images can be Size_A and Size_B, respectively. The standard size of the target moving object can be 'Size'. A capturing direction of the camera lens can be 'Direction' .
[00100] According to Size and Size_A, a distance value between the target moving object and the camera lens in Image A can be obtained. According to Direction and Position A, an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the target moving object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the target moving object in Image A is located at can be referred to as ' Space Position A' . Using similar or the same procedures, the space position that the target moving object in Image B is located at can be calculated and can be referred to as 'Space Position B'. Using the Space Position A and the Space Position B obtained by calculation, distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
[00101] The standard size 'Size' involved in the above-described process can be obtained according to a database for researching various animals, and/or according to already-known size of various moving objects including, e.g., aircraft, automobile, and/or any other appropriate objects. The standard size 'Size' of various types of moving objects can be preset in a database, set up in the terminal or at server-side, in order to be looked up and used during the calculating of a corresponding moving object.
[00102] Further, referring to FIG. 6, when the selected target moving object is the terminal, the processing module 12 can include a turn-on unit 123, and a second processing unit 124. Certain units may be omitted and other units may be included.
[00103] The turn-on unit 123 is configured to trigger and turn on a built-in GPS module or a built-in acceleration-calculating module. The second processing unit 124 is configured to calculate the moving speed information of the terminal, according to GPS data from the built-in GPS module or acceleration data from the built-in acceleration-calculating module, coupled with the system time of the terminal.
[00104] For example, the second processing unit 124 can calculate the moving speed information using a following process. Based on the built-in GPS module, coordinate(s) of various positions during the moving of the terminal can be obtained. Next, a moving distance can be determined according to the coordinates of the positions. Then, according to time value (i.e., time information, e.g., obtained from the system time of the terminal), the moving speed of the terminal can be calculated.
[00105] Alternatively and optionally, based on the acceleration-calculating module, an acceleration value during the moving of the terminal can be obtained. Next, according to the acceleration value and the time value, the moving speed of the terminal can be calculated.
[00106] Further, referring to Figure 6, when the selected target moving object is the terminal, the processing module 12 can include an identifying unit 125, a second obtaining unit 126, and/or a third processing unit 127. Certain units may be omitted and other units may be included.
[00107] The identifying unit 125 is configured to identify a still object in an image preview of multimedia photo-capture. The second obtaining unit 126 is configured to obtain at least two previewing images containing the still object within a preset time interval. The third processing unit 127 is configured to calculate the moving speed information of the terminal according to a position and a size of the still object in each of the previewing images, a standard size of the target moving object, and a capturing direction of the camera lens of the terminal.
[00108] The processing module 12 can simultaneously include the turn-on unit 123, the second processing unit 124, the identifying unit 125, the second obtaining unit 126, and the third processing unit 127. Thus, various units can be switched at any time according to the needs of the user, to calculate the moving speed information of the target moving object. That is, the user can switch between various methods for calculating the moving speed information of the target moving object according to actual needs. [00109] Further, FIG. 7 depicts a structure diagram of an exemplary superimposing module in accordance with various disclosed embodiments. As shown in FIG. 7, in one embodiment, the superimposing module 13 can include an analyzing unit 131, and/or a superimposing unit 132.
[00110] The analyzing unit 131 is configured to, when an image captured by the terminal is received, the target moving object respectively corresponding to each set of the calculated moving speed information can be analyzed and identified. The superimposing unit 132 is configured to superimpose the various sets of moving speed information upon the received image to display the moving speed of the corresponding target moving objects, according to a preset superimposition rule and positions of various target moving objects in the received image.
[0011 1] In various embodiments as disclosed herein, a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview of multimedia photo-capture. Further, the moving speed information can be previewed and displayed in real time on a capture previewing image for the user to view, such that the moving speed information can be subsequently superimposed on an image captured by the user. Thus, recording of moving speed during multimedia capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
[00112] FIG. 8 depicts a structure diagram of an exemplary mobile terminal in accordance with various disclosed embodiments. A mobile terminal according to various disclosed
embodiments can be a device, e.g., a smart phone, a tablet computer, a laptop computer, an e-reader, a wearable device, and any other appropriate device. The mobile terminal 800 can include a camera apparatus 801 and a processor 802. The mobile terminal 800 may further include an optional GPS module and/or an acceleration-calculating module 803, a storage medium 804, a monitor 806, a communication module 808, a database 810, peripherals 812, and one or more bus 814 to couple the devices together. Certain components may be omitted and other components may be included.
[00113] Although a mobile terminal is depicted in various embodiments, the disclosed methods can be implemented on any appropriate computer system, not limited to a mobile terminal. Accordingly, the mobile terminal 800 as depicted in FIG. 8 can be an appropriate computer system for implementing the disclosed methods, without limitation.
[00114] The camera apparatus 801 is configured to implement multimedia photo-capture operations including capturing image(s) and any other appropriate functions applicable to a camera. The processor 802 can include any appropriate processor or processors. Further, the processor 802 can include multiple cores for multi-thread or parallel processing. For example, the processor 802 is configured to, when it is detected that a terminal is used for a multimedia photo-capture operation, select a target moving object for speed calculation. The target moving object can include the terminal, and/or a moving object identified in an image preview of a current multimedia photo- capture. The processor 802 is further configured to, when an image captured by the terminal is received, superimpose the calculated moving speed information on the received image. In various embodiments, the processor 802 can contain a speed-calculating module.
[00115] The storage medium 804 may include memory modules, e.g., Read-Only Memory (ROM), Random Access Memory (RAM), and flash memory modules, and mass storages, e.g., CD- ROM, U-disk, removable hard disk, etc. The storage medium 804 may store computer programs for implementing various processes (e.g., calculating moving speed, etc.), when executed by the processor 802. In addition, the storage medium 804 may store images captured according to user's instruction or images captured backstage for calculating moving speed.
[00116] The monitor 806 may include display devices for displaying contents in the terminal 800, e.g., displaying a previewing image or captured image. The peripherals 812 may include I/O devices such as function buttons (such as shutter button for camera operation), keyboard, and mouse. The peripherals 812 can further include various sensors including, e.g., sensor for detecting capturing direction of the camera apparatus 801, gravity sensor, acceleration sensor, etc.
[00117] Further, the communication module 808 may include network devices for establishing network connections through a communication network, and optionally exchange data/information with a server-side computer. For example, the communication network may include the Internet or other types of computer networks or telecommunication networks, either wired or wireless. The database 810 may include one or more databases for storing certain data and for performing certain operations on the stored data, e.g., storing database containing standard size of objects, storing realtime data, storing mathematical calculation programs, etc.
[00118] The mobile terminal 800 may optionally include a GPS module and/or an
acceleration-calculating module 803, to obtain coordinate(s) of the position of the mobile terminal and/or acceleration information during the moving of the mobile terminal, such that the processor 1 can calculate and obtain the moving speed information of the mobile terminal itself.
[00119] For example, the processor 802 can implement the methods for processing multimedia photo-capture as described in accordance with various embodiments, e.g., as shown in FIGS. 1-3.
[00120] In various embodiments as disclosed herein, a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal or moving speed information of a moving object in an image preview of multimedia photo-capture. Further, the moving speed information can be previewed and displayed in real time on a capture previewing image for the user to view, such that the moving speed information can be subsequently superimposed on an image captured by the user. Thus, recording of moving speed during multimedia capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met. [00121] In certain embodiments, during capturing an image by a user, current moving speeds of various objects can be obtained in real time via a speed-calculating module of a terminal. Further, during capturing an image by the user, the moving speed of each of the various objects can be respectively displayed at appropriate positions on the captured image.
[00122] In one example, a process for calculating the moving speed of a target moving object (e.g., a moving object identified in image preview) can include the following steps. Two images can be taken consecutively, including 'Image A' and 'Image B' . A time interval between taking the two images can be 'Time'. A position of the target moving object in the two images can be Position_A and Position_B, respectively. The size of the target moving object in the two images can be Size_A and Size_B, respectively. The standard size of the target moving object can be ' Size' . A capturing direction of the camera lens can be 'Direction' .
[00123] According to Size and Size A, a distance value between the target moving object and the camera lens in Image A can be obtained. According to Direction and Position A, an angle that the target moving object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the target moving object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the target moving object in Image A is located can be referred to as 'Space Position A'. Using similar or the same procedures, the space position that the target moving object in Image B is located at can be calculated and can be referred to as 'Space Position B'. Using the Space Position A and the Space Position B obtained by calculation, the distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the target moving object can be obtained.
[00124] In another example, the selected target moving object for speed calculation is the camera apparatus. A process for calculating the moving speed of the terminal can include the following steps. Two images containing a still object can be extracted from capture preview, including 'Image A' and 'Image B' . For example, a user can take two images for a still object. A time interval between taking the two images can be 'Time'. A position of the still object in the two images can be Position_A and Position_B, respectively. The size of the still object in the two images can be Size_A and Size_B, respectively. The standard size of the still object can be ' Size' . A capturing direction of the camera lens can be 'Direction'.
[00125] According to Size and Size_A, a distance value between the still object and the camera lens in Image A can be obtained. According to Direction and Position_A, an angle that the still object is located at on a sphere having the camera lens as the center, in Image A, can be calculated. According to the distance value and the angle, the position in space that the still object in Image A is located at can be calculated. The space position can include the distance value and the angle. The space position that the still object in Image A is located at can be referred to as 'Space Position A' . Using similar or the same procedures, the space position that the still object in Image B is located at can be calculated and can be referred to as ' Space Position B' . Using the Space Position A and the Space Position B obtained by calculation, the distance between the Space Position A and the Space Position B can be obtained by calculation. Then, according to the extraction time interval 'Time', the moving speed of the camera apparatus can be obtained.
[00126] FIG. 9 depicts an exemplary system for processing multimedia photo-capture in accordance with various disclosed embodiments. The system can include a general-photo-generating apparatus, a speed-generating module, a camera-apparatus-self-speed-generating module, a capture- target-object- speed-generating module, and/or a photo-and-information-synthesizing module.
[00127] The general-photo-generating apparatus is configured to generate static photo data by acquiring visual information in lens via hardware. The general-photo-generating apparatus can be independent hardware, such as a camera. Alternatively, the general-photo-generating apparatus can be software integrated with hardware, such as photo-taking application on a mobile device.
[00128] The speed-generating module is configured to obtain speed of various objects by using a hardware device or algorithm. The speed-generating module can contain the camera- apparatus-self-speed-generating module, and/or the capture-target-object-speed-generating module.
[00129] The camera-apparatus-self-speed-generating module is configured to directly read the moving speed of the camera apparatus itself, according to built-in hardware in the camera apparatus, such as a GPS, and an accelerometer. Alternatively, the camera-apparatus-self-speed-generating module can indirectly generate the moving speed of the camera apparatus itself, according to an algorithm for generating the moving speed of the camera apparatus itself. In this case, the camera apparatus can be a mobile camera apparatus.
[00130] The capture-target-object-speed-generating module is configured to indirectly generate the moving speed of a target moving object, according to an algorithm for generating the moving speed of the target moving object.
[00131] The photo-and-information-synthesizing module is configured to analyze positions on the photo for superimposing the various speeds (for one or more objects), based on the original photo data and by image recognition. The photo-and-information- synthesizing module can then superimpose the speed(s) on the photo via appropriate technical means (e.g., as disclosed in various embodiments), to generate photo data after the superimposing.
[00132] The process implemented on the system can include the following exemplary steps. Photo data can be generated via the general-photo-generating apparatus. At the same time, original data needed by the algorithm for generating speed can be generated. Next, speed information can be generated via the speed-generating module. Via the photo-and-information-synthesizing module, photo data superimposed with the speed information can be generated. [00133] Part or all of the steps in the methods in accordance with various embodiments can be accomplished using a program/software to instruct related hardware. For example, instructions can be stored on a terminal to implement a method for processing multimedia photo-capture. In various embodiments, the program/software can be stored in a (non-transitory) computer-readable storage medium on a terminal. The program/software can be executed by at least one processor on the terminal, to implement the steps in the methods in accordance with various embodiments. The computer-readable storage medium can include, e.g., ROM/RAM, magnetic disk, optical disk, etc.
[00134] The embodiments disclosed herein are exemplary only. Other applications, advantages, alternations, modifications, or equivalents to the disclosed embodiments are obvious to those skilled in the art and are intended to be encompassed within the scope of the present disclosure.
INDUS TRIAL APPLICABILITY AND ADVANTAGEOUS EFFECT S
[00135] Without limiting the scope of any claim and/or the specification, examples of industrial applicability and certain advantageous effects of the disclosed embodiments are listed for illustrative purposes. Various alternations, modifications, or equivalents to the technical solutions of the disclosed embodiments can be obvious to those skilled in the art and can be included in this disclosure.
[00136] The disclosed methods, apparatus, and terminal devices for processing multimedia photo-capture can be used in a variety of multimedia applications that involve camera technology. The multimedia applications can include, but are not limited to, digital photography, digital photo/video recording/playback/broadcasting, digital surveillance, data collection for any subjects that requires speed information (e.g., sports and transportation).
[00137] Using the methods in accordance with various embodiments, a speed-calculating module of a terminal can be called, to calculate moving speed information of the terminal and/or to calculate moving speed information of one or more moving objects in an image preview during multimedia photo-capture. The moving speed information can be previewed and displayed on a previewing image in real time, for a user to view.
[00138] Further, the moving speed information can be superimposed on an image captured by the user. Thus, recording of moving speed during photo-capturing can be implemented relatively timely and accurately. Users' needs of intelligent and automated image recording can thus be met.
Reference Sign List
Selecting module 11
Processing module 12
Superimposing module 13
Previewing module 14
First obtaining unit 121
First processing unit 122
Turn-on unit 123
Second processing unit 124
Identifying unit 125
Second obtaining unit 126
Third processing unit 127
Analyzing unit 131
Superimposing unit 132
Computer system 800
Camera apparatus 801
Processor 802
GPS module/acceleration-calculating module 803 Storage medium 804
Monitor 806
Communication module 808
Database 810
Peripherals 812
Bus 814

Claims

Claims
1. A method for processing multimedia photo-capture, comprising:
after detecting that a terminal is used for a multimedia photo-capture operation, selecting a target moving object for speed calculation, the target moving object including one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture;
calling a speed-calculating module of the terminal to calculate and obtain moving speed information of the target moving object; and
when an image captured by the terminal is received, superimposing the obtained moving speed information on the received image.
2. The method according to claim 1, wherein, after calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the method further includes:
according to a preset superimposition rule, generating an image layer containing the moving speed information calculated by the speed-calculating module; and
superimposing and displaying the generated image layer on the image preview of multimedia photo-capture, in real time.
3. The method according to claim 1, wherein, when the selected target moving object is the moving object identified in the image preview of the current multimedia photo-capture, during step of calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object includes:
obtaining at least two previewing images containing the moving object, within a preset time interval; and
calculating the moving speed information of the target moving object, according to a position and a size of the moving object in each previewing image of the at least two previewing images, a standard size of the moving object, and a capturing direction of the terminal.
4. The method according to claim 1, wherein, when the selected target moving object is the terminal, during step of calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object includes: calculating the moving speed information of the terminal, according to global positioning system (GPS) data from a built-in GPS module or according to acceleration data from a built-in acceleration-calculating module, coupled with a system time of the terminal.
5. The method according to claim 1, wherein, when the selected target moving object is the terminal, during step of calling the speed-calculating module of the terminal to calculate and obtain the moving speed information of the target moving object, the calculating of the moving speed information of the target moving object includes:
identifying a still object in the image preview of the current multimedia photo-capture; obtaining at least two previewing images containing the still object, within a preset time interval; and
calculating the moving speed information of the terminal, according to a position and a size of the still object in each previewing image of the at least two previewing images, a standard size of the still object, and a capturing direction of the terminal.
6. The method according to any claim of claims 1-5, wherein, when the image captured by the terminal is received, the superimposing of the obtained moving speed information on the received image includes:
when the image captured by the terminal is received, analyzing and identifying the target moving object corresponding to the obtained moving speed information; and
according to the preset superimposition rule and a position of the target moving object in the received image, superimposing the moving speed information on the received image to display a moving speed of the corresponding target moving object.
7. A non-transient computer-readable storage medium, having a program stored thereon, wherein, when being executed, the program causes the terminal to perform the method according to any claim of claims 1-6.
8. An apparatus for processing multimedia photo-capture, comprising:
a selecting module configured to select a target moving object for speed calculation after detecting that a terminal is used for a multimedia photo-capture operation, the target moving object including one or more of the terminal and a moving object identified in an image preview of a current multimedia photo-capture;
a processing module configured to call a speed-calculating module of the terminal to calculate and obtain moving speed information of the target moving object; and
a superimposing module configured to, when an image captured by the terminal is received, superimpose the obtained moving speed information on the received image.
9. The apparatus according to claim 8, further including a previewing module configured to:
according to a preset superimposition rule, generate an image layer containing the moving speed information calculated by the speed-calculating module; and
superimpose and display the generated image layer on the image preview of multimedia photo-capture, in real time.
10. The apparatus according to claim 8, wherein, when the selected target moving object is the moving object identified in the image preview of the current multimedia photo-capture, the processing module includes:
a first obtaining unit configured to obtain at least two previewing images containing the moving object within a preset time interval; and
a first processing unit configured to calculate the moving speed information of the target moving object, according to a position and a size of the moving object in each previewing image of the at least two previewing images, a standard size of the moving object, and a capturing direction of the terminal.
11. The apparatus according to claim 8, wherein, when the selected target moving object is the terminal, the processing module includes:
a turn-on unit configured to trigger and turn on a built-in GPS module or a built-in acceleration-calculating module; and
a second processing unit configured to calculate the moving speed information of the terminal, according to GPS data from the built-in GPS module or according to acceleration data from the built-in acceleration-calculating module, coupled with a system time of the terminal.
12. The apparatus according to claim 8, wherein when the selected target moving object is the terminal, the processing module includes:
an identifying unit configured to identify a still object in the image preview of the current multimedia photo-capture;
a second obtaining unit configured to obtain at least two previewing images containing the still object within a preset time interval; and
a third processing unit configured to calculate the moving speed information of the terminal, according to a position and a size of the still object in each previewing image of the at least two previewing images, a standard size of the still object, and a capturing direction of the terminal.
13. The apparatus according to any claim of claims 8-12, wherein the superimposing module includes:
an analyzing unit configured to, when the image captured by the terminal is received, analyze and identify the target moving object corresponding to the obtained moving speed information; and
a superimposing unit configured to superimpose the moving speed information on the received image to display a moving speed of the corresponding target moving object, according to the preset superimposition rule and a position of the target moving object in the received image.
14. A terminal device, comprising:
a camera apparatus and a processor, the processor being configured to:
select a target moving object for speed calculation after detecting that the camera apparatus of the terminal device is used for a multimedia photo-capture operation, the target moving object including one or more of the terminal device and a moving object identified in an image preview of a current multimedia photo-capture;
call a speed-calculating module of the terminal device to calculate and obtain moving speed information of the target moving object; and
when an image captured by the camera apparatus of the terminal device is received, superimpose the obtained moving speed information on the received image.
PCT/CN2014/080612 2013-06-24 2014-06-24 Method, apparatus and terminal device for processing multimedia photo-capture WO2014206274A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310253078.X 2013-06-24
CN201310253078.XA CN103327251B (en) 2013-06-24 2013-06-24 A kind of multimedia photographing process method, device and terminal equipment

Publications (1)

Publication Number Publication Date
WO2014206274A1 true WO2014206274A1 (en) 2014-12-31

Family

ID=49195756

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/080612 WO2014206274A1 (en) 2013-06-24 2014-06-24 Method, apparatus and terminal device for processing multimedia photo-capture

Country Status (2)

Country Link
CN (1) CN103327251B (en)
WO (1) WO2014206274A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103327251B (en) * 2013-06-24 2016-03-02 腾讯科技(深圳)有限公司 A kind of multimedia photographing process method, device and terminal equipment
CN103905735B (en) * 2014-04-17 2017-10-27 深圳市世尊科技有限公司 The mobile terminal and its dynamic for chasing after shooting function with dynamic chase after shooting method
CN106375706B (en) * 2015-07-22 2019-12-10 宇龙计算机通信科技(深圳)有限公司 method and device for measuring speed of moving object by using double cameras and mobile terminal
CN105827951B (en) * 2016-01-29 2019-05-17 维沃移动通信有限公司 A kind of Moving Objects photographic method and mobile terminal
CN105847696B (en) * 2016-05-05 2019-03-15 北京小米移动软件有限公司 Processing method, device and the equipment taken pictures under motion state

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006140605A (en) * 2004-11-10 2006-06-01 Toshiba Corp Photographing apparatus and its method
CN1984248A (en) * 2005-12-14 2007-06-20 三星电子株式会社 Method for measuring speed using wireless terminal and system implementing the same
CN102944693A (en) * 2012-11-28 2013-02-27 哈尔滨工业大学 System and method based on area array fast field synchronization charge coupled device (CCD) image sensor and used for measuring speed
CN102986208A (en) * 2010-05-14 2013-03-20 株式会社理光 Imaging apparatus, image processing method, and recording medium for recording program thereon
CN103327251A (en) * 2013-06-24 2013-09-25 腾讯科技(深圳)有限公司 Method and device of multimedia shooting processing and terminal device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101753708A (en) * 2008-12-22 2010-06-23 康佳集团股份有限公司 Mobile phone capable of measuring velocity and method for measuring movement velocity of object by mobile phone
CN101604448B (en) * 2009-03-16 2015-01-21 北京中星微电子有限公司 Method and system for measuring speed of moving targets
CN102564450A (en) * 2011-12-23 2012-07-11 奇瑞汽车股份有限公司 Method and device for measuring distance and speed

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006140605A (en) * 2004-11-10 2006-06-01 Toshiba Corp Photographing apparatus and its method
CN1984248A (en) * 2005-12-14 2007-06-20 三星电子株式会社 Method for measuring speed using wireless terminal and system implementing the same
CN102986208A (en) * 2010-05-14 2013-03-20 株式会社理光 Imaging apparatus, image processing method, and recording medium for recording program thereon
CN102944693A (en) * 2012-11-28 2013-02-27 哈尔滨工业大学 System and method based on area array fast field synchronization charge coupled device (CCD) image sensor and used for measuring speed
CN103327251A (en) * 2013-06-24 2013-09-25 腾讯科技(深圳)有限公司 Method and device of multimedia shooting processing and terminal device

Also Published As

Publication number Publication date
CN103327251B (en) 2016-03-02
CN103327251A (en) 2013-09-25

Similar Documents

Publication Publication Date Title
CN108965982B (en) Video recording method and device, electronic equipment and readable storage medium
JP6410930B2 (en) Content item retrieval and association scheme with real world objects using augmented reality and object recognition
US9661214B2 (en) Depth determination using camera focus
US9361731B2 (en) Method and apparatus for displaying video on 3D map
US20150040074A1 (en) Methods and systems for enabling creation of augmented reality content
EP2560145A2 (en) Methods and systems for enabling the creation of augmented reality content
CN109934931B (en) Method and device for collecting image and establishing target object recognition model
US20200154053A1 (en) Camera area locking
US10331209B2 (en) Gaze direction mapping
CN107710280B (en) Object visualization method
CN109582122B (en) Augmented reality information providing method and device and electronic equipment
WO2014206274A1 (en) Method, apparatus and terminal device for processing multimedia photo-capture
CN110853095B (en) Camera positioning method and device, electronic equipment and storage medium
WO2021258579A1 (en) Image splicing method and apparatus, computer device, and storage medium
US9167147B2 (en) Mobile device field of view region determination
WO2017197882A1 (en) Video playing method and device
US20150277550A1 (en) Face-Centered Motion-Based Content Navigation
WO2019062631A1 (en) Local dynamic image generation method and device
US20050251741A1 (en) Methods and apparatus for capturing images
CN112073640A (en) Panoramic information acquisition pose acquisition method, device and system
US20230048952A1 (en) Image registration method and electronic device
US20220345621A1 (en) Scene lock mode for capturing camera images
US11269405B2 (en) Gaze direction mapping
US20230141372A1 (en) Context aware measurement
JP2014170980A (en) Information processing apparatus, information processing method, and information processing program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14817497

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS (EPO FORM 1205A DATED 09.05.2016)

122 Ep: pct application non-entry in european phase

Ref document number: 14817497

Country of ref document: EP

Kind code of ref document: A1