EP2953347B1 - Photographing control method and apparatus - Google Patents

Photographing control method and apparatus Download PDF

Info

Publication number
EP2953347B1
EP2953347B1 EP15162860.9A EP15162860A EP2953347B1 EP 2953347 B1 EP2953347 B1 EP 2953347B1 EP 15162860 A EP15162860 A EP 15162860A EP 2953347 B1 EP2953347 B1 EP 2953347B1
Authority
EP
European Patent Office
Prior art keywords
movement
terminal
speed
photographed
movement speed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP15162860.9A
Other languages
German (de)
French (fr)
Other versions
EP2953347A1 (en
Inventor
Mingyong TANG
Huayijun LIU
Xiao Liu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiaomi Inc
Original Assignee
Xiaomi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiaomi Inc filed Critical Xiaomi Inc
Publication of EP2953347A1 publication Critical patent/EP2953347A1/en
Application granted granted Critical
Publication of EP2953347B1 publication Critical patent/EP2953347B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32Means for focusing
    • G03B13/34Power focusing
    • G03B13/36Autofocus systems
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/02Viewfinders
    • G03B13/10Viewfinders adjusting viewfinders field
    • G03B13/14Viewfinders adjusting viewfinders field to compensate for parallax due to short range
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B19/00Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/052Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed
    • G08G1/054Detecting movement of traffic to be counted or controlled with provision for determining speed or overspeed photographing overspeeding vehicles

Definitions

  • the present disclosure relates to the field of photography and, more particularly, to a focusing control method when photographing a moving object, using a mobile apparatus or terminal equipped with a camera.
  • a photographing control method applied to a terminal includes: obtaining a movement speed of an object in a picture to be photographed by the terminal; determining whether the movement speed is within a preset speed range; and focusing on the object if the movement speed is within the preset speed range.
  • the method further includes: taking photo or video for the object after focusing on the object.
  • the method further includes: identifying a type of the object; determining whether the type of the object is a preset type; and focusing on the object if the type of the object is the preset type.
  • the method further includes: respectively recording movement speeds of the object in a plurality of moments; calculating a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  • the picture to be photographed by the terminal of the terminal includes a plurality of objects and the method further includes: selecting a target object from the plurality of objects in the picture to be photographed by the terminal; respectively obtaining movement speeds of the target object in a plurality of moments; and calculating a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  • selecting a target object from the plurality of objects in the picture to be photographed by the terminal includes: selecting an object focused on currently in the picture to be photographed by the terminal as the target object.
  • obtaining the movement speed of an object in the picture to be photographed by the terminal includes: receiving a movement speed of an entity corresponding to the object measured by a velocity measurement; or, calculating a shift speed of the object in the picture to be photographed, and taking the shift speed as the movement speed of the object; or, calculating a shift speed of the object in the picture to be photographed, obtaining the distance between an entity corresponding to the object and the terminal, and calculating the movement speed of the object according to the shift speed and the distance.
  • focusing on the object includes: calculating a rotation direction and a rotation distance of a lens of the terminal relative to the terminal according to the movement speed; and controlling the lens to rotate relative to the terminal according to the calculated rotation direction and the rotation distance; or, calculating a movement direction and a movement distance of the terminal relative to the object according to the movement speed; and controlling the terminal to move relative to the object according to the calculated movement direction and the movement distance.
  • a photographing control apparatus applied to a terminal includes a movement speed obtaining unit configured to obtain a movement speed of an object in a picture to be photographed by the terminal; a movement speed determining unit configured to determine whether the movement speed is within a preset speed range; and a focus length control unit configured to focus on the object if the movement speed is within the preset speed range.
  • the apparatus further includes: a photographing control unit configured to take photo or video for the object after focusing on the object.
  • the apparatus further includes: an identification unit configured to identify a type of the object; and a type determining unit configured to determine whether the type of the object is a preset type.
  • the focus length control unit focuses on the object if the type of the object is the preset type.
  • the apparatus further includes: a first movement speed record unit configured to respectively record movement speeds of the object in a plurality of moments; and a first preset speed range obtaining unit configured to obtain a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  • the picture to be photographed by the terminal includes a plurality of objects. and the apparatus further includes: a target object selection unit configured to select a target object from the plurality of objects in the picture to be photographed by the terminal; a second movement speed record unit configured to respectively record the movement speeds of the target object in the plurality of moments; and a second preset speed range obtaining unit configured to obtain a preset speed range according to the movement speeds of the target object obtained in the plurality of moments.
  • the target object selection includes: a selection sub-unit configured to select the object focused on currently in the picture to be photographed by the terminal as the target object.
  • the movement speed obtaining unit includes: a movement speed receiver sub-unit configured to receive the movement speed of an entity corresponding to the object measured by a velocity measurement equipment; or, a shift speed calculation sub-unit configured to calculate a shift speed of the object in the picture to be photographed, which is taken as the movement speed; or, a movement speed calculation sub-unit configured to calculate a shift speed of the object in the picture to be photographed; to obtain a distance between the entity corresponding to the object and the terminal; and to calculate the movement speed of the object according to the shift speed and the distance.
  • the focus length control unit includes: a rotation parameter calculation sub-unit configured to calculate a rotation direction and a rotation distance of a lens of the terminal relative to the terminal, and a rotation control sub-unit configured to control the lens of the terminal to rotate relative to the terminal according to the calculated rotation direction and the rotation distance; or, a movement parameter calculation sub-unit configured to calculate a movement direction and a movement distance of the terminal relative to the object, and a movement control sub-unit configured to control the terminal to move relative to the object according to the calculated movement direction and the movement distance.
  • a terminal includes: a processor; and a memory used to store performable instructions of the processor.
  • the processor is configured to: obtain the movement speed of an object in the picture to be photographed by the terminal; determine whether the movement speed is within a preset speed range; and focus on the object if the movement speed is within the preset speed range.
  • the movement speed of the object in the picture to be photographed is obtained, it is determined whether the movement speed is within a preset speed range according to the movement speed, and the object is focused on in the picture to be photographed if the speed within the preset speed range.
  • the movement speed of the object in the picture to be photographed may be served as the feedback and the focus process can be controlled; therefore, when the object in the picture is moving, the terminal camera can automatically follow the object and focus on the object, which makes the focus process be more automatic and less time-consuming.
  • the terminal camera can capture the best images or scenes in time during the movement of the object to be photographed, when the object to be photographed is moving.
  • Fig. 1 is a flow chart showing a photographing control method according to an exemplary embodiment. As shown in Fig. 1 , the photographing control method is used in the terminal, and comprises following steps.
  • Step S101 the movement speed of an object in a picture to be photographed by a terminal is obtained.
  • the movement speed of the object in the picture to be photographed may be the shift speed of the object on the screen of the terminal, or the movement speed of the entity corresponding to the object in the picture to be photographed.
  • the movement speed of the entity corresponding to the object in the picture to be photographed may be directly measured by velocity measurement equipment (such as speed measuring radar); or the movement speed of the object on the screen may be measured firstly, and then the distance between the entity corresponding to the object in the picture to be photographed and the terminal is measured, and eventually the movement speed of the entity is obtained through indirect calculation.
  • Step S102 it is determined whether the movement speed falls into a preset speed range.
  • the user of the terminal may set at least one preset speed range in advance, and judge the movement speed of the object to be photographed according to the experience when taking photo, and then manually select the preset speed range.
  • some shooting functions of the terminal may also be bound with different preset speed ranges, so that when the user selects a certain shooting function, the corresponding preset speed range is automatically selected, for example, the "character" shooting function corresponds to the preset speed range of 3 Km/h to 10 Km/h; the "vehicle” shooting function corresponds to the preset speed range of 20 Km/h to 200 Km/h; and for the cameras installed over the road which are used to catch speeders, the preset speed range may also be directly set to more than 180 Km/h., for example.
  • step S103 the terminal camera focuses on the described object. Otherwise, the process ends.
  • the purpose of setting the preset speed ranges is to focus on the object of interest to the user.
  • the camera can only focus on the object with a speed falling into a range of about 3 Km/h ⁇ 10 Km/h, and vehicles with high speed behind the object or person can be directly ignored.
  • cameras installed over the road which are used to catch speeders are only interested in the vehicles with a speed of movement more than the preset speed, but vehicles, pedestrians or animals with a speed less than the preset speed can be directly ignored.
  • Focus modes may include turning the camera lens on the terminal, and also may include controlling the movement of the terminal relative to the object, for example the terminal is installed on the slide rail and the terminal's movement on the slide rail is controlled.
  • the movement speed of the object in the picture to be photographed is obtained, it is determined whether the movement speed falls into a preset speed range according to the movement speed, and the object in the picture to be photographed is focused on, if the speed falls into the preset speed range.
  • the movement speed of the object in the picture to be photographed may serve as feedback and the focus process control may be controlled, therefore the terminal camera can automatically follow or "pan" the object and focus on the object when the object in the picture to be photographed is moving, so that the whole focusing process is more automatic and less time-consuming.
  • the terminal camera can capture the best images or scenes in time during the movement of the object to be photographed, when the object to be photographed is moving.
  • step S103 the method can also include the following steps, as shown in figure 2 .
  • Step S104 taking photos or videos for the object after the object is focused on.
  • Fig. 3 is a flow chart showing a photographing control method according still another exemplary embodiment. As shown in Fig. 3 , the photographing control method is used in the terminal, and comprises following steps.
  • Step 201 the movement speed of the object in the picture to be photographed by the terminal is obtained.
  • Step 202 it is determined whether the movement speed falls into a preset speed range.
  • step 203 If the movement speed is within the preset speed range, in step 203, the type of the object is determined. Otherwise, the process ends.
  • the focusing on the object is performed only if the movement speed of the object falls into the preset speed range, which can exclude the objects with the movement speed out of the preset speed range.
  • the figure includes a terminal 1, a picture to be photographed 2, a person 3 and a dog 4. Because the movement speed of the dog is close to that of the person, two or more objects in the picture to be photographed 2 are needed to be focused, and thus the focus process may fail.
  • the type of the object can be identified.
  • the step can use the existing image recognition technology to identify the object, for example, face recognition, etc.
  • Step 204 it is determined whether the type of the object is a preset type.
  • the user can set multiple preset types in advance.
  • the description of the preset type can refer to the description about the preset speed range in the embodiment shown if Fig. 1 , the description of which is not repeated here.
  • step 205 the terminal camera focuses on the object.
  • the process can directly end. For example, when taking photos to a person, if the person does not move, but a small animal is moving in the picture to be photographed, so it can be determined that the type of the little animal is not the preset type by the type identification, and it can be decided not to perform the adjustment of the focus length.
  • the method provided by this embodiment of the present disclosure can further identify the type of the object if there are multiple objects of which the movement speed are all meet the requirement in the picture to be photographed, and focus on the object only when its type is the preset type, so as to make the focus length more accurately.
  • Fig. 5 is a flow chart showing a photographing control method according still another exemplary embodiment. As Fig. 5 shown, the photographing control method is used in the terminal, and comprises following steps.
  • Step 301 the movement speeds of the object are respectively recorded in multiple moments.
  • Step 302 a preset speed range is calculated according to the movement speeds of the object obtained in multiple moments.
  • Step 303 it is determined whether the movement speed falls into the preset speed range.
  • step 304 the terminal camera focuses on the described object. Otherwise, the process ends.
  • the preset speed range is set in advance by the user.
  • the movement speed of the object in the picture to be photographed can also be recorded continuously to calculate the preset speed range according to the recorded movement speeds of the object, which can make the preset speed range be amended according to the movement speed of the object, for example, as for a racing car, the preset speed range can be amended continuously from the starting step to the accelerating step of the racing car.
  • the number 5 in the figure indicates a racing car; so this method can be applied to an object of which the movement speed is changed greatly, and the object can be always focused on during the movement of the object.
  • the method may include the following steps.
  • Step 401 a target object is selected from multiple objects in the picture to be photographed by the terminal.
  • the object focused on currently in the picture to be photographed by the terminal can be selected as the target object.
  • the target object can be selected by other ways, for example, the object located at the center area of the picture to be photographed of the terminal may be selected as the target object.
  • a plane 6 and a flying bird 7 are in the picture 2 to be photographed, and the current focus area is 8, so the selected target object is the flying bird in Fig. 8 .
  • Step 402 the movement speeds of the target object are respectively obtained in multiple moments.
  • Step 403 a preset speed range is calculated according to the movement speeds of the object obtained in multiple moments.
  • Step 404 it is determined whether the movement speed falls into the preset speed range.
  • step 405 the terminal camera focuses on the described object. Otherwise, the process ends.
  • the method provided by this embodiment of the present disclosure can select a target object from multiple objects in the picture to be photographed and determine a preset speed range according to the movement speeds of the object obtained in multiple moments, which can only continuously focus on one object in the picture to be photographed.
  • the lens of the terminal when focusing on an object, can be controlled to rotate relative to the terminal, or the terminal can be controlled to move relative to the object.
  • the object is focused on by rotating the lens may be performed in the following manners.
  • Fig. 9 is a block diagram showing a photographing control apparatus according to an exemplary embodiment.
  • the apparatus includes a movement speed obtaining unit 11, a movement speed determining unit 12 and a focus length control unit 13.
  • the movement speed obtaining unit 11 is configured to obtain the movement speed of an object in the picture to be photographed by the terminal.
  • the movement speed obtaining unit 11 can include a movement speed receiver sub-unit, a shift speed calculation sub-unit or a movement speed calculation sub-unit.
  • the movement speed receiver sub-unit is configured to receive the movement speed of the entity corresponding to the object measured by a velocity measurement equipment.
  • the shift speed calculation sub-unit is configured to calculate the shift speed of the object in the picture to be photographed, which is taken as the movement speed.
  • the movement speed calculation sub-unit is configured to calculate the shift speed of the object in the picture to be photographed; to acquire the distance between the entity corresponding to the object and the terminal; and to calculate the movement speed of the object according to the shift speed and the distance.
  • the movement speed determining unit 12 is configured to determine whether the movement speed falls into a preset speed range.
  • the focus length control unit 13 is configured to focus on the object if the movement speed falls into the preset speed range.
  • the focus length control unit 13 includes a rotation parameter calculation sub-unit and a rotation control sub-unit.
  • the rotation parameter calculation sub-unit is configured to calculate the rotation direction and the rotation distance of the lens of the terminal relative to the terminal.
  • the rotation control sub-unit is configured to control the lens of the terminal to rotate relative to the terminal according to the calculated rotation direction and the rotation distance.
  • the focus length control unit 13 includes a movement parameter calculation sub-unit and a movement control sub-unit.
  • the movement parameter calculation sub-unit is configured to calculate the movement direction and the movement distance of the terminal relative to the object.
  • the movement control sub-unit is configured to control the terminal to move relative to the object according to the calculated movement direction and the movement distance.
  • the apparatus provided by the embodiment of the present disclosure obtains the movement speed of the object in the picture, judges whether the movement speed is within a preset speed range as the basis of the movement speed, and focus on the object in the picture when the speed within the preset speed range.
  • the terminal camera can automatically follow the object and focus on the object, which makes the focus process more automatic and less time-consuming, when the object in the picture is moving.
  • the terminal camera can capture the best images or scenes in time in the movement of the object to be photographed, when the object to be photographed is moving.
  • the apparatus may further include a photographing control unit 14.
  • the photographing control unit 14 is configured to take photos or videos of the object, after focusing on it.
  • the apparatus can further include an identification unit and a type determining unit.
  • the identification unit is configured to identify the type of the object.
  • the type determining unit is configured to determine whether the type of the object is a preset type.
  • the focus length control unit 13 focuses on the object.
  • the apparatus provided by this embodiment of the present disclosure can further identify the type of the object if there are multiple objects of which the movement speed all meet the requirement in the picture to be photographed, and focus on the object only if the object type is the preset type, so as to make the focal length be more accurately determined.
  • the preset speed range is set in advance by the user.
  • the movement speed of the object in the picture to be photographed can also be recorded continuously to calculate the preset speed range according to the movement speeds of the object in multiple records. Therefore, in another embodiment of the present disclosure, the apparatus can further include a first movement speed record unit and a first preset speed range obtaining unit.
  • the first movement speed record unit is configured to respectively record the movement speeds of the object in multiple moments.
  • the first preset speed range obtaining unit is configured to obtain a preset speed range according to the movement speeds of the object obtained in multiple moments.
  • the apparatus can further include a target object selection unit, a second movement speed record unit and a second preset speed range obtaining unit.
  • the target object selection unit is configured to select a target object from multiple objects in the picture to be photographed by the terminal.
  • the target object selection unit can include a selection sub-unit which is configured to select the object focused on currently in the picture to be photographed by the terminal as the target object.
  • the second movement speed record unit is configured to respectively record the movement speeds of the target object in multiple moments.
  • the second preset speed range obtaining unit is configured to obtain a preset speed range according to the movement speeds of the target object obtained in multiple moments.
  • the apparatus provided by this embodiment of the present disclosure can select a target object from multiple objects in the picture to be photographed and determine a preset speed range according to the movement speeds of the object obtained in multiple moments, which can only continuously focus on one object in the picture.
  • Fig. 11 is a block diagram showing a terminal according to another exemplary embodiment.
  • the terminal may be a mobile phone, a computer, a digital broadcasting terminal, a message transceiver, a game controller, a tablet device, a medical equipment, a fitness equipment or a personal digital assistant (PDA) etc.
  • PDA personal digital assistant
  • the terminal 800 may include following one or more components: a processing component 802, a memory 804, a power supply 806, a multimedia component 808, an audio component 810, input/output (I/O) interfaces 812, a sensor component 814 and a communication component 816.
  • a processing component 802 a memory 804, a power supply 806, a multimedia component 808, an audio component 810, input/output (I/O) interfaces 812, a sensor component 814 and a communication component 816.
  • the processing component 802 usually controls the overall operations of the terminal 800, such as the operations associated with display, phone calls, data communication, camera operation and record.
  • the processing component 802 may include one or more processor 802 to execute instructions, to complete all or part of the steps of the above method.
  • the processing unit 802 may include one or more modules, to facilitate the interaction between the processing component 802 and the other components.
  • the processing component 802 may include a multimedia module, to facilitate the interaction between the multimedia component 808 and the processing component 802.
  • the memory 804 is configured to store various types of data to support the operation of the terminal 800.
  • the examples of the data include the instructions of any application or method operated in the terminal 800, contact data, address book data, messages, pictures and video, etc.
  • the memory 804 may be any type of volatile or non-volatile storage device or their combinations, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an electrically programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk or a light disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM electrically programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory a magnetic memory
  • flash memory a magnetic disk or a light disk.
  • the power supply component 806 provides power for various components of the terminal 800.
  • the power supply component 806 may include a power management system, one or more power supplies, and other components associated with generation, management and allocation of electricity for terminal 800.
  • the multimedia component 808 includes a screen as an output interface provided between the terminal 800 and users.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, it may be implemented as a touch screen used to receive the input signal from users.
  • the touch panel includes one or more touch sensors used to sense a touch, a slide or a gesture on the touch panel. The touch sensors may not only sense the boundaries of the touch or slide operation, but also detect the time of duration and the pressure associated with the touch or slide operation.
  • the multimedia component 800 includes a prepose (front-facing) camera and/or a postpose (rearward facing) camera.
  • the prepose camera and/or the postpose camera may receive outer multimedia data.
  • the prepose camera and the postpose camera may a fixed optical lens systems or have a focus length and the optical zoom capability.
  • the audio component 810 is configured to output and/or input audio signals.
  • the audio component 810 includes a microphone (MIC).
  • the microphone When the terminal is in an operation mode, such as the calling mode, the recording mode or a voice recognition mode, the microphone is configured to receive the outer audio signals.
  • the received audio signals may be further stored in the memory 804 or transmitted by the communication component 816.
  • the audio component 810 further includes a loudspeaker used to output the audio signals.
  • I/O interfaces 812 are configured to provide interfaces between the processing component 802 and external interface modules, which may be a keyboard, a click wheel, buttons etc. These buttons may include but not limited to a home button, volume buttons, a start button and a lock button.
  • the sensor component 814 includes one or more sensors used to provide various aspects of condition assessment for the terminal 800.
  • the sensor component 814 may detect the on/off state of the terminal 800, relative position of the components, such as a display and a keypad of the terminal 800, the sensor component 814 may also detect the position change of the terminal 800 or one component of the terminal 800, whether the touch between the user and the terminal 800 exists or not, the orientation or acceleration/deceleration of the terminal 800 and the temperature change of the terminal 800.
  • the sensor component 814 may include a proximity sensor which is configured to detect near objects without any physical contact.
  • the sensor component 814 may also include light sensors, such as CMOS or CCD image sensor, used in the imaging applications.
  • the sensor component 814 may also include acceleration sensors, gyroscope sensors, magnetic sensors, pressure sensors or temperature sensors.
  • the communication component 816 is configured to facilitate the wired or wireless communications between the terminal 800 and other devices.
  • the terminal 800 can access to a wireless network based on a communication standard, such as WiFi, 2G or 3G, or their combinations.
  • the communication component 816 receives radio signals from external radio management system or broadcast information via a broadcast channel.
  • the communication component 816 also includes a near field communication (NFC) module, so as to promote the short-range communication.
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, the ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the terminal 800 may be implemented based on one or more application specific integrated circuits (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD) and field programmable gate array (FPGA), controller, microcontroller, microprocessor and other electronic components used to perform the above methods.
  • ASIC application specific integrated circuits
  • DSP digital signal processor
  • DSPD digital signal processing device
  • PLD programmable logic device
  • FPGA field programmable gate array
  • controller microcontroller, microprocessor and other electronic components used to perform the above methods.
  • the non-temporary computer readable storage medium including instructions, such as the memory 804 including instructions, which can be performed by the processor 820 of the terminal 800 to complete the above methods.
  • the non-temporary computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a tape, a floppy disk and an optical data storage device, etc.
  • a non-temporary computer readable storage medium is provided, when the instructions in the storage medium are carried out by the processor of mobile terminals to make the mobile terminal perform a photographing control method according to claims 1-7.

Description

    TECHNICAL FIELD
  • The present disclosure relates to the field of photography and, more particularly, to a focusing control method when photographing a moving object, using a mobile apparatus or terminal equipped with a camera.
  • BACKGROUND
  • With the popularity of mobile terminals such as smart phones and tablet computers etc., it is very convenient to shoot videos and upload videos to a video website. More and more users are accustomed to shoot video or pictures through the mobile terminal to record the things of daily life.
  • In the existing focusing technologies applied to most mobile terminal applications, some have to be operated manually, such as tapping on a touch control of focusing functions with tedious operation steps which is time-consuming; others can focus again after automatic adjustment is repeated on the defocus picture, but the time for adjusting focus is longer. In the actual process, because of this time lag, the picture captured when the object to be photographed moves may not be the best image to be captured. Therefore, the existing focusing technologies often fail to capture the best image when the object to be photographed moves, especially for an ongoing movement during a focusing operation.
    The present state of the art is represented by WO 2013/148591A , US 2010/007748A , US 2010/110178A , WO 97/33262A .
  • SUMMARY
  • In order to solve the problem in the existing focusing technologies, the present invention provides a photographing control and an apparatus in accordance with the claims which follow.
    According to a first aspect of the embodiments of the present disclosure, a photographing control method applied to a terminal is provided. The method includes: obtaining a movement speed of an object in a picture to be photographed by the terminal;
    determining whether the movement speed is within a preset speed range; and focusing on the object if the movement speed is within the preset speed range.
  • Incorporated with the first aspect, in a first implementation of the first aspect, the method further includes: taking photo or video for the object after focusing on the object.
  • Incorporated with the first aspect, in a second implementation of the first aspect, the method further includes: identifying a type of the object; determining whether the type of the object is a preset type; and focusing on the object if the type of the object is the preset type.
  • Incorporated with the first aspect, in a third implementation of the first aspect, the method further includes: respectively recording movement speeds of the object in a plurality of moments; calculating a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  • Incorporated with the first aspect, in a fourth implementation of the first aspect, the picture to be photographed by the terminal of the terminal includes a plurality of objects and the method further includes: selecting a target object from the plurality of objects in the picture to be photographed by the terminal; respectively obtaining movement speeds of the target object in a plurality of moments; and calculating a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  • Incorporated with the first aspect, in a fifth implementation of the first aspect, selecting a target object from the plurality of objects in the picture to be photographed by the terminal includes: selecting an object focused on currently in the picture to be photographed by the terminal as the target object.
  • Incorporated with the first aspect, in a sixth implementation of the first aspect, obtaining the movement speed of an object in the picture to be photographed by the terminal includes: receiving a movement speed of an entity corresponding to the object measured by a velocity measurement; or, calculating a shift speed of the object in the picture to be photographed, and taking the shift speed as the movement speed of the object; or, calculating a shift speed of the object in the picture to be photographed, obtaining the distance between an entity corresponding to the object and the terminal, and calculating the movement speed of the object according to the shift speed and the distance.
  • Incorporated with the first aspect, in a seventh implementation of the first aspect, focusing on the object includes: calculating a rotation direction and a rotation distance of a lens of the terminal relative to the terminal according to the movement speed; and controlling the lens to rotate relative to the terminal according to the calculated rotation direction and the rotation distance; or, calculating a movement direction and a movement distance of the terminal relative to the object according to the movement speed; and controlling the terminal to move relative to the object according to the calculated movement direction and the movement distance.
  • According to a second aspect of the embodiments of the present disclosure, a photographing control apparatus applied to a terminal is provided. The apparatus includes a movement speed obtaining unit configured to obtain a movement speed of an object in a picture to be photographed by the terminal; a movement speed determining unit configured to determine whether the movement speed is within a preset speed range; and a focus length control unit configured to focus on the object if the movement speed is within the preset speed range.
  • Incorporated with the second aspect, in a first implementation of the second aspect, the apparatus further includes: a photographing control unit configured to take photo or video for the object after focusing on the object.
  • Incorporated with the second aspect, in a second implementation of the second aspect, the apparatus further includes: an identification unit configured to identify a type of the object; and a type determining unit configured to determine whether the type of the object is a preset type. The focus length control unit focuses on the object if the type of the object is the preset type.
  • Incorporated with the second aspect, in a third implementation of the second aspect, the apparatus further includes: a first movement speed record unit configured to respectively record movement speeds of the object in a plurality of moments; and a first preset speed range obtaining unit configured to obtain a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  • Incorporated with the second aspect, in a fourth implementation of the second aspect, the picture to be photographed by the terminal includes a plurality of objects. and the apparatus further includes: a target object selection unit configured to select a target object from the plurality of objects in the picture to be photographed by the terminal; a second movement speed record unit configured to respectively record the movement speeds of the target object in the plurality of moments; and a second preset speed range obtaining unit configured to obtain a preset speed range according to the movement speeds of the target object obtained in the plurality of moments.
  • Incorporated with the second aspect, in a fifth implementation of the second aspect, the target object selection includes: a selection sub-unit configured to select the object focused on currently in the picture to be photographed by the terminal as the target object.
  • Incorporated with the second aspect, in a sixth implementation of the second aspect, the movement speed obtaining unit includes: a movement speed receiver sub-unit configured to receive the movement speed of an entity corresponding to the object measured by a velocity measurement equipment; or, a shift speed calculation sub-unit configured to calculate a shift speed of the object in the picture to be photographed, which is taken as the movement speed; or, a movement speed calculation sub-unit configured to calculate a shift speed of the object in the picture to be photographed; to obtain a distance between the entity corresponding to the object and the terminal; and to calculate the movement speed of the object according to the shift speed and the distance.
  • Incorporated with the second aspect, in a seventh implementation of the second aspect, the focus length control unit includes: a rotation parameter calculation sub-unit configured to calculate a rotation direction and a rotation distance of a lens of the terminal relative to the terminal, and a rotation control sub-unit configured to control the lens of the terminal to rotate relative to the terminal according to the calculated rotation direction and the rotation distance; or, a movement parameter calculation sub-unit configured to calculate a movement direction and a movement distance of the terminal relative to the object, and a movement control sub-unit configured to control the terminal to move relative to the object according to the calculated movement direction and the movement distance.
  • According to a third aspect of the embodiments of the present disclosure, a terminal is provided. The terminal includes: a processor; and a memory used to store performable instructions of the processor. The processor is configured to: obtain the movement speed of an object in the picture to be photographed by the terminal; determine whether the movement speed is within a preset speed range; and focus on the object if the movement speed is within the preset speed range.
  • The solutions according to embodiments of the disclosure may have the following advantages.
  • According to the method provided by this embodiment of the present disclosure, the movement speed of the object in the picture to be photographed is obtained, it is determined whether the movement speed is within a preset speed range according to the movement speed, and the object is focused on in the picture to be photographed if the speed within the preset speed range.
  • The movement speed of the object in the picture to be photographed may be served as the feedback and the focus process can be controlled; therefore, when the object in the picture is moving, the terminal camera can automatically follow the object and focus on the object, which makes the focus process be more automatic and less time-consuming.
  • Compared with the related technology, the focus process takes less time, the terminal camera can capture the best images or scenes in time during the movement of the object to be photographed, when the object to be photographed is moving.
  • It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
    • Fig. 1 is a flow chart showing a photographing control method according to an exemplary embodiment.
    • Fig. 2 is a flow chart showing a photographing control method according another exemplary embodiment.
    • Fig. 3 is a flow chart showing a photographing control method according still another exemplary embodiment.
    • Fig. 4 is a diagram showing a picture photographed according to an exemplary embodiment.
    • Fig. 5 is a flow chart showing a photographing control method according still another exemplary embodiment.
    • Fig. 6 is a diagram showing a picture photographed according another exemplary embodiment.
    • Fig. 7 is a flow chart showing a photographing control method according still another exemplary embodiment.
    • Fig. 8 is a diagram showing a picture photographed according still another exemplary embodiment.
    • Fig. 9 is a block diagram showing a photographing control apparatus according to an exemplary embodiment.
    • Fig. 10 is a block diagram showing a photographing control apparatus according to another exemplary embodiment.
    • Fig. 11 is a block diagram showing a terminal according to another exemplary embodiment.
    DESCRIPTION OF THE EMBODIMENTS
  • Detailed description of the present disclosure will further be made with reference to drawings in order to make the above objects, technical solutions and advantages of the present disclosure more apparent.
  • Fig. 1 is a flow chart showing a photographing control method according to an exemplary embodiment. As shown in Fig. 1, the photographing control method is used in the terminal, and comprises following steps.
  • Step S101, the movement speed of an object in a picture to be photographed by a terminal is obtained.
  • When taking photos of a building or other still life and a person with controlled poses, once the focus is completed the object in the in the picture to be photographed by the terminal is static, so the captured image is very clear. But in some movement scenarios, for example, taking photos or videos of sportsmen in action, racing cars at a racing track, or moving persons in a wedding, the object to be photographed is moving and the captured image will be fuzzy if a photo is taken with a preset focal length, unless firstly the movement speed of the object in the picture to be photographed by the terminal is obtained in this step.
  • The movement speed of the object in the picture to be photographed may be the shift speed of the object on the screen of the terminal, or the movement speed of the entity corresponding to the object in the picture to be photographed. For example, the movement speed of the entity corresponding to the object in the picture to be photographed may be directly measured by velocity measurement equipment (such as speed measuring radar); or the movement speed of the object on the screen may be measured firstly, and then the distance between the entity corresponding to the object in the picture to be photographed and the terminal is measured, and eventually the movement speed of the entity is obtained through indirect calculation.
  • Step S102, it is determined whether the movement speed falls into a preset speed range.
  • The user of the terminal may set at least one preset speed range in advance, and judge the movement speed of the object to be photographed according to the experience when taking photo, and then manually select the preset speed range. In addition, some shooting functions of the terminal may also be bound with different preset speed ranges, so that when the user selects a certain shooting function, the corresponding preset speed range is automatically selected, for example, the "character" shooting function corresponds to the preset speed range of 3 Km/h to 10 Km/h; the "vehicle" shooting function corresponds to the preset speed range of 20 Km/h to 200 Km/h; and for the cameras installed over the road which are used to catch speeders, the preset speed range may also be directly set to more than 180 Km/h., for example.
  • If the movement speed falls into the preset speed range, in step S103, the terminal camera focuses on the described object. Otherwise, the process ends.
  • The purpose of setting the preset speed ranges is to focus on the object of interest to the user. In the above example, if the user selects the "character" shooting function, the camera can only focus on the object with a speed falling into a range of about 3 Km/h ~ 10 Km/h, and vehicles with high speed behind the object or person can be directly ignored. Similarly, cameras installed over the road which are used to catch speeders are only interested in the vehicles with a speed of movement more than the preset speed, but vehicles, pedestrians or animals with a speed less than the preset speed can be directly ignored.
  • The object with the movement speed falling into the preset speed range is determined by the user by setting the preset speed range; therefore, the terminal camera can directly focus on that object. Focus modes may include turning the camera lens on the terminal, and also may include controlling the movement of the terminal relative to the object, for example the terminal is installed on the slide rail and the terminal's movement on the slide rail is controlled.
  • According to the method provided by this embodiment of the present disclosure, the movement speed of the object in the picture to be photographed is obtained, it is determined whether the movement speed falls into a preset speed range according to the movement speed, and the object in the picture to be photographed is focused on, if the speed falls into the preset speed range.
  • According to the method, the movement speed of the object in the picture to be photographed may serve as feedback and the focus process control may be controlled, therefore the terminal camera can automatically follow or "pan" the object and focus on the object when the object in the picture to be photographed is moving, so that the whole focusing process is more automatic and less time-consuming.
  • Compared with the prior art, because the actual focus process takes less time, the terminal camera can capture the best images or scenes in time during the movement of the object to be photographed, when the object to be photographed is moving.
  • In another embodiment of the present disclosure, after step S103 the method can also include the following steps, as shown in figure 2.
  • Step S104, taking photos or videos for the object after the object is focused on.
  • In the above steps S103, although focusing on the object is completed and the best image or scene during the movement of the object is captured, but as for photographing operation, only the preparation is finished. So after the step, it also needs to take photos or videos of the object after the object is focused on, so that the best image or scene during the movement of the object can be recorded.
  • Fig. 3 is a flow chart showing a photographing control method according still another exemplary embodiment. As shown in Fig. 3, the photographing control method is used in the terminal, and comprises following steps.
  • Step 201, the movement speed of the object in the picture to be photographed by the terminal is obtained.
  • Step 202, it is determined whether the movement speed falls into a preset speed range.
  • If the movement speed is within the preset speed range, in step 203, the type of the object is determined. Otherwise, the process ends.
  • In the embodiment shown in figure 1, the focusing on the object is performed only if the movement speed of the object falls into the preset speed range, which can exclude the objects with the movement speed out of the preset speed range. However in practical applications, there may be two objects moving with a speed within the preset speed range, for example, when taking photos of a person, a small animal may run into the picture to be photographed, and the movement speeds of the small animal and the person are similar. As shown in Fig. 4, the figure includes a terminal 1, a picture to be photographed 2, a person 3 and a dog 4. Because the movement speed of the dog is close to that of the person, two or more objects in the picture to be photographed 2 are needed to be focused, and thus the focus process may fail.
  • Therefore, in the step in the embodiment of the present disclosure, the type of the object can be identified. In the actual identification process, the step can use the existing image recognition technology to identify the object, for example, face recognition, etc.
  • Step 204, it is determined whether the type of the object is a preset type.
  • The user can set multiple preset types in advance. The description of the preset type can refer to the description about the preset speed range in the embodiment shown if Fig. 1, the description of which is not repeated here.
  • If the type of the object is the preset type, in step 205, the terminal camera focuses on the object.
  • If the type of the object is the preset type, the process can directly end. For example, when taking photos to a person, if the person does not move, but a small animal is moving in the picture to be photographed, so it can be determined that the type of the little animal is not the preset type by the type identification, and it can be decided not to perform the adjustment of the focus length.
  • The method provided by this embodiment of the present disclosure can further identify the type of the object if there are multiple objects of which the movement speed are all meet the requirement in the picture to be photographed, and focus on the object only when its type is the preset type, so as to make the focus length more accurately.
  • Fig. 5 is a flow chart showing a photographing control method according still another exemplary embodiment. As Fig. 5 shown, the photographing control method is used in the terminal, and comprises following steps.
  • Step 301, the movement speeds of the object are respectively recorded in multiple moments.
  • Step 302, a preset speed range is calculated according to the movement speeds of the object obtained in multiple moments.
  • Step 303, it is determined whether the movement speed falls into the preset speed range.
  • If the movement speed falls into the preset speed range, in step 304, the terminal camera focuses on the described object. Otherwise, the process ends.
  • In the above embodiments, the preset speed range is set in advance by the user. In the embodiments of the present disclosure, the movement speed of the object in the picture to be photographed can also be recorded continuously to calculate the preset speed range according to the recorded movement speeds of the object, which can make the preset speed range be amended according to the movement speed of the object, for example, as for a racing car, the preset speed range can be amended continuously from the starting step to the accelerating step of the racing car. As shown in Fig. 6, the number 5 in the figure indicates a racing car; so this method can be applied to an object of which the movement speed is changed greatly, and the object can be always focused on during the movement of the object.
  • When there is more than one object in the picture to be photographed by the terminal, if the method shown in Fig. 5 is implemented, it is necessary to record the movement speeds of the multiple objects, and it is hard to focus on a certain object. Therefore, in the embodiment of the present disclosure, as shown in Fig. 7, the method may include the following steps.
  • Step 401, a target object is selected from multiple objects in the picture to be photographed by the terminal.
  • In this step, the object focused on currently in the picture to be photographed by the terminal can be selected as the target object. In addition, the target object can be selected by other ways, for example, the object located at the center area of the picture to be photographed of the terminal may be selected as the target object. As shown in Fig. 8, a plane 6 and a flying bird 7 are in the picture 2 to be photographed, and the current focus area is 8, so the selected target object is the flying bird in Fig. 8.
  • Step 402, the movement speeds of the target object are respectively obtained in multiple moments.
  • Step 403, a preset speed range is calculated according to the movement speeds of the object obtained in multiple moments.
  • Step 404, it is determined whether the movement speed falls into the preset speed range.
  • If the movement speed falls into the preset speed range, in step 405, the terminal camera focuses on the described object. Otherwise, the process ends.
  • The method provided by this embodiment of the present disclosure can select a target object from multiple objects in the picture to be photographed and determine a preset speed range according to the movement speeds of the object obtained in multiple moments, which can only continuously focus on one object in the picture to be photographed.
  • In the above methods in the embodiments of the present disclosure, when focusing on an object, the lens of the terminal can be controlled to rotate relative to the terminal, or the terminal can be controlled to move relative to the object.
  • In an embodiment, the object is focused on by rotating the lens may be performed in the following manners.
    • 11) The rotation direction and the rotation distance of the lens of the terminal relative to the terminal are calculated according to the movement speed.
      In actual implementation, a corresponding relation between the movement speeds and the rotation direction and the rotation distance can be set in advance, and then in this step the rotation direction and the rotation distance can be calculated by table look-up. Of course, a formula also can be set in advance, and the rotation direction and the rotation distance can be calculated by inputting the movement speed into the formula.
      With the increase of the movement speed of the object, the rotation distance of the lens will also increase.
    • 12) The lens is controlled to rotate relative to the terminal according to the calculated rotation direction and the rotation distance.
      In another embodiment, the object is focused on by moving the mobile terminal may be performed in the following manners.
    • 21) The movement direction and the movement distance of the terminal relative to the object are calculated according to the movement speed.
      With the increase of the movement speed of the object, the movement distance of the terminal relative to the object will also increase.
    • 22) The terminal is controlled to move relative to the object according to the calculated movement direction and the movement distance.
      In each above method embodiments disclosed in the present disclosure, the same steps can learn from each other, the different steps can be freely combined.
  • Fig. 9 is a block diagram showing a photographing control apparatus according to an exemplary embodiment. Referring to Fig. 9, the apparatus includes a movement speed obtaining unit 11, a movement speed determining unit 12 and a focus length control unit 13.
  • The movement speed obtaining unit 11 is configured to obtain the movement speed of an object in the picture to be photographed by the terminal.
  • In this embodiment of the present disclosure, the movement speed obtaining unit 11 can include a movement speed receiver sub-unit, a shift speed calculation sub-unit or a movement speed calculation sub-unit.
  • Wherein, the movement speed receiver sub-unit is configured to receive the movement speed of the entity corresponding to the object measured by a velocity measurement equipment.
  • The shift speed calculation sub-unit is configured to calculate the shift speed of the object in the picture to be photographed, which is taken as the movement speed.
  • The movement speed calculation sub-unit is configured to calculate the shift speed of the object in the picture to be photographed; to acquire the distance between the entity corresponding to the object and the terminal; and to calculate the movement speed of the object according to the shift speed and the distance.
  • The movement speed determining unit 12 is configured to determine whether the movement speed falls into a preset speed range.
  • The focus length control unit 13 is configured to focus on the object if the movement speed falls into the preset speed range.
  • In an embodiment of the present disclosure, the focus length control unit 13 includes a rotation parameter calculation sub-unit and a rotation control sub-unit.
  • The rotation parameter calculation sub-unit is configured to calculate the rotation direction and the rotation distance of the lens of the terminal relative to the terminal.
  • The rotation control sub-unit is configured to control the lens of the terminal to rotate relative to the terminal according to the calculated rotation direction and the rotation distance.
  • In another embodiment, the focus length control unit 13 includes a movement parameter calculation sub-unit and a movement control sub-unit.
  • The movement parameter calculation sub-unit is configured to calculate the movement direction and the movement distance of the terminal relative to the object.
  • The movement control sub-unit is configured to control the terminal to move relative to the object according to the calculated movement direction and the movement distance.
  • The apparatus provided by the embodiment of the present disclosure obtains the movement speed of the object in the picture, judges whether the movement speed is within a preset speed range as the basis of the movement speed, and focus on the object in the picture when the speed within the preset speed range.
  • Because this apparatus can take advantage of the movement speed of the object in the picture as feedback and control the focus process, the terminal camera can automatically follow the object and focus on the object, which makes the focus process more automatic and less time-consuming, when the object in the picture is moving.
  • Compared with the related technology, because the focus process takes less time, the terminal camera can capture the best images or scenes in time in the movement of the object to be photographed, when the object to be photographed is moving.
  • In another embodiment of the present disclosure, as shown in Fig. 10, the apparatus may further include a photographing control unit 14.
  • The photographing control unit 14 is configured to take photos or videos of the object, after focusing on it.
  • In the above embodiment, although focusing on the object is completed and the best image or scene in the movement of the object is captured, but as for photographing operation, only the preparation is finished. So after the steps, it also needs to take photos or videos for the object after the object is focused on, so that the best image or scene during the movement of the object can be recorded.
  • In another embodiment of the present disclosure, the apparatus can further include an identification unit and a type determining unit.
  • The identification unit is configured to identify the type of the object.
  • The type determining unit is configured to determine whether the type of the object is a preset type.
  • If the type of the object is the preset type, the focus length control unit 13 focuses on the object.
  • The apparatus provided by this embodiment of the present disclosure can further identify the type of the object if there are multiple objects of which the movement speed all meet the requirement in the picture to be photographed, and focus on the object only if the object type is the preset type, so as to make the focal length be more accurately determined.
  • In the above embodiments, the preset speed range is set in advance by the user. In the embodiments of the present disclosure, the movement speed of the object in the picture to be photographed can also be recorded continuously to calculate the preset speed range according to the movement speeds of the object in multiple records. Therefore, in another embodiment of the present disclosure, the apparatus can further include a first movement speed record unit and a first preset speed range obtaining unit.
  • The first movement speed record unit is configured to respectively record the movement speeds of the object in multiple moments.
  • The first preset speed range obtaining unit is configured to obtain a preset speed range according to the movement speeds of the object obtained in multiple moments.
  • When there is more than one object in the picture to be photographed by the terminal, if the method in the above embodiment is implemented, it is necessary to record the movement speeds of the multiple objects, and it is hard to focus on a certain object. Therefore, in another embodiment of the present disclosure, the apparatus can further include a target object selection unit, a second movement speed record unit and a second preset speed range obtaining unit.
  • The target object selection unit is configured to select a target object from multiple objects in the picture to be photographed by the terminal.
  • In the embodiments of the present disclosure, the target object selection unit can include a selection sub-unit which is configured to select the object focused on currently in the picture to be photographed by the terminal as the target object.
  • The second movement speed record unit is configured to respectively record the movement speeds of the target object in multiple moments.
  • The second preset speed range obtaining unit is configured to obtain a preset speed range according to the movement speeds of the target object obtained in multiple moments.
  • The apparatus provided by this embodiment of the present disclosure can select a target object from multiple objects in the picture to be photographed and determine a preset speed range according to the movement speeds of the object obtained in multiple moments, which can only continuously focus on one object in the picture.
  • As to the apparatuses in the above embodiments, the specific operation method of each module has been described in detail in the corresponding method embodiments, the description of which is not repeated here.
  • Fig. 11 is a block diagram showing a terminal according to another exemplary embodiment. For example, the terminal may be a mobile phone, a computer, a digital broadcasting terminal, a message transceiver, a game controller, a tablet device, a medical equipment, a fitness equipment or a personal digital assistant (PDA) etc.
  • Referring Fig. 11, the terminal 800 may include following one or more components: a processing component 802, a memory 804, a power supply 806, a multimedia component 808, an audio component 810, input/output (I/O) interfaces 812, a sensor component 814 and a communication component 816.
  • The processing component 802 usually controls the overall operations of the terminal 800, such as the operations associated with display, phone calls, data communication, camera operation and record. The processing component 802 may include one or more processor 802 to execute instructions, to complete all or part of the steps of the above method. In addition, the processing unit 802 may include one or more modules, to facilitate the interaction between the processing component 802 and the other components. For example, the processing component 802 may include a multimedia module, to facilitate the interaction between the multimedia component 808 and the processing component 802.
  • The memory 804 is configured to store various types of data to support the operation of the terminal 800. The examples of the data include the instructions of any application or method operated in the terminal 800, contact data, address book data, messages, pictures and video, etc. The memory 804 may be any type of volatile or non-volatile storage device or their combinations, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an electrically programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk or a light disk.
  • The power supply component 806 provides power for various components of the terminal 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generation, management and allocation of electricity for terminal 800.
  • The multimedia component 808 includes a screen as an output interface provided between the terminal 800 and users. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, it may be implemented as a touch screen used to receive the input signal from users. The touch panel includes one or more touch sensors used to sense a touch, a slide or a gesture on the touch panel. The touch sensors may not only sense the boundaries of the touch or slide operation, but also detect the time of duration and the pressure associated with the touch or slide operation. In some embodiments, the multimedia component 800 includes a prepose (front-facing) camera and/or a postpose (rearward facing) camera. When the terminal 800 is in a operation mode, such as photographing mode or video mode, the prepose camera and/or the postpose camera may receive outer multimedia data. The prepose camera and the postpose camera may a fixed optical lens systems or have a focus length and the optical zoom capability.
  • The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC). When the terminal is in an operation mode, such as the calling mode, the recording mode or a voice recognition mode, the microphone is configured to receive the outer audio signals. The received audio signals may be further stored in the memory 804 or transmitted by the communication component 816. In some embodiments, the audio component 810 further includes a loudspeaker used to output the audio signals.
  • I/O interfaces 812 are configured to provide interfaces between the processing component 802 and external interface modules, which may be a keyboard, a click wheel, buttons etc. These buttons may include but not limited to a home button, volume buttons, a start button and a lock button.
  • The sensor component 814 includes one or more sensors used to provide various aspects of condition assessment for the terminal 800. The sensor component 814, for example, may detect the on/off state of the terminal 800, relative position of the components, such as a display and a keypad of the terminal 800, the sensor component 814 may also detect the position change of the terminal 800 or one component of the terminal 800, whether the touch between the user and the terminal 800 exists or not, the orientation or acceleration/deceleration of the terminal 800 and the temperature change of the terminal 800. The sensor component 814 may include a proximity sensor which is configured to detect near objects without any physical contact. The sensor component 814 may also include light sensors, such as CMOS or CCD image sensor, used in the imaging applications. In some embodiments, the sensor component 814 may also include acceleration sensors, gyroscope sensors, magnetic sensors, pressure sensors or temperature sensors.
  • The communication component 816 is configured to facilitate the wired or wireless communications between the terminal 800 and other devices. The terminal 800 can access to a wireless network based on a communication standard, such as WiFi, 2G or 3G, or their combinations. In an exemplary embodiment, the communication component 816 receives radio signals from external radio management system or broadcast information via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module, so as to promote the short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, the ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • In an exemplary embodiment, the terminal 800 may be implemented based on one or more application specific integrated circuits (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD) and field programmable gate array (FPGA), controller, microcontroller, microprocessor and other electronic components used to perform the above methods.
  • In the exemplary embodiment, it further provides a non-temporary computer readable storage medium including instructions, such as the memory 804 including instructions, which can be performed by the processor 820 of the terminal 800 to complete the above methods. For example, the non-temporary computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a tape, a floppy disk and an optical data storage device, etc.
  • A non-temporary computer readable storage medium is provided, when the instructions in the storage medium are carried out by the processor of mobile terminals to make the mobile terminal perform a photographing control method according to claims 1-7.

Claims (15)

  1. An automatic focusing control method for use with a terminal equipped with a camera, comprising:
    obtaining (S101, S201) a movement speed of an object in a picture to be photographed by the camera;
    determining (S102, S202) whether the movement speed is within a preset speed range;and
    focusing (S103, S205) on the object if the movement speed is within the preset speed range;
    characterized by
    recording respective movement speeds (S301) of the object in a plurality of moments; the preset speed range being calculated (S302, S303) according to said respective movement speeds of the object obtained in the plurality of moments, such that the preset speed range is amended continuously according to the movement speed of the object.
  2. The method according to claim 1, wherein the method further comprises:
    taking photo or video (S104) for the object after focusing (S103) on the object.
  3. The method according to claim 1, wherein the method further comprises:
    identifying (S203) a type of the object;
    determining (S204) whether the type of the object is a preset type; and
    focusing (S205) on the object if the type of the object is the preset type.
  4. The method according to claim 1, wherein the picture to be photographed by the camera includes a plurality of objects; and
    the method further comprises:
    selecting (S401) a target object from the plurality of objects in the picture to be photographed by the camera;
    respectively obtaining movement speeds (S402) of the target object in a plurality of moments; and
    calculating (S403) a preset speed range according to the movement speeds of the object obtained in the plurality of moments.
  5. The method according to claim 4, wherein selecting (S401) a target object from the plurality of objects in the picture to be photographed by the camera comprises:
    selecting an object focused on currently in the picture to be photographed by the camera as the target object.
  6. The method according to claim 1, wherein obtaining (S402) the movement speed of an object in the picture to be photographed by the camera comprises:
    receiving a movement speed of an entity corresponding to the object measured by a velocity measurement;
    or,
    calculating a shift speed of the object in the picture to be photographed, and taking the shift speed as the movement speed of the object;
    or,
    calculating a shift speed of the object in the picture to be photographed, obtaining the distance between an entity corresponding to the object and the camera, and calculating the movement speed of the object according to the shift speed and the distance.
  7. The method according to claim 1, wherein focusing (S405) on the object comprises:
    causing the lens of the camera to rotate relative to the terminal;
    calculating the rotation direction and rotation distance of the lens of the camera relative to the terminal according to the movement speed or increase of the movement speed of the object; and controlling the lens to rotate relative to the terminal according to the calculated rotation direction and the rotation distance.
  8. A focusing control apparatus for a camera in a terminal, the focusing control apparatus comprising:
    a movement speed obtaining unit (11) configured to obtain a movement speed of an object (3,4,5,6,7) in a picture to be photographed by the camera in the terminal;
    a movement speed determining unit (12) configured to determine whether the movement speed is within a preset speed range;
    a focus length control unit (13) configured to focus on the object if the movement speed is within the preset speed range;
    characterised by
    a first movement speed recording unit configured to record respective movement speeds of the object in a plurality of moments;
    a first speed range obtaining unit configured to calculate (S302,S303) the preset speed range according to said respective movement speeds of the object obtained in the plurality of moments, such that the preset speed range is amended continuously according to the movement speed of the object.
  9. The apparatus according to claim 8, wherein the apparatus further comprises:
    a photographing control unit (14) configured to take a photo or video of the object after focusing on the object.
  10. The apparatus according to claim 8, wherein the apparatus further comprises:
    an identification unit configured to identify a type of the object; and
    a type determining unit configured to determine whether the type of the object is a preset type;
    wherein, the focus length control unit (13) focuses on the object if the type of the object is the preset type.
  11. The apparatus according to claim 8, wherein the picture to be photographed by the camera in the terminal includes a plurality of objects; and
    the apparatus further comprises:
    a target object selection unit configured to select a target object from the plurality of objects in the picture to be photographed by the camera;
    a second movement speed record unit configured to respectively record the movement speeds of the target object in the plurality of moments; and
    a second preset speed range obtaining unit configured to obtain a preset speed range according to the movement speeds of the target object obtained in the plurality of moments.
  12. The apparatus according to claim 11, wherein the target object selection comprises:
    a selection sub-unit configured to select the object focused on currently in the picture to be photographed by the camera as the target object.
  13. The apparatus according to claim 8, wherein the movement speed obtaining unit comprises:
    a movement speed receiver sub-unit configured to receive the movement speed of an entity corresponding to the object measured by a velocity measurement equipment;
    or,
    a shift speed calculation sub-unit configured to calculate a shift speed of the object in the picture to be photographed, which is taken as the movement speed;
    or,
    a movement speed calculation sub-unit configured to calculate a shift speed of the object in the picture to be photographed; to obtain a distance between the entity corresponding to the object and the camera; and to calculate the movement speed of the object according to the shift speed and the distance.
  14. The apparatus according to claim 8, comprising means to cause rotation of the lens of the camera relative to the terminal, wherein the focus length control unit comprises:
    a rotation parameter calculation sub-unit configured to calculate a rotation direction and a rotation distance of a lens of the camera relative to the terminal, and a rotation control sub-unit configured to control the lens of the camera to rotate relative to the terminal according to the calculated rotation direction and the rotation distance.
  15. A computer program, which when executing on a processor of a terminal with a camera, performs a method according to any one of claims 1 to 7.
EP15162860.9A 2014-06-03 2015-04-08 Photographing control method and apparatus Active EP2953347B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410242824.XA CN104065878B (en) 2014-06-03 2014-06-03 Filming control method, device and terminal

Publications (2)

Publication Number Publication Date
EP2953347A1 EP2953347A1 (en) 2015-12-09
EP2953347B1 true EP2953347B1 (en) 2016-12-28

Family

ID=51553391

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15162860.9A Active EP2953347B1 (en) 2014-06-03 2015-04-08 Photographing control method and apparatus

Country Status (8)

Country Link
EP (1) EP2953347B1 (en)
JP (1) JP6126744B2 (en)
KR (1) KR101668352B1 (en)
CN (1) CN104065878B (en)
BR (1) BR112015000110A2 (en)
MX (1) MX350523B (en)
RU (1) RU2599177C2 (en)
WO (1) WO2015184723A1 (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9584725B2 (en) 2014-06-03 2017-02-28 Xiaomi Inc. Method and terminal device for shooting control
CN104065878B (en) * 2014-06-03 2016-02-24 小米科技有限责任公司 Filming control method, device and terminal
CN105472231B (en) * 2014-09-03 2019-03-29 联想(北京)有限公司 Control method, image collecting device and electronic equipment
CN104378549A (en) * 2014-10-30 2015-02-25 东莞宇龙通信科技有限公司 Snapshot method and device and terminal
CN106210495A (en) * 2015-05-06 2016-12-07 小米科技有限责任公司 Image capturing method and device
CN104902144A (en) * 2015-05-19 2015-09-09 广东欧珀移动通信有限公司 Rotary camera-based video-tracking method and terminal
CN104902169B (en) * 2015-05-19 2018-05-29 广东欧珀移动通信有限公司 A kind of rotating camera control method and terminal
CN104917961A (en) * 2015-05-19 2015-09-16 广东欧珀移动通信有限公司 Camera rotation control method and terminal
CN104853104B (en) * 2015-06-01 2018-08-28 深圳市微队信息技术有限公司 A kind of method and system of auto-tracking shooting moving target
CN104918015A (en) * 2015-06-04 2015-09-16 广州长视电子有限公司 High-speed operation object-recognizable video monitoring system for expressways
CN105847662A (en) * 2015-06-19 2016-08-10 维沃移动通信有限公司 Moving object shooting method based on mobile terminal, and mobile terminal
JP2017072986A (en) * 2015-10-07 2017-04-13 パナソニックIpマネジメント株式会社 Autonomous flying device, control method and program of autonomous flying device
CN105611151A (en) * 2015-12-17 2016-05-25 深圳市金立通信设备有限公司 Terminal control method and terminal
JP2017184108A (en) * 2016-03-31 2017-10-05 オリンパス株式会社 Imaging apparatus and imaging method
CN106231174A (en) * 2016-07-11 2016-12-14 深圳天珑无线科技有限公司 A kind of method and apparatus taken pictures
CN106506971A (en) * 2016-11-30 2017-03-15 宇龙计算机通信科技(深圳)有限公司 A kind of focusing method and mobile terminal
CN106713656B (en) * 2017-01-13 2020-03-31 努比亚技术有限公司 Shooting method and mobile terminal
CN109379533A (en) * 2018-10-15 2019-02-22 Oppo广东移动通信有限公司 A kind of photographic method, camera arrangement and terminal device
CN109831622B (en) 2019-01-03 2021-06-22 华为技术有限公司 Shooting method and electronic equipment
CN109831626A (en) * 2019-01-30 2019-05-31 中新科技集团股份有限公司 A kind of image pickup method, device, equipment and computer readable storage medium
CN110944114B (en) * 2019-11-28 2021-06-08 维沃移动通信有限公司 Photographing method and electronic equipment
CN112422823B (en) * 2020-11-09 2022-08-09 广汽本田汽车有限公司 Automatic visual shooting triggering method and device
CN113163254B (en) * 2021-04-06 2023-03-28 广州津虹网络传媒有限公司 Live image processing method and device and electronic equipment

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0145436B1 (en) * 1994-10-18 1998-07-15 이헌일 Object selecting method of monitoring camera
US5938717A (en) * 1996-03-04 1999-08-17 Laser Technology, Inc. Speed detection and image capture system for moving vehicles
JP2003058891A (en) * 1996-11-06 2003-02-28 Dohme:Kk Device and method for detecting moving object
JP3678068B2 (en) * 1999-08-30 2005-08-03 三菱電機株式会社 Monitoring device
JP4269908B2 (en) * 2003-11-25 2009-05-27 カシオ計算機株式会社 Electronic camera, electronic camera control program
JP4525089B2 (en) 2004-01-27 2010-08-18 フジノン株式会社 Auto focus system
JP4800073B2 (en) * 2006-03-09 2011-10-26 富士フイルム株式会社 Monitoring system, monitoring method, and monitoring program
JP4915655B2 (en) * 2006-10-27 2012-04-11 パナソニック株式会社 Automatic tracking device
CN101191979A (en) * 2006-11-28 2008-06-04 华晶科技股份有限公司 Automatic focusing method and system
KR100879266B1 (en) 2008-04-25 2009-01-16 이상석 Object tracing and intrusion sensing system
JP2010021598A (en) * 2008-07-08 2010-01-28 Victor Co Of Japan Ltd Image capturing apparatus and method
JP5038283B2 (en) * 2008-11-05 2012-10-03 キヤノン株式会社 Imaging system and lens device
JP5263886B2 (en) 2009-04-08 2013-08-14 国立大学法人 東京大学 Tracking device, tracking microscope equipped with the tracking device, and tracking method
WO2011043350A1 (en) * 2009-10-06 2011-04-14 国立大学法人東京工業大学 Image capturing system
CN102478743A (en) * 2010-11-26 2012-05-30 英业达股份有限公司 Photographic device and control method thereof
CN104012073B (en) * 2011-12-16 2017-06-09 奥林巴斯株式会社 The storage medium of the tracing program that filming apparatus and its image pickup method, storage can be processed by computer
US20130258167A1 (en) * 2012-03-28 2013-10-03 Qualcomm Incorporated Method and apparatus for autofocusing an imaging device
CN103455254B (en) * 2012-06-05 2018-05-22 腾讯科技(深圳)有限公司 Interface focus control method for movement and control device
CN102970485B (en) * 2012-12-03 2018-03-02 广东欧珀移动通信有限公司 A kind of Atomatic focusing method and device
JP5472506B2 (en) * 2013-03-19 2014-04-16 住友電気工業株式会社 Tracking imaging system and imaging control method for a plurality of moving objects
CN103327244A (en) * 2013-06-05 2013-09-25 广东欧珀移动通信有限公司 Shooting focusing method and device based on angular velocity detection
CN104065878B (en) * 2014-06-03 2016-02-24 小米科技有限责任公司 Filming control method, device and terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
JP2016533066A (en) 2016-10-20
KR101668352B1 (en) 2016-10-21
RU2014153519A (en) 2016-07-20
MX2014015637A (en) 2016-06-28
RU2599177C2 (en) 2016-10-10
BR112015000110A2 (en) 2017-06-27
CN104065878A (en) 2014-09-24
MX350523B (en) 2017-09-08
JP6126744B2 (en) 2017-05-10
KR20160001593A (en) 2016-01-06
EP2953347A1 (en) 2015-12-09
CN104065878B (en) 2016-02-24
WO2015184723A1 (en) 2015-12-10

Similar Documents

Publication Publication Date Title
EP2953347B1 (en) Photographing control method and apparatus
US20170064181A1 (en) Method and apparatus for controlling photography of unmanned aerial vehicle
RU2649862C2 (en) Method and device for shooting management
CN104378587B (en) Imaging apparatus control method, device and equipment
JP6538079B2 (en) Imaging parameter setting method, apparatus, program, and recording medium
CN104219448B (en) Image pickup method and device
EP3352453B1 (en) Photographing method for intelligent flight device and intelligent flight device
CN104270565A (en) Image shooting method and device and equipment
RU2664674C2 (en) Method and apparatus for creating a panorama
RU2631675C2 (en) Method and device for controlling video display
US10191708B2 (en) Method, apparatrus and computer-readable medium for displaying image data
CN106231152A (en) The method and device of transmission picture
CN113364965A (en) Shooting method and device based on multiple cameras and electronic equipment
CN106791371A (en) A kind of image pickup method and removable filming apparatus
US9584725B2 (en) Method and terminal device for shooting control
CN104284093A (en) Panorama shooting method and device
CN104811619B (en) Image-forming correction method and device, electronic equipment
CN106375727B (en) Method and device for controlling use state of image pickup equipment
CN114339022B (en) Camera shooting parameter determining method and neural network model training method
CN108769513B (en) Camera photographing method and device
CN114189622A (en) Image shooting method and device, electronic equipment and storage medium
CN105510939B (en) Obtain the method and device of motion path
CN113438462B (en) Multi-device interconnection shooting method and device, electronic device and storage medium
CN114449211A (en) Shooting method and device, electronic equipment and storage medium
CN117499776A (en) Shooting method, shooting device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20160311

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20160425

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 5/232 20060101AFI20160818BHEP

Ipc: G08G 1/054 20060101ALI20160818BHEP

Ipc: G03B 15/06 20060101ALI20160818BHEP

Ipc: G03B 13/00 20060101ALI20160818BHEP

Ipc: G03B 19/00 20060101ALI20160818BHEP

INTG Intention to grant announced

Effective date: 20160901

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 858157

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602015001101

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 3

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170328

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20161228

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 858157

Country of ref document: AT

Kind code of ref document: T

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170428

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170428

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170328

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602015001101

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

26N No opposition filed

Effective date: 20170929

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170408

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170408

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170408

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150408

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161228

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602015001101

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0005232000

Ipc: H04N0023600000

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230523

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230424

Year of fee payment: 9

Ref country code: DE

Payment date: 20220620

Year of fee payment: 9

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230419

Year of fee payment: 9