WO2021249067A1 - Method and system for capturing a real-time video in a plurality of video modes - Google Patents

Method and system for capturing a real-time video in a plurality of video modes Download PDF

Info

Publication number
WO2021249067A1
WO2021249067A1 PCT/CN2021/092051 CN2021092051W WO2021249067A1 WO 2021249067 A1 WO2021249067 A1 WO 2021249067A1 CN 2021092051 W CN2021092051 W CN 2021092051W WO 2021249067 A1 WO2021249067 A1 WO 2021249067A1
Authority
WO
WIPO (PCT)
Prior art keywords
speed
video
camera
capturing
real
Prior art date
Application number
PCT/CN2021/092051
Other languages
French (fr)
Inventor
Sunil Kumar
Nitin SETIA
Shubham MAKRARIYA
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp., Ltd. filed Critical Guangdong Oppo Mobile Telecommunications Corp., Ltd.
Publication of WO2021249067A1 publication Critical patent/WO2021249067A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Definitions

  • the present disclosure generally relates to the field of video analysis and more particularly to a system and method for capturing a real-time video in a plurality of video modes.
  • Video capturing has become not only a source of entertainment in today’s world but also an art to capture various moments relating to an event, in accordance with the uniqueness of the moments. For instance, there may be events that occur only for a few seconds or for a fixed period of time and also there may be events that are repetitive or where the scene is not changing frequently, therefore in different type of events, the techniques of video capturing should also be different such that all the details of each and every unique event are captured successfully and efficiently.
  • an object of the present disclosure is to provide a novel automatic method and system for capturing a real time video in a plurality of video modes.
  • One more object of the present disclosure is to avoid the time taking process of video editing in order to add slow motion effects or time-lapse effects.
  • the present disclosure provides a method and system for capturing a real time video in a plurality of video modes.
  • One aspect of the disclosure relates to a method of capturing a real time video in a plurality of video modes.
  • the method comprises receiving in real-time, at a camera unit, a camera preview frame to capture a video at normal camera speed.
  • the method further comprises identifying, via an object detection module, at least one object in the camera preview frame. Thereafter, the method encompasses detecting, via a speed detection module, an object speed based on a change in position of the identified object. Further the method comprises generating via the speed detection module, a relative speed based on a speed of the camera unit and the detected object speed.
  • the method then encompasses comparing, via a processing unit, the relative speed with a pre-determined speed range. Further the method comprises capturing, via the camera unit, the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
  • the system comprises a camera unit, configured to receive a camera preview frame to capture a video at normal camera speed.
  • the system also comprises an object detection module, configured to identify at least one object in the camera preview frame.
  • the system comprises a speed detection module, configured to detect an object speed based on a change in position of the identified object, and generate a relative speed based on a speed of the camera unit and the detected object speed.
  • the system further comprises a processing unit, configured to compare the relative speed with a pre-determined speed range.
  • the camera unit is further configured to capture the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
  • the user equipment comprises a system configured to receive a camera preview frame to capture a video at normal camera speed.
  • the system is configured to identify at least one object in the camera preview frame. Further the system is configured to detect an object speed based on a change in position of the identified object. Thereafter the system is configured to generate a relative speed based on a speed of the camera unit and the detected object speed.
  • the system is also configured to compare the relative speed with a pre-determined speed range. Further, the system is configured to capture the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
  • FIG. 1 illustrates a block diagram of the system [100] , for capturing a real time video in a plurality of video modes, in accordance with exemplary embodiments of the present disclosure.
  • FIG. 2 illustrates an exemplary architecture of a camera unit [102] , in accordance with exemplary embodiments of the present disclosure.
  • FIG. 3 illustrates an exemplary method flow diagram [300] , depicting method for capturing a real time video in a plurality of video modes, in accordance with exemplary embodiments of the present disclosure.
  • FIG. 4 illustrates an exemplary use case, in accordance with exemplary embodiments of the present disclosure.
  • FIG. 5 illustrates an exemplary use case, in accordance with exemplary embodiments of the present disclosure.
  • Slow motion is required when an object is in motion or moving at a fast rate, so that in order to observe the movement and details of the object, it must be captured in slow motion.
  • the frame rate is adjusted such that an action that has been captured is made to appear occurring at a comparatively slower rate than the natural speed of occurrence of the action.
  • the events where the movement of an object is very slow and it is beneficial to capture the movement in a short duration of time capturing the movement of the object in hyper motion/time lapse is required.
  • hyper motion the frame rate is adjusted such that an action that has been captured is made to appear occurring at a comparatively faster rate than the natural speed of occurrence of the action.
  • a normal capturing mode i.e. capturing video with base frame rate of 30 frames per second.
  • the normal capturing mode is generally used to capture a video where the movement object is neither too fast nor too slow and therefore the movement and the details of the object can be easily identified and captured via the normal capturing mode.
  • the challenge while capturing a real time video of an object is that the current solutions can’ t anticipate the action of the object precisely and the solutions are therefore less efficient and restricted to provide video capturing in a single mode at a single time.
  • the existing solutions fails to provide a system capable of capturing a single video with multiple modes such as with slow motion, time-lapse/hyper-motion and normal mode in a single video. Further in order to overcome this problem a number of prior art solutions have been provided from time to time, but all such solutions are related to creation of a video with different modes after capturing the video, by using one or more supportive editing means.
  • the known solutions lacks to provide a real time capturing of a video with different modes such as slow motion, hyper motion and normal mode in a single video, by considering the properties of the object being captured. Also the prior art solutions require manual intervention of a user to create a video with different modes using various editing means.
  • the present disclosure provides a unique method and system for capturing a real time video in a plurality of video modes.
  • the disclosure allows the user to automatically capture a video with multiple modes such as time lapse, slow motion and the like in real time.
  • the present disclosure encompasses automatically triggering of slow motion recording, time lapse recording and the normal motion recording based on the object and/or the scene being captured.
  • the capturing of a real time video in a plurality of video modes is initiated by receiving a request to start recording/capturing the video.
  • the present disclosure encompasses receiving a camera preview frame to encode the video in a normal-motion-mode/normal-camera-speed and therefore a camera unit starts generating frames at frame rate/camera speed of 30 frames per second.
  • the object that is being captured/recorded is identified via an object detection module in the camera preview frame and thereafter the one or more details of the identified object is then provided to a speed detection module via the object detection module.
  • the speed detection module is configured to detect the speed of the object being captured based on an analysis of a change in a sequence of frames in the camera preview frame. Also, the speed detection module then generates a relative speed based on a speed of the camera unit and the detected object speed.
  • the speed of the camera unit is determined on the basis of a sensed input of at least one accelerometer, wherein the sensed input is relating to a motion and a change in the direction of the camera unit. Further, the present disclosure encompasses comparing the generated relative speed and a pre-determined speed range via a processing unit. Thereafter, the camera unit on the basis of the comparison further starts generating frames at a new revaluated/revised frame rate, for instance 120 frames per second (FPS) and/or 1 FPS, to encode the video in plurality of frame rates or in plurality of video modes associated with different frame rates/camera speeds. Therefore, the present disclosure provides an efficient and effective solution of capturing, a real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range.
  • a new revaluated/revised frame rate for instance 120 frames per second (FPS) and/or 1 FPS
  • the “camera preview frame” comprises at least one real time preview of an event picked up by a camera unit. Further the real-time preview of the event comprises a real time preview of at least one of, at least one scene to be captured, object to be captured and the surrounding or environment associated, with the object.
  • camera preview frame may refer to the preview generated by a camera unit and can be seen on a display unit of a user equipment when the user opens a camera application.
  • a “processing unit” or “processor” includes one or more processors, wherein processor refers to any logic circuitry for processing instructions.
  • a processor may be a general-purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors, one or more microprocessors in association with a DSP core, a controller, a microcontroller, Application Specific Integrated Circuits, Field Programmable Gate Array circuits, any other type of integrated circuits, etc.
  • the processor may perform signal coding data processing, input/output processing, and/or any other functionality that enables the working of the system according to the present disclosure. More specifically, the processor or processing unit is a hardware processor.
  • a user equipment may be any electrical, electronic and computing device or equipment, having at least one camera unit installed on it.
  • the user equipment may include, but is not limited to, a mobile phone, smart phone, laptop, a general-purpose computer, desktop, personal digital assistant, tablet computer, wearable device or any other computing device which is capable of capturing one or more videos.
  • the user equipment contains at least one input means configured to receive an input from a user, a processing unit, a storage unit, a display unit, an object detection module, a speed detection module and a camera unit configured to capture images.
  • memory unit or “storage unit” refers to a machine or computer-readable medium including any mechanism for storing information in a form readable by a computer or similar machine.
  • a computer-readable medium includes read-only memory ( “ROM” ) , random access memory ( “RAM” ) , magnetic disk storage media, optical storage media, flash memory devices or other types of machine-accessible storage media.
  • an “object detection module” may be an intelligent unit having an analysing, computing and detecting capability, and/or the object detection module may be any other such similar unit configured to implement the features of the present disclosure and is obvious to a person skilled in the art.
  • a “speed detection module” may be a smart unit having an analysing and calculating capability, and/or the speed detection module may be any other such similar unit configured to implement the features of the present disclosure and is obvious to a person skilled in the art.
  • FIG. 1 an exemplary block diagram of the system [100] , for capturing a real time video in a plurality of video modes, in accordance with exemplary embodiments of the present disclosure is shown.
  • the system [100] comprises, at least one camera unit [102] , at least one object detection module [104] , at least one speed detection module [106] , at least one processing unit [108] and at least one storage unit [110] . Further the system also comprises one or more units including but not limited to display unit, encoding unit, decoding unit and sensing units such as accelerometer and the like, but the same is not shown in Figure 1 for the purpose of clarity. All of these components/units are assumed to be connected to each other unless otherwise indicated below. Also, in Fig. 1 only few units are shown, however the system [100] may comprise multiple such units or the system [100] may comprise any such numbers of the units, obvious to a person skilled in the art or as required to implement the features of the present disclosure.
  • the system [100] is configured for capturing a real time video in a plurality of video modes with the help of the interconnection between the components/units of the system [100] .
  • the at least one camera unit [102] of the system [100] is configured to receive a camera preview frame to capture a video at a normal camera speed.
  • the normal camera speed is for instance, 30 frames per second.
  • the camera preview frame comprises at least one real time preview of an event picked up by the camera unit.
  • the at least one object detection module [104] of the system [100] is connected to the at least one camera unit [102] .
  • the object detection module [104] is configured to identify at least one object in the camera preview frame.
  • the object may be in at least one of a moving state, a state or shape changing state and a rest state. Further the moving state of the object may comprise each and every movement of the object in the camera preview frame. For instance, the moving state may include a range of movement of the object from very slow movement like change in the positions of stars at night to a very fast movement like a cyclones with wind speed in hundreds of kilometers per hour.
  • the shape changing state may be conversion of one state of object to other, for example a lake water converting into steam due to high environmental temperature or any chemical reaction leading to the formation of new chemical compound like rusting of iron or any such other phenomenon leading to a change in the shape and/or state of the object in the camera preview frame.
  • the rest state relates to an absence of the movement or state change of the object under the camera preview frame.
  • the one or more objects that are being captured are also different and such objects may relate to different states also, therefore, the capturing of the video at normal camera speed will not provide the best results and which further leads to a need in the art to provide a solution to capture one or more real time videos in a plurality of video modes.
  • the plurality of video modes further encompasses at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode.
  • the at least one speed detection module [106] of the system [100] is connected to the at least one object detection module [104] and the at least one camera unit [102] .
  • the speed detection module [106] is configured to detect an object speed based on a change in position of the identified object.
  • the change in position of the identified object may relate to at least one of a change in state, a change in movement and a change in shape of the identified object under the camera preview frame.
  • the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame, as the sequence of frames in the camera preview frame changes with respect to the change in position of the object in the camera preview frame.
  • the speed detection module [106] is also configured to generate a relative speed based on a speed of the camera unit and the detected object speed.
  • the speed of the camera unit is based on a change in the movement and direction of the camera unit [102] .
  • the speed of the camera unit is determined via at least one sensed input of at least one accelerometer of the system [100] .
  • the at least one accelerometer is configured to identify the sensed input by sensing at least one change in the direction and/or position of the camera unit [102] .
  • the generated relative speed is a speed measured in frames per second.
  • the at least one processing unit [108] of the system [100] is connected to the at least one speed detection module [106] , at least one object detection module [104] and the at least one camera unit [102] .
  • the processing unit [108] is configured to compare the generated relative speed with a pre-determined speed range.
  • the pre-determined speed range is a speed range in frames per second (FPS) and the pre-determined speed range may further relates to two pre-defined constant values such as constant K and constant L.
  • the pre-determined speed range may be a speed range varying from constant L to constant K, wherein the constant L may be 10 frames per second and the constant K may be 90 frames per second.
  • processing unit [108] is configured to compare the generated relative speed with a pre-determined speed range, to identify whether the generated relative speed is less than constant L, more than constant K or lies between the constants L and K.
  • constant L and constant K may vary while implementation of the features of the present disclosure in different embodiments.
  • the camera unit [102] of the system [100] is configured to capture the real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range.
  • the camera unit [102] configured to capture the real-time video in the plurality of video modes is further based on encoding of the video at a revised camera speed such as 15 FPS, 30 FPS and/or 230 FPS.
  • the revised camera speed is further based on the comparison of generated relative speed with the pre-determined speed range. For instance, during capturing a video, the object being captured is under the camera preview frame for 9 minutes 30 seconds, and the generated relative speed for first 30 seconds is 100 FPS and the generated relative speed for rest 9 minutes is 7 frames per second (FPS) .
  • FPS frames per second
  • the pre-determined speed range for the instance is 9 FPS (i.e. constant L) to 95 FPS (i.e. constant K) . Therefore if the generated relative speed (FPS) is less than L i.e. 9 then time-lapse mode will be selected. If the generated relative speed is in-between 9 to 95 FPS, normal video mode will be selected and recorded. But if the generated relative speed is greater than K i.e. 95 FPS then slow motion video will be recorded. Therefore, in the above instance the camera unit [102] will first capture/record the video automatically in slow motion and thereafter the video will be captured by the camera unit [102] automatically in time lapse mode.
  • FPS generated relative speed
  • the at least one storage unit [110] is connected to the at least one processing unit [108] , the at least one speed detection module [106] , the at least one object detection module [104] and the at least one camera unit [102] .
  • the storage unit [110] is configured to store at least one automatically captured real time video in the plurality of video modes.
  • the storage unit [110] is further configured to store one or more intermediate data being generated during the processing.
  • FIG. 2 refers to an exemplary architecture of camera unit [102] , in accordance with the exemplary embodiments of the present disclosure.
  • the camera unit [102] comprises, at least one camera preview frame unit [202] , at least one camera driver [204] , at least one camera HAL [206] and at least one camera framework [208] .
  • the camera preview frame unit [202] is configured to provide a graphical user interface to a user to provide the preview of at least one camera preview frame.
  • the present disclosure encompasses that the camera preview frame unit [202] is configured to display a camera preview frame on a display unit of the system [100] .
  • the display unit of the system [100] is may be an integrated display unit within the system [100] or may be any external display unit (not shown in Fig. 2) connected to the system [100] .
  • the camera preview frame comprises at least one real time preview of an event picked up by the camera unit [102] .
  • the real-time preview of the event comprises a real time preview of at least one of, at least one scene to be captured, object to be captured and the surrounding or environment associated, with the object.
  • camera preview frame may refer to the preview generated by the camera unit [102] at the camera preview frame unit [202] that further displayed on the display unit.
  • the camera driver [204] is configured to collect the real-time data and to provide the same to the camera HAL [206] .
  • the camera HAL [206] is configured to process the received real time data based on a received triggering command from the object detection module [104] .
  • the camera framework [208] is configured to provide a module to interact with the object detection module [104] , camera HAL [206] , camera driver [204] and camera preview frame unit [202] .
  • the camera framework [208] is also configured to store files for input data, processing and the guiding mechanism.
  • FIG. 3 an exemplary method flow diagram [300] , depicting method of capturing a real time video in a plurality of video modes, in accordance with exemplary embodiment of the present disclosure is shown.
  • the method begins at step [302] .
  • the method begins when the user opens a camera application on its user device to capture a video.
  • the method comprises receiving in real-time, at a camera unit [102] , a camera preview frame to capture a video at normal camera speed.
  • the normal camera speed is the normal frames per second speed, for instance, 30 frames per second.
  • the camera preview frame comprises at least one real time preview of an event picked up by the camera unit [102] .
  • the events may be any kind of event such as moving clouds, a car racing event, a wedding event, a gaming event, a chemical experiment or any other event a user wish to capture in the form of a video recording.
  • the method comprises identifying, via an object detection module [104] , at least one object in the camera preview frame.
  • the identified object is the object that is to be captured in the video.
  • the identified-object/object may be in at least one of a moving state, a rest state and a shape changing state.
  • the moving state of the object may comprise each and every movement of the object in the camera preview frame.
  • the moving state may include a range of movement or a range of change in the speed of the identified object from a very slow speed to a very fast speed.
  • the shape changing state includes a conversion of one state of object to other state, for example a lake water converting into ice due to very low environmental temperature or any chemical reaction leading to the formation of new chemical compound or any such other phenomenon leading to a change in the shape and/or state of the object under camera preview frame.
  • the rest state relates to an absence of the movement or state change of the object under the camera preview frame.
  • the one or more objects that are being captured are also different and such objects may be at rest position or moving at different speeds, also such objects may relate to different states, therefore, the capturing of the video at normal camera speed will not provide the best results and which further leads to a need in the art to provide a solution to capture automatically one or more real time videos in a plurality of video modes.
  • the plurality of video modes further encompasses at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode.
  • the slow motion mode is used to capture the video where the speed of the object to be captured is very fast and in such instances the slow motion video is captured at 120 FPS to 240 FPS.
  • the hyper motion mode is used to capture the video where the speed of the object to be captured is very slow and in such instances the slow motion video is captured at 1 FPS.
  • the normal motion mode is used to capture the video where the speed of the object to be captured is optimum and in such instances the normal motion video is captured at 30 FPS.
  • the FPS rates associated with the slow-motion mode, hyper-motion mode and normal-motion mode may vary based on the speed of the object that is to be captured.
  • the present disclosure encompasses known methods of object detection in step [306] .
  • the method comprises detecting, via a speed detection module [106] , an object speed based on a change in position of the identified object.
  • the change in position of the identified object may relate to at least one of a change in state, a change in movement and a change in shape of the identified object under the camera preview frame.
  • the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame, as the sequence of frames in the camera preview frame changes with respect to the change in position of the object. For instance, if the position of a car changes from coordinates (x1, y1) to (x2, y2) in two subsequent frames, then the car (object) is said to undergo change in position.
  • the method encompasses generating via the speed detection module [106] , a relative speed based on a speed of the camera unit and the detected object speed.
  • the speed of the camera unit is based on a change in the movement and direction of the camera unit [102] .
  • the speed of the camera unit is based on a sensed input of at least one accelerometer.
  • the method also encompasses identifying the sensed input by sensing at least one change in the direction and/or position of the camera unit [102] , via the at least one accelerometer. In an example if a user recording a video via a camera unit [102] installed on his/her user device, is walking from one location to another.
  • a number of frames received per second at the camera unit [102] based on the speed and/or direction of the user (or camera unit [102] ) is the speed of the camera unit.
  • the generated relative speed is a speed measured in frames per second. For instance, if a user is moved from a point A to point B in order to capture a moving object, therefore a position of a camera unit [102] installed at a camera device of the user, also changes in accordance with the movement of the user from the point A to the point B. Therefore, the number of frames being received at the camera unit [102] (i.e. speed of the camera unit) also changes based on the change in the position of a camera unit [102] .
  • the method therefore encompasses generating a relative speed based on a change in a sequence of frames received at a camera unit [102] , wherein the a change in a sequence of frames is further based on the speed of the camera unit and the detected object speed.
  • the speed of the camera unit is the number of frames received at the camera unit [102] , based on the change in the direction and/or position of the camera unit [102] .
  • the method encompasses comparing, via a processing unit [108] , the generated relative speed with a pre-determined speed range.
  • the pre-determined speed range is a speed range in frames per second (FPS) and the pre-determined speed range may further relates to two pre-defined constant values such as constant K and constant L.
  • the pre-determined speed range may be a speed range varying from constant L to constant K, wherein the constant L may be 5 frames per second and the constant K may be 85 frames per second.
  • the processing unit [108] is configured to compare the generated relative speed with a pre-determined speed range, to identify whether the generated relative speed is less than constant L, more than constant K or lies between the constants L and K.
  • the method comprises capturing, via the camera unit [102] , the real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range. Further, the capturing of the real-time video in the plurality of video modes further comprises encoding of the real time video at a revised camera speed such as 2 FPS, 30 FPS and/or 215 FPS. Also, the revised camera speed is further based on the comparison of generated relative speed with the pre-determined speed range. For instance, during capturing a video the object being captured is under the camera preview frame for 15 minutes 40 seconds, and the generated relative speed for first 1 minute 40 seconds is 90 FPS and the generated relative speed for rest 14 minutes is 4 frames per second (FPS) .
  • a revised camera speed such as 2 FPS, 30 FPS and/or 215 FPS.
  • the revised camera speed is further based on the comparison of generated relative speed with the pre-determined speed range. For instance, during capturing a video the object being captured is under the camera preview frame for 15 minutes 40 seconds,
  • the pre- determined speed range for the instance is 5 FPS (i.e. constant L) to 85 FPS (i.e. constant K) . Therefore, if the generated relative speed (FPS) is less than L i.e. 5 then time-lapse mode will be selected. If the generated relative speed is in-between 5 to 85 FPS, normal video mode will be selected and recorded. But if the generated relative speed is greater than K i.e. 85 FPS then slow motion video will be recorded. Therefore, in the above instance the method encompasses first capturing/recording of the video automatically in slow motion and thereafter recording of the video automatically in time lapse mode. Also, the method further encompasses storing the captured real time video in the plurality of video modes at a storage unit [110] .
  • the method After successfully capturing the real time video in the plurality of video modes, the method further terminates at step [316] .
  • the one more aspect of the present disclosure relates to user equipment for capturing a real time video in a plurality of video modes comprising at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode.
  • the user equipment comprises a system [100] , wherein the system [100] is configured to receive a camera preview frame to capture a video at normal camera speed.
  • the normal camera speed is 30 frames per second.
  • the system thereafter configured to identify at least one object in the camera preview frame. Further the system is configured to detect an object speed based on a change in position of the identified object.
  • the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame.
  • the system is configured to generate a relative speed based on a speed of the camera unit and the detected object speed.
  • the system identifies a sensed input relating to a change in a movement or direction of the camera unit [102] to determine the speed of the camera unit [102] .
  • the system thereafter configured to compare the generated relative speed with a pre-determined speed range.
  • the pre-determined speed range is a speed range in frames per second (FPS) and the pre-determined speed range may further relates to a range of two pre-defined constant values constant K and constant L.
  • the system is configured to capture the real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range.
  • step [402] a starry night sky is shown and step [406] a shooting star at the starry night sky is shown.
  • a starry night sky is shown and step [406] a shooting star at the starry night sky is shown.
  • the system [100] of the present disclosure automatically starts recording the video in a time lapse mode and as soon as a shooting star is detected under the camera preview frame (as indicated at step [406] ) , the system [100] automatically switches from the time lapse mode to slow motion mode (as indicated at step [404] ) , as the shooting star appears only for a few seconds and moving at a very fast speed.
  • a car racing track prior to staring of a car race is shown and at step [504] two racing cars crossing each other are shown.
  • the system [100] of the present disclosure automatically starts recording the video in a time lapse mode and as soon as the race starts and two fast moving cars crossing each other are detected under the camera preview frame (as indicated at step [506] ) , the system [100] automatically switches from the time lapse mode to slow motion mode (as indicated at step [504] ) , as the crossing of cars will occur only for a few seconds and also as both the cars are moving at a very fast speed.
  • one more use case of the present disclosure relates to recording a video while driving where a time-lapse video could be desired to be captured. Also, while driving there may some scenic moment that occurs like horses are passing, birds are flying across and these moments are required to be captured in slow-motion. Therefore, in the event of driving, the method of present disclosure encompasses first automatically capturing the video in time lapse mode and thereafter upon occurrence of the scenic moment automatically capturing the video in slow motion mode.
  • one more use case of the present disclosure relates to automatically capturing of a wedding video in different modes, as in a wedding event there are a number of moments that a user needs to capture in slow motion mode, and also there are various other moments the user wish to capture in time lapse mode and normal video mode. Further, usually a single wedding video with all three modes i.e. time lapse mode, slow motion mode and normal recording mode is done by post editing by adding effects for slow motion and time lapses separately. But the present disclosure provides a solution of automatically capturing of the real time video of the wedding event in the all three modes. The present solution automatically start recording in time lapse mode for the moments which are repetitive and not changing frequently. Also, the present solution automatically switches to other modes depending upon the speed of the objects in the wedding event that are to be captured.
  • the present solution provides significant technical advancement over the existing solutions by allowing capturing of a single video in multiple video recording modes, automatically.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The present disclosure provides a methods [300] and system [100] for capturing a real time video in a plurality of video modes. The method [300] encompasses receiving in real-time, a camera preview frame to capture a video at normal camera speed. The method [300] further comprises identifying, at least one object in the camera preview frame. Thereafter, the method [300] detects, an object speed based on a change in position of the identified object. Further the method [300] leads to generating, a relative speed based on a speed of a camera unit and the detected object speed. The method [300] thereafter encompasses comparing, the relative speed with a pre-determined speed range. The method [300] further comprises capturing, the real-time video in the plurality of video modes based on the comparison of relative speed with the pre-determined speed range.

Description

METHOD AND SYSTEM FOR CAPTURING A REAL-TIME VIDEO IN A PLURALITY OF VIDEO MODES
FIELD OF INVENTION
The present disclosure generally relates to the field of video analysis and more particularly to a system and method for capturing a real-time video in a plurality of video modes.
BACKGROUND
This section is intended to provide information relating to field of the disclosure and thus any approach or functionality described below should not be assumed to be qualified as prior art merely by its inclusion in this section.
Video capturing has become not only a source of entertainment in today’s world but also an art to capture various moments relating to an event, in accordance with the uniqueness of the moments. For instance, there may be events that occur only for a few seconds or for a fixed period of time and also there may be events that are repetitive or where the scene is not changing frequently, therefore in different type of events, the techniques of video capturing should also be different such that all the details of each and every unique event are captured successfully and efficiently.
Furthermore with the evolution of technologies, it is now possible to capture videos at any instant of time via inbuilt cameras in mobile devices or other handheld devices. Also, a number of advanced technologies implemented in the camera devices have enabled the camera devices to operate considering the surrounding environmental conditions and the features of the object that is to be captured. Although the existing solutions have provided various ways of smart and efficient video capturing but these currently known solutions have many limitations and therefore there is a need in the art for improvement in this area of technology.
SUMMARY
This section is provided to introduce certain objects and aspects of the present disclosure in a simplified form that are further described below in the detailed description. This summary is not intended to identify the key features or the scope of the claimed subject matter.
In order to overcome at least a few problems associated with the known solutions as provided in the previous section, an object of the present disclosure is to provide a novel automatic method and system for capturing a real time video in a plurality of video modes.
It is another object of the present disclosure to provide a system and method to create a video in real time having multiple modes such as slow motion, hyper motion and normal video mode. Also, one more object of the present disclosure is to provide the users the privilege to capture different moments in one video in real time after detecting objects and their speed. Also, one of the object of the present disclosure is to provide a system and method to record a video by automatically triggering the different modes, such as slow motion, normal motion and fast motion depending upon the object and the scene.
One more object of the present disclosure is to avoid the time taking process of video editing in order to add slow motion effects or time-lapse effects.
In order to achieve the afore-mentioned objectives, the present disclosure provides a method and system for capturing a real time video in a plurality of video modes. One aspect of the disclosure relates to a method of capturing a real time video in a plurality of video modes. The method comprises receiving in real-time, at a camera unit, a camera preview frame to capture a video at normal camera speed. The method further comprises identifying, via an object detection module, at least one object in the camera preview frame. Thereafter, the method encompasses detecting, via a speed detection module, an object speed based on a change in position of the identified object. Further the method comprises generating via the speed detection module, a relative speed based on a speed of the camera unit and the detected object speed. The method then encompasses comparing, via a processing unit, the relative speed with a pre-determined speed range. Further the method comprises capturing, via the camera unit, the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
Further, another aspect of the disclosure relates to a system for capturing a real time video in a plurality of video modes. The system comprises a camera unit, configured to receive a camera preview frame to capture a video at normal camera speed. The system also comprises an object detection module, configured to identify at least one object in the camera preview frame. Further the system comprises a speed detection module, configured to detect an object speed based on a change in position of the identified object, and generate a relative speed based on a speed of the camera unit and the detected object speed. The system further comprises a processing unit, configured to compare the relative speed with a pre-determined speed range. The camera unit is further configured to capture the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
Yet, another aspect of the disclosure relates to a user equipment for capturing a real time video in a plurality of video modes. The user equipment comprises a system configured to receive a camera preview frame to capture a video at normal camera speed. The system is configured to identify at least one object in the camera preview frame. Further the system is configured to detect an object speed based on a change in position of the identified object. Thereafter the system is configured to generate a relative speed based on a speed of the camera unit and the detected object speed. The system is also configured to compare the relative speed with a pre-determined speed range. Further, the system is configured to capture the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are incorporated herein, and constitute a part of this disclosure, illustrate exemplary embodiments of the disclosed methods and systems in which like reference numerals refer to the same parts throughout the different drawings. Components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Some drawings may indicate the components using block diagrams and may not represent the internal circuitry of each component. It will be appreciated by those skilled in the art that disclosure of such drawings includes disclosure of electrical components, electronic components or circuitry commonly used to implement such components.
FIG. 1 illustrates a block diagram of the system [100] , for capturing a real time video in a plurality of video modes, in accordance with exemplary embodiments of the present disclosure.
FIG. 2 illustrates an exemplary architecture of a camera unit [102] , in accordance with exemplary embodiments of the present disclosure.
FIG. 3 illustrates an exemplary method flow diagram [300] , depicting method for capturing a real time video in a plurality of video modes, in accordance with exemplary embodiments of the present disclosure.
FIG. 4 illustrates an exemplary use case, in accordance with exemplary embodiments of the present disclosure.
FIG. 5 illustrates an exemplary use case, in accordance with exemplary embodiments of the present disclosure.
The foregoing shall be more apparent from the following more detailed description of the disclosure.
DETAILED DESCRIPTION
In the following description, for the purposes of explanation, various specific details are set forth in order to provide a thorough understanding of embodiments of the present disclosure. It will be apparent, however, that embodiments of the present disclosure may be practiced without these specific details. Several features described hereafter can each be used independently of one another or with any combination of other features. An individual feature may not address all of the problems discussed above or might address only some of the problems discussed above. Some of the problems discussed above might not be fully addressed by any of the features described herein.
The advancements in the field of camera technologies and video analysis have provided a remarkable development in video capturing techniques. For instance, a number of video capturing modes are available in the camera devices to capture a video in a particular configuration such as in slow motion, hyper motion, normal video capturing mode with base frame rate and the like.
Slow motion is required when an object is in motion or moving at a fast rate, so that in order to observe the movement and details of the object, it must be captured in slow motion. In slow motion the frame rate is adjusted such that an action that has been captured is made to appear occurring at a comparatively slower rate than the natural speed of occurrence of the action.
Also, the events where the movement of an object is very slow and it is beneficial to capture the movement in a short duration of time, capturing the movement of the object in hyper motion/time lapse is required. In hyper motion the frame rate is adjusted such that an action that has been captured is made to appear occurring at a comparatively faster rate than the natural speed of occurrence of the action. Similarly one other way to capture video is a normal capturing mode, i.e. capturing video with base frame rate of 30 frames per second. The normal capturing mode is generally used to capture a video where the movement object is neither too fast nor too slow and therefore the movement and the details of the object can be easily identified and captured via the normal capturing mode.
The challenge while capturing a real time video of an object is that the current solutions can’ t anticipate the action of the object precisely and the solutions are therefore less efficient and restricted to provide video capturing in a single mode at a single time.
Furthermore, the existing solutions fails to provide a system capable of capturing a single video with multiple modes such as with slow motion, time-lapse/hyper-motion and normal mode in a single video. Further in order to overcome this problem a number of prior art solutions have been provided from time to time, but all such solutions are related to creation of a video with different modes after capturing the video, by using one or more supportive editing means.
Thus, the known solutions lacks to provide a real time capturing of a video with different modes such as slow motion, hyper motion and normal mode in a single video, by considering the properties of the object being captured. Also the prior art solutions require manual intervention of a user to create a video with different modes using various editing means.
Therefore, in view of these and other existing limitations, there is an imperative need in the art to provide a solution to overcome the limitations of prior existing solutions and to provide a more efficient method and system for capturing a real-time video in a plurality of video modes.
The present disclosure provides a unique method and system for capturing a real time video in a plurality of video modes. The disclosure allows the user to automatically capture a video with multiple modes such as time lapse, slow motion and the like in real time. In order to automatically capture a video in a plurality of video modes the present disclosure encompasses automatically triggering of slow motion recording, time lapse recording and the normal motion recording based on the object and/or the scene being captured. Furthermore, the capturing of a real time video in a plurality of video modes is initiated by receiving a request to start recording/capturing the video. Thereafter on the basis of the received request, the present disclosure encompasses receiving a camera preview frame to encode the video in a normal-motion-mode/normal-camera-speed and therefore a camera unit starts generating frames at frame rate/camera speed of 30 frames per second. Further, the object that is being captured/recorded is identified via an object detection module in the camera preview frame and thereafter the one or more details of the identified object is then provided to a speed detection module via the object detection module. Further the speed detection module is configured to detect the speed of the object being captured based on an analysis of a change in a sequence of frames in the camera preview frame. Also, the speed detection module then generates a relative speed based on a speed of the camera unit and the detected object speed. The speed of the camera unit is determined on the basis of a sensed input of at least one accelerometer, wherein the sensed input is relating to a motion and a change in the direction of the camera unit. Further, the present disclosure encompasses comparing the generated relative speed and a pre-determined speed range via a processing unit. Thereafter, the camera unit on the basis of the comparison further starts generating frames at a new revaluated/revised frame rate, for instance 120 frames per second (FPS) and/or 1 FPS, to encode the video in plurality of frame rates or in plurality of video modes associated with different frame rates/camera speeds. Therefore, the present disclosure provides an efficient and effective solution of capturing, a real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range.
As used herein, the “camera preview frame” comprises at least one real time preview of an event picked up by a camera unit. Further the real-time preview of the event comprises a real time preview of at least one of, at least one scene to be captured, object to be captured and the surrounding or environment associated, with the object. For instance, camera preview frame may refer to the preview generated by a camera unit and can be seen on a display unit of a user equipment when the user opens a camera application.
As used herein, a “processing unit” or “processor” includes one or more processors, wherein processor refers to any logic circuitry for processing instructions. A processor may be a general-purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors, one or more microprocessors in association with a DSP core, a controller, a microcontroller, Application Specific Integrated Circuits, Field Programmable Gate Array circuits, any other type of integrated circuits, etc. The processor may perform signal coding data processing, input/output processing, and/or any other functionality that enables the working of the system according to the present disclosure. More specifically, the processor or processing unit is a hardware processor.
As used herein, “a user equipment” , may be any electrical, electronic and computing device or equipment, having at least one camera unit installed on it. The user equipment may include, but is not limited to, a mobile phone, smart phone, laptop, a general-purpose computer, desktop, personal digital assistant, tablet computer, wearable device or any other computing device which is capable of capturing one or more videos. The user equipment contains at least one input means configured to receive an input from a user, a processing unit, a storage unit, a display unit, an object detection module, a speed detection module and a camera unit configured to capture images.
As used herein, “memory unit” or “storage unit” , refers to a machine or computer-readable medium including any mechanism for storing information in a form readable by a computer or similar machine. For example, a computer-readable medium includes read-only memory ( “ROM” ) , random access memory ( “RAM” ) , magnetic disk storage media, optical storage media, flash memory devices or other types of machine-accessible storage media.
As used herein, an “object detection module” may be an intelligent unit having an analysing, computing and detecting capability, and/or the object detection module may be any other such similar unit configured to implement the features of the present disclosure and is obvious to a person skilled in the art.
As used herein, a “speed detection module” may be a smart unit having an analysing and calculating capability, and/or the speed detection module may be any other such similar unit configured to implement the features of the present disclosure and is obvious to a person skilled in the art.
The present disclosure is further explained in detail below with reference now to the diagrams.
Referring to FIG. 1, an exemplary block diagram of the system [100] , for capturing a real time video in a plurality of video modes, in accordance with exemplary embodiments of the present disclosure is shown.
The system [100] comprises, at least one camera unit [102] , at least one object detection module [104] , at least one speed detection module [106] , at least one processing unit [108] and at least one storage unit [110] . Further the system also comprises one or more units including but not limited to display unit, encoding unit, decoding unit and sensing units such as accelerometer and the like, but the same is not shown in Figure 1 for the purpose of clarity. All of these components/units are assumed to be connected to each other unless otherwise indicated below. Also, in Fig. 1 only few units are shown, however the system [100] may comprise multiple such units or the system [100] may comprise any such numbers of the units, obvious to a person skilled in the art or as required to implement the features of the present disclosure.
The system [100] is configured for capturing a real time video in a plurality of video modes with the help of the interconnection between the components/units of the system [100] .
The at least one camera unit [102] of the system [100] is configured to receive a camera preview frame to capture a video at a normal camera speed. The normal camera speed is for instance, 30 frames per second. The camera preview frame comprises at least one real time preview of an event picked up by the camera unit.
The at least one object detection module [104] of the system [100] is connected to the at least one camera unit [102] . The object detection module [104] is configured to identify at least one object in the camera preview frame. The object may be in at least one of a moving state, a state or shape changing state and a rest state. Further the moving state of the object may comprise each and every movement of the object in the camera preview frame. For instance, the moving state may include a range of movement of the object from very slow movement like change in the positions of stars at night to a very fast movement like a cyclones with wind speed in hundreds of kilometers per hour. Also, the shape changing state may be conversion of one state of object to other, for example a lake water converting into steam due to high environmental temperature or any chemical reaction leading to the formation of new chemical compound like rusting of iron or any such other phenomenon leading to a change in the shape and/or state of the object in the camera preview frame. Further, the rest state relates to an absence of the movement or state change of the object under the camera preview frame. Further, in different events the one or more objects that are being captured are also different and such objects may relate to different states also, therefore, the capturing of the video at normal camera speed will not provide the best results and which further leads to a need in the art to provide a solution to capture one or more real time videos in a plurality of video modes. The plurality of video modes further encompasses at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode.
The at least one speed detection module [106] of the system [100] is connected to the at least one object detection module [104] and the at least one camera unit [102] . The speed detection module [106] is configured to detect an object speed based on a change in position of the identified object. Further, the change in position of the identified object may relate to at least one of a change in state, a change in movement and a change in shape of the identified object under the camera preview frame. Also, the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame, as the sequence of frames in the camera preview frame changes with respect to the change in position of the object in the camera preview frame.
Further, the speed detection module [106] is also configured to generate a relative speed based on a speed of the camera unit and the detected object speed. The speed of the camera unit is based on a change in the movement and direction of the  camera unit [102] . Also, the speed of the camera unit is determined via at least one sensed input of at least one accelerometer of the system [100] . The at least one accelerometer is configured to identify the sensed input by sensing at least one change in the direction and/or position of the camera unit [102] . Further the generated relative speed is a speed measured in frames per second.
The at least one processing unit [108] of the system [100] is connected to the at least one speed detection module [106] , at least one object detection module [104] and the at least one camera unit [102] . The processing unit [108] is configured to compare the generated relative speed with a pre-determined speed range. The pre-determined speed range is a speed range in frames per second (FPS) and the pre-determined speed range may further relates to two pre-defined constant values such as constant K and constant L. For instance, the pre-determined speed range may be a speed range varying from constant L to constant K, wherein the constant L may be 10 frames per second and the constant K may be 90 frames per second. Further, the processing unit [108] is configured to compare the generated relative speed with a pre-determined speed range, to identify whether the generated relative speed is less than constant L, more than constant K or lies between the constants L and K. Furthermore, the values of constant L and constant K may vary while implementation of the features of the present disclosure in different embodiments.
Further, the camera unit [102] of the system [100] is configured to capture the real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range. The camera unit [102] configured to capture the real-time video in the plurality of video modes is further based on encoding of the video at a revised camera speed such as 15 FPS, 30 FPS and/or 230 FPS. Also, the revised camera speed is further based on the comparison of generated relative speed with the pre-determined speed range. For instance, during capturing a video, the object being captured is under the camera preview frame for 9 minutes 30 seconds, and the generated relative speed for first 30 seconds is 100 FPS and the generated relative speed for rest 9 minutes is 7 frames per second (FPS) . Also, the pre-determined speed range for the instance is 9 FPS (i.e. constant L) to 95 FPS (i.e. constant K) . Therefore if the generated relative speed (FPS) is less than L i.e. 9 then time-lapse mode will be selected. If the generated relative speed is in-between 9 to 95 FPS, normal video mode will be selected and recorded. But if the generated relative speed is greater than K i.e. 95 FPS then slow motion  video will be recorded. Therefore, in the above instance the camera unit [102] will first capture/record the video automatically in slow motion and thereafter the video will be captured by the camera unit [102] automatically in time lapse mode.
Further, the at least one storage unit [110] is connected to the at least one processing unit [108] , the at least one speed detection module [106] , the at least one object detection module [104] and the at least one camera unit [102] . The storage unit [110] is configured to store at least one automatically captured real time video in the plurality of video modes. The storage unit [110] is further configured to store one or more intermediate data being generated during the processing.
FIG. 2 refers to an exemplary architecture of camera unit [102] , in accordance with the exemplary embodiments of the present disclosure. The camera unit [102] comprises, at least one camera preview frame unit [202] , at least one camera driver [204] , at least one camera HAL [206] and at least one camera framework [208] .
The camera preview frame unit [202] is configured to provide a graphical user interface to a user to provide the preview of at least one camera preview frame. The present disclosure encompasses that the camera preview frame unit [202] is configured to display a camera preview frame on a display unit of the system [100] . The display unit of the system [100] is may be an integrated display unit within the system [100] or may be any external display unit (not shown in Fig. 2) connected to the system [100] . Also, the camera preview frame comprises at least one real time preview of an event picked up by the camera unit [102] . Further the real-time preview of the event comprises a real time preview of at least one of, at least one scene to be captured, object to be captured and the surrounding or environment associated, with the object. For instance, camera preview frame may refer to the preview generated by the camera unit [102] at the camera preview frame unit [202] that further displayed on the display unit.
The camera driver [204] , is configured to collect the real-time data and to provide the same to the camera HAL [206] . The camera HAL [206] is configured to process the received real time data based on a received triggering command from the object detection module [104] .
The camera framework [208] is configured to provide a module to interact with the object detection module [104] , camera HAL [206] , camera driver [204] and camera preview frame unit [202] . The camera framework [208] is also configured to store files for input data, processing and the guiding mechanism.
Referring to Fig. 3, an exemplary method flow diagram [300] , depicting method of capturing a real time video in a plurality of video modes, in accordance with exemplary embodiment of the present disclosure is shown. As shown in Fig. 3, the method begins at step [302] . For instance, the method begins when the user opens a camera application on its user device to capture a video.
At step [304] , the method comprises receiving in real-time, at a camera unit [102] , a camera preview frame to capture a video at normal camera speed. The normal camera speed is the normal frames per second speed, for instance, 30 frames per second. Also, the camera preview frame comprises at least one real time preview of an event picked up by the camera unit [102] . For instance, the events may be any kind of event such as moving clouds, a car racing event, a wedding event, a gaming event, a chemical experiment or any other event a user wish to capture in the form of a video recording.
Next, at step [306] , the method comprises identifying, via an object detection module [104] , at least one object in the camera preview frame. The identified object is the object that is to be captured in the video. Also, the identified-object/object may be in at least one of a moving state, a rest state and a shape changing state. Further the moving state of the object may comprise each and every movement of the object in the camera preview frame. For instance, the moving state may include a range of movement or a range of change in the speed of the identified object from a very slow speed to a very fast speed. Also, the shape changing state includes a conversion of one state of object to other state, for example a lake water converting into ice due to very low environmental temperature or any chemical reaction leading to the formation of new chemical compound or any such other phenomenon leading to a change in the shape and/or state of the object under camera preview frame. Further, the rest state relates to an absence of the movement or state change of the object under the camera preview frame.
Further, in different events the one or more objects that are being captured are also different and such objects may be at rest position or moving at different speeds, also such objects may relate to different states, therefore, the capturing of the video at  normal camera speed will not provide the best results and which further leads to a need in the art to provide a solution to capture automatically one or more real time videos in a plurality of video modes. The plurality of video modes further encompasses at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode. The slow motion mode is used to capture the video where the speed of the object to be captured is very fast and in such instances the slow motion video is captured at 120 FPS to 240 FPS. The hyper motion mode is used to capture the video where the speed of the object to be captured is very slow and in such instances the slow motion video is captured at 1 FPS. Also, the normal motion mode is used to capture the video where the speed of the object to be captured is optimum and in such instances the normal motion video is captured at 30 FPS. Also, in one more instance the FPS rates associated with the slow-motion mode, hyper-motion mode and normal-motion mode may vary based on the speed of the object that is to be captured.
The present disclosure encompasses known methods of object detection in step [306] .
Next, at step [308] , the method comprises detecting, via a speed detection module [106] , an object speed based on a change in position of the identified object. The change in position of the identified object may relate to at least one of a change in state, a change in movement and a change in shape of the identified object under the camera preview frame. Also, the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame, as the sequence of frames in the camera preview frame changes with respect to the change in position of the object. For instance, if the position of a car changes from coordinates (x1, y1) to (x2, y2) in two subsequent frames, then the car (object) is said to undergo change in position.
Next, at step [310] , the method encompasses generating via the speed detection module [106] , a relative speed based on a speed of the camera unit and the detected object speed. The speed of the camera unit is based on a change in the movement and direction of the camera unit [102] . Also, the speed of the camera unit is based on a sensed input of at least one accelerometer. The method also encompasses identifying the sensed input by sensing at least one change in the direction and/or position of the camera unit [102] , via the at least one accelerometer. In an example if a user recording a video via a camera unit [102] installed on his/her user device, is walking from one location to another. In such a case, a number of frames received per second at the camera unit [102] based on the speed and/or direction of the user (or camera unit [102] ) is  the speed of the camera unit. Also, the generated relative speed is a speed measured in frames per second. For instance, if a user is moved from a point A to point B in order to capture a moving object, therefore a position of a camera unit [102] installed at a camera device of the user, also changes in accordance with the movement of the user from the point A to the point B. Therefore, the number of frames being received at the camera unit [102] (i.e. speed of the camera unit) also changes based on the change in the position of a camera unit [102] . Further, in the given instance the position of the object is also simultaneously changed from coordinates (x1, y1) to (x2, y2) in two subsequent frames, the method therefore encompasses generating a relative speed based on a change in a sequence of frames received at a camera unit [102] , wherein the a change in a sequence of frames is further based on the speed of the camera unit and the detected object speed. Furthermore, the speed of the camera unit is the number of frames received at the camera unit [102] , based on the change in the direction and/or position of the camera unit [102] .
Thereafter, at step [312] , the method encompasses comparing, via a processing unit [108] , the generated relative speed with a pre-determined speed range. The pre-determined speed range is a speed range in frames per second (FPS) and the pre-determined speed range may further relates to two pre-defined constant values such as constant K and constant L. For instance, the pre-determined speed range may be a speed range varying from constant L to constant K, wherein the constant L may be 5 frames per second and the constant K may be 85 frames per second. Further, the processing unit [108] is configured to compare the generated relative speed with a pre-determined speed range, to identify whether the generated relative speed is less than constant L, more than constant K or lies between the constants L and K.
Further, at step [314] , the method comprises capturing, via the camera unit [102] , the real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range. Further, the capturing of the real-time video in the plurality of video modes further comprises encoding of the real time video at a revised camera speed such as 2 FPS, 30 FPS and/or 215 FPS. Also, the revised camera speed is further based on the comparison of generated relative speed with the pre-determined speed range. For instance, during capturing a video the object being captured is under the camera preview frame for 15 minutes 40 seconds, and the generated relative speed for first 1 minute 40 seconds is 90 FPS and the generated relative speed for rest 14 minutes is 4 frames per second (FPS) . Also, the pre- determined speed range for the instance is 5 FPS (i.e. constant L) to 85 FPS (i.e. constant K) . Therefore, if the generated relative speed (FPS) is less than L i.e. 5 then time-lapse mode will be selected. If the generated relative speed is in-between 5 to 85 FPS, normal video mode will be selected and recorded. But if the generated relative speed is greater than K i.e. 85 FPS then slow motion video will be recorded. Therefore, in the above instance the method encompasses first capturing/recording of the video automatically in slow motion and thereafter recording of the video automatically in time lapse mode. Also, the method further encompasses storing the captured real time video in the plurality of video modes at a storage unit [110] .
After successfully capturing the real time video in the plurality of video modes, the method further terminates at step [316] .
Furthermore, the one more aspect of the present disclosure relates to user equipment for capturing a real time video in a plurality of video modes comprising at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode. The user equipment comprises a system [100] , wherein the system [100] is configured to receive a camera preview frame to capture a video at normal camera speed. The normal camera speed is 30 frames per second. The system thereafter configured to identify at least one object in the camera preview frame. Further the system is configured to detect an object speed based on a change in position of the identified object. The change in position of the identified object is based on a change in a sequence of frames in the camera preview frame. Thereafter the system is configured to generate a relative speed based on a speed of the camera unit and the detected object speed. The system identifies a sensed input relating to a change in a movement or direction of the camera unit [102] to determine the speed of the camera unit [102] . The system thereafter configured to compare the generated relative speed with a pre-determined speed range. The pre-determined speed range is a speed range in frames per second (FPS) and the pre-determined speed range may further relates to a range of two pre-defined constant values constant K and constant L. Further, the system is configured to capture the real-time video in the plurality of video modes based on the comparison of generated relative speed with the pre-determined speed range.
Further, some of the exemplary use cases of the present disclosure are explained as below:
Referring to Fig. 4, an exemplary use case, in accordance with exemplary embodiments of the present disclosure is shown. At step [402] a starry night sky is shown and step [406] a shooting star at the starry night sky is shown. In order to capture a  video of the starry night sky a user starts recording the video and as the starry night sky is usually still the system [100] of the present disclosure automatically starts recording the video in a time lapse mode and as soon as a shooting star is detected under the camera preview frame (as indicated at step [406] ) , the system [100] automatically switches from the time lapse mode to slow motion mode (as indicated at step [404] ) , as the shooting star appears only for a few seconds and moving at a very fast speed.
Further referring to Fig. 5, an exemplary use case, in accordance with exemplary embodiments of the present disclosure is shown. At step [502] a car racing track prior to staring of a car race is shown and at step [504] two racing cars crossing each other are shown. In order to capture a video of the car racing event, a user starts recording the video and as the cars prior to starting the car race are still or moving at a very slow speed, the system [100] of the present disclosure automatically starts recording the video in a time lapse mode and as soon as the race starts and two fast moving cars crossing each other are detected under the camera preview frame (as indicated at step [506] ) , the system [100] automatically switches from the time lapse mode to slow motion mode (as indicated at step [504] ) , as the crossing of cars will occur only for a few seconds and also as both the cars are moving at a very fast speed.
Furthermore, one more use case of the present disclosure relates to recording a video while driving where a time-lapse video could be desired to be captured. Also, while driving there may some scenic moment that occurs like horses are passing, birds are flying across and these moments are required to be captured in slow-motion. Therefore, in the event of driving, the method of present disclosure encompasses first automatically capturing the video in time lapse mode and thereafter upon occurrence of the scenic moment automatically capturing the video in slow motion mode.
Also, one more use case of the present disclosure relates to automatically capturing of a wedding video in different modes, as in a wedding event there are a number of moments that a user needs to capture in slow motion mode, and also there are various other moments the user wish to capture in time lapse mode and normal video mode. Further, usually a single wedding video with all three modes i.e. time lapse mode, slow motion mode and normal recording mode is done by post editing by adding effects for slow motion and time lapses separately. But the present disclosure provides a solution of automatically capturing of the real time video of the wedding event in the all three modes. The present solution  automatically start recording in time lapse mode for the moments which are repetitive and not changing frequently. Also, the present solution automatically switches to other modes depending upon the speed of the objects in the wedding event that are to be captured.
As evident from the above disclosure, the present solution provides significant technical advancement over the existing solutions by allowing capturing of a single video in multiple video recording modes, automatically.
While considerable emphasis has been placed herein on the disclosed embodiments, it will be appreciated that many embodiments can be made and that many changes can be made to the embodiments without departing from the principles of the present disclosure. These and other changes in the embodiments of the present disclosure will be apparent to those skilled in the art, whereby it is to be understood that the foregoing descriptive matter to be implemented is illustrative and non-limiting.

Claims (15)

  1. A method [300] of capturing a real time video in a plurality of video modes, the method comprising:
    - receiving in real-time, at a camera unit [102] , a camera preview frame to capture a video at normal camera speed;
    - identifying, via an object detection module [104] , at least one object in the camera preview frame;
    - detecting, via a speed detection module [106] , an object speed based on a change in position of the identified object;
    - generating , via the speed detection module [106] , a relative speed based on a speed of the camera unit and the detected object speed;
    - comparing, via a processing unit [108] , the relative speed with a pre-determined speed range; and
    - capturing, via the camera unit [102] , the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
  2. The method as claimed in claim 1 wherein the plurality of video modes comprises at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode.
  3. The method as claimed in claim 1 wherein the normal camera speed is 30 frames per second.
  4. The method as claimed in claim 1 wherein the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame.
  5. The method as claimed in claim 1 wherein the speed of the camera unit is based on a sensed input of at least one accelerometer.
  6. The method as claimed in claim 1 wherein the capturing of the real-time video in the plurality of video modes further comprises encoding of the real time video at a revised camera speed.
  7. The method as claimed in claim 6 wherein the revised camera speed is further based on the comparison of relative speed with the pre-determined speed range.
  8. A system [100] for capturing a real time video in a plurality of video modes, the system comprising:
    - a camera unit [102] , configured to receive a camera preview frame to capture a video at normal camera speed;
    - an object detection module [104] , configured to identify at least one object in the camera preview frame;
    - a speed detection module [106] , configured to:
    detect an object speed based on a change in position of the identified object, and
    generate a relative speed based on a speed of the camera unit and the detected object speed;
    - a processing unit [108] , configured to compare the relative speed with a pre-determined speed range; and
    - the camera unit [102] , configured to capture the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
  9. The system as claimed in claim 8 wherein the plurality of video modes comprises at least one of a slow-motion mode, a hyper-motion mode and a normal-motion mode.
  10. The system as claimed in claim 8 wherein the normal camera speed is 30 frames per second.
  11. The system as claimed in claim 8 wherein the change in position of the identified object is based on a change in a sequence of frames in the camera preview frame.
  12. The system as claimed in claim 8 wherein the system further comprises at least one accelerometer configured to identify a sensed input to determine the speed of the camera unit.
  13. The system as claimed in claim 8 wherein the camera unit configured to capture the real-time video in the plurality of video modes is further based on encoding of the real time video at a revised camera speed.
  14. The system as claimed in claim 13 wherein the revised camera speed is further based on the comparison of relative speed with the pre-determined speed range.
  15. A user equipment for capturing a real time video in a plurality of video modes, the user equipment comprising:
    - a system [100] , configured to:
    receive a camera preview frame to capture a video at normal camera speed;
    identify at least one object in the camera preview frame;
    detect an object speed based on a change in position of the identified object;
    generate a relative speed based on a speed of the camera unit and the detected object speed;
    compare the relative speed with a pre-determined speed range; and
    capture the real-time video in the plurality of video modes based on the comparison of the relative speed with the pre-determined speed range.
PCT/CN2021/092051 2020-06-12 2021-05-07 Method and system for capturing a real-time video in a plurality of video modes WO2021249067A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN202041024847 2020-06-12
IN202041024847 2020-06-12

Publications (1)

Publication Number Publication Date
WO2021249067A1 true WO2021249067A1 (en) 2021-12-16

Family

ID=78845201

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/092051 WO2021249067A1 (en) 2020-06-12 2021-05-07 Method and system for capturing a real-time video in a plurality of video modes

Country Status (1)

Country Link
WO (1) WO2021249067A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070195182A1 (en) * 2006-02-21 2007-08-23 Olympus Corporation Imaging apparatus for setting image areas having individual frame rates
CN101290787A (en) * 2007-04-16 2008-10-22 奥多比公司 Changing video frequency playback speed ratio
CN101729777A (en) * 2009-10-22 2010-06-09 华为终端有限公司 Digital image acquisition method and equipment
CN101806988A (en) * 2009-02-12 2010-08-18 奥林巴斯映像株式会社 Image pickup apparatus and image pickup method
US20120176505A1 (en) * 2011-01-11 2012-07-12 Samsung Electronics Co., Ltd. Method and apparatus for capturing moving picture
CN104683691A (en) * 2015-02-02 2015-06-03 上海小蚁科技有限公司 Photographing method, device and equipment
CN105245817A (en) * 2014-06-19 2016-01-13 深圳中兴力维技术有限公司 Video playback method and video playback device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070195182A1 (en) * 2006-02-21 2007-08-23 Olympus Corporation Imaging apparatus for setting image areas having individual frame rates
CN101290787A (en) * 2007-04-16 2008-10-22 奥多比公司 Changing video frequency playback speed ratio
CN101806988A (en) * 2009-02-12 2010-08-18 奥林巴斯映像株式会社 Image pickup apparatus and image pickup method
CN101729777A (en) * 2009-10-22 2010-06-09 华为终端有限公司 Digital image acquisition method and equipment
US20120176505A1 (en) * 2011-01-11 2012-07-12 Samsung Electronics Co., Ltd. Method and apparatus for capturing moving picture
CN105245817A (en) * 2014-06-19 2016-01-13 深圳中兴力维技术有限公司 Video playback method and video playback device
CN104683691A (en) * 2015-02-02 2015-06-03 上海小蚁科技有限公司 Photographing method, device and equipment

Similar Documents

Publication Publication Date Title
JP6425856B1 (en) Video recording method, server, system and storage medium
US10043551B2 (en) Techniques to save or delete a video clip
US9635307B1 (en) Preview streaming of video data
CN101523894B (en) Imaging device and subject detection method
US9578279B1 (en) Preview streaming of video data
CN105844659B (en) The tracking and device of moving component
US9900499B2 (en) Time lapse user interface enhancements
US9691180B2 (en) Determination of augmented reality information
Ma et al. Video saliency forecasting transformer
US10846515B2 (en) Efficient face detection and tracking
CN102263895A (en) Imaging system, imaging apparatus, interchangeable lens, method of controlling imaging system, and program
CN112511859B (en) Video processing method, device and storage medium
CN109086725B (en) Hand tracking method and machine-readable storage medium
KR101668930B1 (en) Video analytic encoding
KR20190120106A (en) Method for determining representative image of video, and electronic apparatus for processing the method
CN114520886A (en) Slow-motion video recording method and equipment
CN102693292B (en) Method for processing and rapidly retrieving inland ship videos based on RFID
JP7204786B2 (en) Visual search method, device, computer equipment and storage medium
WO2021249067A1 (en) Method and system for capturing a real-time video in a plurality of video modes
US20220230331A1 (en) Method and electronic device for determining motion saliency and video playback style in video
Choudhary et al. Real time video summarization on mobile platform
WO2014106851A1 (en) Determining start and end points of a video clip based on a single click
Nakamura et al. Structuring personal activity records based on attention-analyzing videos from head mounted camera
CN103957472A (en) Timing-sequence-keeping video summary generation method and system based on optimal reconstruction of events
Alam et al. An empirical study of image captioning using deep learning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21822504

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21822504

Country of ref document: EP

Kind code of ref document: A1