RU2658116C2 - Method and device for capturing images - Google Patents

Method and device for capturing images Download PDF

Info

Publication number
RU2658116C2
RU2658116C2 RU2016134879A RU2016134879A RU2658116C2 RU 2658116 C2 RU2658116 C2 RU 2658116C2 RU 2016134879 A RU2016134879 A RU 2016134879A RU 2016134879 A RU2016134879 A RU 2016134879A RU 2658116 C2 RU2658116 C2 RU 2658116C2
Authority
RU
Russia
Prior art keywords
motion
images
device
command
memory
Prior art date
Application number
RU2016134879A
Other languages
Russian (ru)
Other versions
RU2016134879A (en
RU2016134879A3 (en
Inventor
Илья САФОНОВ
Original Assignee
Нокиа Текнолоджиз Ой
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Нокиа Текнолоджиз Ой filed Critical Нокиа Текнолоджиз Ой
Priority to RU2016134879A priority Critical patent/RU2658116C2/en
Publication of RU2016134879A publication Critical patent/RU2016134879A/en
Publication of RU2016134879A3 publication Critical patent/RU2016134879A3/ru
Application granted granted Critical
Publication of RU2658116C2 publication Critical patent/RU2658116C2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles

Abstract

FIELD: information technology.
SUBSTANCE: invention relates to an image capture technology, namely to a method and a device for capturing images. Above image capture device that is used in the method for capturing images, includes at least one processor and at least one memory, in which the computer program code is stored. Wherein at least one memory and the computer program code are configured in such a way, so that, with at least one processor, the device performs at least the following: storing motion information in the memory, containing at least one cue of movement, which relates to a certain desired element of motion, which the user wants to capture in the image; determination of the moment of initiation, in which a command is to be transmitted to capture one or more images, so that the image is taken at the required time; establishing a wireless connection between said device and one or more auxiliary devices; issuing instructions to at least one of the auxiliary devices to trigger the provision of motion sensor signals; wherein the device receives signals from traffic sensors from one or more auxiliary devices; detecting said initiation time in the received motion sensor signals, and issuing a command for capturing one or more images when said initiation time is detected. Above computer program code contains the code for storing information about the movement in memory; code for determining the moment of initiation, in which a command is to be transmitted to capture one or more images; code for establishing a wireless connection between the master and one or more auxiliary devices; code for issuing a command to at least one of the auxiliary devices to start providing motion sensor signals; code for receiving motion sensor signals from one or more auxiliary devices; code for detecting said initiation time in the received motion sensor signals, and code for issuing a command for capturing said one or more images when said initiation time is detected.
EFFECT: image capture.
27 cl, 6 dwg

Description

FIELD OF TECHNOLOGY

[0001] The present invention generally relates to image capture technology. More specifically, the present invention relates to a method and apparatus for capturing images.

BACKGROUND

[0002] Currently, many portable devices are equipped with means for capturing photographs and video images. Most mobile phones, tablet devices, etc. contain a digital camera. In addition, the quality of mobile phone cameras is constantly improving. It is generally accepted to use professional or semi-professional digital cameras to obtain still images (DSC, Digital Still Camera), which allow you to capture a sequence of frames using a short shutter speed, for example, to shoot a scene with fast movement. After that, the best frame is usually selected manually.

[0003] In addition, a number of remote controls are used to obtain images on digital devices, for example, remote with respect to a digital camera or smartphone. In some solutions, one digital camera can be configured as a master camera, and other digital cameras as auxiliary cameras that take pictures simultaneously with the master camera.

[0004] High-speed cameras allow you to take pictures at high speed, but you can not always use such cameras if necessary. In addition, although remote controls provide assistance in the process of photographing, it is necessary to solve the problem of obtaining photographs at the right time.

SUMMARY OF THE INVENTION

[0005] Various aspects of embodiments of the present invention are set forth in the claims.

[0006] In accordance with a first aspect of the present invention, a method is provided. The method includes storing motion information in memory containing at least one motion sign; determination of the launch moment associated with at least one sign of movement; master signal reception of motion sensors; detecting the start time in the received signals of the motion sensors and issuing a command by the master to capture one or more images when the start time is detected.

[0007] The method may be, for example, a method for capturing images by one or more devices.

[0008] In accordance with an embodiment of the present invention, detecting a trigger moment includes determining at least one feature of a motion sensor signal based on received motion sensor signals and comparing said at least one feature of a motion sensor signal with said at least one motion feature, stored in memory.

[0009] According to an embodiment of the present invention, the method also includes establishing a wireless connection between the master device and one or more auxiliary devices and issuing commands to at least one of the auxiliary devices to trigger the provision of motion sensor signals. According to an embodiment of the present invention, motion sensor signals are received by the master device from at least one auxiliary device.

[0010] According to an embodiment of the present invention, receiving motion sensor signals includes receiving, by the master device, motion sensor signals from at least one auxiliary device.

[0011] In accordance with an embodiment of the present invention, issuing a command for capturing one or more images includes issuing a command for capturing one or more images to the host device.

[0012] According to an embodiment of the present invention, issuing a command for capturing one or more images includes issuing a command for capturing one or more images of the at least one auxiliary device.

[0013] According to an embodiment of the present invention, the method also includes downloading or receiving, by the host device, stored traffic information.

[0014] In accordance with an embodiment of the present invention, the method also includes initiating a test session during which the following is performed: receiving, by the master, samples of signals of motion sensors; recording received samples of motion sensor signals and determining at least one motion sign based on recorded samples of motion sensor signals, as well as storing said at least one motion sign.

[0015] According to an embodiment of the present invention, the method also includes performing during a test session: establishing a wireless connection between the master device and one or more auxiliary devices and issuing commands to at least one of the auxiliary devices to trigger the provision of motion sensor signals, the reception of samples of signals of motion sensors during the test session includes the reception of the master device samples of signals of motion sensors at least m Here from one auxiliary device.

[0016] In accordance with an embodiment of the present invention, the method also includes recording a video signal by the master and synchronizing the recorded video signal with the received signal count of the motion sensor.

[0017] According to an embodiment of the present invention, the method also includes receiving information about a user selecting a desired moment in a recorded video signal and selecting a motion characteristic corresponding to a desired moment in the recorded video signal, wherein determining a trigger moment associated with at least one motion symptom, includes determining the launch moment associated with the selected motion sign.

[0018] According to an embodiment of the present invention, the method also includes adjusting at least one image pickup characteristic based on the received motion sensor signals before issuing a command for capturing one or more images, wherein issuing a command for capturing one or more images includes issuing a command for capturing one or more images using said customized at least one image capturing characteristic.

[0019] According to an embodiment of the present invention, the method also includes adjusting at least the image capturing characteristic based on the stored motion information before issuing a command for capturing one or more images, wherein issuing a command for capturing one or more images also includes issuing a command for capturing one or more images using said customized at least one image capturing characteristic.

[0020] According to an embodiment of the present invention, adjusting at least one image pickup characteristic includes adjusting at least one of the following characteristics: exposure, shutter speed, and aperture.

[0021] According to an embodiment of the present invention, the method also includes sharing the captured images with a master device and one or more auxiliary devices.

[0022] In accordance with a second aspect of the present invention, an apparatus is provided. The device comprises at least one processor and at least one memory in which the computer program code is stored. At least one memory and computer program code are configured so that using at least one processor, the device performs at least the following: storing motion information in memory containing at least one motion sign; determination of the launch moment associated with at least one sign of movement; receiving motion sensor signals by said device; detecting the start time in the received signals of the motion sensors and issuing a command to capture one or more images upon detection of the start time.

[0023] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, a device performs the following: detecting a start time by determining at least one sign of a motion sensor signal based on the received signals of the motion sensors and comparing said at least one feature of the motion sensor signal with said at least one traffic sign tions stored in the memory.

[0024] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor the device performs the following: establishing a wireless connection between the device and one or more auxiliary devices; the issuance of at least one of the auxiliary devices commands to start providing the signals of motion sensors and receiving the said device signals of motion sensors from at least one auxiliary device.

[0025] In accordance with an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, a device performs the following: issuing an instruction to said device to capture one or more images.

[0026] In accordance with an embodiment of the present invention, at least one memory and computer program code are configured so that using at least one processor, the device performs the following: issuing at least one of the auxiliary devices commands to capture one or more images.

[0027] According to an embodiment of the present invention, at least one memory and computer program code are configured such that, using at least one processor, a device performs the following: downloading or receiving stored motion information.

[0028] In accordance with an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, the device initiates a test session and performs the following during the test session: receiving samples of motion sensor signals; recording received samples of signals from motion sensors; determining at least one motion sign based on the recorded samples of the motion sensor signals and storing at least one motion sign in the memory.

[0029] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor the device performs the following during a test session: establishing a wireless connection between said device and one or more auxiliary devices issuing commands to at least one of the auxiliary devices to start providing motion sensor signals and receiving motion sensor signals from at least one auxiliary device.

[0030] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, a device performs the following: recording a video signal and synchronizing the recorded video signal with the received signals of the motion sensors.

[0031] In accordance with an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, a device performs the following: receiving information about a user selecting a desired trigger time in a recorded video signal; the choice of the sign of movement corresponding to the desired moment in the recorded video signal, while the start time is determined in relation to the selected sign of movement.

[0032] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, the device performs the following: adjusting at least one image pickup characteristic based on the received motion sensor signals before issuing a command to capture one or more images.

[0033] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, a device performs the following: adjusting at least one image pickup characteristic based on stored motion information before issuing a command to capture one or more images.

[0034] According to an embodiment of the present invention, at least one memory and computer program code are configured such that using at least one processor, the device adjusts at least one of the following characteristics: exposure, shutter speed, and aperture.

[0035] According to an embodiment of the present invention, the at least one memory and computer program code are configured such that by using at least one processor, the device allows the captured images to be shared between said device and one or more accessory devices.

[0036] In accordance with a third aspect of the present invention, a computer program is provided. A computer program comprises code for storing motion information in memory containing at least one motion sign; code for determining the start time associated with at least one sign of movement; code for receiving signals from motion sensors; a code for detecting the start time in the received signals of the motion sensors and a code for issuing a command to capture one or more images when the start time is detected, the computer program being executed by the processor.

[0037] According to an embodiment of the present invention, the computer program is a computer program product comprising a computer-readable medium that stores computer program code for use by a computer.

[0038] In accordance with a fourth aspect of the present invention, an apparatus is provided. The device comprises a processor configured to perform the following: storing motion information in memory containing at least one motion sign; determining the launch moment associated with at least one sign of movement; receiving signals from motion sensors; detecting the start time in the received signals of the motion sensors and issuing a command to capture one or more images when detecting the start time.

[0039] In accordance with a fifth aspect of the present invention, there is provided a computer-readable medium. A computer-readable medium comprises a computer program of program code instructions, the execution of which by a computer performs the following: storing motion information in memory containing at least one motion sign; determination of the launch moment associated with at least one sign of movement; receiving signals from motion sensors; detecting the start time in the received signals of the motion sensors and issuing a command to capture one or more images when detecting the start time.

[0040] In accordance with a sixth aspect of the present invention, an apparatus is provided. The device comprises means for storing motion information in memory containing at least one motion sign; means for determining a launch moment associated with at least one sign of movement; means for receiving device signals of motion sensors; means for detecting a trigger moment in the received signals of the motion sensors; and means for issuing a command for capturing one or more images when a trigger moment is detected.

BRIEF DESCRIPTION OF THE DRAWINGS

[0041] To provide a more complete understanding of embodiments of the present invention, the following is a description of the invention with reference to the accompanying drawings.

[0042] FIG. 1 is a flowchart illustrating method steps in accordance with one embodiment of the present invention.

[0043] FIG. 2 is a flowchart illustrating method steps in accordance with one embodiment of the present invention.

[0044] FIG. 3 is a flowchart illustrating the operations of an example test session in accordance with one embodiment of the present invention.

[0045] FIG. 4 is a flowchart illustrating operations of an example of a basic photography session in accordance with one embodiment of the present invention.

[0046] FIG. 5 shows a graph of the accelerometer reading versus time when the user jumps.

[0047] FIG. 6 shows a block diagram of a device in accordance with one embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

[0048] Embodiments of the present invention and its potential advantages will become apparent in the process of studying FIG. 1-5.

[0049] FIG. 1 shows the operation of a method in accordance with one embodiment of the present invention. Motion information containing at least one sign of movement is stored in the master (step 101). The host device may be a device such as a portable telephone, digital video camera, remote control or tablet device. Traffic information contains at least one sign of movement. Such a feature may include, but is not limited to, a specific desired motion element that the user wants to capture in the image. For example, a sign of movement may relate to a change in acceleration at the highest point of the jump, or to a specific reference form of the motion sensor signal that is associated with a particular movement. The sign of movement may also be a single value of the acceleration reference. Access to this feature can be carried out directly in the stored traffic information, or this feature can be encoded.

[0050] The master determines a start time associated with at least one sign of movement (step 102). In one embodiment of the present invention, the start-up time is the moment at which the command for capturing the image is to be transmitted so that the image is captured at the desired point in time. When determining the start time, the delay introduced by the device when taking the image can be taken into account. The start-up time can be essentially the point in time at which you want to take a photo, or the start-up time can be preceded by the time you took the picture.

[0051] Then, the master device starts receiving signals of the motion sensors (103). Motion sensors may include, for example, an accelerometer and / or gyroscope (more specifically, an angular velocity sensor) that reflect a motion profile. The barometer of microelectromechanical systems (MEMS, Microelectromechanical system) (pressure sensor) can also reflect movement and can be part of a motion sensor, as well as be a combination of various sensors.

[0052] After the host device begins to receive motion sensor signals, this device detects the start time in the received signals (step 104). Under the start time, defined in the received signals, is understood the moment of initiation of issuing a command to capture images.

[0053] Upon detection of a start time, the host issues a command to capture one or more images (step 105). The master can issue this command for itself, in other words, a command to use its own camera. The master device may also issue a command to capture one or more images in at least one of the auxiliary devices. The master can issue a command immediately after detecting the start time or with some delay.

[0054] These operations can be performed using various means, for example, using a processor in a device, or by encoding operations in the form of a computer program and executed by a processor. The processor may be part of a device, such as a computer, mobile phone, tablet, digital camera, or any other suitable device. The proposed method can be implemented, for example, in the form of one or more interacting applications for smartphones or other mobile devices. Functions can also be implemented, for example, within the operating system of mobile devices.

[0055] In FIG. 2 shows the operation of a method in accordance with one embodiment of the present invention. In accordance with this method, at least two devices are used: one master device and one or more slave devices.

[0056] Motion information containing at least one motion indication is stored in the master (step 201). The host device may be a device such as a cell phone, digital camera, remote control or tablet device. Traffic information stored in the master device can be downloaded from an Internet server or received in advance from another device, copied in the master device or generated by it. Information can be generated in advance by first performing a test session. An optional test session is described in detail with reference to FIG. 3.

[0057] The motion information contains at least one sign of movement. Such a feature may include, but is not limited to, a specific desired motion element that the user wants to capture in the image. For example, a sign of movement may relate to a change in acceleration at the highest point of the jump, or to a specific reference form of the motion sensor signal that is associated with a particular movement, or to a specific value of acceleration. Access to this feature can be carried out directly in the stored traffic information, or this feature can be encoded. As an example of motion information, a pre-recorded signal profile of a motion sensor containing certain features can be cited. The user can save profiles of specific movements in a data set (library) and apply them when taking photographs.

[0058] The master determines a start time associated with at least one sign of movement (step 202). This process can be performed, for example, by receiving user selection information or automatically. The trigger moment associated with the sign is determined for subsequent initiation of photography, and thus, the trigger moment can be determined so that the movement of interest is recorded on the resulting image. For example, the launch time can be essentially the moment the desired change in acceleration is reached at the highest point of the jump, or it can slightly precede this time to compensate for the delay introduced by the camera. In an alternative embodiment of the invention, the start time, for example, can be selected manually or automatically based on the samples of the motion sensor signal.

[0059] A wireless connection is established between the master device and the at least one auxiliary device, and the master device issues a “Start” command for the auxiliary devices (step 203). A wireless connection may include, but is not limited to, a Wi-Fi or Bluetooth connection. Establishing a wireless connection may be the first operation or, alternatively, one of the subsequent steps performed before receiving signals from motion sensors coming from auxiliary devices (that is, before step 204 shown in Fig. 2). The master can be equipped with a wireless module, such as a Wi-Fi or Bluetooth module. Accessories can also be equipped with a similar wireless module.

[0060] Then, the motion sensors begin transmitting signals to the master device, and the master device begins to receive these signals (step 204). Signals can be received essentially in real time, that is, with a slight delay, or come in the form of a sequence of discrete samples. The sampling frequency of the signals can be, for example, from 200 to 400 Hz. Motion sensors may include, for example, an accelerometer and / or gyroscope (more specifically, an angular velocity sensor) that reflect a motion profile. The barometer of microelectromechanical systems (MEMS, Microelectromechanical system) (pressure sensor) can also reflect movement and can be part of a motion sensor, as well as be a combination of various sensors. In accordance with one embodiment of the present invention, signals may be transmitted to the host device from one or more motion sensors. One of the motion sensors may be a motion sensor of the host device itself, while other motion sensors may be installed in one or more auxiliary devices. Auxiliary devices can be divided into groups of measuring auxiliary devices that transmit signals from motion sensors, and auxiliary devices for photographing, which may or may not transmit signals from motion sensors and receive commands for subsequent image capture.

[0061] After the host device has started receiving motion sensor signals, this device can detect one or more trigger times in the received signals (step 205). Under the start time, defined in the received signals, is understood the moment of initiation of the command to capture images or images. Detecting a trigger time may include determining at least one feature of the motion sensor signal based on the received motion sensor signals and comparing one or more features of the received motion sensor signals with at least one motion feature contained in the stored motion information. The determination of at least one feature of the signal of the motion sensor may directly relate to the feature of the motion or the determination of the calculated feature of the signal representing the feature of motion. For example, if the signs of the received signals of the motion sensors correspond to the signs contained in the stored information about the movement, which is associated with the aforementioned specific trigger time, then detect the trigger moment of the received signal. In another embodiment of the present invention, the master can compare the received signal samples of the motion sensors with the stored signal samples or with profiles (stored as motion information) and detect a trigger moment when it substantially coincides with said specific trigger moment in the stored samples or profiles .

[0062] Upon detection of a start time, the host issues a command to capture one or more images (step 206). The master can issue this command for itself, that is, a command to use its own camera. This device can alternatively or additionally also issue a command for capturing one or more images in at least one of the auxiliary devices. At least one auxiliary device may be an additional auxiliary device for photographing. The command may include instructions for capturing images simultaneously by all devices or in a predetermined or random sequence. Images may be, for example, high resolution photographs.

[0063] In one embodiment of the present invention, before issuing a command to capture one or more images, at least one image capture characteristic may be set based on the received signals of the motion sensors or based on the stored motion information. At least one image capture characteristic may include exposure, shutter speed, and aperture, or a combination thereof. These features can also be adjusted based on ambient lighting or flash use. This aspect of the invention is described in more detail with reference to FIG. 5.

[0064] In an optional step 207, the images can be shared between the master and auxiliary devices. Such sharing can be realized using wireless technology, over the Internet or a wired connection.

[0065] FIG. 3 shows an example of test session operations (in other words, a training mode) in accordance with an embodiment of the present invention. In one embodiment, a master device and one or more accessory devices are used. In another embodiment of the present invention, the test session can only be performed by the master. Between the master device and all auxiliary (slave) devices establish a wireless connection. For this, Wi-Fi or Bluetooth technology or any other wireless data technology can be used. If subscribers or moving objects participate in a test session, they can transfer one or more devices, that is, auxiliary devices, on their bodies. When the participants are ready, the master issues a “Start” command (step 301). It contains a command for at least one auxiliary device to start the process of providing motion sensor signals. If manual control is required, the user may be prompted to transmit the “Start” command by pressing a button. Ancillary devices can start collecting motion sensor signals, such as a three-axis accelerometer, gyroscope, and a combination of various sensors, and start transmitting signals to the host device (step 302). In one embodiment of the present invention, assistive devices may generate audible signals and / or vibration signals to indicate to the session participants the need to perform the desired movement. The master device receives and records the samples of the signals of the motion sensors of the auxiliary devices (step 303). In one embodiment of the present invention, the master device can also record video using its own camera. In the case of recording a video signal, two recordings (i.e., the video signal and the signals of the motion sensors) are synchronized. In one embodiment of the invention, samples of the accelerometer and gyroscope readings, as well as projection samples on the vertical axis, can be added to packets transmitted to the master device that records the video signal. To suppress noise, samples can also be processed with a low-pass filter. The packet rate may coincide with or exceed the frame rate of the video signal.

[0066] In one embodiment of the present invention, the master device can receive and record samples of motion sensor signals from its own sensor or its own motion sensors. In this embodiment, a similar video synchronization procedure may be performed.

[0067] After the required motions are completed, the host device issues a Stop command to the auxiliary devices (step 304) and stops the recording process of the signals of the auxiliary device motion sensors (step 305). If a video signal was recorded by the master device, this device also stops recording it at step 305. Then, at least one motion sign is determined based on the recorded motion sensor signals and at least one motion sign is stored in the memory (step 306). In one of the embodiments of the present invention, the sign of movement can be selected automatically. In another embodiment of the invention, the sign of movement may be selected based on the selection information entered by the user. For example, a user may select a recorded sample of a motion sensor signal indicating a motion of interest. In an alternative embodiment of the invention, if a video signal is recorded, the required moment in the video signal can be selected by the user, for example, in accordance with the moment when a sign of a movement of interest is detected. Then, in the stored motion information, a motion characteristic corresponding to the selected required moment is selected. In addition, in one embodiment of the present invention, based on the speed of the movement, an exposure time, for example, can be additionally estimated.

[0068] The host device stores the results of the test session as part of the stored motion information (step 307). Results may include synchronized video and motion sensors, as well as selected trigger times. Results may also include, for example, holding time. In addition, test session results can be shared between devices and / or users.

[0069] FIG. 4, in accordance with an embodiment of the present invention, operations of the main session (i.e., the actual photo session) performed after the test session shown, for example, in FIG. 3, or after downloading the test session data. The master device downloads the results of the test session (step 401). Results for a given type of dynamic motion can be selected automatically or entered by the user. A wireless connection is established between the master and auxiliary devices, and the master issues an “Start” command to the auxiliary devices to start the main session (step 402). It will be apparent to one skilled in the art that in an alternative embodiment of the invention, a wireless connection may also be established in a first step.

[0070] The auxiliary devices begin to transmit motion sensor signals to the master, and the master begins to receive these signals (step 403). Ancillary devices can transmit motion sensor signals in packets using the same filtering procedure as during the tests. Assistive devices may also generate sound and / or vibration signals to indicate the start of a main session. Then, the participant or participants in the session perform the required movements. The master detects the start time in the received signal or signals of the motion sensors (step 404). This procedure can be performed by determining at least one feature of the motion sensor signal based on the received motion sensor signals and comparing said at least one feature of the motion sensor signal with at least one motion feature stored in the memory. The determination of at least one feature of the motion sensor signal may include determining the actual feature of the movement (for example, a value of a measured acceleration reference) or a computed representation of the feature of the movement. If such a determination is made by comparison, a trigger moment is detected when certain signs of the signal substantially coincide with a sign or signs in the stored motion information.

[0071] Then, upon detecting the start time, the master transmits a command for capturing images to one or more photography devices (step 405). The host device may be one of the photography devices, or it may be the only photography device. If a start moment is detected for only a part of the auxiliary devices, the master can be configured to issue a command, for example, based on two or more detected start times. Thus, several pictures can be taken. In one embodiment of the present invention, if several trigger points are detected, a multiple exposure photograph can be constructed based on the captured images. This can be done, for example, by photographing various phases of movement (each of which is determined by the moment of launch), followed by combining the obtained photographs in one image. A multi-exposure photograph can be, for example, an image with mixed translucent layers, fragments of several photographs combined into one, or a collage.

[0072] After taking a photograph or photographs, the host device stops receiving sensor signals (step 406). To complete the main session, it can also issue a Stop command for all auxiliary devices. In one embodiment of the present invention, newly acquired photographs may be shared between the host and assistive devices.

[0073] FIG. 5 shows an example of a graph of accelerometer readings in the case of a user jumping in whose pocket an auxiliary device is located. In FIG. 5 shows a fragment corresponding to the time of launch. The horizontal axis represents the time values (in seconds), and the vertical axis shows the accelerometer readings (in m / s 2 ). When determining or detecting a trigger point, camera delay may be considered. The following characteristics can be considered as an example of the features of a fragment: the number of intersections of the middle level in front of the fragment, the sign of the derivative, and the value of the signal and / or its derivative.

[0074] In one embodiment of the present invention, the following approach may be used to estimate the exposure time as a function of speed. If the master device is stationary during the test session, then it is assumed that its initial speed V0 is zero; otherwise, the velocity V0 is equal to some predetermined value, for example 15 m / s. For a short period of time dt, for example, between two consecutive counts, the movement can be considered uniform, and the current speed can be determined as follows: V (i) = V (i-1) + a (i) ⋅ dt, where i = 1 ... N; a (i) is the current value of the acceleration; V (0) = V0. This allows us to estimate the maximum speed Vm during the tests. Under the assumption that the minimum size (height and / or width) of the captured image is W pixels, and the minimum size of the captured scene is two meters, since the movement of the person is considered and this figure corresponds to the height of the person, the exposure time calculated by the formula t = (2 / W) / Vm, allows you to capture the image without blurring the image due to movement. When finalizing the exposure time, the lighting conditions during the main photography session may also be taken into account.

[0075] FIG. 6 is a block diagram of a device, such as a mobile terminal, in accordance with an embodiment of the present invention. Although some characteristics of the device are illustrated and described below by way of example, embodiments of the present invention can also be used by other types of electronic devices such as mobile phones, laptop computers, personal digital assistants (PDAs), pagers, laptops, gaming devices, television devices and electronic systems and other types of devices.

[0076] As shown, a device may include at least one processor 601 associated with a memory 602 or memory modules 602. The processor 601 is configured to store, control, write, and / or read information from memory 602. It can also be configured to control the operation of the device. Additionally, the device may include a wireless connection module 603, a camera 604, for example a digital camera, a display 605, and an input interface 606, all of which components can be connected to the processor 601 in the operating mode. The processor 601 can be configured to control other elements of the device through an effective control alarm. The processor 601 may be implemented, for example, in the form of various means, including electrical circuits, at least one processing core, one or more microprocessors working in conjunction with a digital signal processor (s), one or more processors working without using a digital signal processor , one or more coprocessors, one or more multicore processors, one or more controllers, processing circuits, one or more computers, other various processing elements, including integrated circuits, such as ASIC (application specific integrated circuit), or FPGA (field programmable gate array), or combinations thereof. Accordingly, although in FIG. 6 shows one processor, in some embodiments of the present invention, a plurality of processors or processing cores may be used as processor 601. The signals transmitted and received by the processor 603 using the wireless connection module 603 may include signaling information in accordance with a cellular system radio interface standard and / or any number of different wired or wireless network communication technologies, including, but not limited to, technologies such as Wi- Fi, global interoperability for microwave access (WiMax, Worldwide Interoperability for Microwave Access), wireless local area network (WLAN, wireless local access network), technologies defined, for example, by 802.11, 802.16 titut of Electrical and Electronics Engineers (IEEE, Institute of Electrical and Electronics Engineers), etc. In addition, these signals may include voice data, user-generated data, user-requested data, and the like. In this regard, the device may be configured to function according to one or more radio interface standards, communication protocols, modulation types, access types, and the like. More specifically, the device can operate in accordance with various communication protocols of the first generation (1G), second generation (2G), generation 2.5G, third generation (3G), fourth generation (4G), communication protocols of the multimedia subsystem for transmitting data over the Internet protocol (IMS, Internet Protocol Multimedia Subsystem), for example, in accordance with the session initiation protocol (SIP, session initiation protocol), etc.

[0077] The processor 601 may comprise a user interface circuit configured to control at least some functions of one or more user interface elements, such as a camera 604, a display 605, an input interface 606, and the like. The processor 601 and / or the user interface circuit of the processor 601 may be configured to control one or more functions of one or more user interface elements using computer program instructions (eg, software and / or firmware) stored in a memory 602 available to the processor 601 The memory 602 may include, for example, volatile memory, non-volatile memory, and the like. For example, volatile memory may include random access memory (RAM, Random Access Memory), including dynamic and / or static RAM memory, internal or external cache memory, etc. Non-volatile memory, which may be internal and / or removable, may include, for example, read-only memory, flash memory, magnetic storage devices (e.g., hard disks, floppy drives, magnetic tapes, etc.), storage devices and / or optical disc media, non-volatile random access memory (NVRAM, non-volatile random access memory), etc.

[0078] The input interface 606 may include means (not shown in the drawing) that allow the device to receive data; such means include, for example, a keyboard, a touch screen, a joystick and / or at least one other information input device. The device may also contain other short-range transceivers, such as an infrared (IR) transceiver, a Bluetooth ™ transceiver using technology developed by a consortium of Bluetooth technology, a wireless transceiver using a universal serial bus (USB, universal serial bus), and etc. The Bluetooth ™ transceiver can be configured to operate in accordance with Bluetooth ™ technology at low and ultra low power levels, for example, according to Wibree ™ radio standards.

[0079] The apparatus shown in FIG. 6 may be configured to implement one or more embodiments of the present invention in accordance with FIG. 1-4 and can act as a master.

[0080] Without limiting the scope, interpretation, or application of the following claims, the technical result of one or more embodiments of the present invention disclosed in this description is the ability to capture images of points of interest using one or more standard photography devices, such as telephones with built-in digital camera. Another technical result of one or more embodiments of the present invention is the precise selection of points of interest when photographing dynamic movements. Another technical result of one or more embodiments of the present invention is the automatic adjustment of image characteristics for dynamic movements. Another technical result of one or more embodiments of the present invention is the elimination of the delay between pressing a button and the actual image capture, as well as eliminating camera shake when a button is pressed.

[0081] Embodiments of the present invention may be implemented as software, hardware, application logic, or a combination of software, hardware, and application logic. In one embodiment of the present invention, application logic, software, or a set of instructions are stored on one of various conventional computer-readable media. In the context of this description, a “machine-readable medium” may be any medium or means capable of containing, storing, transmitting, distributing, or transporting instructions for use (or in connection with use) of a system, equipment, or instruction execution device, such as a computer. A computer-readable medium may include a computer-readable medium, which may be any medium or means capable of containing or storing instructions for using (or in connection with using) a system, equipment, or instruction execution device, such as a computer.

[0082] If necessary, the various functions discussed in this description may be performed in a different order and / or simultaneously. In addition, if necessary, one or more of the above functions may be combined or optional.

[0083] Although various aspects of the present invention are set forth in the independent claims, other aspects of the invention include other combinations of the features described in the described embodiments of the invention and / or the dependent claims, with the features indicated in the independent claims, and not only those combinations that are expressly indicated in the claims.

[0084] It should also be noted here that although the embodiments of the present invention are described above, this description should not be construed in a limiting sense. On the contrary, various modifications and changes can be made within the spirit of the present invention defined by the attached claims.

Claims (84)

1. The method of capturing images, including:
storing the master information in the memory of the motion information containing at least one sign of motion, which relates to a specific desired element of motion that the user wants to capture in the image;
determining by the master device the moment of initiation at which the command for capturing one or more images is to be transmitted so that the image is captured at the required time, while said moment is associated with at least one sign of movement;
Establishing a wireless connection between the master device and one or more auxiliary devices;
the issuance by the master of at least one of the auxiliary devices of a command to start providing signals from motion sensors;
receiving, by the master, signals of motion sensors from one or more auxiliary devices;
detection by the master of said initiating moment in the received signals of motion sensors and
the issuing of a command by the master to capture one or more images upon detection of said initiation moment.
2. The method according to p. 1, in which the detection of said initiation moment includes:
determining at least one feature of the motion sensor signal based on the received motion sensor signals; and
comparing said at least one motion characteristic of the motion sensor signal with said at least one motion characteristic stored in the memory.
3. The method according to claim 1 or 2, in which issuing a command to capture one or more images includes issuing a command to capture one or more images to the host device.
4. The method of claim 1, wherein issuing a command for capturing one or more images includes issuing a command for capturing one or more images of the at least one auxiliary device.
5. The method according to claim 1 or 2, further comprising loading or receiving, by the host device, stored traffic information.
6. The method according to p. 1 or 2, which also includes initiating a test session, during which perform the following:
reception by the master of the samples of the motion sensor signal;
recording received samples of the motion sensor signal and
determining at least one motion sign based on the recorded samples of the motion sensor signal and storing said at least one motion sign in memory.
7. The method according to p. 6, including also performing during the test session:
establish a wireless connection between the master device and one or more auxiliary devices and
issuing at least one of the auxiliary devices commands to start providing the signals of motion sensors;
the reception of samples of the signal of the motion sensor during the test session includes receiving the master device samples of the signal of the motion sensor from at least one auxiliary device.
8. The method of claim 6, further comprising recording a video signal by the host device and synchronizing the recorded video signal with the received samples of the motion sensor signal.
9. The method according to p. 8, including also:
receiving information about the user selecting the desired moment in the recorded video signal and
selection of a sign of movement corresponding to the required moment in the recorded video signal;
the determination of the moment of initiation associated with at least one sign of motion includes determining the moment of initiation associated with the selected sign of motion.
10. The method according to p. 1 or 2, including also:
setting at least one image capture characteristic based on the received signals of the motion sensors before the master issues a command to capture one or more images;
wherein issuing a command for capturing one or more images also includes issuing a command for capturing one or more images using said configured at least one image capturing characteristic.
11. The method according to p. 1 or 2, including also:
setting at least one image capture characteristic based on the stored motion information before issuing a command by the master to capture one or more images;
wherein issuing a command for capturing one or more images also includes issuing a command for capturing one or more images using said configured at least one image capturing characteristic.
12. The method of claim 10, wherein adjusting the at least one image capture characteristic includes adjusting at least one of the following characteristics: exposure, shutter speed, and aperture.
13. The method of claim 1 or 2, further comprising sharing the captured images with a master device and one or more auxiliary devices.
14. A device for capturing images containing:
at least one processor and
at least one memory in which computer program code is stored;
at least one memory and computer program code are configured so that using at least one processor, the device performs at least the following:
storing in the memory information about the movement containing at least one sign of movement, which refers to a specific desired element of motion that the user wants to capture in the image;
determining the moment of initiation at which the command for capturing one or more images is to be transmitted so that the image is captured at the desired time, said moment being associated with at least one sign of movement;
establishing a wireless connection between said device and one or more auxiliary devices;
issuing at least one of the auxiliary devices commands to start providing the signals of motion sensors;
receiving device signals of motion sensors from one or more auxiliary devices;
detecting said initiation moment in the received signals of the motion sensors and
issuing a command to capture one or more images upon detection of said initiation moment.
15. The device according to p. 14, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
detecting said initiating moment by determining at least one feature of the motion sensor signal based on the received motion sensor signals; and comparing said specific at least one feature of the motion sensor signal with said at least one motion characteristic stored in the memory.
16. The device according to p. 14, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
issuing commands to said device to capture one or more images.
17. The device according to p. 14, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
issuing at least one of the auxiliary devices commands for capturing one or more images.
18. The device according to p. 14 or 15, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
Download or receive stored traffic information.
19. The device according to p. 14 or 15, in which at least one memory and computer program code are configured so that using at least one processor, the device initiates a test session and performs the following during the test session:
receiving samples of signals from motion sensors;
recording received samples of signals from motion sensors and
determining at least one motion sign based on the recorded samples of the signals of the motion sensors and storing said at least one motion sign in memory.
20. The device according to p. 19, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following during a test session:
establishing a wireless connection between said device and one or more auxiliary devices;
issuing at least one of the auxiliary devices commands to start providing the signals of motion sensors and
receiving said device of motion sensor signals from at least one of the auxiliary devices.
21. The device according to p. 19, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
video recording and
synchronization of the recorded video signal with the received samples of the signals of the motion sensors.
22. The device according to p. 21, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
receiving information about the user choosing the moment of initiation in the recorded video signal and
selection of a sign of movement corresponding to the required moment in the recorded video signal;
however, the initiation moment is determined in relation to the selected sign of movement.
23. The device according to p. 14 or 15, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
setting at least one image capture characteristic based on the received signals of the motion sensors before issuing a command to capture one or more images.
24. The device according to p. 14 or 15, in which at least one memory and computer program code are configured so that using at least one processor, the device performs the following:
setting up at least one image capture characteristic based on stored motion information before issuing a command to capture one or more images.
25. The device according to p. 23, in which at least one memory and computer program code are configured so that using at least one processor, the device performs at least one of the following characteristics: exposure, shutter speed and aperture.
26. The device according to p. 14 or 15, in which at least one memory and computer program code are configured so that using at least one processor, the device provides the sharing of captured images by the said device and one or more auxiliary devices.
27. A computer-readable medium on which a computer program is stored comprising a computer program code intended for use by a computer, said computer program code comprising:
a code for storing motion information in memory containing at least one motion sign that relates to a specific desired motion element that the user wants to capture in the image;
code for determining the initiation moment at which the command for capturing one or more images is to be transmitted so that the image is captured at the desired moment in time, said moment being associated with at least one sign of movement;
code for establishing a wireless connection between the master device and one or more auxiliary devices;
code for issuing at least one of the auxiliary devices commands to start providing signals from motion sensors;
code for receiving signals from motion sensors from one or more auxiliary devices;
code for detecting said moment of initiation in the received signals of motion sensors and
code for issuing a command to capture said one or more images upon detection of said initiation moment;
wherein the computer program is executed by the processor.
RU2016134879A 2016-08-26 2016-08-26 Method and device for capturing images RU2658116C2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
RU2016134879A RU2658116C2 (en) 2016-08-26 2016-08-26 Method and device for capturing images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
RU2016134879A RU2658116C2 (en) 2016-08-26 2016-08-26 Method and device for capturing images

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
RU2013150049/08A Division RU2013150049A (en) 2013-11-11 2013-11-11 Method and device for capture of images

Publications (3)

Publication Number Publication Date
RU2016134879A RU2016134879A (en) 2018-03-01
RU2016134879A3 RU2016134879A3 (en) 2018-03-01
RU2658116C2 true RU2658116C2 (en) 2018-06-19

Family

ID=61596974

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2016134879A RU2658116C2 (en) 2016-08-26 2016-08-26 Method and device for capturing images

Country Status (1)

Country Link
RU (1) RU2658116C2 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6700487B2 (en) * 2000-12-06 2004-03-02 Koninklijke Philips Electronics N.V. Method and apparatus to select the best video frame to transmit to a remote station for CCTV based residential security monitoring
US20060203101A1 (en) * 2005-03-14 2006-09-14 Silsby Christopher D Motion detecting camera system
US20080298796A1 (en) * 2007-05-30 2008-12-04 Kuberka Cheryl J Camera configurable for autonomous operation
US20110279683A1 (en) * 2010-05-17 2011-11-17 Edward John Yarmchuk Automatic Motion Triggered Camera with Improved Triggering

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6700487B2 (en) * 2000-12-06 2004-03-02 Koninklijke Philips Electronics N.V. Method and apparatus to select the best video frame to transmit to a remote station for CCTV based residential security monitoring
US20060203101A1 (en) * 2005-03-14 2006-09-14 Silsby Christopher D Motion detecting camera system
US20080298796A1 (en) * 2007-05-30 2008-12-04 Kuberka Cheryl J Camera configurable for autonomous operation
US20110279683A1 (en) * 2010-05-17 2011-11-17 Edward John Yarmchuk Automatic Motion Triggered Camera with Improved Triggering

Also Published As

Publication number Publication date
RU2016134879A3 (en) 2018-03-01
RU2016134879A (en) 2018-03-01

Similar Documents

Publication Publication Date Title
US10367997B2 (en) Enriched digital photographs
US20180059511A1 (en) Continuous autofocus mechanisms for image capturing devices
CN104243819B (en) Photo acquisition methods and device
CN106254756B (en) Filming apparatus, information acquisition device, system and method and recording medium
US9148567B2 (en) Methods and devices for controlling camera image capture
WO2017181556A1 (en) Video game live streaming method and device
US20170034430A1 (en) Video recording method and device
US8736716B2 (en) Digital camera having variable duration burst mode
US9332208B2 (en) Imaging apparatus having a projector with automatic photography activation based on superimposition
CN102263899B (en) Photographing device and control method therefor
RU2599177C2 (en) Method of photographing controlling, device and terminal
US7483061B2 (en) Image and audio capture with mode selection
US10455180B2 (en) Electronic apparatus and method for conditionally providing image processing by an external apparatus
EP2878121B1 (en) Method and apparatus for dual camera shutter
TWI464513B (en) Wireless communications systems, portable electronic devices and methods for controlling a remote flashlight source
EP2731326A2 (en) Method and apparatus for shooting and storing multi-focused image in electronic device
KR20150009184A (en) Apparatus and method for processing an image having a camera device
CN101317445B (en) Imaging device and imaging device body
CN101675659B (en) System and method of photography using desirable feature recognition
JP4277837B2 (en) Imaging device
CN107770452B (en) Photographing method, terminal and related medium product
US8848097B2 (en) Image processing apparatus, and method, for providing special effect
US8144232B2 (en) Camera system and method for picture sharing using geotagged pictures
KR101834674B1 (en) Method and device for image photographing
US20130044228A1 (en) Motion-Based Video Stabilization