WO2021256764A1 - Dispositif et procédé de stockage vidéo - Google Patents

Dispositif et procédé de stockage vidéo Download PDF

Info

Publication number
WO2021256764A1
WO2021256764A1 PCT/KR2021/007164 KR2021007164W WO2021256764A1 WO 2021256764 A1 WO2021256764 A1 WO 2021256764A1 KR 2021007164 W KR2021007164 W KR 2021007164W WO 2021256764 A1 WO2021256764 A1 WO 2021256764A1
Authority
WO
WIPO (PCT)
Prior art keywords
storage
image
time stamp
swing
motion
Prior art date
Application number
PCT/KR2021/007164
Other languages
English (en)
Korean (ko)
Inventor
최명철
이호형
김준오
백성주
Original Assignee
주식회사 브이씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 브이씨 filed Critical 주식회사 브이씨
Publication of WO2021256764A1 publication Critical patent/WO2021256764A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/915—Television signal processing therefor for field- or frame-skip recording or reproducing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/9201—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

  • the present invention relates to an image storage device and an image storage method.
  • the golfer determines a target point in consideration of the current position of the golf ball and the position of the hole, selects an appropriate golf club and hits the golf ball so that the golf ball moves to the target point.
  • a golfer's swing motion is very important in order to move the golf ball to a desired target point.
  • a golfer wants to shoot a swing video to analyze his or her swing motion or to refer to the swing motion of another golfer, and accordingly, a technique for recording and reproducing a swing video is attracting attention.
  • An object of the present invention is to provide an image storage device and an image storage method capable of reducing storage capacity while providing good reproduction quality to a user with respect to a photographed swing image.
  • An image storage device includes: a motion determination module for determining a golfer's motion using a first camera and extracting a time stamp related to the motion; a storage section setting module for setting a plurality of storage sections in the swing image captured by the second camera based on the time stamp; and storing the swing image at a first frame rate for a first storage section among the plurality of storage sections, and storing the swing image at a second frame rate different from the first frame rate for a second storage section among the plurality of storage sections. It may include an image storage module.
  • the motion determination module may determine the motion of the golfer by performing image recognition of a golf ball or a club from an image captured by the first camera.
  • the motion determination module detects at least one of a recognition result for a golf ball or club obtained by performing image recognition, an impact sound detection sensor, an infrared sensor, and a MEMS (Micro Electro Mechanical System) sensor.
  • a golfer's motion can be determined by analyzing the recognition result of the golf ball or club obtained by using the same.
  • the capturing frame rate of the first camera may be higher than the capturing frame rate of the second camera.
  • the storage section setting module may set a plurality of storage sections by matching the time stamp extracted by the motion determination module to the swing image.
  • the storage interval setting module receives a preset adjustment parameter from the outside, and generates a new time stamp by performing an operation that reflects the adjustment parameter to the time stamp extracted by the operation determination module, and , it is possible to set a plurality of storage sections in the swing image by using the new time stamp.
  • the storage interval setting module may determine a storage start time and a storage end time based on the time stamp extracted by the operation determination module.
  • An image storage device includes: a motion determination module for determining when a golfer's motion occurs using a sensor and extracting a time stamp for the time; a storage section setting module for setting a plurality of storage sections in a swing image captured using a camera, based on the time stamp; and storing the swing image at a first frame rate for a first storage section among the plurality of storage sections, and storing the swing image at a second frame rate different from the first frame rate for a second storage section among the plurality of storage sections. It may include an image storage module.
  • the senor includes an impact sound detection sensor
  • the operation determination module determines an impact point by sensing the impact sound of a golf ball and a club using the impact sound detection sensor
  • a storage interval setting module may set a plurality of storage sections by matching the time stamp for the impact point to the swing image.
  • the senor includes an infrared sensor
  • the motion determination module determines the impact point by determining the starting point of the golf ball using the infrared sensor
  • the storage section setting module is at the impact point
  • a plurality of storage sections can be set by matching the time stamp for the swing to the swing image.
  • the senor includes a MEMS sensor
  • the motion determination module determines the impact point by sensing the amount of impact on the golf ball and the club using the MEMS sensor
  • the storage interval setting module is the impact point
  • a plurality of storage sections can be set by matching the time stamp for the swing image with the swing image.
  • An image storage device receives a swing image captured by using a camera, performs image recognition on a golf ball or club from the swing image to determine the golfer's motion, and time associated with the motion an operation determination module for extracting a stamp; a storage section setting module configured to set a plurality of storage sections in the swing image based on the time stamp; and storing the swing image at a first frame rate for a first storage section among the plurality of storage sections, and storing the swing image at a second frame rate different from the first frame rate for a second storage section among the plurality of storage sections. It may include an image storage module.
  • the motion determination module a golf ball obtained by using at least one of a recognition result for a golf ball or club obtained by performing image recognition, an impact sound detection sensor, an infrared sensor, and a MEMS sensor
  • the golfer's motion may be determined by analyzing the recognition result of the club together.
  • the storage section setting module may set a plurality of storage sections by matching the time stamp extracted by the motion determination module to the swing image.
  • the storage interval setting module receives a preset adjustment parameter from the outside, and generates a new time stamp by performing an operation that reflects the adjustment parameter to the time stamp extracted by the operation determination module, and , it is possible to set a plurality of storage sections in the swing image by using the new time stamp.
  • An image storage method includes the steps of: determining an operation of a golfer and extracting a time stamp associated with the operation; setting a plurality of storage sections in the swing image based on the time stamp; and storing the swing image at a first frame rate for a first storage section among the plurality of storage sections, and storing the swing image at a second frame rate different from the first frame rate for a second storage section among the plurality of storage sections.
  • the step of extracting the time stamp includes determining the motion of the golfer by performing image recognition on a golf ball or club from an image captured by a first camera
  • the step of setting the storage section of may include setting a plurality of storage sections in the swing image captured by the second camera.
  • the step of extracting the time stamp includes a recognition result for a golf ball or club obtained by performing image recognition, and at least one of an impact sound detection sensor, an infrared sensor, and a MEMS sensor. It may include analyzing the recognition result of one golf ball or club together to determine the golfer's motion.
  • the setting of the plurality of storage sections may include setting the plurality of storage sections by matching the extracted time stamp to the swing image.
  • the setting of the plurality of storage sections may include: receiving a preset adjustment parameter from the outside; generating a new time stamp by performing an operation to reflect the adjustment parameter to the extracted time stamp; and setting a plurality of storage sections in the swing image by using the new time stamp.
  • the present invention in consideration of the user's interest in the swing image, by storing the swing image at a different frame rate for each swing motion, it is possible to efficiently use the storage resource of the device in which the swing image is stored, as well as It is possible to minimize the network resources required to transmit the swing image.
  • the accuracy of the storage section set in the swing image can be increased as well as the swing image It is possible to set a storage section immediately after it is taken.
  • the playback quality of the swing image meets the criteria of the user who wants to analyze the swing image You can provide a swing video to do this.
  • FIG. 1 is a block diagram illustrating an image storage system according to an embodiment of the present invention.
  • FIG. 2 is a diagram for explaining an operation of an image storage device according to an embodiment of the present invention.
  • FIG. 3 is a diagram for explaining an operation of an image storage device according to an embodiment of the present invention.
  • FIG. 4 is a flowchart illustrating an image storage method according to an embodiment of the present invention.
  • FIG. 5 is a block diagram illustrating an image storage system according to an embodiment of the present invention.
  • FIG. 6 is a block diagram illustrating an image storage system according to an embodiment of the present invention.
  • FIG. 7 is a block diagram illustrating a computing device for implementing an image storage device and an image storage method according to an embodiment of the present invention.
  • FIG. 1 is a block diagram illustrating an image storage system according to an embodiment of the present invention.
  • an image storage system 1 includes a first camera 3 , a second camera 5 , an image storage device 10 , a memory 20 , and a storage 30 . ) may be included.
  • the configuration of the image storage system 1 according to embodiments of the present invention is not limited to that shown in FIG. 1 , and some elements may be changed or omitted in FIG. 1 according to specific implementation purposes. Other elements not shown may be added.
  • the image storage system 1 may take a swing image by using these elements, and store the captured image at a different frame rate for each swing motion.
  • the image storage device 10 classifies the golfer's swing motion based on the image data SD provided from the first camera 3 , and provides it from the second camera 5 according to the divided swing motion After setting a plurality of storage sections for the received image data VD, when storing the image data VD in the memory 20 or the storage 30 , different frame rates may be applied to each of the plurality of storage sections.
  • the image storage device 10 may include an operation determination module 100 , a storage section setting module 110 , an image storage module 120 , and an image buffer 130 .
  • the first camera 3 may be disposed near the golfer to photograph the golfer's motion.
  • the first camera 3, for example, may be disposed in front of the golfer or may be disposed on the top of the golfer, but the present invention does not limit the location where the first camera 3 is disposed to a specific location.
  • the first camera 3 may provide the image data SD of the golfer's motion to the motion determination module 100 .
  • the first camera 3 may include a (second) high-speed camera sensor, a radar sensor, and the like.
  • (Second) high-speed camera sensor is a camera sensor that can shoot high-speed objects that are very fast for the human eye, that is, resolution, shooting frame rate, sensitivity, exposure time, etc. It refers to a sensor implemented as a range.
  • the radar sensor refers to a sensor that detects and measures an object by emitting electromagnetic waves and detecting waves that are reflected from a target and return, for example, pulse radar, continuous wave radar (CW Radar). can be implemented as a Doppler radar, a frequency modulated CW radar (FMCW radar), etc. Therefore, in the present specification, the description thereof will be omitted.
  • the scope of the present invention is not limited thereto, and the first camera 3 may be implemented to include a sensor other than a (second) high-speed camera sensor and a radar sensor.
  • the first camera 3 may be connected to the image storage device 10 through an Ethernet interface, but the scope of the present invention is not limited thereto.
  • the second camera 5 may generate a swing image by photographing the motion of the golfer. Unlike the first camera 3 , the second camera 5 may be a camera capable of photographing at a normal speed. The second camera 5 may provide the image data VD obtained by photographing the golfer's motion at a normal speed to the image buffer 130 .
  • the capturing frame rate of the first camera 3 may be higher than the capturing frame rate of the second camera 5, which will be described later.
  • the shooting frame rate of the first camera 3 may be 300 fps (frames per second), and the shooting frame rate of the second camera 5 may be 120 fps, but the scope of the present invention is limited thereto. no.
  • the second camera 5 may be connected to the image storage device 10 through a USB (Universal Serial Bus) interface, but the scope of the present invention is not limited thereto.
  • USB Universal Serial Bus
  • the image buffer 130 may temporarily store the image data VD provided from the second camera 5 .
  • the image data VD temporarily stored in the image buffer 130 is provided to the image storage module 120 and stored in the memory 20 or the storage 30 before being stored in the memory 20 or the storage 30 , as will be described later, the storage interval setting module 120 .
  • a plurality of storage sections may be set by The image data VD for which a plurality of storage sections are set may be stored in the memory 20 or the storage 30 at different frame rates for each of the plurality of storage sections.
  • the memory 20 may be implemented as a volatile memory including random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), etc., and non-volatile memory including flash memory. It may be implemented as a memory, and may be implemented as any type of memory device not listed. Meanwhile, the storage 30 may be implemented as any type of device, including a solid state drive (SSD) and a hard disk drive (HDD).
  • SSD solid state drive
  • HDD hard disk drive
  • the motion determination module 100 may determine the golfer's motion using the first camera 3 and extract a time stamp TS associated with the corresponding motion. Specifically, the motion determination module 100 may determine the motion of the golfer from the image data SD obtained by photographing the motion of the golfer using the first camera 3 . To this end, the motion determination module 100 may perform recognition of the golf ball or club, for example, measure the position and speed of the golf ball or club. The motion determination module 100 may distinguish the motion of the golfer from the image data SD provided from the first camera 3 by tracking changes in the measured position and speed.
  • the operation of the golfer is, for example, an address operation, a take back operation, an operation in a top state, a down swing operation, an operation at the time of impact, and follow. It may be divided into a follow through operation, a finish operation, etc., but the scope of the present invention is not limited thereto.
  • Arbitrary operations that can be defined according to can be determined.
  • the operation determination module 100 mainly determines the operation of the top state, the down swing operation, and the operation at the point in time when the impact occurs.
  • the motion determination module 100 may determine the golfer's motion by performing image recognition of a golf ball or a club from an image captured by the first camera 3 .
  • the image recognition is through software executing a tracking algorithm for tracking the movement of an object, for example, a golf ball or a club, present in the image when a continuous digital image taken with the first camera 3 is first started. can be performed.
  • Such image recognition is a technology that detects objects by paying attention to the characteristics of objects such as SIFT (Scale Invariant Feature Transform), SURF (Speeded-up Robust Features), Haar, and HOG (Histogram of Oriented Gradients), DPM (Deformable Part- Based Model), a technology that divides and analyzes an object into several parts and connects each part with a machine learning method such as SVM (Support Vector Machine), CNN (Convolutional Neural Network), R-CNN (Region-based Convolutional Neural Network) , Fast R-CNN, R-FCN, YOLO (You Only Look Once), SSD (Single Shot MultiBox Detector), etc. can be implemented using techniques using deep learning or artificial intelligence, etc. It is not limited.
  • the motion determination module 100 may acquire information about the position and speed of a golf ball or a club through image recognition.
  • the motion determination module 100 may determine a point in time when the club speed before impact is 0 as a top-state motion, or from a point in time when the speed of the club is maximum and when the position of the golf ball changes. The time of impact can be determined. As such, the motion determination module 100 may subdivide and determine the motion of the golfer from information on the position and speed of the golf ball or club.
  • the motion determination module 100 includes a recognition result for a golf ball or a club obtained by performing image recognition, an impact sound detection sensor, an infrared sensor, and a MEMS (Micro Electro Mechanical System) sensor
  • a golfer's motion may be determined by analyzing a recognition result of a golf ball or a club acquired using at least one of other sensors such as .
  • the impact sound detection sensor may be used, for example, to detect the impact sound exceeding a predetermined threshold to detect the time point at which the impact occurs
  • the infrared sensor may be used to detect the starting point of the golf ball
  • the MEMS sensor may be implemented in the form of, for example, a wearable device worn by a golfer, and may be used to detect a time point at which an impact occurs by detecting an amount of impact exceeding a predetermined threshold.
  • the motion determination module 100 for example, the first impact time obtained by performing image recognition, and the second impact time detected using the impact sound detection sensor, infrared sensor, and MEMS sensor There is a difference In this case, a more accurate impact time may be derived by giving different weights to each of the first impact time and the second impact time.
  • the operation determination module 100 may extract a time stamp TS associated with the determined operation. For example, when the operation determined by the operation determination module 100 from the image data SD provided from the first camera 3 is an operation in the top state, the operation determination module 100 may include the first camera 3 ), a time stamp TS corresponding to a time point at which an operation of the top state is detected may be extracted based on the system time. In addition, when the action determination module 100 determines the impact from the image data SD provided from the first camera 3 , the action determination module 100 determines the impact based on the system time of the first camera 3 . A time stamp (TS) corresponding to a viewpoint may be extracted. The operation determination module 100 may provide the extracted time stamp TS to the storage interval setting module 110 .
  • TS time stamp
  • the storage section setting module 110 may set a plurality of storage sections in the swing image VD captured by the second camera 5 based on the time stamp TS. Specifically, the storage section setting module 110 matches the time stamp TS extracted by the operation determination module 100 to the swing image VD based on the system time of the second camera 5 to multiple You can set the storage section of
  • the storage section setting module 110 based on the time stamp (TS) corresponding to the top state and impact point extracted by the operation determination module 100, the down swing section in the swing image (VD) It can be set as one storage section.
  • the storage section setting module 110 by matching the time stamp TS corresponding to the top state to the swing image VD as the system time reference of the second camera 5, the swing image VD standard You can set the starting point of the downswing section.
  • the storage section setting module 110 by matching the time stamp (TS) corresponding to the impact point to the swing image (VD) as the system time reference of the second camera (5), the swing image (VD) as a standard You can set the end point of the down swing section.
  • the storage section setting module 110 receives a preset adjustment parameter from the outside, and performs an operation to reflect the adjustment parameter to the time stamp (TS) extracted by the operation determination module 100 to obtain a new time stamp created, and a plurality of storage sections may be set in the swing image VD using a new time stamp.
  • TS time stamp
  • the storage section setting module 110 based on the time stamp (TS) corresponding to the impact point extracted by the operation determination module 100, and a new time stamp generated by reflecting the adjustment parameter, swing An impact section in the video VD can be set as one storage section.
  • the adjustment parameter includes a first adjustment parameter and a second adjustment parameter
  • the first adjustment parameter indicates a first predetermined time before the impact time
  • the second adjustment parameter indicates a second predetermined time after the impact time
  • the storage section setting module 110 sets a time stamp corresponding to a time point before the first time from the time stamp corresponding to the impact time point, and the swing image based on the system time of the second camera 5
  • VD swing image
  • the storage section setting module 110 sets a time stamp corresponding to a time point after a second time from the time stamp TS corresponding to the time of impact, the swing image VD as the system time reference of the second camera 5 ), it is possible to set the end point of the impact section based on the swing image (VD). Accordingly, by using such an adjustment parameter, it is possible to customize the setting of the storage section according to the specific needs of the user.
  • the storage section setting module 110 may provide the information SI on the set storage section to the image storage module 120 .
  • the information SI on the storage section includes, for example, time stamp information on the start and end points of the storage section, which is matched with the system time reference of the second camera 5 .
  • the scope of the present invention is not limited thereto, and the method of providing the information SI on the storage section set by the storage section setting module 110 to the image storage module 120 is specific. Depending on the purpose of the implementation, it can be changed as much as possible.
  • the storage interval setting module 110 may determine a storage start time and a storage end time based on the time stamp TS extracted by the operation determination module 100 .
  • the storage start time is time stamp information matched based on the system time of the second camera 5
  • the image storage module 120 actually starts storage among the swing images VD temporarily stored in the image buffer 130 .
  • the storage end time is the time stamp information matched with the system time reference of the second camera 5, and the image storage module 120 of the swing images (VD) temporarily stored in the image buffer 130 is This is the point at which saving actually ends.
  • the storage start time and storage end time which mean that the image storage module 120 actually starts or ends the storage, may be different from the start time and end time of the swing image VD. Since the storage start time and the storage end time at which the image storage module 120 actually starts or ends the storage may correspond to the starting point or the ending point of the storage section set in the swing image VD, information about the storage section ( SI) and may be transmitted to the image storage module 120 .
  • the image storage module 120 stores the swing image at a first frame rate for a first storage section among a plurality of storage sections based on the information SI on the storage section provided from the storage section setting module 110 . and the swing image may be stored at a second frame rate different from the first frame rate for the second storage period among the plurality of storage periods.
  • the image storage module 120 may store at 60 fps for the down swing section set in the swing image VD, and store it at 120 fps for the impact section set in the swing image VD, and other For the section of , it can be saved at 30 fps.
  • the importance may be different for each swing motion, and some golfers, for example, may be mainly interested in the motion at the point in time when an impact occurs, and other golfers, for example, the downswing You may be mainly interested in the motion and the motion at the time of impact.
  • the image storage device 10 stores the swing image at a different frame rate for each swing motion in consideration of the user's interest in the swing image, so that it is possible to efficiently use the storage resource of the device in which the swing image is stored, as well as It is possible to minimize the network resources required to transmit the swing image.
  • the image storage device 10 automates the setting of the storage section of the swing image by reflecting the user's interest in the swing image, the accuracy of the storage section set in the swing image can be increased as well as the swing image It is possible to set a storage section immediately after it is taken.
  • the image storage device 10 reflects the user's interest in the swing image to customize the section setting of the swing image, so that the playback quality of the swing image meets the criteria of the user who wants to analyze the swing image You can provide a swing video to do this.
  • the swing video (VD) stored in this way can be played back at a playback speed corresponding to the stored frame rate, so simply playing the stored video analyzes the swing motion in a concise way that the playback speed is slowed down in the section of interest It is possible to provide a user with a swing image that is convenient to perform.
  • FIG. 2 is a diagram for explaining an operation of an image storage device according to an embodiment of the present invention.
  • the image storage device 10 may set a first storage period I to a fourth storage period IV in the swing image VD.
  • the operation determination module 100 may determine the operation of the golfer in the top state and the operation at the point in time when the impact occurs, and provide a time stamp TS associated with the operation to the storage interval setting module 110 .
  • the operation of the golfer's top state and the operation at the point in time when the impact occurs are performed by performing image recognition on the image data SD photographed by the first camera 3 or by combining methods other than image recognition as described above. Thus, it can be determined by detecting a change in the position and speed of the golf ball and the club.
  • the storage section setting module 110 based on the time stamp (TS), stores the first storage section (I) to the fourth storage section (IV) in the swing image VD photographed using the second camera 5 . can be set.
  • the storage interval setting module 110 may determine a storage start time t1 and a storage end time t4.
  • the storage start time t1 and the storage end time t4 are within a range to prevent omission of the address operation and the takeback operation, the follow-through operation, and the finish operation, but are within the range of the start and end time of the swing image VD. It may be appropriately determined within a range that does not include unnecessary images (eg, other actions unrelated to the swing before the address or after the finish operation).
  • the storage interval setting module 110 may determine a time point t2.
  • the viewpoint t2 refers to a viewpoint of the top state matched to the swing image VD based on the system time of the second camera 5 .
  • the storage interval setting module 110 may determine a time point t3.
  • the time point t3 refers to an impact time point matched to the swing image VD based on the system time of the second camera 5 .
  • the storage interval setting module 110 may determine a time point t31 and a time point t32 .
  • the time point t31 reflects the preset adjustment parameter, and refers to a time point corresponding to a time before the first time d1 from the time point t3 corresponding to the impact time point
  • the time point t32 is a preset adjustment By reflecting the parameters, it means a time point corresponding to a time point after the second time d2 from the time point t3 corresponding to the impact point.
  • the storage section setting module 110 corresponds to the first storage section I ('up swing section') corresponding to the time point (t1) to the time point (t2), the time point (t2) to the time point (t31).
  • the second storage period (II) ('down swing period'), the third storage period (III) ('impact period') corresponding to the time point t31 to the time point t32, and the time point t32 to the time point t4)
  • a fourth storage period IV ('follow swing period') corresponding to may be set.
  • the storage section setting module 110 provides such setting information SI to the image storage module 120, and accordingly, the image storage module 120 provides the swing image VD, the first storage section I and For the fourth storage period (IV), a first frame rate, for example, 30 fps, is stored in the memory 20 or storage 30, and for the second storage period (II), a second frame rate, for example, 60 fps. It may be stored in the memory 20 or the storage 30 , and may be stored in the memory 20 or the storage 30 at a third frame rate, for example, 120 fps for the third storage period III.
  • FIG. 3 is a diagram for explaining an operation of an image storage device according to an embodiment of the present invention.
  • the image storage device 10 may set a first storage period I to a fifth storage period V in the swing image VD.
  • the operation determination module 100 determines the operation of the golfer in the top state, the operation at the point in time when the down swing is in progress between the impacts in the top state, and the operation at the point in time when the impact occurs, and a time stamp (TS) associated with the operation may be provided to the storage interval setting module 110 .
  • TS time stamp
  • it can be determined by detecting a change in the position and speed of the golf ball and the club.
  • the storage section setting module 110 on the basis of the time stamp (TS), the first storage section (I) to the fifth storage section (V) in the swing image (VD) photographed using the second camera (5) can be set.
  • the storage interval setting module 110 may determine a storage start time t1 and a storage end time t5 .
  • the storage interval setting module 110 may determine a time point t2.
  • the viewpoint t2 refers to a viewpoint of the top state matched to the swing image VD based on the system time of the second camera 5 .
  • the storage interval setting module 110 may determine a time point t3.
  • the time point t3 refers to a time point at which the down swing progresses in the middle between impacts in the top state, which is matched to the swing image VD based on the system time of the second camera 5 .
  • the storage interval setting module 110 may determine a time point t4.
  • the time point t4 refers to an impact time point matched to the swing image VD based on the system time of the second camera 5 .
  • the storage interval setting module 110 may determine the time points t41 and t42, as described above with respect to the time points t31 and t32 of FIG. 2 .
  • the storage section setting module 110 is a first storage section (I) ('up swing section') corresponding to the time point (t1) to the time point (t2), the time point (t2) to the time point (t3) corresponding to The second storage period (II) ('first downswing period'), the third storage period (III) corresponding to the time point (t3) to the time point (t41) ('second downswing period'), the time point (t41)
  • a fourth storage section IV ('impact section') corresponding to time t42 to time t42 and a fifth storage section V corresponding to time point t42 to time t5 ('follow swing section') are set.
  • the storage section setting module 110 provides such setting information SI to the image storage module 120, and accordingly, the image storage module 120 provides the swing image VD, the first storage section I and For the fifth storage period (V), a first frame rate, for example, 24 fps, is stored in the memory 20 or storage 30, and for the second storage period (II), a second frame rate, for example, 30 fps.
  • a third frame rate for example, 60 fps for the third storage period (III)
  • the fourth storage period ( IV) may be stored in the memory 20 or the storage 30 at a fourth frame rate, for example, 120 fps.
  • FIG. 4 is a flowchart illustrating an image storage method according to an embodiment of the present invention.
  • an image storage method includes determining the golfer's operation (S401), extracting a time stamp related to the golfer's operation (S403), and reflecting the adjustment parameter Generating a new time stamp by performing an operation (S405), setting a plurality of storage sections in the swing image based on the time stamp (S407), a first frame for a first storage section among the plurality of storage sections
  • the method may include storing the swing image at a rate ( S409 ) and storing the swing image at a second frame rate different from the first frame rate for a second storage period among a plurality of storage periods ( S411 ).
  • step S401 includes determining the motion of a golfer by performing image recognition on a golf ball or club from an image captured by the first camera
  • step S407 may include setting a plurality of storage sections in the swing image captured by the second camera.
  • step S401 is a golf ball or club obtained by performing image recognition, and a golf ball or club obtained by using at least one of an impact sound detection sensor, an infrared sensor, and a MEMS sensor. It may include analyzing the recognition result of the ball or the club together to determine the golfer's motion.
  • step S407 may include setting a plurality of storage sections by matching the extracted time stamp to the swing image.
  • step S405 includes receiving a preset adjustment parameter from the outside, generating a new time stamp by performing an operation to reflect the adjustment parameter to the extracted time stamp, and , step S407 may include setting a plurality of storage sections in the swing image by using a new time stamp.
  • FIG. 5 is a block diagram illustrating an image storage system according to an embodiment of the present invention.
  • the operation determination module 100 uses the sensor 7 to determine when the golfer's motion occurs, as shown in FIG. 1 . It differs from the image storage system 1 described above in relation to this. That is, the image storage system 2 may determine when the golfer's motion occurs using only a technique other than image recognition.
  • the senor includes an impact sound detection sensor
  • the operation determination module 100 determines the impact point by sensing the impact sound of a golf ball and a club using the impact sound detection sensor
  • a storage interval setting module ( 110 ) may set a plurality of storage sections by matching the time stamp for the impact point to the swing image.
  • the sensor includes an infrared sensor
  • the motion determination module 100 determines the impact point by determining the starting point of the golf ball using the infrared sensor
  • the storage section setting module 110 may set a plurality of storage sections by matching the time stamp for the impact point to the swing image.
  • the senor includes a MEMS sensor
  • the operation determination module 100 determines the impact point by sensing the amount of impact on the golf ball and the club using the MEMS sensor
  • a storage interval setting module ( 110) may set a plurality of storage sections by matching the time stamp for the impact point to the swing image.
  • the motion determination module 100 may determine the impact point by combining at least two of the impact sound detection sensor, the infrared sensor, and the MEMS sensor.
  • FIG. 6 is a block diagram illustrating an image storage system according to an embodiment of the present invention.
  • the image storage system 3 receives a swing image captured by the operation determination module 100 using the camera 9 and receives the golf ball from the swing image.
  • the image storage system 1 described above with reference to FIG. 1 and the image storage system 1 described with reference to FIG. 5 it is different from the image storage system 1 described above with reference to FIG. 1 and the image storage system 1 described with reference to FIG. 5 in that the golfer's motion is determined by performing image recognition on the club. That is, the image storage system 3 directly performs image recognition on the image data VD photographing the golfer's motion at a normal speed corresponding to the second camera 5 of the image storage system 1, so that golf Changes in position and speed of the ball or club can be detected. To this end, as described above with reference to FIG.
  • image recognition is when a continuous digital image captured by the first camera 3 is first started, the movement of an object, such as a golf ball or club, existing in the image This may be done through software running a tracking algorithm for tracking.
  • image recognition is a technology that detects objects by paying attention to the characteristics of objects such as SIFT, SURF, Haar, and HOG, and a technology that divides and analyzes an object into several parts such as DPM and connects each part with a machine learning method such as SVM , CNN, R-CNN, Fast R-CNN, R-FCN, YOLO, may be implemented using techniques using deep learning or artificial intelligence, such as SSD, but the scope of the present invention is not limited thereto.
  • FIG. 7 is a block diagram illustrating a computing device for implementing an image storage device and an image storage method according to an embodiment of the present invention.
  • an image storage device and an image storage method according to an embodiment of the present invention may be implemented using a computing device 50 .
  • the computing device 50 includes at least one of a processor 510 , a memory 530 , a user interface input device 540 , a user interface output device 550 , and a storage device 560 in communication via a bus 520 . can do.
  • Computing device 50 may also include network interface 570 electrically connected to network 40 , such as a wireless network.
  • the network interface 570 may transmit or receive signals with other entities through the network 40 .
  • the processor 510 may be implemented in various types such as an application processor (AP), a central processing unit (CPU), a graphic processing unit (GPU), and the like, and executes a command stored in the memory 530 or the storage device 560 . It may be any semiconductor device that does The processor 510 may be configured to implement the functions and methods described with reference to FIGS. 1 to 6 .
  • AP application processor
  • CPU central processing unit
  • GPU graphic processing unit
  • the processor 510 may be implemented in various types such as an application processor (AP), a central processing unit (CPU), a graphic processing unit (GPU), and the like, and executes a command stored in the memory 530 or the storage device 560 . It may be any semiconductor device that does
  • the processor 510 may be configured to implement the functions and methods described with reference to FIGS. 1 to 6 .
  • the memory 530 and the storage device 560 may include various types of volatile or non-volatile storage media.
  • the memory may include a read-only memory (ROM) 531 and a random access memory (RAM) 532 .
  • the memory 530 may be located inside or outside the processor 510 , and the memory 530 may be connected to the processor 510 through various known means.
  • the image storage device and the image storage method according to the embodiments of the present invention may be implemented as a program or software executed in the computing device 50, and the program or software may be stored in a computer-readable medium. have.
  • image storage device and the image storage method according to embodiments of the present invention may be implemented as hardware capable of being electrically connected to the computing device 50 .
  • the storage resource of the device in which the swing image is stored can be efficiently used.
  • the accuracy of the storage section set in the swing image can be increased as well as the swing image It is possible to set a storage section immediately after it is taken.
  • the playback quality of the swing image meets the criteria of the user who wants to analyze the swing image You can provide a swing video to do this.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

L'invention concerne un dispositif de stockage vidéo et un procédé de stockage vidéo. Le dispositif de stockage vidéo peut comporter: un module de détermination de mouvement qui détermine le mouvement d'un golfeur en utilisant une première caméra, et extrait une estampille temporelle associée au mouvement; un module de configuration de sections de stockage qui configure, sur la base de l'estampille temporelle, de multiples sections de stockage d'une vidéo de swing filmée à l'aide d'une seconde caméra; et un module de stockage vidéo qui stocke une vidéo de swing dans une première section de stockage parmi les multiples sections de stockage à une première fréquence de trames, et stocke une vidéo de swing dans une seconde section de stockage parmi les multiples sections de stockage à une seconde fréquence de trames différente de la première fréquence de trames.
PCT/KR2021/007164 2020-06-16 2021-06-08 Dispositif et procédé de stockage vidéo WO2021256764A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020200072946A KR20210155564A (ko) 2020-06-16 2020-06-16 영상 저장 장치 및 영상 저장 방법
KR10-2020-0072946 2020-06-16

Publications (1)

Publication Number Publication Date
WO2021256764A1 true WO2021256764A1 (fr) 2021-12-23

Family

ID=79175692

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/007164 WO2021256764A1 (fr) 2020-06-16 2021-06-08 Dispositif et procédé de stockage vidéo

Country Status (2)

Country Link
KR (1) KR20210155564A (fr)
WO (1) WO2021256764A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102574229B1 (ko) * 2023-01-11 2023-09-01 배현직 골프 스윙 분석 장치 및 그 방법

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100818169B1 (ko) * 2007-02-20 2008-04-02 한국과학기술원 골프 스윙 궤적 측정장치 및 방법
KR101434514B1 (ko) * 2014-03-21 2014-08-26 (주) 골프존 이종 장치간 데이터 시간 동기화 방법 및 시간 동기화된 데이터를 생성하기 위한 데이터 처리 장치
KR101556879B1 (ko) * 2015-01-23 2015-10-01 에스비텍크 주식회사 골프 스윙 동작 촬영 저장 장치 및 방법
KR20160097582A (ko) * 2015-02-09 2016-08-18 주식회사 골프존 사용자 운동 동작 분석 정보 제공을 위한 데이터 처리방법 및 이를 이용한 사용자 운동 동작 분석장치와, 사용자 골프 스윙 분석정보 제공을 위한 데이터 처리방법 및 이를 이용한 골프 스윙 분석 장치
KR20170041254A (ko) * 2014-08-11 2017-04-14 세이코 엡슨 가부시키가이샤 촬영 제어 방법, 촬영 제어 장치, 촬영 제어 시스템 및 프로그램
KR20190051594A (ko) * 2017-11-07 2019-05-15 삼성전자주식회사 복수의 카메라들을 이용하여 영상을 촬영하는 전자 장치와 이의 동작 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100818169B1 (ko) * 2007-02-20 2008-04-02 한국과학기술원 골프 스윙 궤적 측정장치 및 방법
KR101434514B1 (ko) * 2014-03-21 2014-08-26 (주) 골프존 이종 장치간 데이터 시간 동기화 방법 및 시간 동기화된 데이터를 생성하기 위한 데이터 처리 장치
KR20170041254A (ko) * 2014-08-11 2017-04-14 세이코 엡슨 가부시키가이샤 촬영 제어 방법, 촬영 제어 장치, 촬영 제어 시스템 및 프로그램
KR101556879B1 (ko) * 2015-01-23 2015-10-01 에스비텍크 주식회사 골프 스윙 동작 촬영 저장 장치 및 방법
KR20160097582A (ko) * 2015-02-09 2016-08-18 주식회사 골프존 사용자 운동 동작 분석 정보 제공을 위한 데이터 처리방법 및 이를 이용한 사용자 운동 동작 분석장치와, 사용자 골프 스윙 분석정보 제공을 위한 데이터 처리방법 및 이를 이용한 골프 스윙 분석 장치
KR20190051594A (ko) * 2017-11-07 2019-05-15 삼성전자주식회사 복수의 카메라들을 이용하여 영상을 촬영하는 전자 장치와 이의 동작 방법

Also Published As

Publication number Publication date
KR20210155564A (ko) 2021-12-23

Similar Documents

Publication Publication Date Title
US10070046B2 (en) Information processing device, recording medium, and information processing method
US20200302154A1 (en) Image processing method, apparatus, storage medium, and electronic device
CN111149350B (zh) 使用事件相机生成静态图像
CN1841187B (zh) 图像摄取设备及其控制方法
JP4800073B2 (ja) 監視システム、監視方法、及び監視プログラム
WO2017034220A1 (fr) Procédé de mise au point automatique sur une région d'intérêt par un dispositif électronique
CN102572238B (zh) 摄像设备及其控制方法
WO2021256764A1 (fr) Dispositif et procédé de stockage vidéo
EP3622487A1 (fr) Procédé de fourniture de vidéo à 360 degrés et dispositif pour prendre en charge celui-ci
WO2017026664A1 (fr) Système de fourniture d'informations d'image d'élan de golf, dispositif de caméra pour fournir des informations d'image d'élan de golf et procédé pour fournir des informations d'image d'élan de golf
WO2020171379A1 (fr) Capture d'une photographie à l'aide d'un dispositif mobile
WO2021002681A1 (fr) Dispositif électronique de reconnaissance d'objet et son procédé de fonctionnement
US8526673B2 (en) Apparatus, system and method for recognizing objects in images using transmitted dictionary data
US20220132028A1 (en) Imaging apparatus, information processing method, and recording medium
WO2023080667A1 (fr) Traitement d'image wdr de caméra de surveillance par reconnaissance d'objets basée sur l'ia
WO2022250196A1 (fr) Dispositif et procédé de suivi de patient atteint de démence
CN112055152A (zh) 具有两个输出接口的摄像装置
US20160353052A1 (en) Adjusting length of living images
CN112437233B (zh) 视频生成方法、视频处理方法、装置和摄像设备
WO2014123299A1 (fr) Serveur de synchronisation de contenus et procédé de synchronisation de contenus utilisant la mise en correspondance de mouvements
WO2023068845A1 (fr) Procédé et dispositif électronique pour capture d'image basée sur un événement d'interêt
CN113315913A (zh) 图像传感器控制方法及相关产品
CN113489878A (zh) 电子设备、信息同步方法和计算机可读存储介质
WO2024029880A1 (fr) Procédé d'apprentissage et appareil d'apprentissage pour entraîner un modèle de détection du regard, basé sur un apprentissage profond, pour détecter un regard, procédé de test et appareil de test utilisant ledit procédé
JP2008141700A (ja) 監視システム、監視方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21825614

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.05.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21825614

Country of ref document: EP

Kind code of ref document: A1