KR102202099B1 - Video management method for minimizing storage space and user device for performing the same - Google Patents

Abstract

The present invention relates to a method for playing an image using an application installed on a user device, wherein the method includes the steps of: searching at least one audio file and video file stored in the user device; checking an actual recording time for any one audio file; and matching a confirmed actual recording time with production time of the video file, and outputting the matched video file while playing the audio file. According to the present invention, while saving the total capacity occupied by the video file, resources required for reproducing the video file can be saved.

Description

A video management method that minimizes storage space and a user device that performs it {VIDEO MANAGEMENT METHOD FOR MINIMIZING STORAGE SPACE AND USER DEVICE FOR PERFORMING THE SAME}

The present invention relates to an image management method for minimizing a storage space and a device for performing the same. More specifically, it relates to a method for generating and storing an image, and viewing an image while minimizing a storage space, and a device for performing the same.

In recent university lectures, academic seminars, and corporate presentations, attendees often record videos or take pictures of lectures or speeches being conducted using a smartphone or tablet PC. By recording the site of lectures, academic seminars, and presentations, participants can record important content and use the recorded material for future production reports.

The longer the lecture or speech is, the longer the video recording time becomes. Accordingly, there is a problem that the capacity of the file stored in the user device becomes larger than necessary.

As a representative example, when recording a full HD resolution (1,980*1,080) 60fps video for 1 hour based on a smartphone, a lot of storage space may be required depending on the bit rate. For example, if the bit rate is about 32,000 kbps, theoretically, about 14 GB of storage space is required. Considering the storage space of a typical smart phone, if there are multiple video files, more than half of the storage space of the smart phone is occupied by the video alone.

In addition, since a single file of 4 GB or more cannot be stored in a FAT32 format storage device that cannot recognize a single file, it may not be possible to check the video created depending on the playback device.

The technology that is the background of the present invention has been prepared to facilitate understanding of the present invention. It should not be understood as an admission that the matters described in the technology behind the invention exist as prior art.

Accordingly, there is a demand for a video management method for saving the total capacity occupied by the video file and saving resources required for playing the video file.

The inventors of the present invention use various types of codecs to compress the data capacity of a video, so that the size of the file is not drastically reduced immediately before the file is transmitted, but is handled in a series of processes from shooting to storing and playing the video. We tried to develop a new video management method that can minimize the size of the video file to be played.

As a result, the inventors of the present invention can capture or retrieve and acquire only a still image at a specific moment in a situation where it is not necessary to shoot or reproduce a continuous scene, and create and reproduce a moving picture by combining a still image and an audio file. We have come to develop an application that performs a new video management method.

A problem to be solved in an embodiment of the present invention is a video playback method capable of outputting a video file suitable for the audio file while playing the audio file by matching the time when the audio file is recorded and the time when the video file is recorded. And a user device that performs this.

The problem to be solved in another embodiment of the present invention is an image generation method capable of acquiring a video while recording audio and at the same time, and combining the audio and video when the audio recording ends, but minimizing the size of the file, and It is to provide a user device that does this.

The problem to be solved in another embodiment of the present invention is an image storage method capable of minimizing the size of a finally stored image by storing only selected image frames as needed while recording video and audio, and a user performing the same To provide a device.

The problems of the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above-described problems, an image reproducing method according to an embodiment of the present invention is provided. The method is a method of playing an image using an application installed on a user device, the step of searching for at least one audio file and a video file stored in the user device, and checking an actual recording time for any one audio file. And matching the determined actual recording time with the generation time of the video file, and outputting the matched video file while playing the audio file.

According to a feature of the present invention, the step of confirming may further include calculating a time when recording of the audio file is started by subtracting the total playback time of the audio file from the time when the audio file is created. .

According to another feature of the present invention, the actual recording time may be expressed as year, month, day, hour, minute, and second from a start time to an end time of recording the audio file.

According to another feature of the present invention, the outputting may include determining a similarity of the corresponding video files when there are at least two video files with matching creation times at one point in the actual recording time of the audio file. It may contain more.

According to another feature of the present invention, in the outputting, if the video files are similar as a result of the determination, while playing the audio file, outputting one of the video files at the point in time And, it may be a step of simultaneously outputting the remaining video files to the playback progress icon at the point in time.

According to another feature of the present invention, the outputting may include, if the video files are not similar as a result of the determination, while playing the audio file, the video files at the point in time are the screen size of the user device. It may be a step of dividing and outputting according to.

According to another feature of the present invention, the generation time of the video file can be checked using information of any one of a name or a storage location of the video file.

In order to solve the above-described problems, an image generation method according to an embodiment of the present invention is provided. The method is a method of generating an image using an application installed in a user device, comprising: starting audio recording, acquiring at least one video file according to a photographing signal while the audio is being recorded, the video file And storing the acquired time point in an audio timeline, terminating the recording of the audio, and generating an image obtained by matching the audio and the video file.

According to a feature of the present invention, the generating step includes matching the video file obtained according to the n-1th photographing signal with the audio timeline before the nth photographing signal (n is a natural number of 2 or more) is acquired. It may further include.

According to another feature of the present invention, the generating step further comprises applying a screen transition effect to the video file obtained according to the first photographing signal and matching the audio timeline before the first photographing signal is obtained. can do.

According to another feature of the present invention, after the generating step, the step of checking whether an additional video file corresponding to the video generation time exists in the user device and the confirmed video file is an audio file of the final generated video. It may further include the step of further matching.

According to another feature of the present invention, the further matching may further include detecting a timeline in which audio has not been acquired for a predetermined time in the final generated image, and the detected audio timeline and the addition When the recording time of the video file corresponds, the step of matching the additional video file to a corresponding audio timeline may be further included.

In order to solve the above-described problems, an image storage method according to an embodiment of the present invention is provided. The method is a method of storing an image captured using an application installed on a user device, the step of capturing an image including video and audio according to an image capturing start signal, and detecting a change between frames in the image frame of the image The step of inserting one image frame into an audio timeline up to the previous time based on the time when the change between frames is detected, and at least one image frame is matched with the audio timeline of the image according to an image capturing end signal. And storing the generated image.

According to a feature of the present invention, the one image frame may be any one of a plurality of image frames captured on an audio timeline prior to the image.

According to another feature of the present invention, the detecting step further includes selecting at least one fixed object or moving object from the photographing area, and setting a property of the fixed object or a moving area of the moving object. I can.

According to another feature of the present invention, the property of the fixed object includes a fixed frame coordinate and an image frame in the frame coordinate, and the detecting step is a step of detecting a change between image frames in the frame coordinate. I can.

According to another feature of the present invention, after the photographing step, the steps of acquiring at least one image frame according to an image capturing signal and inserting the acquired image frame into a timeline prior to the image It may further include.

In order to solve the above-described problems, a user device according to an embodiment of the present invention is provided. The user device includes a communication unit, a storage unit, an output unit, an input unit, and a processor operably connected to the communication unit, the storage unit, the output unit, and the input unit, and to play an image by driving an application stored in the storage unit. A user device including, wherein the processor searches at least one audio file and a video file stored in the storage unit, and checks an actual recording time for any one audio file, and the confirmed actual recording time and the video file And, while playing the audio file, output the matched video file.

In order to solve the above-described problems, a user device according to an embodiment of the present invention is provided. The user device includes a communication unit, a storage unit, an output unit, an input unit, and a processor that is operably connected to the communication unit, the storage unit, the output unit, and the input unit, and generates an image by driving an application stored in the storage unit. A user device comprising, wherein the processor starts recording audio, acquires at least one video file according to a photographing signal while the audio is being recorded, and stores a time point at which the video file is acquired in an audio timeline, And terminating the recording of the audio, and generating an image obtained by matching the audio and the video file.

In order to solve the above-described problems, a user device according to an embodiment of the present invention is provided. The user device includes a communication unit, a storage unit, an output unit, an input unit, and a processor that is operably connected to the communication unit, the storage unit, the output unit, and the input unit, and generates an image by driving an application stored in the storage unit. A user device including, wherein the processor captures an image including video and audio according to an image capture start signal, detects a change between frames in an image frame of the image, and refers to a time point at which the change between frames is detected. And inserting one image frame into the previous audio timeline, and storing an image in which at least one image frame is matched to the audio timeline of the image according to an image capturing end signal.

Details of other embodiments are included in the detailed description and drawings.

According to the present invention, only image frames of a necessary portion of a captured image including video and audio are stored, so that the stored image does not have to have several tens of frames per second, so the size of the entire image can be greatly reduced. In addition, as the size of the entire image is reduced, it is possible to secure a storage space of the device and save time and resources required for file playback.

Furthermore, without a high-performance codec for compressing an image, an image can be smoothly played back using an application that can be installed on a user device, and a captured high-resolution image can be stored as a small-size image file.

In addition, it is possible to analyze the actual recording time of the audio, check the time when the video was recorded, and play the video matched with the audio and video. In particular, in the case of a video file that does not contain accurate time information In addition to the storage information, additional information such as the name of the video file and the storage location can be used to accurately synchronize the audio and video times.

In addition, the present invention can arbitrarily select and insert/store an image file to be stored while capturing an image including video and audio, so that an image having a long playback time can be stored in a small capacity. In particular, by separating fixed objects and moving objects within the shooting area, and by distinguishing objects whose images change at predetermined time intervals, such as a PPT screen, actively detects changes in the actual environment being photographed, and images appropriate for the image. You can get the file.

In addition, by acquiring an image file suitable for an image, even if a still image is output, the understanding of the image can be maintained without degrading.

The effects according to the present invention are not limited by the contents exemplified above, and more various effects are included in the present invention.

1 is a schematic diagram illustrating an outline of an image management method according to an embodiment of the present invention.
2 is a block diagram illustrating a configuration of a user device in which an application providing an image management method according to an embodiment of the present invention is installed.
3 is a schematic flowchart of an image reproducing method according to an embodiment of the present invention.
4 is a schematic diagram illustrating a method of checking an actual recording time of an audio file in an image reproducing method according to an embodiment of the present invention.
5A and 5B are schematic diagrams illustrating a method of outputting an image from a user device through an image reproducing method according to an exemplary embodiment of the present invention.
6 is a schematic flowchart of an image generating method according to another embodiment of the present invention.
7 is a schematic diagram illustrating a method of matching audio and video in an image generating method according to another embodiment of the present invention.
8 is a schematic flowchart of an image storage method according to another embodiment of the present invention.
9A to 9C are schematic diagrams illustrating a method of acquiring or storing one image frame in an image storage method according to another exemplary embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in a variety of different forms, only the present embodiments make the disclosure of the present invention complete, and common knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims. In connection with the description of the drawings, similar reference numerals may be used for similar elements.

In this document, expressions such as "have," "may have," "include," or "may contain" are the presence of corresponding features (eg, elements such as numbers, functions, actions, or parts). And does not exclude the presence of additional features.

In this document, expressions such as "A or B," "at least one of A or/and B," or "one or more of A or/and B" may include all possible combinations of items listed together. . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as "first," "second," "first," or "second," used in this document can modify various elements, regardless of their order and/or importance, and refer to one element. It is used to distinguish it from other components and does not limit the components. For example, a first user device and a second user device may represent different user devices regardless of order or importance. For example, without departing from the scope of rights described in this document, a first component may be named a second component, and similarly, a second component may be renamed to a first component.

Some component (eg, a first component) is "(functionally or communicatively) coupled with/to)" to another component (eg, a second component) or " When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or may be connected through another component (eg, a third component). On the other hand, when a component (eg, a first component) is referred to as being “directly connected” or “directly connected” to another component (eg, a second component), the component and the It may be understood that no other component (eg, a third component) exists between the different components.

The expression "configured to" as used in this document is, for example, "suitable for," "having the capacity to" depending on the situation. ," "designed to," "adapted to," "made to," or "capable of" can be used interchangeably. The term "configured to (or set)" may not necessarily mean only "specifically designed to" in hardware. Instead, in some situations, the expression "a device configured to" may mean that the device "can" along with other devices or parts. For example, the phrase “processor configured (or configured) to perform A, B, and C” means a dedicated processor (eg, an embedded processor) for performing the operation, or by executing one or more software programs stored in a memory device. , May mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

Terms used in this document are only used to describe a specific embodiment, and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art described in this document. Among the terms used in this document, terms defined in a general dictionary may be interpreted as having the same or similar meanings as those in the context of the related technology, and unless explicitly defined in this document, an ideal or excessively formal meaning Is not interpreted as. In some cases, even terms defined in this document cannot be interpreted to exclude embodiments of this document.

Each of the features of the various embodiments of the present invention may be partially or entirely combined or combined with each other, and as a person skilled in the art can fully understand, technically various interlocking and driving are possible, and each of the embodiments may be independently implemented with respect to each other. It may be possible to do it together in a related relationship.

For clarity of interpretation of the present specification, terms used in the present specification will be defined below.

1 is a schematic diagram illustrating an outline of an image management method according to an embodiment of the present invention.

Referring to FIG. 1, in an image management method according to an embodiment of the present invention, while an image including video and audio is being played, thousands or tens of thousands of image frames are not listed, and only a few image frames may be listed. have. For example, while the audio of the first area is being played, one image frame “Photo 1” may be played, while the audio of the second area is playing, one image frame “Photo 2” is played. Can be, and “Photo 3” can be played back for later playback.

As described above, in the image management method according to an embodiment of the present invention, only the core image frames (the moment when recording is required in lectures and speeches) are left in the image, and the remaining image frames are not used, so that the entire image is displayed in the user device. It can drastically reduce the capacity required for playback or storage.

Meanwhile, the “image management method” defined in the present invention may include all operation methods related to an image, for reproducing, photographing, and storing an image.

2 is a block diagram illustrating a configuration of a user device in which an application providing an image management method according to an embodiment of the present invention is installed.

Referring to FIG. 2, the user device 100 is a device in which an application for capturing, storing, and reproducing an image is installed and executed. A communication unit 110, a storage unit 120, an input unit 130, and an output unit 140 And a processor 150.

The communication unit 110 may receive a video file or an audio file required to reproduce or generate an image from an external device (not shown) using a wired/wireless communication network. Here, the video file may include a single image file and an image file composed of a plurality of images, and each may include information necessary to reproduce an image. Specifically, the video file may include information on a name consisting of a shooting date, a resolution, a shooting location, a file size, a shooting date, and a storage location in the user device 100, and the audio file is Information about a recording time, a recording location, and a storage location in the user device 100 may be included.

The storage unit 120 may store a video file or an audio file received through the communication unit 110. According to an embodiment, the storage unit 120 may classify each piece of information according to time. For example, the storage unit 120 may classify and store a video file according to a time when a video file is captured, and may classify and store an audio file according to a time when an audio file is recorded.

In this way, by classifying each file according to the time taken or recorded, it is possible to output a video file suitable for a corresponding time without interruption while playing any one audio file later.

In various embodiments, the storage unit 120 may include a volatile or nonvolatile recording medium capable of storing various types of data, commands, and information. For example, the storage unit 120 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, PROM, network storage. It may include at least one type of storage medium among storage and cloud.

Commands for the operation of the user device 100 may be recorded in the storage unit 120. In an embodiment, an application (not shown) for managing an image may be recorded in the storage unit 120. The application may include a recording medium that provides a user interface to the output unit 140 when executed by the processor 150 and stores a command or program code that enables an image to be captured or reproduced according to a user input.

The input unit 130 may receive various inputs from a user. For example, the input unit 130 may receive an audio input according to a user's input of a recording start/end signal through a touch or a button, and may receive a video input according to a photographing signal input. In addition, the input unit 130 may receive audio and simultaneously receive an image according to a photographing signal, and may receive an image without audio data.

The output unit 140 is an output device for reproducing an image including audio and video or for audibly and visually expressing information for photographing an image, and is an audio output device, an LCD (Liquid Crystal Display), and an LED (Light Emitting Diode), etc. may include various types of display devices. Depending on the embodiment, various user interfaces for reproducing or photographing an image may be provided through a visual output device.

In addition, the visual output device may receive a user's touch input. In this case, the input unit 130 and the output unit 140 may be formed of one physical component. In addition, the visual output device may include various sensing means capable of recognizing various inputs generated in an area displaying an image.

The processor 150 is operably connected to the communication unit 110, the storage unit 120, the input unit 130, and the output unit 140 to control the overall operation of the user device 100, and the storage unit ( An application stored in 120) may be driven to play back an image, or various commands for generating and storing an image may be executed.

According to an embodiment, the processor 150 may simultaneously play at least one audio file and a video file stored in the storage unit 120. Specifically, the processor 150 may search for at least one audio file and a video file stored in the storage unit 120 and transmit the searched list to the output unit 140.

When any one audio file is selected according to the user's selection, the processor 150 may check the actual recording time for the audio file and match the confirmed actual recording time with the generation time of the video file. That is, the processor 150 may extract video files that have been photographed during the recording time, match the video files at each time of the audio file, and output the matched video file while playing the audio file. have.

Meanwhile, there may be a plurality of video files that match a point in time in minutes and seconds of the actual recording time. In this case, the processor 150 may compare and analyze video files to adjust a playback method, and a detailed description thereof will be described later.

In this way, the processor 150 may output at least one video file stored in the storage unit 120 according to time while any one audio file is being played, and the audio and video are simultaneously played, so that the user device ( 100) may play a role of an image mixing viewer that generates and reproduces one image.

According to another embodiment, the processor 150 may acquire and store a video file through the input unit 130 and the output unit 140 at the same time as the audio recording, and in this process, the size of the finally stored image can be greatly reduced. have. Specifically, the processor 150 may acquire at least one video file according to a photographing signal while audio is being recorded. In this case, the time when the video file is acquired may be stored in the audio timeline.

That is, the processor 150 may match one video file acquired according to the photographing signal to the timeline of the audio while the audio is being recorded, and the processor 150 has a video-audio matching structure as described in FIG. 1 above. You can create an image with.

In this way, the processor 150 controls the input unit 130 and the output unit 140 to simultaneously acquire audio and video and generate a single image. In this process, the audio and video are not simply combined. , The audio file and the video file may be edited in consideration of the size of the finally generated image.

According to another embodiment, while capturing an actual space, the processor 150 may detect a change in the actual space and edit and store video and audio data according to a situation. Specifically, the processor 150 may capture an image including video and audio according to an image capturing start signal, and detect a change between frames in an image frame of the image. Here, the change between image frames may be performed using various known image similarity analysis methods. For example, the processor 150 may calculate a degree of similarity and a degree of change between frames using a method of measuring a cosine-similarity similarity.

Until the inter-frame change is detected, the processor 150 may insert one image frame into the audio timeline, and when inter-frame change is detected, the change in the audio timeline after the inter-frame change is detected. You can insert an image frame.

After repeating this process, the processor 150 may store an image in which at least one image frame is matched to the audio timeline of the image according to the image capturing end signal. That is, compared to a general storage method, the processor 150 may significantly reduce the size of the entire image in the process of storing a high-resolution image or an image having a long playback time.

Meanwhile, the processor 230 may correspond to a computing device such as a central processing unit (CPU) or an application processor (AP). In addition, the processor 230 may be implemented in the form of an integrated chip (IC) such as a System on Chip (SoC) in which various computing devices are integrated.

So far, the configuration of the user device 100 in which an application providing an image management method according to an embodiment of the present invention is installed has been described. Hereinafter, image reproduction according to an embodiment of the present invention is described using FIGS. 3 to 5B. Let's explain how.

3 is a schematic flowchart of an image reproducing method according to an embodiment of the present invention, and FIG. 4 is an exemplary description of a method of checking an actual recording time of an audio file in an image reproducing method according to an embodiment of the present invention. It is a schematic diagram for doing.

Referring to FIG. 3, the user device 100 searches for at least one audio file and a video file stored in the device (S110). According to an embodiment, a list of audio files recorded through the device or received from an external device may be output on the screen of the user device 100.

The user may select any one audio file to be played back as an image, and after step S110, the user device 100 checks the actual recording time for any one audio file (S120).

Referring to FIG. 4, in the case of a general audio file, information on the start time of recording the audio file is not included, and the approximate location, date, total playback time, and recording end time (audio It contains only information about the time the file was created). On the other hand, in the case of a video file, since it contains information about the generated time, data of different attributes cannot be combined and played back as a single video with only the information that the audio file and the video file have.

Accordingly, the user device 100 may calculate a time at which recording of the audio file starts by subtracting the total playback time of the audio file from the time at which the audio file is generated. For example, in FIG. 4, since the time when the audio file is generated is 12:58 pm and the total playing time is 54 minutes, the user device 100 may calculate that the recording start time of the audio file is 12:4. . That is, the user device 100 may express the audio file recording start time to the end time as year, month, day, hour, minute, and second in order to match the generation time of the video file with the audio file.

After step S120, the user device 100 matches the confirmed actual recording time and the generation time of the video file, and outputs the matched video file while playing the audio file (S130). For example, the user device 100 can check that video files ①~③ are created and stored during the recording time, and then output the matched video files ①~③ while playing the audio file. can do.

In addition, the user device 100 may check the generation time of the video file using information on any one of the name, the generation location, and the storage location of the video file. For example, the user device 100 may confirm that the corresponding video file was created at 5:34:7 PM on June 1, 2020 through the name “20200601_173407.jpg”. Similarly, the user device 100 may check the generation time of the corresponding video file according to the storage location of the video file, specifically, the storage location name of the video file.

On the other hand, when the generation time in the video file stored in the user device 100 is confirmed only in minutes, there may be difficulties in matching with the audio files divided up to the second. For example, a plurality of video files were actually recorded at 12:5:10, 20 seconds, 30 seconds, and 40 seconds, respectively, but a plurality of video files were all generated at 12:05 on the user device 100. If it is stored as a video file, an additional process for analyzing the video file is required in order to match the audio file corresponding to 12:05:00 to 59 seconds with a plurality of video files.

Specifically, when there are at least two video files matching the creation time at any one of the actual recording times of the audio file, the user device 100 may determine the similarity of the corresponding video files. Here, the user device 100 may use various known image similarity analysis methods to determine the similarity between video files.

5A and 5B are schematic diagrams illustrating a method of outputting an image from a user device through an image reproducing method according to an exemplary embodiment of the present invention.

Referring to FIG. 5A, as a result of determination of the user device 100, when two or more corresponding video files are similar, while playing an audio file, outputs any one video file (①) among video files at a corresponding time point, The remaining video files ② may be simultaneously output in a size smaller than the original size on the playback progress icon A at one point. Here, any one video file may be a video file randomly selected by the user device 100.

On the contrary, as a result of the determination of the user device 100, if the corresponding video files are not similar, the video files (①, ②) can be divided and output according to the screen size of the user device 100, as shown in FIG. 5B. have. If the number of video files is greater than the number of divided areas (eg, 4 divisions) set in advance, video files may be divided and sequentially output in a unit smaller than the generation time unit of video files according to the order in which video files are stored. . For example, if there are 12 video files created at 7:22 am, the user device 100 may perform 1 to 4 times / 5 times to 8 times / 9 times while the audio file is being played according to the storage order. Video file 12 can be divided by 20 seconds and output.

As described above, using the image reproducing method according to an exemplary embodiment of the present invention, the user device 100 can easily reproduce a single image by synchronizing the time of separately recorded and photographed audio and video. Particularly, in the case of a video file that is recognized only by the minute, it can be played in various ways depending on the number and image analysis method, so video files captured by various shooting programs can be used in the image playback method according to an embodiment of the present invention. Can be applied.

So far, a method of reproducing an image using an audio file and a video file already possessed by a user device according to an embodiment of the present invention has been described. Hereinafter, a new audio file and a video file are obtained and mixed. A method of generating an image will be described.

6 is a schematic flowchart of a method for generating an image according to another exemplary embodiment of the present invention, and FIG. 7 is a schematic diagram illustrating a method of matching audio and video in an image generating method according to another exemplary embodiment of the present invention. to be.

Referring to FIG. 6, the user device 100 starts recording audio (S210) and acquires at least one video file according to a photographing signal while audio is being recorded (S220). That is, the user device 100 can record and shoot at the same time, and store both the audio being recorded and the video file acquired in real time by including time information corresponding to year, month, day, hour, minute, and second. have.

After step S220, the user device 100 stores the time point at which the video file is acquired in the audio timeline (S230). Specifically, the user device 100 may insert a time stamp for the time point at which the video file is acquired in the audio timeline, and this process may be repeatedly performed according to the user's photographing signal.

After step S230, the user device 100 ends the recording of audio and generates an image obtained by matching the audio and video files (S240). In this case, "matching" means that the time is set so that the video file can be output on the screen of the user device 100 together while the audio file is being played.

Referring to FIG. 8, the user device 100 may match a video file obtained according to the n-1th photographing signal with an audio timeline before an n-th photographing signal (n is a natural number of 2 or more) is obtained. . That is, when the user device 100 acquires the 4th shooting signal, the video file acquired according to the 3rd shooting signal on the audio timeline immediately after acquiring the 3rd shooting signal to just before the 4th shooting signal is acquired. Can be matched.

According to an embodiment, when the video file acquired according to the second photographing signal is an image, a continuous image excluding audio properties may be matched with the corresponding audio file.

In addition, the user device 100 applies a screen transition effect to the video file obtained according to the first photographing signal and matches the audio timeline before the first photographing signal is obtained, so that the final generated image is simply cut off. In addition, a natural image can be created so that it can be recognized as a connected image. For example, the screen transition effect may include various effects such as a blurring effect and a mosaic effect.

Also, after the recording is finished and an image is generated, the user device 100 may additionally insert a video file that cannot be included in the image. Specifically, the user device 100 may check whether an additional video file stored in the user device 100 exists, and more specifically, may check whether the stored additional video file is a file corresponding to an image generation time.

If there is an additional video file, the user device 100 may additionally match it to the finally generated audio file. In this case, the user device 100 may match the image based on the generation time of the video file, but may detect an appropriate time point to which the video file is matched using the audio timeline.

To this end, the user device 100 detects a timeline in which audio has not been acquired for a predetermined time from the last generated image, and when the detected audio timeline corresponds to the recording time of the additional video file, the corresponding audio timeline Additional video files can be matched.

For example, when a speaker plays or shows a separate video file in the middle of a speech at a speech site, audio may not be obtained for a predetermined time of displaying the video file. If the user device 100 uses the audio timeline to insert a separate video file shown by the presenter after creating an image, the video file may be inserted at the appropriate timing after the presenter introduces the video file. have.

In this way, the user device 100 may generate one image while separately and simultaneously performing audio recording and video recording. That is, the image generation method according to another embodiment of the present invention does not capture an image including audio and video through an image capture mode that acquires several tens of frames per second, but only a few videos required by a user during audio recording. After acquiring, it is possible to generate a single image by combining them, so that the size of the finally generated image can be greatly reduced.

On the other hand, even if an image capturing mode that acquires several tens of frames per second is used, a method for reducing the file size of the final captured image may be required, and this will be described with reference to FIGS. 8 and 9C.

8 is a schematic flowchart of an image storage method according to another embodiment of the present invention, and FIGS. 9A to 9C are a method of acquiring or storing one image frame in an image storage method according to another embodiment of the present invention. It is a schematic diagram for explaining by way of example.

Referring to FIG. 8, the user device 100 captures an image including video and audio according to an image capture start signal (S310). In general, in the case of image shooting, it can be understood that a space in which various objects and people move in real time is photographed, but in the present invention, a situation in which a space in which the movement of such objects is small is photographed is assumed.

In addition, while capturing an image, the user device 100 may acquire an image of several tens of frames per second according to the shooting setting, but the image of all frames is not used for image storage, and the image obtained accordingly is the final image storage. It can be temporarily stored until.

After step S310, the user device 100 detects a change between frames in the image frame of the image (S320). Here, the user device 100 may use various known image similarity analysis methods to detect changes between frames.

For example, when the user device 100 photographs a space with a small number of moving objects, such as a landscape or a lecture, 1) according to a change in the shooting angle due to the user's manipulation, 2) according to the movement of the object, and an image frame of an image The change between frames can be detected.

Meanwhile, in the present invention, it is assumed that a space in which objects are less moving is assumed, but a fixed object or a moving object may exist in the photographing area. Accordingly, the user device 100 may receive at least one fixed object or a moving object selected from the user and set a reference value for determining that inter-frame change has occurred for each fixed object or moving object.

Referring to FIG. 9A, a user may select a moving object B such as a lecturer and a fixed object C such as a presentation screen in the user device 100. In this case, in the case of the moving object B, even if the moving object B moves, as shown by the dotted line, a movement allowable range that is not recognized as a change between frames may be set.

Meanwhile, when the user device 100 receives the selection of the fixed object C, the user device 100 may check the properties of the fixed object C. Specifically, in the case of the fixed object C, since the fixed object C has a fixed frame coordinate C-1 in the output screen of the user device 100 as its property value, the user device 100 has a fixed frame coordinate C -1) and the image frame (C-2) in the frame coordinate (C-1) can be checked, and a change between the image frames (C-2) can be detected. For example, if the lecturer switches the presentation screen while the lecture is in progress, the user device 100 may recognize this as a change between frames.

After step S320, the user device 100 inserts one image frame into the previous audio timeline based on the time when the inter-frame change is detected (S330). Here, one image frame may be any one of a plurality of image frames photographed in the audio timeline region before the image.

That is, since the current user device 100 is capturing a shooting space with little physical change, tens and hundreds of image frames acquired in the image capturing mode are all similar image frames, and all image frames represent previous images. It can be an image

According to an embodiment, the user device 100 may additionally acquire an image by the user while automatically detecting a frame change in the photographing area.

Referring to FIG. 9B, when shooting is started through the image capturing start icon 131, an image capturing icon 133 and an image capturing stop icon 135 are displayed on the screen of the user device 100 as shown in FIG. 9C. May appear additionally. The user device 100 may acquire at least one image frame according to an image capturing signal provided by the user, and may insert the acquired image frame into a timeline prior to the image.

The user device 100 may detect a change between frames in an image frame before receiving an image capturing end signal, and may insert the image frame into the audio timeline based on the detected time point.

After step S330, the user device 100 stores an image in which at least one image frame is matched to the audio timeline of the image according to the image capturing end signal (S340). That is, in the case of the final stored image, since the stored image does not have thousands or tens of thousands of frames per second, and has only necessary image frames during the playback time, the size of the entire image can be greatly reduced.

So far, an image management method according to various embodiments of the present invention has been described. According to the present invention, without a high-performance codec for compressing an image, an image can be smoothly played back using an application that can be installed on a user device, and a captured high-resolution image can be stored as a small-capacity image file.

In addition, it is possible to analyze the actual recording time of the audio, check the time when the video was recorded, and play the video matched with the audio and video. In particular, in the case of a video file that does not contain accurate time information In addition to the storage information, additional information such as the name of the video file and the storage location can be used to accurately synchronize the audio and video times.

Although the embodiments of the present invention have been described in more detail with reference to the accompanying drawings, the present invention is not necessarily limited to these embodiments, and various modifications may be made without departing from the spirit of the present invention. . Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

100: user device
110: communication department
120: storage unit
130: input unit
140: output
150: processor

Claims (20)

As a method of playing an image using an application installed on a user device,
Searching at least one audio file and video file stored in the user device;
Checking an actual recording time for any one audio file; And
Matching the confirmed actual recording time with the generation time of the video file, and outputting the matched video file while playing the audio file; Including,
The outputting step,
When there are at least two video files matching the creation time at one point in the actual recording time of the audio file, determining the similarity of the corresponding video files, further comprising,
A video reproducing method for simultaneously outputting the two or more video files in different ways according to a determination result. The method of claim 1,
The step of confirming,
Subtracting the total playback time of the audio file from the time when the audio file was created, and calculating a time when the recording of the audio file started. The method of claim 2,
The actual recording time is,
The video playback method, wherein the recording of the audio file is expressed as year, month, day, hour, minute, and second from a start time to an end time. delete The method of claim 1,
The outputting step,
As a result of the determination, if the video files are similar,
While playing the audio file, outputting one of the video files at the one point in time, and simultaneously outputting the remaining video files to the playback progress icon at the one point in time. The method of claim 1,
The outputting step,
As a result of the determination, if the video files are not similar,
While playing the audio file, dividing and outputting the video files according to the screen size of the user device at the point in time. The method of claim 1,
The creation time of the video file is,
The video playback method, which is identified using information on any one of a name or a storage location of the video file. delete delete delete delete delete As a method of storing a captured image using an application installed on a user device,
Capturing an image including video and audio according to an image capturing start signal;
Detecting a change between frames in the image frame of the image;
Inserting one image frame into an audio timeline up to a previous point based on a time point at which the inter-frame change is detected; And
Storing an image in which at least one image frame is matched to an audio timeline of the image according to an image capturing end signal; Including,
The detecting step,
Receiving at least one fixed object or a moving object selected from the photographing area, and
Setting the property of the fixed object or the moving area of the moving object, further comprising. The method of claim 13,
The one image frame,
The image storage method, wherein the image is any one of a plurality of image frames photographed on an audio timeline prior to the image. delete The method of claim 13,
The properties of the fixed object,
Including a fixed frame coordinates and an image frame in the frame coordinates,
The detecting step,
The step of detecting a change between image frames in the frame coordinates. The method of claim 13,
After the step of photographing,
Obtaining at least one image frame according to the image capturing signal, and
Inserting the acquired image frame into a timeline prior to the image. Communication department;
Storage;
Output section;
Input unit; And
A user device comprising a processor that is operably connected to the communication unit, the storage unit, the output unit, and the input unit, and plays an image by driving an application stored in the storage unit,
The processor,
Search at least one audio file and video file stored in the storage unit, check the actual recording time of any one audio file, match the confirmed actual recording time with the creation time of the video file, and the audio file During playback, the matched video file is output,
When there are at least two video files with matching creation times at one point in the actual recording time of the audio file, the similarity of the corresponding video files is determined, and the two or more video files are simultaneously output in different ways according to the determination result To the user device. delete Communication department;
Storage;
Output section;
Input unit; And
A user device comprising a processor that is operably connected to the communication unit, the storage unit, the output unit, and the input unit, and generates an image by driving an application stored in the storage unit,
The processor,
An image including video and audio is photographed according to an image capturing start signal, and an inter-frame change is detected in the image frame of the image. Inserting an image frame and storing an image in which at least one image frame is matched to an audio timeline of the image according to an image capturing end signal,
A user device for selecting at least one fixed object or a moving object from a photographing area and setting a property of the fixed object or a moving area of the moving object.

Images